博客主页Main Page

大语言模型LLM之文本数据处理 Text Data Processing for Large Language Models (LLMs)

2024-12-22 15:30:00

有了LLM的基础之后，若要实现自己的LLM，首先需要对文本进行一定处理，将其转成计算机能理解的嵌入向量数据 After understanding the fundamentals of LLMs, if you want to build your own LLM, the first step is to process the text data and convert it into embedding vector data that can be understood by computers.

大语言模型LLM概念入门理解 An Introductory Understanding of the Concept of Large Language Models (LLMs)

2024-12-15 18:00:00

最近开始学习大语言模型LLM，本节介绍LLM和Transformer的概念、基本构建原理，以及搭建LLM的步骤 I recently started learning about large language models (LLMs). This section introduces the concepts of LLMs and Transformers, the basic principles of their construction, and the steps to build an LLM.

挖掘历史政经新闻数据的价值（探索中） Unlocking the Value of Historical Political and Economic News Data (Exploring)

2024-12-07 17:00:00

在利用爬虫收集了一段时间的政经新闻数据后，目前正研究利用GPT等大模型工具发现其中价值并进行预测的可能 After using web crawlers to collect political and economic news data for a period of time, I am now exploring the potential of leveraging tools like GPT and other large models to uncover value and make predictions

构建网站AI小助手 Building a Website AI Assistant

2024-11-30 15:00:00

我基于自己的知识库搭建了一个AI客服机器人，它能根据知识库材料和提出的问题进行相应回答（基于RAG架构和本地向量召回）I built an AI customer service bot based on my own knowledge base. It can provide appropriate answers according to the materials in the knowledge base and the questions asked (based on the RAG architecture and local vector retrieval).

利用新闻爬虫和GPT构建汇总日报 Constructing a Daily Summary Report Using News Crawlers and GPT

2024-11-22 17:00:00

一个每天用爬虫爬取新闻，并使用的GPT生成摘要总结并且进行锐评的思路和架构实现 An approach and implementation for building a system that crawls news daily using web crawlers, generates summary reports with GPT, and provide commentary.

网站服务器OOM问题排查 Troubleshooting OOM Issues on the Website Server

2024-11-19 17:30:00

自从安装了netdata监控之后，隔三差五收到服务器OOM的邮件通知，于是尝试进行问题的排查 Since I installed the Netdata monitoring tool, I’ve been receiving periodic email notifications about OOM events on the server. So, I conducted an investigation.