Design question for an AI knowledge system using company data
The goal is to build an internal knowledge management system using company data. The planned approach involves RAG and AI agents.
The work is at an early stage, after six years of experience and a move into projects. The first step is a using a small number of documents from .
Storage and would start on HPC and later move to the cloud. The main open question is how to design the full pipeline, from document intake and storage to search, answer generation, and .
Key points
- The planned system would use company data for internal knowledge management.
- RAG and AI agents are the main technologies being considered.
- The first version would be a with a few documents.
- would begin on HPC and later move to the cloud.
- The main decision is how to design the full pipeline from documents to answers.