RAG needs better handling for documents with charts and diagrams
A RAG system for annual reports, news, and scientific papers may need more than simple text . Scientific papers often mix diagrams, charts, text, and numbers, so the system must keep the relationships between those parts. The goal is to extract as much detail as possible from each document.
If someone asks about a diagram, the system should use both the diagram and its nearby explanation to give a useful answer. The main challenge is choosing a better practice for handling complex documents during the stage.
Key points
- The target data includes annual reports, news, and scientific papers.
- Scientific papers can contain diagrams, charts, text, and numbers in one document.
- Simple text may not capture all important details.
- Good answers about a diagram need the diagram plus nearby context.
- choices affect both answer quality and .