Simple RAG fixes mattered more than switching AI models
In RAG development, changing the mattered less than several simple system improvements. Better chunking of long documents and adding a reranker had a large effect.
Building an from real user questions also made a major difference. No exact gains or cost savings were provided.
Key points
- Simple had more impact than switching models.
- Better chunking made documents easier to search effectively.
- A reranker moved the most relevant search results toward the top.
- Real user questions were used to build an .
- No measured or cost improvement was reported.