A tool for replaying old RAG searches against past LanceDB versions
rag-timetravel helps track when and why search quality changes in a RAG system as more documents are added. It runs on LanceDB versioning and creates lightweight snapshots whenever the index is updated. It also keeps a simple record of queries and the document chunks that were retrieved.
Any past query can be replayed against any past version of the index, making it possible to compare result changes and score differences. It includes a , a Python API, and basic HTML reports.
Key points
- It creates snapshots of a LanceDB index after updates.
- It can replay old queries against older index versions.
- It compares retrieved results and scores across versions.
- It provides a , Python API, and HTML reports.
- It is useful for checking in RAG-based AI agents.