A risk checklist idea for company-doc RAG chatbots

The idea is an early test product for teams building company-document RAG chatbots, internal knowledge bots, or document assistants. Before a team builds or launches the system, it would receive an evidence-backed pre-mortem based on real failures from similar systems. The brief would show what went wrong, link the evidence behind those failures, and provide a launch checklist.

The sample brief covers stale chunks, wrong retrieval, citation trust, metadata gaps, long-context problems, and launch checks. The main open questions are whether this would change real build or launch decisions, which warnings are actually useful, which parts feel too generic or hard to trust, what failure modes are missing, and whether builders would use it before starting a RAG project.