Finding the right source does not guarantee a supported AI answer
Finding the correct source passage does not prove that the final AI answer is reliable. The AI may ignore part of the evidence or combine passages that conflict with each other. It may fill missing details from what it learned during training and attach sources that do not support its claims.
It can also make statements that go beyond the available evidence. This creates an important choice: check whether the answer broadly matches the evidence, or verify the support for every individual claim.
Key points
- Finding the correct passage and producing a supported answer are separate steps.
- An AI can ignore evidence or combine passages that disagree.
- It can fill evidence gaps with information learned during training.
- A listed source may not support the related claim, and the answer may exceed the evidence.
- can examine the full response or verify each claim separately.