Examine a fictional answer about business documents and learn to check passages, conditions, missing information and conflicting versions separately.
The spoken explanation, organised by chapter.
In document chat, check the evidence behind the answer, not only its source link.
A fictional work instruction says equipment may leave the premises only after approval. The assistant says staff may take equipment away. The source exists, but an important condition has disappeared.
The application processes documents, retrieves relevant passages and formulates an answer. Show the document and version behind the passage used. Check that its text was extracted correctly before judging the answer.
A reference must actually support the wording. Compare exceptions, table headings and units too. The correct document title is insufficient if the cited passage says something different from the answer.
What if someone asks how long approval takes, but the source says nothing about timing? The assistant should acknowledge the gap. A typical timeframe from general knowledge is not this company’s documented agreement.
If versions give different instructions, ask the responsible owner to assess the conflict. Also check which documents the user may see before answering. A prompt does not replace access enforcement.
Use representative questions, scans and tables. Test an unanswerable question, conflicting sources and a user without permission. Also change or delete a document and check new answers and their references.
Choose documents with an owner and reviewed example questions. Agree who updates them and handles missing information. Expand only when source support and the maintenance process are useful.
Read OXIAE’s document chat guide for source support, missing information and conflicting documents.
1:51Use a fictional procedure question to trace a RAG failure to missing sources, missed passages, incorrect use of context or access controls before answering.
Source articleRAG system development
1:52Follow a fictional work instruction through its lifecycle and see how source owners, versions, access permissions and deletion keep an AI knowledge base manageable.
Source articleAI knowledge base
1:55Use a fictional assistant to examine where business information is processed and retained, from documents and model input to search indexes, logs and backups.
Source articlePrivate AI for business