WEBVTT

00:00:01.000 --> 00:00:05.370
In document chat, check the evidence behind the answer, not only

00:00:05.400 --> 00:00:06.570
its source link.

00:00:06.840 --> 00:00:10.730
A fictional work instruction says equipment may leave the premises

00:00:10.760 --> 00:00:12.370
only after approval.

00:00:12.600 --> 00:00:16.010
The assistant says staff may take equipment away.

00:00:16.280 --> 00:00:20.090
The source exists, but an important condition has disappeared.

00:00:20.360 --> 00:00:24.650
The application processes documents, retrieves relevant passages and

00:00:24.680 --> 00:00:26.090
formulates an answer.

00:00:26.360 --> 00:00:29.530
Show the document and version behind the passage used.

00:00:30.040 --> 00:00:34.010
Check that its text was extracted correctly before judging the answer.

00:00:34.440 --> 00:00:37.330
A reference must actually support the wording.

00:00:37.560 --> 00:00:41.250
Compare exceptions, table headings and units too.

00:00:41.480 --> 00:00:45.610
The correct document title is insufficient if the cited passage says

00:00:45.720 --> 00:00:47.210
something different from the answer.

00:00:47.800 --> 00:00:51.210
What if someone asks how long approval takes, but the source

00:00:51.240 --> 00:00:52.850
says nothing about timing?

00:00:53.080 --> 00:00:55.250
The assistant should acknowledge the gap.

00:00:55.480 --> 00:01:00.570
A typical timeframe from general knowledge is not this company’s documented agreement.

00:01:00.840 --> 00:01:04.810
If versions give different instructions, ask the responsible owner to

00:01:04.880 --> 00:01:06.490
assess the conflict.

00:01:06.680 --> 00:01:10.650
Also check which documents the user may see before answering.

00:01:10.680 --> 00:01:13.850
A prompt does not replace access enforcement.

00:01:13.960 --> 00:01:17.770
Use representative questions, scans and tables.

00:01:17.880 --> 00:01:22.170
Test an unanswerable question, conflicting sources and a user without

00:01:22.200 --> 00:01:23.370
permission.

00:01:23.520 --> 00:01:28.250
Also change or delete a document and check new answers and their references.

00:01:28.520 --> 00:01:32.010
Choose documents with an owner and reviewed example questions.

00:01:32.520 --> 00:01:35.970
Agree who updates them and handles missing information.

00:01:36.200 --> 00:01:40.570
Expand only when source support and the maintenance process are useful.

00:01:40.840 --> 00:01:45.290
Read OXIAE’s document chat guide for source support, missing

00:01:45.320 --> 00:01:47.930
information and conflicting documents.