THE STARTING POINT
Questions for preparing content, ownership and answer review before a pilot.
Choose the content boundary.
Identify the documents the assistant should use and the questions it is intended to help with. Check which versions are current and who owns them. Exclude material that the pilot audience should not access. A large collection of unreviewed documents can create more uncertainty than a small, well-defined source set.
Make unsupported answers visible.
Agree how the assistant should respond when the source material does not support an answer. Review whether references lead to the relevant passage and whether the response reflects it. Include questions that cannot be answered from the selected documents so the evaluation checks the boundary as well as useful answers.
Plan content maintenance.
Decide how revised or withdrawn documents reach the source set. Assign a route for reporting misleading answers and outdated references. Treat the assistant as part of a content-maintenance process, with review responsibilities that continue after the first demonstration.
TAKE THE NEXT STEP
Your discovery checklist
- Approve a current, accessible document set.
- Test questions that the sources cannot answer.
- Assign document-update and answer-review responsibilities.