Ask real questions
Testing should mimic real visitors. Include easy questions, ambiguous questions, product or service recommendations, policy questions, and requests for a human.
- What do you sell?
- What should I choose for this need?
- How long does delivery take?
- What is the return policy?
- Can I speak with a person?
Watch for failure cases
The agent should not invent private access or execute risky actions. A good test includes questions it should refuse, clarify, or hand off.
- Refund this order
- Change my booking
- Log into my account
- Give me a guaranteed outcome
- Answer a question not covered by sources
Publish criteria
Publish when common questions are answered directly, sources look relevant, unsupported questions are handled honestly, and handoff works for sensitive cases.
Related