How to test the performance of an AI employee and personally verify their skills before launching to clients?

Question

Accepted Answer

The following tools are provided to test an AI employee's skills before launch:

Preliminary interview: In the Roles Board section, using the Interview me button, you can communicate with a role to test its style and logic prior to hiring.
Public page: In the Settings section, a unique link is available for personal testing of Binom's responses via text, voice, or WebRTC.
Binom Examiner: An AI quality controller automatically simulates customer inquiries, verifies adherence to instructions, and generates an error report.
Chats section: Allows you to monitor dialogues in real time, temporarily block the AI to answer manually, and immediately save corrections to the knowledge base.
Trial period: For 7 days, you can test any role and all core platform features for free.

Updated on 19.10.26

The following tools are available for testing the AI employee's skills before launch:

Preliminary interview: In the Roles Board section, click the "Interview me" button to chat with the role and check its style and logic before hiring.
Public page: In the Settings section, you'll find a unique link for personally testing Binom's replies by text, by voice, or via WebRTC.
Binom Examiner: The AI quality controller automatically simulates customer inquiries, checks compliance with instructions, and generates a report on errors.
Chats section: Lets you monitor conversations in real time, temporarily pause the AI to reply manually, and save corrections straight to the knowledge base.

Testing the chatbot step by step

Wait until it's ready. Binom Tutor will tell you in the chat when Binom is ready for testing: how Binom's admission process works.
Open a new conversation. The public link is in Settings → "Basic". Open it in incognito mode: in older conversations, Binom remembers the previous exchange.
Ask questions the way a customer would. Common questions, prices and availability, complex and tricky cases, off-topic questions. Test by voice if your customers will be calling.
Check the answers against the facts. If an answer is outdated, see why the bot answers with outdated data; if answers contradict each other, see conflicts in the knowledge base.
Fix it directly from the conversation. In Chats, save the correct answer as a knowledge card: how to do this.
Check the role. Before hiring, talk to the role by clicking the "Chat" button on the Roles Board: how to hire a role.

How to test answer accuracy in real scenarios

Compile a list of 10 to 20 real customer questions from your email or messengers and run them through the public link. Fix each wrong answer with a knowledge card, then ask the question again in a new conversation. For more on accuracy, see how to avoid AI hallucinations.

Frequently asked

How do I test the chatbot before launch?

Use the public link from Settings → "Basic" in a new conversation, following the steps above.

Why does the bot still answer the old way during testing?

You're checking in a conversation opened earlier. Open a new one: the bot answers with outdated data.