✅ What is Response Relevancy?
Response Relevancy is a feature that assesses the relevance of a candidate’s video response to the question asked. It provides a quantitative score (0-100) based on how closely the candidate’s response matches expected content.
This is particularly helpful in:
Screening high volumes of applicants quickly
Ensuring objective scoring standards
Identifying well-prepared, knowledgeable candidates
🔄 How is the Response Relevancy Score Calculated?
Interviewer.AI uses advanced AI models to measure the alignment between the candidate’s response and a reference point.
There are two main scoring flows:
Flow Type | Reference Used | Description |
General Flow | No reference provided | Model assesses based on common knowledge and relevance to question context. |
Ideal Flow | Ideal answer provided | Score based on match with the client's provided answer. |
⚖️ How to Interpret Scores:
Score Range | Interpretation |
85–100 | Excellent: Highly relevant and well-structured |
70–84 | Good: Mostly relevant, some minor gaps |
50–69 | Average: Some relevance, but lacks depth |
<50 | Low: Response is not adequately aligned |
Note: Scores should be used alongside grammar, tone, and personality analysis for a holistic view.
🔧 Best Practices for Customers
1. Choose the Right Flow
General Flow: Great for broad or behavioral questions.
Ideal Flow: Ideal for technical or role-specific questions.
2. Write Clear Questions
Avoid vague phrasing. Be specific in what you want the candidate to address.
Example
❌ "Tell me about a time you worked in a team."
✅ "Describe a situation where you resolved a conflict within a team. What was the outcome?"
3. Use Ideal Answers for Benchmarks
Provide an example answer for critical questions to enable objective scoring. This should be detailed, structured, and role-relevant.
4. Exclude Open-ended Questions
Questions like "Tell me about yourself" can skew relevancy scores. You can disable relevancy scoring at the question level.
🌐 Online Access and Interface
You can enable Response Relevancy per interview while creating the interview. Look for the toggle: "Measure Response Relevancy Score"
You can also toggle off the relevancy for specific questions to avoid score distortion.
🔍 Troubleshooting
If the score toggle isn’t visible, check with Interviewer.AI support ([email protected]) to confirm your organization's access.
Scores won’t appear for skipped questions or when toggled off manually.
ℹ️ Need Help?
For further help in configuring your interview to get the best use of Response Relevancy, please reach out to your Customer Success Manager.