Role-based candidate assessments: Solveig's one hard question
Role-based candidate assessments, told as a story: how Solveig, an HR lead, finally answered the question her director asks before every job offer.
At 8:40 on a grey Monday, Henrik closed the meeting-room door and asked Solveig the question behind every role-based candidate assessment: “Before we make an offer, how do we know a new agent understands our escalation rules, and not just that they interview well?”
Solveig leads HR at Larkfield Energy’s customer contact centre. Last spring, two hires with polished CVs and great interviews left within six weeks, both after escalations went wrong. Four agent offers had to go out by the end of the month, and Henrik, the operations director, wanted an answer at the quarterly review, five weeks away.
Solveig, Henrik and everyone at Larkfield are fictional. Her problem is not.
Tuesday, 7:30: what the role really needs
Generic aptitude tests knew nothing about Larkfield’s policies, so she started on the floor, before the phones opened, with Rohan, the team lead who would manage the new hires.
They went through the thick policy binder and asked one thing of every section: does a new agent need this on day one, or will onboarding teach it? Escalation rules, refund policy, complaint handling and data protection basics stayed. The billing system’s internal codes went. “If we test that,” Rohan said, “we only hire people who already worked here.”
Wednesday: building a role-based candidate assessment
That evening Solveig exported the four sections to PDF and uploaded them to the LearningClarity study platform. LearningClarity built a topic and its subtopics from them: the list from the floor, nothing more.
Then the step most teams skip: someone who does the job answers the questions before any candidate sees them. Abena, a senior agent with nine years on the phones, went first.
Abena opened Quiz Mode on all four subtopics and pressed “I don’t know” instead of guessing. One honest wobble: she missed most of the data protection questions. She asked why each answer was correct and frowned. “These are about retention periods. That’s the compliance team’s job, not mine.”
That section was out of date; testing it would have punished good candidates for Larkfield’s old paperwork. Solveig uploaded the current guidance instead and built the topic again. The CIPD factsheet on selection methods says skill-based assessments should resemble real job tasks where possible. Abena had just shown her what that means.
The next Tuesday: the candidates’ half hour
Six shortlisted candidates had accepted the topic Solveig shared by email, each with their own copy. In a quiet meeting room, each took Exam Mode on the whole topic with the same settings: Medium difficulty, timed, 20 questions.
Teo, 26, from retail, sat a long time over one question, chin on his hand. His results showed a score, a mastery level and an AI performance summary: strong on escalations and complaints, weaker on refund rules.
Henrik wanted to rank the six by score and cut. Solveig refused: the exam was one input. Teo’s structured interview and his mock complaint call with Rohan were the day’s best, and refund rules can be taught. Teo got an offer.
Three weeks later: a first morning that started in the middle
On Teo’s first morning Solveig handed him a coffee, and he laughed when Rohan asked where he wanted to begin. His summary had named refunds, so he had already gone back to that subtopic in Explain Mode, tapping Simplify on partial refunds and letting Listen read sections aloud on the bus.
The evening before the review
At dusk, Solveig and Rohan reviewed the round. Three of the four new hires had stumbled on the same refund exception. When strong people miss the same thing, the question or the policy is usually the problem. Rohan agreed to rewrite that page before the next round.
On Thursday Henrik asked again, and Solveig answered. “We still don’t know everything. But for each of the four, I can show you what they knew about our policies before the offer, what we taught them first, and which part of our own material was wrong.”
Henrik was quiet for a moment. “That’s the first hiring answer I can actually check.”
Three takeaways
- Start from the role, not a question bank. Test what a new hire needs on day one; leave the rest to onboarding.
- Let someone who does the job go first. If they miss it, fix the material, not the candidate.
- Treat the score as one input. Its gaps show where onboarding begins.
Hiring soon? Read how Nevine filled 50 posts in six days, then upload one policy your team relies on and take a five-question quiz on it yourself before any candidate does.
Frequently asked questions
Can I build an assessment from our own policy documents?
Yes. Upload PDF files (up to 40 MB each), images or .txt files, and LearningClarity builds a topic and its subtopics from the content. Export Word or PowerPoint files to PDF first; scanned PDFs without a text layer cannot be read.
What can I set in Exam Mode?
You choose the scope, question types, difficulty (Medium, Hard or Random), timed or untimed, and the number of questions. Results show a score, a full question review, an AI performance summary of strengths and areas to revisit, and a mastery level.
Can another person get a copy of a topic I created?
Yes. Share it by email with another LearningClarity user. They preview it and accept or decline; on accepting they get an independent copy with their own progress.