Decision making

Write scoring criteria for video answers

Turn "I liked them" into something your team can agree on: what a strong, acceptable and weak answer includes, how scores are checked against the evidence, and how to tune scoring to your standards.

7 min read · Updated · For recruiters and hiring managers who review recorded answers

The short version

Write down what a strong answer contains before anyone records one. Then every score can be checked against the answer that earned it, and corrected when it is wrong.

Why video answers need written criteria

Without criteria, reviewers score confidence, accent and lighting instead of the answer. Written criteria keep everyone, including the AI that drafts the first score, looking at the same things.

Write criteria for each question

For every question, write down

  • What the question is really testing, in one sentence.
  • Two or three things a strong answer includes.
  • What an acceptable answer looks like.
  • Red flags that should lower the score.
  • What not to score: delivery polish, background, accent.

Set up the questions in the journey

  1. 1

    Record on any device

    Candidates record answers in the browser on a phone or laptop.

    In Journeys
  2. 2

    Ask with a face on screen

    Ask each question with a recorded clip or an AI-generated interviewer video.

    In Journeys
  3. 3

    Weight the questions

    Use the scoring matrix and grade bands so the questions that matter most count most.

    In Journeys

Check every score against the evidence

  1. 1

    Scored against your guidance

    Each answer is evaluated against the criteria you wrote, and the score sits beside the answer and transcript that earned it.

    In Journeys
  2. 2

    Compare people question by question

    Line candidates up on the compare board to see how each one answered the same question.

    In Applicant tracking

Calibrate to your team

  1. 1

    Set how strict scoring is

    Tune scoring for your organization, so a passing score means what your team means by it.

    In Journeys
  2. 2

    Correct it when you disagree

    Override any score. Corrections feed back so scoring learns what your team values.

    In Journeys

A calibration session

  • Pick a handful of finished journeys for one role.
  • Have two reviewers score them alone using the written criteria.
  • Compare where they disagree, and with the drafted score.
  • Rewrite any criterion that two people read differently.

The products in this playbook

JourneysA short, scored pre-interview every applicant takes on their phone, ranked against your criteria.Explore JourneysApplicant trackingJobs, approvals, careers pages, pipeline, offers and reporting on one candidate record.Explore Applicant tracking

Questions, answered

Does the AI decide who moves forward?

No. It drafts a score against your criteria and shows the evidence. Your team reviews, overrides when needed, and makes the decision.

How detailed should criteria be?

Short enough to read while watching an answer: a sentence on what is tested, and two or three things a strong answer includes.

Should we score how people come across on camera?

Only if the job requires it. For most roles, score what they say and leave delivery, background and accent out of it.

Keep reading

All playbooks
Decision making7 min readRun a calibrated hiring debrief on the full recordA debrief that decides on evidence, not on whoever speaks first: feedback in before the meeting, the whole record on screen, a short agenda, and a decision and offer that follow from it.Read the playbookDecision making6 min readFrom applicant volume to an evidence-based shortlistA practical framework for combining video, transcripts, assessment results, integrity signals, and recruiter judgment into one review process.Read the playbookHow it connects10 min readHow InsightHire connects: from first search to first yearFollow one hire end to end: sourcing with Scout, a scored journey, ranked review, structured interviews, the offer and onboarding, then Grow, with Vouch checks along the way.Read the playbook

Put this playbook to work.

Bring one real role and we'll set it up with you in InsightHire.

Book a demo