The central idea
A strong shortlist is not the candidates with the highest single score. It is the smallest group with enough relevant evidence to justify deeper human investment.
01
Agree on evidence before reviewing candidates
Hiring teams create inconsistency when they decide what matters after seeing individual candidates. Define the required competencies, evidence sources, thresholds, and acceptable tradeoffs before opening the results.
02
Review the ranking as a starting point
Automated ranking reduces sorting work, but it should not become an unexplained final decision. Inspect competency gaps, item-level responses, integrity context, and cohort benchmarks before shortlisting.
03
Compare candidates on the same dimensions
Side-by-side comparison is most useful when every candidate is evaluated against the same role-specific dimensions. Avoid adding ad hoc criteria because one applicant has an unusual background or particularly polished answer.
04
Use integrity signals proportionally
A tab change or long idle period is context, not proof of misconduct. Review the pattern, the assessment rules, and the candidate explanation before allowing an integrity flag to outweigh job-relevant evidence.
05
Record the reason for the shortlist
For each shortlisted candidate, capture the evidence that justified the next step and the areas the live interview should explore. This creates a cleaner handoff and keeps the deeper interview focused.