Reading Time
10 minutes

How to set defensible knock-out criteria in recruitment

Knock-out criteria are binary pass/fail decisions applied to job applicants before any human judgement enters the process. Unlike ranked scoring, where a lower score still allows a candidate to progress, a knock-out removes them entirely. That finality is precisely what makes them high risk. A poorly designed cut-off can exclude large numbers of qualified candidates in a way that constitutes indirect discrimination under the Equality Act 2010: a neutral provision, criterion or practice that puts people with a protected characteristic at a particular disadvantage, unless it can be objectively justified as a proportionate means of achieving a legitimate aim.

This guide takes you through the complete workflow: choosing the right metrics, setting defensible thresholds, running an adverse impact screen, building an audit trail, and monitoring performance over time. By the end, you'll have a reviewed knock-out rule set with documented evidence and a monitoring plan rather than a set of filters that quietly exclude the wrong people.

When knock-out criteria are the right tool

Use a knock-out only when a criterion is genuinely job-relevant, verifiable from objective evidence, and narrowly tied to a real capability requirement. The classic examples are: a mandatory qualification required by law (e.g. an SIA licence for a security role), a right-to-work eligibility check, or a language proficiency requirement that is genuinely essential to the role duties.

If you're uncertain whether a requirement is essential, or if it could reasonably be assessed at a later stage through structured tests or interviews, use progressive screening instead: broad application sift, then structured assessment, then interview. Progressive screening preserves more candidates for evaluation and reduces the risk of inadvertently removing people who would have performed well.

Do not use knock-outs for:

  • Salary history (a proxy for previous disadvantage and often legally risky)
  • Years of experience beyond what is genuinely necessary for the role
  • Degree requirements where no specific qualification is mandated
  • Vague requirements ("strong communication skills") that cannot be objectively measured at the application stage
  • Postcode proximity, unless shift or on-site operational requirements are genuinely non-negotiable and documented

Collect the right data before setting any cut-off

Before you define a threshold, you need a baseline dataset. Collect applicant counts across the full funnel (application, sift, knock-out stage, advance/pass) over a defined time window. For high-volume roles, 90 days is a reasonable starting point. For lower-volume specialist hiring, you may need 12 months or more to accumulate usable numbers.

You also need to be able to calculate selection rates by relevant demographic groups to run an adverse impact screen. Handle protected attribute data carefully and lawfully under UK GDPR: collect it via an anonymised equal opportunities form rather than through the scored assessment itself, and keep it separate from scoring records.

Collect downstream outcome data too: hiring manager ratings at 90 days, training completion rates, time-to-productivity scores. These become your validation anchor. Without them, you cannot demonstrate that the knock-out actually predicts job success.

Run data quality checks before you start: identify missing responses, duplicate applications, and inconsistent scoring labels across shifts or locations.

Setting knock-out criteria thresholds: a step-by-step process

Step 1. Translate job requirements into job-relevant measures. Start from a current job analysis or task inventory, not from a historic job description or a recruiter's intuition. Map each requirement to observable, measurable evidence.

Step 2. Decide the trigger type. An eligibility knock-out answers a binary factual question (does this person hold the required licence?). A scoring-based knock-out applies a numeric threshold to an assessment result. Both are legitimate, but scoring-based knock-outs carry higher statistical risk and require validation evidence.

Step 3. For scoring-based knock-outs, choose between a hard cut-off and a score band. A hard cut-off (e.g. reject everyone below 60 out of 100) is simpler to administer but more likely to produce adverse impact. A score band (e.g. flag everyone between 50 and 65 for a secondary assessment, auto-advance those above 65, and only reject those below 50) preserves borderline candidates for further review. Score bands are often a proportionate alternative to hard cut-offs.

Step 4. Build in an equivalency pathway: a documented route for a candidate to demonstrate they meet the underlying requirement through alternative evidence. This is not an ad hoc discretion door; it should be a defined process with clear criteria, applied consistently.

Step 5. If any part of your knock-out depends on assessor judgement (e.g. a scored telephone screen), run a calibration exercise before go-live. Have two or three scorers independently assess the same set of practice responses and reconcile discrepancies.

Step 6. Define your appeal and review pathway. Any candidate removed by an automated knock-out must have a route to request human review, particularly where a disability adjustment may be relevant. Under UK GDPR Article 22C, solely automated decisions with legal or similarly significant effects on individuals attract additional safeguards, including the right to obtain human review and to contest the decision. The ICO's guidance on fairness in the AI lifecycle (published March 2023) sets out how organisations should provide meaningful information about the logic involved in automated decisions.

Adverse impact analysis: the four-fifths rule and sample size checks

The four-fifths rule (80% rule) is a practical screening benchmark, not a legal test in its own right. According to the EEOC's Uniform Guidelines on Employee Selection Procedures, a selection rate for a protected group that is less than 80% of the rate for the group with the highest selection rate generally indicates adverse impact and warrants investigation.

Worked example:

Suppose you're running a numeric skills assessment with a cut-off of 60 out of 100 for a warehouse operative role. In a recent cohort of 400 applicants:

GroupAppliedPassed cut-offSelection rate
Group A25017570.0%
Group B1507550.0%

Group A has the highest selection rate at 70%. The four-fifths threshold is 80% of 70% = 56%. Group B's rate of 50% falls below 56%. This is a trigger for further review.

What to do when the four-fifths threshold is breached:

  1. Pause rollout if the rule hasn't yet been applied at scale.
  2. Run complementary checks: compare the absolute difference in selection rates, review reject-rate composition, and look at whether Group B candidates who did advance had equivalent or better downstream outcomes.
  3. Revise the threshold or introduce banding (see the remediation section below).
  4. Re-run the calculation on the revised rule before applying it.

Sample size guidance: Small sample sizes can produce misleading results in both directions. A ratio calculated from 15 candidates per group is statistically unreliable. Your organisation should define a minimum N policy before go-live. A commonly applied internal policy is to require at least 30 applicants per group before running an adverse impact calculation, and to flag any result based on fewer than 50 per group as provisional pending further data. Set your own thresholds based on your hiring volumes and risk appetite, and document them.

Validate and document every decision

Each knock-out rule needs a documented record containing:

  • Rule statement: the exact criterion as applied (e.g. "Candidates who score below 50/100 on the verbal reasoning assessment are automatically removed from the process.")
  • Job-relatedness evidence: the job analysis or task inventory that supports the criterion, and who signed off on the link
  • Threshold or band: the exact numeric value(s) applied and the rationale for that number
  • Data window: the date range and applicant counts used to set and validate the threshold
  • Adverse impact results: the four-fifths calculation, sample sizes, and whether the threshold was breached
  • Remediation decisions: if a threshold was revised, document what changed and why
  • Approval sign-off: name, role, and date for both the HR/TA lead and a compliance or legal reviewer
  • Review date: when the rule will next be assessed

Keep a change log. If a threshold is adjusted, version-control the record so you can show what was in place during any given hiring campaign.

Remediation when adverse impact appears

Banding is the most common first remedy. Instead of a single cut-off at 60, create three zones: auto-advance (above 65), review band (50 to 65), and reject (below 50). Candidates in the review band complete a secondary, lower-cost screen before a final decision is made. This approach is consistent with proportionality under the Equality Act 2010: if a less restrictive measure achieves the same legitimate aim, you should use it.

Multiple-input knock-outs reduce reliance on a single metric. Combining a short skills test with a structured work sample, for example, can actually reduce adverse impact signals compared to either measure alone, because different assessments surface different evidence of capability. Selection Lab's role-specific assessment bundles are designed precisely for this: combining cognitive, skills-based, and situational assessments into a validated funnel rather than relying on any single filter.

Before rolling out a revised rule, test it retrospectively against your historical data. Run the revised four-fifths calculation and compare it to the original. Only proceed if the adverse impact signal has reduced to an acceptable level.

Document all accommodations and alternative evidence routes centrally. These must not be handled case by case without a record.

Monitoring after go-live

Set up a structured review cadence from day one:

  • Go-live window (first 30 to 60 days): review selection rates by group weekly and check for early drift.
  • Quarterly review (ongoing): re-run four-fifths calculations, review override and reversal rates, check downstream outcomes for recent cohorts.
  • Monthly review during high-volume campaigns: volume creates statistical power quickly; don't wait a quarter to spot an emerging problem.

Define trigger-based alerts: for example, if the selection rate ratio for any group drops below 85% in a rolling 30-day window, escalate for immediate review before the next hiring campaign continues.

Produce two reporting outputs: a one-page summary for HR leadership showing selection rates, override rates, and any flagged anomalies; and a technical appendix for compliance stakeholders showing the full calculation, data quality notes, and the change log.

Platforms that integrate knock-out logic with ATS workflows, such as Selection Lab's SmartChat intake tool, can surface override and reversal rates directly within your existing reporting dashboard. That kind of visibility makes it far easier to spot drift early and demonstrate to stakeholders that human review pathways are being used, not bypassed.

A note on automated knock-outs and UK GDPR

If your knock-out rules are applied automatically by an ATS or AI screening tool with no human in the loop before a rejection is issued, UK GDPR Article 22C applies. Candidates have the right to obtain human review of the decision, to express their point of view, and to contest the outcome. You must also be able to provide meaningful information about the logic involved in the automated process.

In practice, this means:

  • Your privacy notice and application communications must explain that automated screening is used and how it works.
  • A documented human review process must exist and be accessible to candidates who request it.
  • The logic of each knock-out rule must be recorded in a form that a recruiter can explain to a candidate in plain language.

The ICO's fairness framework for the AI lifecycle (March 2023) is a practical reference point for how to structure these disclosures.

Quick reference: what a defensible knock-out looks like

A knock-out criterion is defensible when it is:

  1. Grounded in a current job analysis, not a historic job description
  2. Verifiable from objective evidence at the application stage
  3. Applied consistently across all candidates and all locations
  4. Tested for adverse impact using the four-fifths rule before go-live
  5. Documented with job-relatedness evidence, threshold rationale, and approval sign-offs
  6. Paired with a human review and appeal pathway
  7. Monitored quarterly (or more frequently during high-volume periods) against live selection rate data

Getting this right takes more upfront effort than setting a quick filter. But a knock-out rule that can't survive scrutiny isn't saving you time: it's creating legal exposure and removing candidates who may have been among your best hires.

FAQ

Can game-based assessments promote diversity in the hiring process?

Yes, game-based assessments can support diversity by focusing on skills and behaviors rather than traditional criteria like résumés, which may contain unconscious biases. This gives candidates from diverse backgrounds a fairer chance to demonstrate their potential.

What is a game-based assessment?

A game-based assessment is a method that uses game mechanics to evaluate a candidate’s skills, competencies, and personality traits. While playing these games, candidates are assessed on aspects like problem-solving, cognitive ability, and behavior under pressure in an interactive way.

What are the advantages of game-based assessments?

Game-based assessments offer a more engaging and interactive experience for candidates, which can lead to a more positive perception of the hiring process—especially among certain groups. For employers, they provide deeper insights into both cognitive and behavioral traits, which traditional tests may miss. They also reduce the chance of socially desirable answers, as candidates tend to respond more authentically in a game environment.

How reliable are game-based assessments compared to traditional tests?

When well-designed, game-based assessments can be just as reliable—or even more reliable—than traditional tests. They assess a wide range of behaviors and cognitive abilities in a dynamic setting. However, the quality of these assessments varies greatly, so careful evaluation is essential.

How does a game-based assessment work?

Candidates participate in interactive games designed to measure specific skills and behaviors. Evaluation goes beyond just the final score—it also considers how the candidate makes decisions, handles challenges, and responds to different scenarios. These insights reveal underlying thought processes and behavioral patterns.

Are game-based assessments scientifically validated?

The main drawback is that many game-based assessments are relatively new and have not yet been extensively researched by independent academics. Providers often cite their own research, which is rarely externally validated. Without independent studies, the reliability of these assessments remains uncertain—something to keep in mind when selecting one.

How can game based assessments contribute to a better candidate experience

This can vary significantly by audience. The playful, interactive nature of game-based assessments can lower stress levels for some candidates compared to traditional tests. However, research shows that certain groups, especially those over 35, may find them more stressful. Men also tend to rate the experience more positively than women.

Can you practice game-based assessment?

You can familiarize yourself with the style of games used, but it’s difficult to "practice" for them in a traditional sense. These assessments are designed to measure natural reactions and authentic behavior, so repeated practice typically has less effect on performance than with traditional tests.

Will game-based assessments replace traditional tests in the future?

It’s likely that game-based assessments will become more common in hiring processes, but they probably won’t fully replace traditional tests. Both approaches have value and can complement each other depending on the role and the company’s needs.

How are the results of a game-based assessment analyzed?

Results are analyzed based on predefined criteria such as problem-solving ability, reaction time, and behavior under pressure. Advanced algorithms collect and interpret this data to provide a reliable, objective evaluation of a candidate’s strengths.

What kind of skills do game-based assessments measure?

They assess a wide range of abilities, including problem-solving, adaptability, decision-making under pressure, teamwork, and emotional intelligence. Depending on the design, they may also evaluate cognitive skills like memory, attention, and pattern recognition.

How long does a game-based assessment take?

Typically, these assessments last between 15 and 60 minutes, depending on the game’s complexity and the number of skills being tested. They’re usually shorter and more engaging than traditional assessments, making for a smoother candidate experience.

Are game-based assessments suitable for all roles?

They are especially effective for roles that require flexibility, creativity, problem-solving, and strong interpersonal skills. For highly technical or specialized roles, additional assessments may be needed to measure specific knowledge.

What’s the difference between a game-based and a gamified assessment?

A gamified assessment adds game-like elements (such as points or rewards) to a traditional test to increase engagement. A game-based assessment, on the other hand, is a standalone game designed specifically to evaluate certain competencies. The game itself is the primary evaluation tool, not just an enhancement.

FAQ

How can I improve my company’s retention rate?

The retention rate can be improved by investing in employee development and satisfaction. This includes offering training, career opportunities, and recognition for their contributions. A culture of open communication and attention to work-life balance can also contribute to higher retention. Additionally, offering competitive compensation and involving employees in decision-making can strengthen loyalty.

What are the benefits of growth opportunities for employee retention?

Growth opportunities can promote employee retention by giving staff a sense of direction and motivation. When they have the chance to learn and develop professionally within the company, they feel valued, which increases their loyalty. This can prevent them from leaving to seek better opportunities elsewhere. kunnen het behoud van personeel bevorderen door medewerkers een gevoel van richting en motivatie te geven. Wanneer zij de kans krijgen om te leren en zich professioneel te ontwikkelen binnen het bedrijf, voelen zij zich gewaardeerd, wat hun loyaliteit vergroot. Dit kan voorkomen dat ze vertrekken om elders betere kansen te zoeken.

What are the key factors that influence employee retention?

Key factors that influence employee retention include salary and benefits, opportunities for professional development, work-life balance, company culture, and the relationship with supervisors. Employees tend to stay longer when they feel valued, challenged, and supported in their work environment.

Why is employee retention so important for organizations?

Employee retention is important because it helps reduce recruitment and training costs for new employees, and it contributes to retaining knowledge and experience within the organization. High retention also ensures continuity within teams, leading to a more stable company culture, higher customer satisfaction, and improved business outcomes.

Which recruitment strategies help improve retention?

Recruitment strategies that can improve retention include identifying candidates who align with the company culture, using assessments to evaluate soft skills, and providing transparency about role expectations during the hiring process. Employees who feel connected to the organization and have clarity about their role are more likely to stay longer.

How can a good onboarding process contribute to higher retention?

An effective onboarding process can contribute to higher retention by helping new employees quickly adapt to their role, the company culture, and expectations. By providing support and clear information from the start, their engagement is increased, and the likelihood of them leaving early due to feelings of being overwhelmed or lacking guidance is reduced.

What is the role of company culture in retaining employees?

Company culture plays a crucial role in employee retention. When employees feel heard, valued, and connected to the values and norms of the company, they are more likely to stay. A positive culture that fosters collaboration, respect, and personal growth can significantly enhance employee motivation and satisfaction.

How can leadership and management style influence retention?

Leadership and management style have a significant impact on retention. Leaders who inspire, support, and coach their team can increase employee engagement and satisfaction. Offering autonomy and trust can lead to higher loyalty, while inefficient or negative management styles can contribute to dissatisfaction and increased employee turnover.

What is the importance of recognition and rewards for employee retention?

Recognition and rewards play an important role in employee retention by showing staff that their work is valued. This can increase their motivation and loyalty. In addition to financial rewards, compliments, promotions, and other forms of recognition can also contribute to satisfaction and retaining employees.

What role does work-life balance play in improving retention?

A balanced work-life balance plays an important role in increasing retention. By reducing stress and improving job satisfaction, employees are more likely to stay with the company. Initiatives such as flexible working hours, remote work options, and respect for personal time can contribute to this balance.

What does increasing retention mean within a company?

Increasing retention within a company means implementing strategies to keep employees with the organization for longer. This can be achieved by improving job satisfaction, offering growth opportunities, and fostering a positive and supportive company culture.

How do I measure the success of my retention strategy?

The success of a retention strategy can be measured by tracking retention rates and turnover rates, and by gaining insights from exit interviews. Additionally, employee satisfaction surveys and feedback from performance evaluations can provide valuable information about the effectiveness of the strategies applied.

What are the costs of a low retention rate?

A low retention rate can bring significant costs, such as increased expenses for recruiting and training new employees. Furthermore, the loss of experienced staff can lead to lower productivity, reduced knowledge transfer, and a negative impact on company culture.

How can I increase employee engagement?

To increase employee engagement, involve them in decision-making processes, regularly ask for their feedback, and recognize their contributions. Offering development opportunities and maintaining transparent communication can also contribute to greater engagement.

How can technology help improve employee retention?

Technology can be a tool for improving employee retention by facilitating communication, feedback, and development. By using online platforms for training, recognition, and evaluation, companies can create a more engaged and satisfied workforce.

FAQ

How long does it take to complete the tool?

Less than 10 minutes. You’ll answer 30 guided questions and get a summary of what to look for in your next assessment platform.

Can this checklist help me compare assessment providers?

Yes. By clarifying what matters most to your team, it makes comparing providers' features, pricing, and strengths much easier and more strategic.

How can I use this checklist if I’m not doing a formal RFI?

It’s equally valuable for internal evaluations, exploring new tools, or improving your current hiring process even if you’re not issuing an RFI or RFQ.

What should I look for in a modern assessment tool?

Prioritize platforms with user-friendly design, mobile compatibility, strong analytics, ATS integrations, and inclusive features like neurodiversity support.

What types of assessments should I consider in 2025?

Leading tools combine cognitive testing, situational judgment tests (SJTs), behavior assessments, and predictive AI to evaluate candidates more holistically.

Who should use an assessment checklist?

HR professionals, hiring managers, and procurement teams evaluating pre-selection solutions, especially those comparing AI-powered or compliance-driven assessment platforms.

How does this checklist help with RFIs and RFQs for assessments?

The checklist helps you define your exact requirements so you can confidently draft or respond to Requests for Information (RFI) or Requests for Quotation (RFQ) for assessment tools.

What is an assessment tool in hiring?

An assessment tool evaluates candidates’ skills, behaviors, and fit during the recruitment process. It helps improve hiring decisions and streamline pre-selection.

Game-based assessment packs

← Our Blog

How to set defensible knock-out criteria in recruitment

Learn how to design job-relevant knock-out rules, apply the four-fifths rule, and build an audit trail to avoid unfair filtering under UK law.
Joeri Everaers
COO
Read time: Approx
10 minutes

Knock-out criteria are binary pass/fail decisions applied to job applicants before any human judgement enters the process. Unlike ranked scoring, where a lower score still allows a candidate to progress, a knock-out removes them entirely. That finality is precisely what makes them high risk. A poorly designed cut-off can exclude large numbers of qualified candidates in a way that constitutes indirect discrimination under the Equality Act 2010: a neutral provision, criterion or practice that puts people with a protected characteristic at a particular disadvantage, unless it can be objectively justified as a proportionate means of achieving a legitimate aim.

This guide takes you through the complete workflow: choosing the right metrics, setting defensible thresholds, running an adverse impact screen, building an audit trail, and monitoring performance over time. By the end, you'll have a reviewed knock-out rule set with documented evidence and a monitoring plan rather than a set of filters that quietly exclude the wrong people.

When knock-out criteria are the right tool

Use a knock-out only when a criterion is genuinely job-relevant, verifiable from objective evidence, and narrowly tied to a real capability requirement. The classic examples are: a mandatory qualification required by law (e.g. an SIA licence for a security role), a right-to-work eligibility check, or a language proficiency requirement that is genuinely essential to the role duties.

If you're uncertain whether a requirement is essential, or if it could reasonably be assessed at a later stage through structured tests or interviews, use progressive screening instead: broad application sift, then structured assessment, then interview. Progressive screening preserves more candidates for evaluation and reduces the risk of inadvertently removing people who would have performed well.

Do not use knock-outs for:

  • Salary history (a proxy for previous disadvantage and often legally risky)
  • Years of experience beyond what is genuinely necessary for the role
  • Degree requirements where no specific qualification is mandated
  • Vague requirements ("strong communication skills") that cannot be objectively measured at the application stage
  • Postcode proximity, unless shift or on-site operational requirements are genuinely non-negotiable and documented

Collect the right data before setting any cut-off

Before you define a threshold, you need a baseline dataset. Collect applicant counts across the full funnel (application, sift, knock-out stage, advance/pass) over a defined time window. For high-volume roles, 90 days is a reasonable starting point. For lower-volume specialist hiring, you may need 12 months or more to accumulate usable numbers.

You also need to be able to calculate selection rates by relevant demographic groups to run an adverse impact screen. Handle protected attribute data carefully and lawfully under UK GDPR: collect it via an anonymised equal opportunities form rather than through the scored assessment itself, and keep it separate from scoring records.

Collect downstream outcome data too: hiring manager ratings at 90 days, training completion rates, time-to-productivity scores. These become your validation anchor. Without them, you cannot demonstrate that the knock-out actually predicts job success.

Run data quality checks before you start: identify missing responses, duplicate applications, and inconsistent scoring labels across shifts or locations.

Setting knock-out criteria thresholds: a step-by-step process

Step 1. Translate job requirements into job-relevant measures. Start from a current job analysis or task inventory, not from a historic job description or a recruiter's intuition. Map each requirement to observable, measurable evidence.

Step 2. Decide the trigger type. An eligibility knock-out answers a binary factual question (does this person hold the required licence?). A scoring-based knock-out applies a numeric threshold to an assessment result. Both are legitimate, but scoring-based knock-outs carry higher statistical risk and require validation evidence.

Step 3. For scoring-based knock-outs, choose between a hard cut-off and a score band. A hard cut-off (e.g. reject everyone below 60 out of 100) is simpler to administer but more likely to produce adverse impact. A score band (e.g. flag everyone between 50 and 65 for a secondary assessment, auto-advance those above 65, and only reject those below 50) preserves borderline candidates for further review. Score bands are often a proportionate alternative to hard cut-offs.

Step 4. Build in an equivalency pathway: a documented route for a candidate to demonstrate they meet the underlying requirement through alternative evidence. This is not an ad hoc discretion door; it should be a defined process with clear criteria, applied consistently.

Step 5. If any part of your knock-out depends on assessor judgement (e.g. a scored telephone screen), run a calibration exercise before go-live. Have two or three scorers independently assess the same set of practice responses and reconcile discrepancies.

Step 6. Define your appeal and review pathway. Any candidate removed by an automated knock-out must have a route to request human review, particularly where a disability adjustment may be relevant. Under UK GDPR Article 22C, solely automated decisions with legal or similarly significant effects on individuals attract additional safeguards, including the right to obtain human review and to contest the decision. The ICO's guidance on fairness in the AI lifecycle (published March 2023) sets out how organisations should provide meaningful information about the logic involved in automated decisions.

Adverse impact analysis: the four-fifths rule and sample size checks

The four-fifths rule (80% rule) is a practical screening benchmark, not a legal test in its own right. According to the EEOC's Uniform Guidelines on Employee Selection Procedures, a selection rate for a protected group that is less than 80% of the rate for the group with the highest selection rate generally indicates adverse impact and warrants investigation.

Worked example:

Suppose you're running a numeric skills assessment with a cut-off of 60 out of 100 for a warehouse operative role. In a recent cohort of 400 applicants:

GroupAppliedPassed cut-offSelection rate
Group A25017570.0%
Group B1507550.0%

Group A has the highest selection rate at 70%. The four-fifths threshold is 80% of 70% = 56%. Group B's rate of 50% falls below 56%. This is a trigger for further review.

What to do when the four-fifths threshold is breached:

  1. Pause rollout if the rule hasn't yet been applied at scale.
  2. Run complementary checks: compare the absolute difference in selection rates, review reject-rate composition, and look at whether Group B candidates who did advance had equivalent or better downstream outcomes.
  3. Revise the threshold or introduce banding (see the remediation section below).
  4. Re-run the calculation on the revised rule before applying it.

Sample size guidance: Small sample sizes can produce misleading results in both directions. A ratio calculated from 15 candidates per group is statistically unreliable. Your organisation should define a minimum N policy before go-live. A commonly applied internal policy is to require at least 30 applicants per group before running an adverse impact calculation, and to flag any result based on fewer than 50 per group as provisional pending further data. Set your own thresholds based on your hiring volumes and risk appetite, and document them.

Validate and document every decision

Each knock-out rule needs a documented record containing:

  • Rule statement: the exact criterion as applied (e.g. "Candidates who score below 50/100 on the verbal reasoning assessment are automatically removed from the process.")
  • Job-relatedness evidence: the job analysis or task inventory that supports the criterion, and who signed off on the link
  • Threshold or band: the exact numeric value(s) applied and the rationale for that number
  • Data window: the date range and applicant counts used to set and validate the threshold
  • Adverse impact results: the four-fifths calculation, sample sizes, and whether the threshold was breached
  • Remediation decisions: if a threshold was revised, document what changed and why
  • Approval sign-off: name, role, and date for both the HR/TA lead and a compliance or legal reviewer
  • Review date: when the rule will next be assessed

Keep a change log. If a threshold is adjusted, version-control the record so you can show what was in place during any given hiring campaign.

Remediation when adverse impact appears

Banding is the most common first remedy. Instead of a single cut-off at 60, create three zones: auto-advance (above 65), review band (50 to 65), and reject (below 50). Candidates in the review band complete a secondary, lower-cost screen before a final decision is made. This approach is consistent with proportionality under the Equality Act 2010: if a less restrictive measure achieves the same legitimate aim, you should use it.

Multiple-input knock-outs reduce reliance on a single metric. Combining a short skills test with a structured work sample, for example, can actually reduce adverse impact signals compared to either measure alone, because different assessments surface different evidence of capability. Selection Lab's role-specific assessment bundles are designed precisely for this: combining cognitive, skills-based, and situational assessments into a validated funnel rather than relying on any single filter.

Before rolling out a revised rule, test it retrospectively against your historical data. Run the revised four-fifths calculation and compare it to the original. Only proceed if the adverse impact signal has reduced to an acceptable level.

Document all accommodations and alternative evidence routes centrally. These must not be handled case by case without a record.

Monitoring after go-live

Set up a structured review cadence from day one:

  • Go-live window (first 30 to 60 days): review selection rates by group weekly and check for early drift.
  • Quarterly review (ongoing): re-run four-fifths calculations, review override and reversal rates, check downstream outcomes for recent cohorts.
  • Monthly review during high-volume campaigns: volume creates statistical power quickly; don't wait a quarter to spot an emerging problem.

Define trigger-based alerts: for example, if the selection rate ratio for any group drops below 85% in a rolling 30-day window, escalate for immediate review before the next hiring campaign continues.

Produce two reporting outputs: a one-page summary for HR leadership showing selection rates, override rates, and any flagged anomalies; and a technical appendix for compliance stakeholders showing the full calculation, data quality notes, and the change log.

Platforms that integrate knock-out logic with ATS workflows, such as Selection Lab's SmartChat intake tool, can surface override and reversal rates directly within your existing reporting dashboard. That kind of visibility makes it far easier to spot drift early and demonstrate to stakeholders that human review pathways are being used, not bypassed.

A note on automated knock-outs and UK GDPR

If your knock-out rules are applied automatically by an ATS or AI screening tool with no human in the loop before a rejection is issued, UK GDPR Article 22C applies. Candidates have the right to obtain human review of the decision, to express their point of view, and to contest the outcome. You must also be able to provide meaningful information about the logic involved in the automated process.

In practice, this means:

  • Your privacy notice and application communications must explain that automated screening is used and how it works.
  • A documented human review process must exist and be accessible to candidates who request it.
  • The logic of each knock-out rule must be recorded in a form that a recruiter can explain to a candidate in plain language.

The ICO's fairness framework for the AI lifecycle (March 2023) is a practical reference point for how to structure these disclosures.

Quick reference: what a defensible knock-out looks like

A knock-out criterion is defensible when it is:

  1. Grounded in a current job analysis, not a historic job description
  2. Verifiable from objective evidence at the application stage
  3. Applied consistently across all candidates and all locations
  4. Tested for adverse impact using the four-fifths rule before go-live
  5. Documented with job-relatedness evidence, threshold rationale, and approval sign-offs
  6. Paired with a human review and appeal pathway
  7. Monitored quarterly (or more frequently during high-volume periods) against live selection rate data

Getting this right takes more upfront effort than setting a quick filter. But a knock-out rule that can't survive scrutiny isn't saving you time: it's creating legal exposure and removing candidates who may have been among your best hires.