Reading Time

AI hiring audit: what vendors must supply for evaluation

This guide defines precisely what a vendor should supply when responding to an audit or tender for an AI recruitment assessment platform. It is written for procurement leads, legal counsel, HR directors, and CHROs who need to evaluate vendor documentation quickly, defensibly, and across the full hiring workflow, from initial candidate intake through pre-screening, role matching, interview support, and final evaluation.

The documentation requirements described here reflect current regulatory frameworks: the EU AI Act (Article 11 and Annex IV), the NIST AI Risk Management Framework, ISO/IEC 42001:2023, and jurisdiction-specific rules such as New York City's Local Law 144. Where a vendor cannot produce documentation against these standards, that gap is itself a risk signal.

Vendor audit response summary: what to request and where it lives

Before reviewing individual documents, ask the vendor to supply a one-page audit response index. This single table maps each buyer question to a specific downloadable artifact, a document version number, and a date. Without it, procurement teams spend hours locating evidence that may or may not exist.

A well-structured audit package uses a folder hierarchy similar to this:

/00-ExecutiveSummary
/01-SystemDocumentation
/02-DataGovernance
/03-BiasAuditReports_vX.Y
/04-ModelCards_vX.Y
/05-RemediationAndMonitoring
/06-PrivacySecurity
/07-IntegrationAndAPIs
/08-ChangeLogAndNextAudit

Each folder contains versioned artifacts. Auditors can then map a question about, say, disparate impact testing to /03-BiasAuditReports_v2.1/methodology.pdf without chasing the vendor for clarification.

The vendor's executive summary (folder /00) should also define where AI is actually active in the workflow. A platform like Selection Lab covers a multi-stage selection flow: conversational SmartChat intake, psychometric and game-based assessments, role-match scoring, and structured interview question generation. Each stage has a different risk profile, different data inputs, and different fairness exposure. The executive summary must state which stages are AI-driven, which are human-controlled, and where the handoff occurs.

Audit methodology and dataset documentation

The bias audit section is where most vendor documentation packages are weakest. A checklist of compliance topics is not a bias audit. What buyers need is a downloadable audit methodology document that answers these questions specifically:

Who conducted the audit? An independent audit is preferable. If the audit was conducted internally, the vendor must provide a signed attestation from a named data scientist or ethics officer and describe the review controls applied.

What method was used? The standard approach for employment decisions is disparate impact analysis using the four-fifths (80%) rule, comparing selection rates between a reference group and each protected group. Vendors should state explicitly whether they used selection-rate-based testing, predictive parity, equalized odds, or a combination. Each choice has different implications for which group bears the cost of model error.

What data was tested? The dataset summary should cover:

  • Source period (e.g., applications processed between Q1 2023 and Q4 2024)
  • Total record count, and counts per protected group attribute tested
  • Inclusion and exclusion criteria (e.g., roles included, minimum sample size thresholds)
  • How protected-group attributes were derived (self-reported, inferred, or proxy-based) and the limits of each approach
  • A clear statement of what was NOT tested and why

The "not tested" disclosure matters as much as what was tested. A vendor that tested only the scoring model but not the conversational intake stage (SmartChat) or the role-match algorithm has an incomplete audit. Buyers should request scope boundaries in writing.

Technical documentation artifacts (system architecture overview, data flow diagram, logging approach, and a version/change log) belong in /01-SystemDocumentation. These are required under the EU AI Act's Annex IV for high-risk AI systems and align with NIST's AI Risk Management Framework guidance on documenting testing results for repeatability and accountability.

Performance metrics broken down by subgroup

This is the section most vendor documentation either omits entirely or presents in vague terms. Buyers should require a structured metrics table, not a summary statement.

For each protected group (gender, age group, ethnicity/national origin, disability status where applicable), the report should include:

  • Selection rate for each group and the ratio to the reference group (disparate impact ratio)
  • Four-fifths rule pass/fail for each comparison
  • False positive rate (candidates incorrectly advanced) and false negative rate (candidates incorrectly rejected) by subgroup, where the model produces a binary or ranked output
  • Sample size for each subgroup and a confidence interval or note on statistical reliability for small subgroups (fewer than 30 observations should be flagged explicitly)
  • Threshold definitions: what score or decision boundary triggers a pass, a hold, or a rejection at each stage

These figures should appear in the downloadable bias audit report in /03-BiasAuditReports_vX.Y, not only in a sales slide or a summary email. An executive summary interpretation section within the same document should explain what the numbers mean for hiring decisions: for instance, whether a 0.78 disparate impact ratio at the pre-screening stage means that a specific demographic group is being rejected at a meaningfully higher rate before a human ever reviews their application.

NYC Local Law 144 sets a directly applicable precedent here: employers using automated employment decision tools must commission an annual, independent bias audit and publish the results publicly, with candidate notification at least ten days before the tool is used. Even organizations outside New York should treat LL 144 as a de facto minimum standard for what a published bias audit looks like.

Remediation and ongoing monitoring controls

A bias audit that has never triggered a remediation action is either a well-performing system or an audit that hasn't found anything yet. Buyers should ask explicitly: "What has changed in the model, data, or workflow as a result of your bias audits?"

The vendor's remediation documentation (in /05-RemediationAndMonitoring) should list:

  • Specific issues identified in each audit cycle
  • The action taken: model retrain, data rebalancing, threshold adjustment, workflow change, or temporary suspension of a feature
  • The date the change was deployed
  • Whether a re-audit was conducted after remediation, and the result

Ongoing monitoring is a separate but related requirement. Post-deployment monitoring drift is a real risk: a model that passes bias testing on historical data can degrade in fairness as the applicant pool shifts, as job requirements change, or as economic conditions alter who applies. The vendor should define:

  • Monitoring frequency (monthly, quarterly)
  • The KPIs monitored (selection rate ratios, score distributions, prediction accuracy)
  • The drift threshold that triggers an alert
  • The rollback or stop rule if a threshold is breached
  • The human escalation path: who is notified, how quickly, and what decisions require human sign-off before the system continues operating

Governance documentation should include a RACI chart identifying who owns each control. ISO/IEC 42001:2023 requires exactly this kind of continual improvement structure within an AI management system.

Candidate notification procedures also belong here. Where regulation requires candidates to be informed that an automated tool is being used (as under NYC LL 144, or as good practice under GDPR Article 13/14), the vendor should document how that notice is delivered and stored.

Version history, model cards, and the next audit date

Model cards are a structured transparency artifact that has become standard practice for operationalizing the documentation requirements of frameworks like the EU AI Act. Each AI component in the platform should have its own model card covering:

  • Model purpose and intended use
  • Training data summary
  • Known limitations and out-of-scope uses
  • Performance metrics by subgroup
  • Evaluation methodology
  • Version and release date

These belong in /04-ModelCards_vX.Y. When a model is updated, a new versioned model card replaces the previous one, and the old version is archived. Auditors can then confirm that the version of the model in production during any given period corresponds to a specific documented artifact.

The change log in /08-ChangeLogAndNextAudit should record every change event that could affect model behavior or fairness outcomes: model retrains, prompt updates (for conversational AI components), threshold changes, new assessment types added, and integration changes that alter data inputs. Each entry should note whether the change triggered an ad-hoc re-audit.

The next scheduled audit date must be stated explicitly. Annual audits are a minimum. Any of the following events should trigger an unscheduled re-audit: a significant change to the model or scoring logic, a change in the applicant population that materially alters subgroup representation, a regulatory update in an applicable jurisdiction, or a candidate complaint that implies systematic scoring error.

Plain-language answers to standard tender questions

Procurement and legal teams often include questions in RFP documents that require non-technical answers. Vendors should provide a Q&A document in /00-ExecutiveSummary that covers the following:

Why are bias audits performed? AI models trained on historical hiring data can reproduce past patterns of under-selection for certain demographic groups. Bias audits test whether the model's outputs disadvantage any protected group at a statistically meaningful level, and document what was done when they do.

What does "disparate impact" mean in practice? If the platform selects candidates from one demographic group at a rate less than four-fifths (80%) of the rate for the highest-selected group, that is a disparate impact finding requiring investigation. It does not automatically mean the tool is discriminatory, but it does require documented review and a response.

Where is personal data stored? The vendor must name the data residency location and the legal basis for any cross-border transfer. Selection Lab, for example, stores personal data in Frankfurt, operates under GDPR, and uses local LLMs to strip personal information from conversational transcripts before processing.

What are the retention and consent terms? The vendor should provide a data retention schedule, a description of the candidate consent flow, and evidence of how consent is recorded and revoked. Data processing agreements with sub-processors should be available on request.

Is the audit independent? "Independent" means conducted by an organization with no financial interest in the outcome. Where the audit is internal, the vendor should describe the separation of duties between the team that built the model and the team that evaluated it.

What happens during an incident? The vendor should provide an incident response procedure covering detection, classification, notification timelines, and remediation steps. This belongs in /06-PrivacySecurity.

Can data be exported? ATS integration documentation and data portability specifications belong in /07-IntegrationAndAPIs. Buyers should confirm that candidate data, assessment results, and audit logs can be exported in a standard format if the contract ends.

Where does human oversight occur? The vendor must define which decisions are made solely by the AI system and which require human review before action is taken. For a platform that spans conversational intake, scoring, match-per-role ranking, and interview question generation, the handoff points between automated and human judgment must be documented at each stage.

Downloadable artifacts checklist

The following documents constitute a complete audit-ready documentation package. Each item should be available for download, version-labeled, and dated:

[ ] Vendor Audit Response Summary (index page mapping questions to documents)
[ ] System architecture overview and data flow diagram
[ ] Bias audit report (methodology, dataset summary, subgroup metrics, remediation actions, executive interpretation)
[ ] Model card(s) per AI component (version-matched to current deployment)
[ ] Performance metrics by protected group (selection rates, DI ratios, FP/FN rates, sample sizes)
[ ] Remediation log (issues found, actions taken, re-audit results)
[ ] Monitoring plan (KPIs, frequency, drift thresholds, escalation path, RACI)
[ ] Version and change log with next audit date
[ ] GDPR compliance documentation (data residency, retention schedule, DPA with sub-processors)
[ ] Candidate consent flow documentation
[ ] Incident response procedure
[ ] ATS integration spec and data portability documentation
[ ] Non-technical Q&A (plain-language responses to standard tender questions)

A vendor that produces all of these artifacts in a structured, versioned folder is demonstrating operational maturity. One that responds with a compliance badge and a one-page overview is signaling that the audit infrastructure does not yet exist.

The regulatory pressure to maintain this documentation is only increasing. The EU AI Act's Article 11 and Annex IV requirements for high-risk AI systems, NIST's AI RMF guidance on quantitative fairness indicators, and ISO/IEC 42001:2023's lifecycle governance controls all point toward the same expectation: documented, repeatable, independently verifiable evidence that the system behaves fairly and that someone is accountable when it doesn't.

When evaluating vendors, request this package before any product demonstration. If the documentation exists and is well-organized, it reflects how the vendor operates. If it has to be assembled from scratch in response to your request, that tells you something equally important.

FAQ

Can game-based assessments promote diversity in the hiring process?

Yes, game-based assessments can support diversity by focusing on skills and behaviors rather than traditional criteria like résumés, which may contain unconscious biases. This gives candidates from diverse backgrounds a fairer chance to demonstrate their potential.

What is a game-based assessment?

A game-based assessment is a method that uses game mechanics to evaluate a candidate’s skills, competencies, and personality traits. While playing these games, candidates are assessed on aspects like problem-solving, cognitive ability, and behavior under pressure in an interactive way.

What are the advantages of game-based assessments?

Game-based assessments offer a more engaging and interactive experience for candidates, which can lead to a more positive perception of the hiring process—especially among certain groups. For employers, they provide deeper insights into both cognitive and behavioral traits, which traditional tests may miss. They also reduce the chance of socially desirable answers, as candidates tend to respond more authentically in a game environment.

How reliable are game-based assessments compared to traditional tests?

When well-designed, game-based assessments can be just as reliable—or even more reliable—than traditional tests. They assess a wide range of behaviors and cognitive abilities in a dynamic setting. However, the quality of these assessments varies greatly, so careful evaluation is essential.

How does a game-based assessment work?

Candidates participate in interactive games designed to measure specific skills and behaviors. Evaluation goes beyond just the final score—it also considers how the candidate makes decisions, handles challenges, and responds to different scenarios. These insights reveal underlying thought processes and behavioral patterns.

Are game-based assessments scientifically validated?

The main drawback is that many game-based assessments are relatively new and have not yet been extensively researched by independent academics. Providers often cite their own research, which is rarely externally validated. Without independent studies, the reliability of these assessments remains uncertain—something to keep in mind when selecting one.

How can game based assessments contribute to a better candidate experience

This can vary significantly by audience. The playful, interactive nature of game-based assessments can lower stress levels for some candidates compared to traditional tests. However, research shows that certain groups, especially those over 35, may find them more stressful. Men also tend to rate the experience more positively than women.

Can you practice game-based assessment?

You can familiarize yourself with the style of games used, but it’s difficult to "practice" for them in a traditional sense. These assessments are designed to measure natural reactions and authentic behavior, so repeated practice typically has less effect on performance than with traditional tests.

Will game-based assessments replace traditional tests in the future?

It’s likely that game-based assessments will become more common in hiring processes, but they probably won’t fully replace traditional tests. Both approaches have value and can complement each other depending on the role and the company’s needs.

How are the results of a game-based assessment analyzed?

Results are analyzed based on predefined criteria such as problem-solving ability, reaction time, and behavior under pressure. Advanced algorithms collect and interpret this data to provide a reliable, objective evaluation of a candidate’s strengths.

What kind of skills do game-based assessments measure?

They assess a wide range of abilities, including problem-solving, adaptability, decision-making under pressure, teamwork, and emotional intelligence. Depending on the design, they may also evaluate cognitive skills like memory, attention, and pattern recognition.

How long does a game-based assessment take?

Typically, these assessments last between 15 and 60 minutes, depending on the game’s complexity and the number of skills being tested. They’re usually shorter and more engaging than traditional assessments, making for a smoother candidate experience.

Are game-based assessments suitable for all roles?

They are especially effective for roles that require flexibility, creativity, problem-solving, and strong interpersonal skills. For highly technical or specialized roles, additional assessments may be needed to measure specific knowledge.

What’s the difference between a game-based and a gamified assessment?

A gamified assessment adds game-like elements (such as points or rewards) to a traditional test to increase engagement. A game-based assessment, on the other hand, is a standalone game designed specifically to evaluate certain competencies. The game itself is the primary evaluation tool, not just an enhancement.

FAQ

How can I improve my company’s retention rate?

The retention rate can be improved by investing in employee development and satisfaction. This includes offering training, career opportunities, and recognition for their contributions. A culture of open communication and attention to work-life balance can also contribute to higher retention. Additionally, offering competitive compensation and involving employees in decision-making can strengthen loyalty.

What are the benefits of growth opportunities for employee retention?

Growth opportunities can promote employee retention by giving staff a sense of direction and motivation. When they have the chance to learn and develop professionally within the company, they feel valued, which increases their loyalty. This can prevent them from leaving to seek better opportunities elsewhere. kunnen het behoud van personeel bevorderen door medewerkers een gevoel van richting en motivatie te geven. Wanneer zij de kans krijgen om te leren en zich professioneel te ontwikkelen binnen het bedrijf, voelen zij zich gewaardeerd, wat hun loyaliteit vergroot. Dit kan voorkomen dat ze vertrekken om elders betere kansen te zoeken.

What are the key factors that influence employee retention?

Key factors that influence employee retention include salary and benefits, opportunities for professional development, work-life balance, company culture, and the relationship with supervisors. Employees tend to stay longer when they feel valued, challenged, and supported in their work environment.

Why is employee retention so important for organizations?

Employee retention is important because it helps reduce recruitment and training costs for new employees, and it contributes to retaining knowledge and experience within the organization. High retention also ensures continuity within teams, leading to a more stable company culture, higher customer satisfaction, and improved business outcomes.

Which recruitment strategies help improve retention?

Recruitment strategies that can improve retention include identifying candidates who align with the company culture, using assessments to evaluate soft skills, and providing transparency about role expectations during the hiring process. Employees who feel connected to the organization and have clarity about their role are more likely to stay longer.

How can a good onboarding process contribute to higher retention?

An effective onboarding process can contribute to higher retention by helping new employees quickly adapt to their role, the company culture, and expectations. By providing support and clear information from the start, their engagement is increased, and the likelihood of them leaving early due to feelings of being overwhelmed or lacking guidance is reduced.

What is the role of company culture in retaining employees?

Company culture plays a crucial role in employee retention. When employees feel heard, valued, and connected to the values and norms of the company, they are more likely to stay. A positive culture that fosters collaboration, respect, and personal growth can significantly enhance employee motivation and satisfaction.

How can leadership and management style influence retention?

Leadership and management style have a significant impact on retention. Leaders who inspire, support, and coach their team can increase employee engagement and satisfaction. Offering autonomy and trust can lead to higher loyalty, while inefficient or negative management styles can contribute to dissatisfaction and increased employee turnover.

What is the importance of recognition and rewards for employee retention?

Recognition and rewards play an important role in employee retention by showing staff that their work is valued. This can increase their motivation and loyalty. In addition to financial rewards, compliments, promotions, and other forms of recognition can also contribute to satisfaction and retaining employees.

What role does work-life balance play in improving retention?

A balanced work-life balance plays an important role in increasing retention. By reducing stress and improving job satisfaction, employees are more likely to stay with the company. Initiatives such as flexible working hours, remote work options, and respect for personal time can contribute to this balance.

What does increasing retention mean within a company?

Increasing retention within a company means implementing strategies to keep employees with the organization for longer. This can be achieved by improving job satisfaction, offering growth opportunities, and fostering a positive and supportive company culture.

How do I measure the success of my retention strategy?

The success of a retention strategy can be measured by tracking retention rates and turnover rates, and by gaining insights from exit interviews. Additionally, employee satisfaction surveys and feedback from performance evaluations can provide valuable information about the effectiveness of the strategies applied.

What are the costs of a low retention rate?

A low retention rate can bring significant costs, such as increased expenses for recruiting and training new employees. Furthermore, the loss of experienced staff can lead to lower productivity, reduced knowledge transfer, and a negative impact on company culture.

How can I increase employee engagement?

To increase employee engagement, involve them in decision-making processes, regularly ask for their feedback, and recognize their contributions. Offering development opportunities and maintaining transparent communication can also contribute to greater engagement.

How can technology help improve employee retention?

Technology can be a tool for improving employee retention by facilitating communication, feedback, and development. By using online platforms for training, recognition, and evaluation, companies can create a more engaged and satisfied workforce.

FAQ

How long does it take to complete the tool?

Less than 10 minutes. You’ll answer 30 guided questions and get a summary of what to look for in your next assessment platform.

Can this checklist help me compare assessment providers?

Yes. By clarifying what matters most to your team, it makes comparing providers' features, pricing, and strengths much easier and more strategic.

How can I use this checklist if I’m not doing a formal RFI?

It’s equally valuable for internal evaluations, exploring new tools, or improving your current hiring process even if you’re not issuing an RFI or RFQ.

What should I look for in a modern assessment tool?

Prioritize platforms with user-friendly design, mobile compatibility, strong analytics, ATS integrations, and inclusive features like neurodiversity support.

What types of assessments should I consider in 2025?

Leading tools combine cognitive testing, situational judgment tests (SJTs), behavior assessments, and predictive AI to evaluate candidates more holistically.

Who should use an assessment checklist?

HR professionals, hiring managers, and procurement teams evaluating pre-selection solutions, especially those comparing AI-powered or compliance-driven assessment platforms.

How does this checklist help with RFIs and RFQs for assessments?

The checklist helps you define your exact requirements so you can confidently draft or respond to Requests for Information (RFI) or Requests for Quotation (RFQ) for assessment tools.

What is an assessment tool in hiring?

An assessment tool evaluates candidates’ skills, behaviors, and fit during the recruitment process. It helps improve hiring decisions and streamline pre-selection.

Game-based assessment packs

← Our Blog

AI hiring audit: what vendors must supply for evaluation

Request a complete audit package from AI hiring vendors: bias audit methodology, subgroup performance metrics, model cards, remediation logs, and monitoring controls aligned with E
Joeri Everaers
COO
Read time: Approx

This guide defines precisely what a vendor should supply when responding to an audit or tender for an AI recruitment assessment platform. It is written for procurement leads, legal counsel, HR directors, and CHROs who need to evaluate vendor documentation quickly, defensibly, and across the full hiring workflow, from initial candidate intake through pre-screening, role matching, interview support, and final evaluation.

The documentation requirements described here reflect current regulatory frameworks: the EU AI Act (Article 11 and Annex IV), the NIST AI Risk Management Framework, ISO/IEC 42001:2023, and jurisdiction-specific rules such as New York City's Local Law 144. Where a vendor cannot produce documentation against these standards, that gap is itself a risk signal.

Vendor audit response summary: what to request and where it lives

Before reviewing individual documents, ask the vendor to supply a one-page audit response index. This single table maps each buyer question to a specific downloadable artifact, a document version number, and a date. Without it, procurement teams spend hours locating evidence that may or may not exist.

A well-structured audit package uses a folder hierarchy similar to this:

/00-ExecutiveSummary
/01-SystemDocumentation
/02-DataGovernance
/03-BiasAuditReports_vX.Y
/04-ModelCards_vX.Y
/05-RemediationAndMonitoring
/06-PrivacySecurity
/07-IntegrationAndAPIs
/08-ChangeLogAndNextAudit

Each folder contains versioned artifacts. Auditors can then map a question about, say, disparate impact testing to /03-BiasAuditReports_v2.1/methodology.pdf without chasing the vendor for clarification.

The vendor's executive summary (folder /00) should also define where AI is actually active in the workflow. A platform like Selection Lab covers a multi-stage selection flow: conversational SmartChat intake, psychometric and game-based assessments, role-match scoring, and structured interview question generation. Each stage has a different risk profile, different data inputs, and different fairness exposure. The executive summary must state which stages are AI-driven, which are human-controlled, and where the handoff occurs.

Audit methodology and dataset documentation

The bias audit section is where most vendor documentation packages are weakest. A checklist of compliance topics is not a bias audit. What buyers need is a downloadable audit methodology document that answers these questions specifically:

Who conducted the audit? An independent audit is preferable. If the audit was conducted internally, the vendor must provide a signed attestation from a named data scientist or ethics officer and describe the review controls applied.

What method was used? The standard approach for employment decisions is disparate impact analysis using the four-fifths (80%) rule, comparing selection rates between a reference group and each protected group. Vendors should state explicitly whether they used selection-rate-based testing, predictive parity, equalized odds, or a combination. Each choice has different implications for which group bears the cost of model error.

What data was tested? The dataset summary should cover:

  • Source period (e.g., applications processed between Q1 2023 and Q4 2024)
  • Total record count, and counts per protected group attribute tested
  • Inclusion and exclusion criteria (e.g., roles included, minimum sample size thresholds)
  • How protected-group attributes were derived (self-reported, inferred, or proxy-based) and the limits of each approach
  • A clear statement of what was NOT tested and why

The "not tested" disclosure matters as much as what was tested. A vendor that tested only the scoring model but not the conversational intake stage (SmartChat) or the role-match algorithm has an incomplete audit. Buyers should request scope boundaries in writing.

Technical documentation artifacts (system architecture overview, data flow diagram, logging approach, and a version/change log) belong in /01-SystemDocumentation. These are required under the EU AI Act's Annex IV for high-risk AI systems and align with NIST's AI Risk Management Framework guidance on documenting testing results for repeatability and accountability.

Performance metrics broken down by subgroup

This is the section most vendor documentation either omits entirely or presents in vague terms. Buyers should require a structured metrics table, not a summary statement.

For each protected group (gender, age group, ethnicity/national origin, disability status where applicable), the report should include:

  • Selection rate for each group and the ratio to the reference group (disparate impact ratio)
  • Four-fifths rule pass/fail for each comparison
  • False positive rate (candidates incorrectly advanced) and false negative rate (candidates incorrectly rejected) by subgroup, where the model produces a binary or ranked output
  • Sample size for each subgroup and a confidence interval or note on statistical reliability for small subgroups (fewer than 30 observations should be flagged explicitly)
  • Threshold definitions: what score or decision boundary triggers a pass, a hold, or a rejection at each stage

These figures should appear in the downloadable bias audit report in /03-BiasAuditReports_vX.Y, not only in a sales slide or a summary email. An executive summary interpretation section within the same document should explain what the numbers mean for hiring decisions: for instance, whether a 0.78 disparate impact ratio at the pre-screening stage means that a specific demographic group is being rejected at a meaningfully higher rate before a human ever reviews their application.

NYC Local Law 144 sets a directly applicable precedent here: employers using automated employment decision tools must commission an annual, independent bias audit and publish the results publicly, with candidate notification at least ten days before the tool is used. Even organizations outside New York should treat LL 144 as a de facto minimum standard for what a published bias audit looks like.

Remediation and ongoing monitoring controls

A bias audit that has never triggered a remediation action is either a well-performing system or an audit that hasn't found anything yet. Buyers should ask explicitly: "What has changed in the model, data, or workflow as a result of your bias audits?"

The vendor's remediation documentation (in /05-RemediationAndMonitoring) should list:

  • Specific issues identified in each audit cycle
  • The action taken: model retrain, data rebalancing, threshold adjustment, workflow change, or temporary suspension of a feature
  • The date the change was deployed
  • Whether a re-audit was conducted after remediation, and the result

Ongoing monitoring is a separate but related requirement. Post-deployment monitoring drift is a real risk: a model that passes bias testing on historical data can degrade in fairness as the applicant pool shifts, as job requirements change, or as economic conditions alter who applies. The vendor should define:

  • Monitoring frequency (monthly, quarterly)
  • The KPIs monitored (selection rate ratios, score distributions, prediction accuracy)
  • The drift threshold that triggers an alert
  • The rollback or stop rule if a threshold is breached
  • The human escalation path: who is notified, how quickly, and what decisions require human sign-off before the system continues operating

Governance documentation should include a RACI chart identifying who owns each control. ISO/IEC 42001:2023 requires exactly this kind of continual improvement structure within an AI management system.

Candidate notification procedures also belong here. Where regulation requires candidates to be informed that an automated tool is being used (as under NYC LL 144, or as good practice under GDPR Article 13/14), the vendor should document how that notice is delivered and stored.

Version history, model cards, and the next audit date

Model cards are a structured transparency artifact that has become standard practice for operationalizing the documentation requirements of frameworks like the EU AI Act. Each AI component in the platform should have its own model card covering:

  • Model purpose and intended use
  • Training data summary
  • Known limitations and out-of-scope uses
  • Performance metrics by subgroup
  • Evaluation methodology
  • Version and release date

These belong in /04-ModelCards_vX.Y. When a model is updated, a new versioned model card replaces the previous one, and the old version is archived. Auditors can then confirm that the version of the model in production during any given period corresponds to a specific documented artifact.

The change log in /08-ChangeLogAndNextAudit should record every change event that could affect model behavior or fairness outcomes: model retrains, prompt updates (for conversational AI components), threshold changes, new assessment types added, and integration changes that alter data inputs. Each entry should note whether the change triggered an ad-hoc re-audit.

The next scheduled audit date must be stated explicitly. Annual audits are a minimum. Any of the following events should trigger an unscheduled re-audit: a significant change to the model or scoring logic, a change in the applicant population that materially alters subgroup representation, a regulatory update in an applicable jurisdiction, or a candidate complaint that implies systematic scoring error.

Plain-language answers to standard tender questions

Procurement and legal teams often include questions in RFP documents that require non-technical answers. Vendors should provide a Q&A document in /00-ExecutiveSummary that covers the following:

Why are bias audits performed? AI models trained on historical hiring data can reproduce past patterns of under-selection for certain demographic groups. Bias audits test whether the model's outputs disadvantage any protected group at a statistically meaningful level, and document what was done when they do.

What does "disparate impact" mean in practice? If the platform selects candidates from one demographic group at a rate less than four-fifths (80%) of the rate for the highest-selected group, that is a disparate impact finding requiring investigation. It does not automatically mean the tool is discriminatory, but it does require documented review and a response.

Where is personal data stored? The vendor must name the data residency location and the legal basis for any cross-border transfer. Selection Lab, for example, stores personal data in Frankfurt, operates under GDPR, and uses local LLMs to strip personal information from conversational transcripts before processing.

What are the retention and consent terms? The vendor should provide a data retention schedule, a description of the candidate consent flow, and evidence of how consent is recorded and revoked. Data processing agreements with sub-processors should be available on request.

Is the audit independent? "Independent" means conducted by an organization with no financial interest in the outcome. Where the audit is internal, the vendor should describe the separation of duties between the team that built the model and the team that evaluated it.

What happens during an incident? The vendor should provide an incident response procedure covering detection, classification, notification timelines, and remediation steps. This belongs in /06-PrivacySecurity.

Can data be exported? ATS integration documentation and data portability specifications belong in /07-IntegrationAndAPIs. Buyers should confirm that candidate data, assessment results, and audit logs can be exported in a standard format if the contract ends.

Where does human oversight occur? The vendor must define which decisions are made solely by the AI system and which require human review before action is taken. For a platform that spans conversational intake, scoring, match-per-role ranking, and interview question generation, the handoff points between automated and human judgment must be documented at each stage.

Downloadable artifacts checklist

The following documents constitute a complete audit-ready documentation package. Each item should be available for download, version-labeled, and dated:

[ ] Vendor Audit Response Summary (index page mapping questions to documents)
[ ] System architecture overview and data flow diagram
[ ] Bias audit report (methodology, dataset summary, subgroup metrics, remediation actions, executive interpretation)
[ ] Model card(s) per AI component (version-matched to current deployment)
[ ] Performance metrics by protected group (selection rates, DI ratios, FP/FN rates, sample sizes)
[ ] Remediation log (issues found, actions taken, re-audit results)
[ ] Monitoring plan (KPIs, frequency, drift thresholds, escalation path, RACI)
[ ] Version and change log with next audit date
[ ] GDPR compliance documentation (data residency, retention schedule, DPA with sub-processors)
[ ] Candidate consent flow documentation
[ ] Incident response procedure
[ ] ATS integration spec and data portability documentation
[ ] Non-technical Q&A (plain-language responses to standard tender questions)

A vendor that produces all of these artifacts in a structured, versioned folder is demonstrating operational maturity. One that responds with a compliance badge and a one-page overview is signaling that the audit infrastructure does not yet exist.

The regulatory pressure to maintain this documentation is only increasing. The EU AI Act's Article 11 and Annex IV requirements for high-risk AI systems, NIST's AI RMF guidance on quantitative fairness indicators, and ISO/IEC 42001:2023's lifecycle governance controls all point toward the same expectation: documented, repeatable, independently verifiable evidence that the system behaves fairly and that someone is accountable when it doesn't.

When evaluating vendors, request this package before any product demonstration. If the documentation exists and is well-organized, it reflects how the vendor operates. If it has to be assembled from scratch in response to your request, that tells you something equally important.