Sources

107 controls from 10 published frameworks. Each checklist item cites the controls below. Requirements are short paraphrases; always check the source document.

NIST AI Risk Management Framework 1.0

National Institute of Standards and Technology. Artificial Intelligence Risk Management Framework (AI RMF 1.0). NIST AI 100-1. 2023. https://doi.org/10.6028/NIST.AI.100-1 Source document

ControlClauseRequirement (paraphrase)Plan itemsReview
N01GOVERN 1.5Plan ongoing monitoring and periodic review of the risk process, define roles, and set the review frequency.O01, C05draft
N02GOVERN 1.7Have processes for decommissioning and phasing out AI systems safely, without raising risk.C04draft
N03GOVERN 2.1 and 2.3Document roles, responsibilities and lines of communication. Executive leadership owns decisions on AI risk.G01, G02draft
N04GOVERN 3.2Define and differentiate roles for human and AI configurations and for oversight of AI systems.G01, P10draft
N05GOVERN 4.3Enable AI testing, incident identification and information sharing.O06draft
N06GOVERN 6.1 and 6.2Address third party AI risks by policy. Have contingency processes for failures or incidents in high risk third party data or AI.P07draft
N07MEASURE 2.4Monitor the functionality and behavior of the AI system and its components in production.O01draft
N08MEASURE 2.6Evaluate safety regularly. Safety metrics reflect reliability, robustness, real time monitoring and response times for AI system failures.O01draft
N09MEASURE 2.11Evaluate and document fairness and bias.P05, O04draft
N10MEASURE 3.1 and 3.3Track known and emergent risks regularly using intended versus actual performance in deployed contexts. Give end users and affected communities channels to report problems and appeal outcomes.P01, P02, O03, O05draft
N11MEASURE 4.2 and 4.3Validate performance in the deployment context with domain experts. Identify and document measurable performance improvements or declines.P01, P04, O03draft
N12MANAGE 2.3Follow procedures to respond to and recover from a previously unknown risk.O08draft
N13MANAGE 2.4Have mechanisms, with assigned and understood responsibilities, to supersede, disengage or deactivate systems whose performance or outcomes depart from intended use.C03draft
N14MANAGE 3.1 and 3.2Monitor third party resources and pre trained models regularly. Apply and document risk controls.P07, C01, C02draft
N15MANAGE 4.1Implement post deployment monitoring plans. They cover user input capture, appeal and override, decommissioning, incident response, recovery and change management.P10, O01, O05, O08, C02, C03, C04draft
N16MANAGE 4.3Communicate incidents and errors to relevant AI actors, including affected communities. Track, respond to and recover from incidents, and document this.O06, O08draft

Joint Commission and CHAI Guidance on the Responsible Use of AI in Healthcare

The Joint Commission and Coalition for Health AI. Guidance on the Responsible Use of AI in Healthcare (RUAIH). 17 September 2025. https://digitalassets.jointcommission.org/api/public/content/dcfcf4f1a0cc45cdb526b3cb034c68c2 Source document

ControlClauseRequirement (paraphrase)Plan itemsReview
J01Element 1, leadershipAppoint individuals with technology expertise to lead AI use. Include a multidisciplinary team spanning executive, compliance, IT, safety, clinical, cybersecurity, privacy and stakeholder roles.G01, G02draft
J02Element 1, policy and boardPolicies cover selection through lifecycle management and equitable use. The governing board receives regular updates on use, outcomes and adverse events.G02, G03draft
J03Element 3, data use agreementsVendor data agreements define permitted uses, prohibit re identification, require security compliance and reserve audit rights with penalties.P06draft
J04Element 4, pre deployment requestsAsk vendors how the tool was validated and tested, whether they will tune or validate on a deployment representative sample, and how bias was evaluated.P03draft
J05Element 4, monitoring policyWrite policies naming responsible parties for regular validation, comparison of outputs to known parameters, checks of use case outcomes and confidence, confirmation of data currency, and an AI dashboard.O01, O03draft
J06Element 4, risk based frequencyMonitor more often for tools close to clinical decisions. Administrative tools can be checked periodically.O02draft
J07Element 4, vendor feedbackEstablish channels with vendors. Vendors notify the health system of model changes or updates that may need an unplanned performance check. Locally found issues go to vendors.C01draft
J08Element 4, adverse event reportingCreate a process to report adverse events or ongoing errors to leadership and vendors.O06draft
J09Element 5, voluntary blinded reportingHave a process for confidential, blinded reporting of AI safety events to an independent organization. Record events in internal incident systems. Designated individuals own AI quality and safety.G01, O07draft
J10Element 6, risk and bias processIdentify, categorize and document prospective and observed risks and biases, especially safety and access risks. Use model cards.P01, P02draft
J11Element 6, local validation and ongoing bias checksCheck that tool testing covers the populations served. Tune or test on local data. Monitor and audit for bias before deployment and during use.P04, P05, O04draft
J12Element 7, education and trainingProvide role specific training and documentation. Define who may use each tool. Decide when training is needed before rollout and whether it must recur.P09draft
J13Element 2, patient privacy and transparencyProtect patient data from unauthorized use or release. Disclose and educate patients and families on AI use. Notify patients when AI directly affects their care and how their data are used. Obtain consent where and when relevant. Policies address transparency for staff and patients.P08draft

EU Artificial Intelligence Act, high risk system requirements

European Parliament and Council of the European Union. Regulation (EU) 2024/1689 laying down harmonised rules on artificial intelligence (Artificial Intelligence Act). Official Journal of the European Union, 12 July 2024. https://eur-lex.europa.eu/eli/reg/2024/1689/oj Source document

ControlClauseRequirement (paraphrase)Plan itemsReview
E01Article 9, risk management systemRun a continuous risk management process across the lifecycle. Identify known and foreseeable risks, estimate them, adopt mitigation and test.P02, O01draft
E02Article 10, data and data governanceGovern training, validation and test data. Examine data for bias and gaps relevant to the intended population.P05, P06draft
E03Article 12, record keepingLog events automatically over the system lifetime so operation can be traced and monitored.O01, O03draft
E04Article 13, transparency and information to deployersSupply instructions that state intended purpose, accuracy, known limits and oversight measures.P01, P03draft
E05Article 14, human oversightDesign for effective oversight by people who can understand outputs, override them and stop the system.P10draft
E06Article 15, accuracy, robustness and cybersecurityDeclare accuracy levels. Keep performance robust and resilient to errors, faults and attacks.P04, C02draft
E07Article 17, quality management systemKeep documented procedures for compliance, change management, testing, monitoring and accountability.G01, C05draft
E08Article 26, obligations of deployersUse the system per instructions, assign oversight to competent staff, monitor operation, keep logs and report problems.P09, O01, O06draft
E09Articles 72 and 73, post market monitoring and serious incident reportingCollect and analyze performance data after release. Report serious incidents to the authority without delay.O06, O08draft

ONC HTI-1 decision support intervention criterion

Office of the National Coordinator for Health Information Technology. Health Data, Technology, and Interoperability: Certification Program Updates, Algorithm Transparency, and Information Sharing (HTI-1) Final Rule. 89 Fed. Reg. 1192 (4 January 2024). 45 CFR 170.315(b)(11). Source document

ControlClauseRequirement (paraphrase)Plan itemsReview
H01170.315(b)(11), source attributesMake intervention source attributes available to users: origin, funding, release dates, inputs used and how it was validated.P01, P03draft
H02170.315(b)(11), risk analysisAnalyze risks to validity, reliability, robustness, fairness, intelligibility, safety, security and privacy for predictive tools.P02draft
H03170.315(b)(11), risk mitigationPut documented practices in place to mitigate the risks found in the analysis.O01, C03draft
H04170.315(b)(11), governanceSet policies and controls for how data are acquired, managed and used by the tool.P06, P08draft
H05170.315(b)(11), feedback and exportLet users give feedback on outputs and export it in computable form with the action taken.O03, O05draft

WHO Ethics and Governance of Artificial Intelligence for Health

World Health Organization. Ethics and governance of artificial intelligence for health: WHO guidance. Geneva: WHO; 2021. https://iris.who.int/handle/10665/341996 Source document

ControlClauseRequirement (paraphrase)Plan itemsReview
W01Principle 1, protect human autonomyKeep humans in control of health decisions. Protect privacy and obtain valid consent.P08, P10draft
W02Principle 2, promote well being, safety and the public interestMeet regulatory requirements for safety, accuracy and efficacy. Apply quality control in practice.P04, O03draft
W03Principle 3, transparency, explainability and intelligibilityPublish enough information before deployment so the tool can be understood, debated and challenged.P01, P08draft
W04Principle 4, responsibility and accountabilityName who is responsible. Provide appropriate mechanisms for questioning and redress.G01, O06draft
W05Principle 5, inclusiveness and equityDesign and use for the widest appropriate access. Monitor for bias and unequal performance.P05, O04draft
W06Principle 6, responsive and sustainableAssess responsiveness during real use. Plan for sustainability and for retirement of tools that no longer perform.O03, C04draft

ISO/IEC 42001 Artificial intelligence management system

International Organization for Standardization and International Electrotechnical Commission. ISO/IEC 42001:2023 Information technology, Artificial intelligence, Management system. 2023. https://www.iso.org/standard/81230.html Source document

ControlClauseRequirement (paraphrase)Plan itemsReview
I01Clause 5, leadership and AI policyTop management sets an AI policy, assigns roles and commits resources.G01, G02draft
I02Annex A.3, internal organizationDefine roles and responsibilities. Provide a process to report concerns.G01, O07draft
I03Annex A.5, assessing impacts of AI systemsAssess impacts on individuals and groups, document results and keep them current.P02, P05draft
I04Annex A.6, AI system life cycleSet objectives, verification and validation criteria, deployment and operation controls, monitoring and change handling.P04, O01, C02draft
I05Annex A.7, data for AI systemsDocument data acquisition, quality, provenance and preparation.P06draft
I06Annex A.8, information for interested partiesProvide user documentation, incident communication and reporting channels.P08, P09draft
I07Annex A.9, use of AI systemsDefine responsible use processes, objectives and intended use.P09, P10draft
I08Annex A.10, third party and customer relationshipsAllocate responsibilities with suppliers and customers. Assess supplier risk.P07, C01draft
I09Clauses 9 and 10, performance evaluation and improvementMonitor, audit and review the management system. Correct nonconformity and improve.O03, C05draft

FDA Predetermined Change Control Plan guidance for AI enabled device software

U.S. Food and Drug Administration. Marketing Submission Recommendations for a Predetermined Change Control Plan for Artificial Intelligence-Enabled Device Software Functions. Guidance for Industry and FDA Staff. 2024. https://www.fda.gov/media/166704/download Source document

ControlClauseRequirement (paraphrase)Plan itemsReview
F01Description of modificationsState the planned changes to the AI function that will be made after release.C01, C02draft
F02Modification protocolDefine data handling, retraining, performance evaluation and update procedures for each planned change.C02draft
F03Impact assessmentAssess benefits and risks of each modification and how risks are mitigated.C01, C02draft

CHAI Responsible AI Guide

Coalition for Health AI. Responsible AI Guide. https://assets.ctfassets.net/7s4afyr9pmov/6e7PrdrsNTQ5FjZ4uyRjTW/c4070131c523d4e1db26105aa51f087d/CHAI_Responsible-AI-Guide.pdf Source document

ControlClauseRequirement (paraphrase)Plan itemsReview
R01Stage 1, usefulnessJustify why AI addresses the problem and why it beats non AI alternatives. Complete a risk benefit and cost benefit analysis.P01, P12draft
R02Stage 1, usefulnessAssess workflow integration, including the effect on patient clinician interaction.P09, P12draft
R03Stage 1, fairnessDefine fairness for the use case. Identify subgroups at risk. Set a bias monitoring and mitigation strategy.P02, P13draft
R04Stage 1, fairness and securityFor acquired tools, ask the vendor for subgroup performance and parity data. Review third party security practices.P03, P07draft
R05Stage 1, transparencyDocument intended use, users and target population with inclusion and exclusion criteria. Choose a documentation format such as a model card.P01, P11draft
R06Stage 1, security and privacyKeep an AI systems inventory with data processing maps. Run an initial privacy and security risk assessment.P07, P08draft
R07Stage 1, safetyConfirm regulatory and ethical requirements: FDA software criteria, IRB need, consent and adverse event disclosure.G02, P02draft
R08Stage 2, usefulnessAssess usability with human factors methods. Document robustness testing.P04, P12draft
R09Stage 2, safetyLet end users control, direct and override recommendations. Record each override.P10, O10draft
R10Stage 2, safetyWrite a risk management plan with adverse events, causes and corrective actions. Define adverse and serious adverse events.P02, O06, O08draft
R11Stage 2, safetySet reporting and recall procedures and a threshold for reporting potential patient harm. Share concerns with the developer and regulators.O06, O07draft
R12Stage 2, transparencyLabel the model in plain language: development, purpose, limits, error rates and underrepresented subpopulations. Update the label when new limits appear.P01, P11draft
R13Stage 2, fairnessProvide simple channels for end user feedback on bias. Review feedback in time to stop escalation.O04, O05draft
R14Stage 2, accountabilitySet a governance structure and a change management plan that split developer and implementer duties. Define how the teams communicate.G02, C02draft
R15Stage 2, security and privacySet data governance: access controls, secure transfer, encryption, audit trails, retention, third party sharing terms and incident response.P06, P08, O11draft
R16Stage 3, engineeringFollow a data management plan. Use quality assured data with documented lineage that represents the target population. Test robustness across populations.P04, P05draft
R17Stage 4, assessRun installation qualification and local validation. Run a prospective silent evaluation.P04, P14draft
R18Stage 4, assessTrain end users. Name the business owner accountable for testing. Approve implementation, measurement and mitigation plans before the pilot.G01, P09draft
R19Stage 5, pilotPilot first. Assess real world impact, workflow fit, acceptance and downstream effects. Update the risk plan. Decide on scale up from set success criteria.P15draft
R20Stage 6, deploy and monitorMonitor continuously. Audit regularly. Watch for drift. Set retraining procedures. Document all changes and share findings.O01, O03, O12draft
R21Governance foundationAssign roles by SOP. Place oversight high enough to decide on resources, incidents and rollback. Provide independent review and train staff.G01, G02, P09, O14draft
R22Stakeholder rolesName a business owner, a technology owner and an executive sponsor. Give end users a route to report risks.G01draft
R23Independent reviewArrange independent review for objectivity. Share results to build trust.O14draft

CHAI Assurance Standards Guide

Coalition for Health AI. Assurance Standards Guide (draft for public comment, June 2024). https://www.chai.org/blog/chai-releases-draft-responsible-health-ai-framework-for-public-comment Source document

ControlClauseRequirement (paraphrase)Plan itemsReview
A01Stage 3, usefulnessCheck that training data match the deployment setting and that local data represent the population. Monitor data quality and drift.P04, O12draft
A02Stage 3, fairnessJustify any use of protected attributes. Check proxies and composite scores for hidden bias.P05, P13draft
A03Stage 3, transparencyDocument data provenance, lineage and limits. Version control the datasets.P06, P11draft
A04Stage 4, fairnessKeep training and test data independent. Assess performance and parity across subgroups.P05, P14draft
A05Stage 4, securityAssess third party providers. Keep audit records and system documentation. Set up vulnerability reporting.P03, P07draft
A06Stage 5, transparencyReduce automation bias. Manage clinician disagreement with outputs. Assess what users do after an AI interaction.P10, O10draft
A07Stage 5, securityRun configuration change control. Review audit logs. Keep an incident response plan. Set resilience needs for critical AI services.O08, O11, C02draft
A08Stage 5 and 6, safetyReview regularly whether the system is still relevant or obsolete.C04, C05draft
A09Stage 6, fairnessMonitor drift effects on bias. Name who monitors bias. Assess drift risk between pilot and full deployment.O04, O12draft
A10Stage 6, transparencyTell patients and affected groups about the AI role. Make end of life processes clear.P08, C04draft
A11Stage 6, securityNotify stakeholders of cybersecurity and privacy incidents. Report unintended uses. Assure the supply chain.O06, O08draft
A12Stage 6, safetyConfirm updates keep the system safe and effective. Analyze impact on safety and benefit.C01, C02draft
A13Governance principleProvide high level oversight, a bias management structure with clear roles, and mandatory training on ethics, quality, intended use and risks.G02, P09draft
A14Stage 2, fairness and transparencyDefine clear decision thresholds. Provide explainability measures for subgroup assessment.P10, P11draft

CHAI Applied Model Card

Coalition for Health AI. Applied Model Card, documentation v0.1. https://mc.chai.org/v0.1/documentation.pdf ; template and schema at https://github.com/coalition-for-health-ai/mc-schema Source document

ControlClauseRequirement (paraphrase)Plan itemsReview
M01HeaderRecord name, developer, contact for issues, release stage, release date, version, global availability and regulatory approval.P11draft
M02Uses and directionsState intended use and workflow, primary users, how to use, target population and cautioned out of scope settings.P01, P11draft
M03WarningsState known risks and limitations, known biases and ethical considerations, and the clinical risk level.P02, P11draft
M04Trust ingredients, AI system factsState outputs, model type, foundation models, input data, development data, bias mitigation, maintenance, security practices and transparency mechanisms.P11, P13draft
M05Transparency informationState the funding source, third party information and stakeholders consulted.P03, P11draft
M06Key metrics, usefulness, usability and efficacyReport goal, result, interpretation, test type, test data and validation process.P04, P11draft
M07Key metrics, fairness and equityReport the same six metric fields for fairness and equity.P05, P11draft
M08Key metrics, safety and reliabilityReport the same six metric fields for safety and reliability.P04, P11draft
M09ResourcesList evaluation references, clinical trials, publications, reimbursement status and patient consent or disclosure.P08, P11draft

Planned: NIST AI 600-1 generative AI profile, CHAI Assurance Reporting Checklists, FDA clinical decision support guidance, HIPAA security rule and state AI laws. Add a framework.