AI governance glossary
82 terms used across the records, in plain language. Each names the instrument it comes from: these are explanations for orientation, not the legal text, so follow the source for the binding wording, and the links for the duties that apply.
Governance, risk and compliance
- AI GRC (governance, risk and compliance) #
-
AI GRC (governance, risk and compliance) is the integrated discipline of assigning accountability and policy for AI systems, identifying and treating the risks they create, and showing conformity with the laws, standards and contracts that apply to them, usually through an AI management system and an evidence trail.
ISO 42001 gap assessment →AI governance RACI →AI system inventory →
- AI risk #
-
AI risk is the combination of how likely an AI system is to cause harm and how severe that harm would be, to people, organisations or society. The EU AI Act defines risk this way, and the NIST AI RMF uses the same probability-and-consequence composite.
Source: EU AI Act (Regulation (EU) 2024/1689), Article 3(2) AI risk register →AI risk assessment control →AI risk and incidents →
- EU AI Act #
-
The EU AI Act (Regulation (EU) 2024/1689) is the European Union's horizontal law on artificial intelligence. It prohibits certain AI practices, sets requirements for high-risk AI systems, imposes transparency duties and regulates general-purpose AI models, with obligations applying in stages from February 2025.
Source: EU AI Act (Regulation (EU) 2024/1689) EU AI Act role and risk classifier →High-risk deployer compliance pack →
- Algorithmic bias #
-
Algorithmic bias is systematic error in an AI system's outputs that produces unjustified differences in treatment or outcomes for people or groups, for example by sex, race, age or disability. It can come from the data, the model's design, or the context in which the system is used.
Source: NIST SP 1270, Towards a Standard for Identifying and Managing Bias in Artificial Intelligence Employment AI bias audit kit →
- AI lineage (data and model provenance) #
-
AI lineage is the documented record of where an AI system's data and models came from and how they changed: sources, licences, collection methods, preprocessing, training runs, versions and deployments. It lets an organisation trace an output or a defect back to its inputs.
Source: EU AI Act (Regulation (EU) 2024/1689), Article 10 Training data provenance and copyright register →AI data governance register →
- AI impact assessment #
-
An AI impact assessment is a structured evaluation, before deployment and whenever things change, of how an AI system and its foreseeable uses may affect individuals, groups and society, recording the impacts found and the measures taken to address them.
Source: ISO/IEC 42005:2025, AI system impact assessment AI impact assessment template →AI impact assessment control →
- AI bill of materials (AIBOM) #
-
An AI bill of materials (AIBOM) is a machine-readable inventory of the components of an AI system: models, datasets, software dependencies and services, with their versions, licences and provenance. It extends the software bill of materials (SBOM) to AI.
- Shadow AI #
-
Shadow AI is the use of AI tools, models or features inside an organisation without the knowledge or approval of the people responsible for security, privacy and compliance, such as staff pasting data into public chatbots or AI features switched on in existing software.
AI acceptable use policy →AI use case intake and triage →AI system inventory →
- AI explainability #
-
AI explainability is the ability of an AI system, or the people operating it, to give reasons for an output that are accurate and understandable to the person receiving them, and to recognise when the system is operating outside the conditions it was designed for.
Source: NISTIR 8312, Four Principles of Explainable Artificial Intelligence Adverse decision explanation and appeal kit →Decision explanation and appeal route control →
- AI management system (ISO/IEC 42001) #
-
ISO/IEC 42001 is the international standard for an AI management system: the policies, roles, risk and impact assessment processes, controls and continual improvement an organisation sets up to develop, provide or use AI responsibly. Published in December 2023, organisations can be certified against it.
Source: ISO/IEC 42001:2023 ISO/IEC 42001 record →ISO 42001 gap assessment →
- NIST AI Risk Management Framework (AI RMF) #
-
The NIST AI Risk Management Framework (AI RMF 1.0) is a voluntary US framework, published in January 2023, for managing risks to people, organisations and society from AI. It organises the work into four functions: Govern, Map, Measure and Manage.
Source: NIST AI 100-1 NIST AI RMF record →NIST, EU and ISO crosswalk →
- Bias audit (automated employment decision tools) #
-
Under New York City Local Law 144, an impartial evaluation by an independent auditor of an automated employment decision tool, reporting selection or scoring rates and impact ratios by sex and race or ethnicity. Employers must have one done within a year before using the tool, publish a summary, and notify candidates.
Source: NYC Department of Consumer and Worker Protection Local Law 144 record →
- Model card #
-
A short document published with a machine-learning model that states its intended use, the data it was evaluated on, its performance across groups and conditions, and its known limitations. The format comes from Mitchell et al. (2019) and now meets part of the documentation duties several laws place on model providers.
Source: Mitchell et al., Model Cards for Model Reporting (2019) Technical documentation control →AI model card template →
AI security
- Google Secure AI Framework (SAIF) #
-
Google's Secure AI Framework (SAIF) is a conceptual framework, published by Google in June 2023, for securing AI systems. It sets out six core elements, from extending established security foundations to AI to placing AI system risks in the context of business processes.
Source: Google, Secure AI Framework (SAIF) AI red team test plan →
- OWASP Top 10 for LLM Applications #
-
The OWASP Top 10 for LLM Applications is the Open Worldwide Application Security Project's list of the ten most critical security risks in applications built on large language models. The 2025 edition runs from LLM01 Prompt Injection to LLM10 Unbounded Consumption.
Source: OWASP Top 10 for LLM Applications 2025 AI red team test plan →
- Prompt injection #
-
Prompt injection is an attack in which crafted input, typed by a user or hidden in content the model reads, overrides an LLM application's instructions, making it ignore its system prompt, disclose data or take unintended actions. OWASP ranks it first (LLM01) among LLM application risks.
Source: OWASP Top 10 for LLM Applications 2025, LLM01 Prompt Injection AI red team test plan →Red-team testing control →
- Data poisoning #
-
Data poisoning is an attack that corrupts an AI model by inserting or altering its training or fine-tuning data, so that the model learns hidden behaviours, errors or backdoors. NIST classifies poisoning as a training-stage attack in its adversarial machine learning taxonomy (NIST AI 100-2).
Source: NIST AI 100-2 E2025, Adversarial Machine Learning: A Taxonomy and Terminology of Attacks and Mitigations Data governance and dataset documentation control →AI data governance register →
- AI hallucination (confabulation) #
-
An AI hallucination is output from a generative AI system that is presented confidently but is false, fabricated or unsupported by its inputs, such as invented facts, citations or legal authorities. NIST's Generative AI Profile calls this risk confabulation.
Source: NIST AI 600-1, Artificial Intelligence Risk Management Framework: Generative Artificial Intelligence Profile Human oversight procedure →
- Agentic AI #
-
Agentic AI is an AI system that pursues a goal by planning and taking actions with some autonomy, such as calling tools and APIs, browsing, writing and running code or sending messages, rather than only producing text for a person to act on.
Source: OWASP Top 10 for LLM Applications 2025, LLM06 Excessive Agency AI agent registry →
- Red teaming (AI) #
-
AI red teaming is structured adversarial testing in which testers try to make an AI system fail, by producing harmful output, leaking data, bypassing safeguards or taking unintended actions, so that weaknesses are found and fixed before attackers or users find them.
Source: EU AI Act (Regulation (EU) 2024/1689) Red-team testing control →AI red team test plan →
EU AI Act concepts
- AI system #
-
A machine-based system that operates with some autonomy, may adapt after it is deployed, and infers from the input it receives how to generate outputs such as predictions, content, recommendations or decisions that can influence physical or virtual environments. This is the EU AI Act's definition, which follows the OECD's; whether software is an "AI system" decides whether the Act applies to it at all.
Source: EU AI Act (Regulation (EU) 2024/1689) EU AI Act →AI system inventory control →
- General-purpose AI model (GPAI) #
-
An AI model, typically trained on a large amount of data with self-supervision at scale, that shows significant generality, can perform a wide range of distinct tasks and can be built into many downstream systems. Models used only for research or prototyping before release are excluded. Providers of these models have their own duties under the EU AI Act, separate from the duties attached to AI systems.
Source: EU AI Act (Regulation (EU) 2024/1689) Duties of AI model providers →
- Systemic risk (general-purpose AI) #
-
Under the EU AI Act, a general-purpose AI model has systemic risk when it has high-impact capabilities, which is presumed when the cumulative compute used to train it exceeds 10²⁵ floating-point operations, or when the Commission designates it. Such models carry extra duties: model evaluation including adversarial testing, assessing and mitigating systemic risks, reporting serious incidents, and cybersecurity protection.
Source: EU AI Act (Regulation (EU) 2024/1689) Frontier model safety framework control →Red-team testing control →
- High-risk AI system #
-
In the EU AI Act, an AI system that is a safety component of (or is itself) a product covered by the EU product-safety laws listed in Annex I and needing third-party conformity assessment, or one used in an area listed in Annex III, such as biometrics, critical infrastructure, education, employment, access to essential services, law enforcement, migration and the administration of justice. A provider may document that an Annex III system is not high-risk when it does not pose a significant risk of harm.
Source: EU AI Act (Regulation (EU) 2024/1689) Risk management duties →EU AI Act role and risk classifier →
- Prohibited AI practices #
-
Uses of AI the EU AI Act bans outright, including manipulative or deceptive techniques that cause significant harm, exploiting vulnerabilities, social scoring, predicting crime from profiling alone, untargeted scraping of facial images, emotion recognition in workplaces and schools (with narrow exceptions), biometric categorisation by sensitive traits, and most real-time remote biometric identification by police in public spaces.
Source: EU AI Act (Regulation (EU) 2024/1689) Prohibited practice duties →Prohibited-use screening control →
- Intended purpose #
-
The use a provider intends an AI system for, including the context and conditions of use, as stated in its instructions, marketing and technical documentation. Classification as high-risk, and most provider duties, are assessed against the intended purpose; using a system outside it can shift provider duties onto the user.
- Substantial modification #
-
A change to an AI system after it is placed on the market that the provider's original conformity assessment did not foresee, and that affects its compliance or changes its intended purpose. Under the EU AI Act, whoever makes a substantial modification to a high-risk system can become its provider, with the provider's duties.
Source: EU AI Act (Regulation (EU) 2024/1689) Release and change management control →
- Conformity assessment #
-
The process of showing that a high-risk AI system meets the EU AI Act's requirements before it is placed on the market or put into service, either by the provider's own internal check or with a notified body. It ends with an EU declaration of conformity and CE marking, and for most Annex III systems a registration in the EU database.
Source: EU AI Act (Regulation (EU) 2024/1689) Conformity assessment duties →Conformity assessment and registration control →
- Notified body #
-
An independent conformity assessment body designated by an EU member state to assess high-risk AI systems where the EU AI Act requires a third party, for example certain biometric systems.
- Quality management system (QMS) #
-
The documented policies, procedures and instructions a provider of a high-risk AI system keeps to ensure compliance across the system's life: design, testing, data management, risk management, post-market monitoring, incident reporting and accountability. Required of providers by the EU AI Act.
Source: EU AI Act (Regulation (EU) 2024/1689) Quality management duties →Quality management system control →
- Post-market monitoring #
-
The activities a provider carries out to collect and review data on how its AI systems perform once in use, so that it can spot the need for corrective or preventive action. High-risk providers must have a documented post-market monitoring plan.
Source: EU AI Act (Regulation (EU) 2024/1689) Post-market monitoring duties →Post-market monitoring plan template →
- Serious incident #
-
An incident or malfunction of an AI system that directly or indirectly leads to death or serious harm to a person's health, a serious and irreversible disruption of critical infrastructure, an infringement of obligations that protect fundamental rights, or serious harm to property or the environment. Providers of high-risk systems must report serious incidents to the market surveillance authority.
Source: EU AI Act (Regulation (EU) 2024/1689) Incident duties →AI incident response playbook →
- Human oversight #
-
Design and operating measures that let people effectively oversee an AI system while it is in use: understand its capabilities and limits, watch for automation bias, interpret its output, and decide not to use it, override it or stop it. Required for high-risk systems under the EU AI Act and a common expectation in other frameworks.
Source: EU AI Act (Regulation (EU) 2024/1689) Human oversight duties →Human oversight procedure template →
- Fundamental rights impact assessment (FRIA) #
-
An assessment, before first use, of how a high-risk AI system could affect the people it is used on: who is affected, the specific risks of harm, the human oversight in place and what happens if the risks materialise. The EU AI Act requires it of public bodies, private bodies providing public services, and deployers of systems for credit scoring and for life and health insurance pricing.
Source: EU AI Act (Regulation (EU) 2024/1689) Impact assessment duties →FRIA template →
- AI literacy #
-
The skills, knowledge and understanding that let providers, deployers and affected people use AI systems in an informed way and be aware of their opportunities, risks and possible harm. The EU AI Act asks providers and deployers to take measures to ensure a sufficient level of AI literacy among the staff who deal with AI systems.
Source: EU AI Act (Regulation (EU) 2024/1689) AI literacy duties →AI literacy training plan →
- Deep fake #
-
AI-generated or AI-manipulated image, audio or video content that resembles existing people, objects, places or events and would falsely appear authentic. The EU AI Act requires deployers to disclose that such content is artificial, with lighter rules for evidently artistic or satirical work.
Source: EU AI Act (Regulation (EU) 2024/1689) Transparency duties →Synthetic content labelling control →
- AI regulatory sandbox #
-
A controlled framework run by a competent authority in which providers can develop, train, validate and test innovative AI systems for a limited time under regulatory supervision. The EU AI Act requires each member state to set up at least one.
Who does what
- Provider / developer #
-
Develops an AI system or model, or has it developed, and places it on the market or puts it into service under its own name.
- Deployer / user organisation #
-
Uses an AI system under its own authority (other than personal, non-professional use).
- Importer #
-
Places on a market an AI system that bears the name of a provider established outside that market.
- Distributor #
-
Makes an AI system available on a market without being its provider or importer.
- Authorised representative #
-
Person or entity mandated by a non-established provider to carry out obligations on its behalf.
- Individual user / affected person #
-
Natural person interacting with, or affected by, an AI system.
- Public authority / government body #
-
Public-sector body procuring, deploying or overseeing AI systems.
- General-purpose AI model provider #
-
Provider of a general-purpose AI model, including foundation and frontier models.
Kinds of AI system
- General-purpose AI model #
-
A model trained on broad data that can perform a wide range of tasks and be integrated into many systems.
- Generative AI system #
-
System that produces text, images, audio, video or code.
- Automated decision-making system #
-
System that makes or materially supports decisions about people.
- Biometric identification or categorisation system #
-
System processing biometric data to identify, verify or categorise people, or recognise emotions.
- Recommender / ranking system #
-
System that ranks, recommends or personalises content, products or people.
- Safety component of a product #
-
AI used as a safety component of machinery, vehicles, medical devices or similar regulated products.
- Chatbot / conversational agent #
-
System that interacts with people through natural language.
- Predictive or scoring system #
-
System that scores, profiles or predicts behaviour, risk or eligibility.
Risk categories
- Prohibited practice #
-
Use banned outright (terminology used by the EU AI Act; other jurisdictions may differ).
- High-risk #
-
Use subject to the strictest requirements before and after deployment.
- Transparency obligations #
-
Use permitted with disclosure or labelling duties (for example chatbots, synthetic content).
- Minimal or unregulated risk #
-
No AI-specific obligations beyond general law.
- Systemic-risk general-purpose model #
-
General-purpose models with high-impact capabilities subject to additional duties.
- Not classified by the instrument #
-
The instrument does not use a risk tiering.
Kinds of compliance evidence
- Policy document #
-
An approved, versioned statement of intent and rules, signed off by accountable management.
- Procedure or standard operating process #
-
A documented, repeatable process with steps, roles and inputs.
- Register entry #
-
A row in a maintained inventory: AI systems, vendors, models or datasets.
- Risk register #
-
A maintained list of identified risks with owner, rating, treatment and review date.
- Risk assessment #
-
A completed assessment of one system's risks, with method, findings and treatment decisions.
- Impact assessment #
-
A completed assessment of effects on people, groups or rights, with mitigations.
- Data protection impact assessment #
-
An assessment required by data-protection law for high-risk processing of personal data.
- Dataset documentation #
-
Provenance, collection, labelling, representativeness and known limitations of training, validation and test data.
- Model documentation #
-
Intended purpose, architecture, training, evaluation and limitations of a model.
- Technical documentation file #
-
The assembled documentation a regulator or notified body would review.
- Evaluation or test report #
-
Results of testing accuracy, robustness, bias, safety or security against defined criteria.
- Monitoring record #
-
Logs, dashboards or reports from ongoing performance and drift monitoring.
- Incident record #
-
A recorded incident with timeline, impact, root cause and corrective action.
- Regulatory filing or notification #
-
A submission made to an authority: a registration, a report, a declaration.
- Approval or sign-off record #
-
Evidence that an accountable person approved a decision, with date and scope.
- Governance meeting record #
-
Minutes or decisions of a board, committee or review body.
- Training record #
-
Who was trained on what, when, with completion evidence.
- Contract clause or supplier term #
-
Agreed terms with a vendor or customer allocating AI duties, data rights and notification.
- Supplier assessment #
-
A completed due-diligence questionnaire or audit of a third party.
- Disclosure or notice #
-
The text shown to a person: an AI interaction notice, a content label, an explanation of a decision.
- Access or activity log #
-
System-generated records of who did what, retained for a defined period.
- Audit or assurance report #
-
An internal or external review of whether a control operates as described.
- Conformity declaration or certificate #
-
A signed declaration or third-party certificate of conformity with a rule or standard.
Missing a term, or think a definition is off? Tell us; corrections are logged on the corrections page.
Frequently asked questions
What is AI GRC?
AI GRC (governance, risk and compliance) is the integrated discipline of assigning accountability and policy for AI systems, identifying and treating the risks they create, and showing conformity with the laws, standards and contracts that apply to them, usually through an AI management system and an evidence trail.
What is AI risk?
AI risk is the combination of how likely an AI system is to cause harm and how severe that harm would be, to people, organisations or society. The EU AI Act defines risk this way, and the NIST AI RMF uses the same probability-and-consequence composite.
What is the EU AI Act?
The EU AI Act (Regulation (EU) 2024/1689) is the European Union's horizontal law on artificial intelligence. It prohibits certain AI practices, sets requirements for high-risk AI systems, imposes transparency duties and regulates general-purpose AI models, with obligations applying in stages from February 2025.
What is ISO/IEC 42001?
ISO/IEC 42001 is the international standard for an AI management system: the policies, roles, risk and impact assessment processes, controls and continual improvement an organisation sets up to develop, provide or use AI responsibly. Published in December 2023, organisations can be certified against it.
What is the NIST AI RMF?
The NIST AI Risk Management Framework (AI RMF 1.0) is a voluntary US framework, published in January 2023, for managing risks to people, organisations and society from AI. It organises the work into four functions: Govern, Map, Measure and Manage.