Guide

What should an AI governance policy include?

An AI governance policy should state why it exists, who owns AI, which tools and agents are allowed, which actions need a named approval, how cost is limited, what is recorded, how incidents are handled and when the policy is reviewed. Keep it to two pages, so people read it and managers can enforce it.

  • Sourced
  • Updated 16 Nov 2026

Get Your Free Trial

In 30 seconds

Eight sections

Purpose

Why the policy exists.

Owners

Who is accountable.

Rules

What AI may and may not do.

The definition

An AI agent policy is the part of this document about agents, and an AI acceptable use policy template is the shorter version about what people may do with AI tools. A policy that sits in a folder protects no one. The test is simple: can a manager point to the rule and show the record that it was followed?

The eight sections

  1. Purpose and scope. Which AI tools, agents and teams it covers.
  2. Owners. One accountable executive, and one named owner for each agent.
  3. Allowed tools and agents. A list, kept in an agent registry.
  4. Data rules. What data AI may read, and what it may never see.
  5. Approval rules. Which actions need a named person to say yes before they run.
  6. Cost limits. Budget per team, and what happens at the limit. See AI spend governance.
  7. Records. What is kept for every action, and for how long. See the audit trail.
  8. Incidents and review. Who can stop AI work, who is told, and when the policy is reviewed.

A starting text you can adapt

> We use AI to do work faster, with a person accountable for every result. Each AI agent has a named owner. Agents start with read only access. Any action that changes something outside our systems, sends a message to a customer, or spends money needs a named approver. Each team has a monthly AI budget. Every action is recorded with who asked, who approved, what changed and what it cost. Anyone in the company can stop AI work. We review this policy every quarter.

AI governance checklist

Use this as a monthly check that the policy is working:

  • [ ] Every agent is on the list and has a named owner.
  • [ ] Each agent's access was reviewed this month.
  • [ ] Actions that change things outside need a named approver, and approvers have cover.
  • [ ] Each team has a budget and knows what happens at the limit.
  • [ ] A complete record exists for last week's actions, and someone has read a sample.
  • [ ] Anyone can find the stop, and the people who may use it know who they are.
  • [ ] New tools and agents are added to the list before they start work.
  • [ ] The policy has a review date.

Make it work in daily use

  • Put the rules in the tool, not only in the document. An approval that the system enforces is stronger than one people must remember.
  • Name approvers by role, so cover is clear on holidays.
  • Test it: pick one action from last week and trace its record.

40%+

of agentic AI projects predicted to be canceled by the end of 2027, citing cost, unclear value and weak risk controls.

Source: Gartner, June 2025

How MFDIO applies this today

Several of these rules can be set in MFDIO itself: approvals before risky actions, spend limits in Work Units, roles, an emergency stop and an append-only audit trail. See what works today. Rules about data and incidents stay in your own policy.

Questions people ask

Is this the same as an acceptable use policy? An acceptable use policy covers what people may do with AI tools. A governance policy also covers agents that act on their own.

Do we need a lawyer? For legal obligations, yes. Ask a qualified adviser what your rules require.

Limits of this guide

This guide is general information and not legal advice. MFDIO does not hold SOC 2 or ISO 27001 today. Market figures are analyst or survey estimates and vary between sources.

Sources

  1. Gartner, June 2025: over 40% of agentic AI projects predicted to be canceled by the end of 2027, citing cost, unclear value and weak risk controls
  2. MFDIO product facts: checked against /how-it-works, /safe-by-design and /status on 16 November 2026

Published . Last updated . Written by the MFDIO team.

Put It to Work

Free for 14 days, no card.

Get Your Free Trial