AI for executives · for the COO and CIO

AI operating model: who decides, who builds and who is accountable

An operating model answers three questions: who chooses what gets built, who builds and runs it, and who answers for the result. Without it, every department buys its own tool and nobody owns the risk.

Short answer

An AI operating model sets how a company decides on, builds, runs and governs AI. For most small and mid-size companies the right shape is hub-and-spoke: a small central group sets standards, approves tools and runs shared platforms, while each business unit owns its use cases and results. A steering committee of executives sets priorities and settles disputes.

  • Microsoft 365
  • Google Workspace
  • Salesforce
  • ServiceNow
  • Slack
  • NIST

Last reviewed . General guidance for executives, not legal, tax or accounting advice.

How much central control each stage of AI work usually needs

Illustrative score, 1 (leave to the business unit) to 5 (decide centrally). A planning judgement, not measured data.

Show as table
ItemHow much central control each stage of AI work usually needs
Approving tools and vendors5
Data access and security rules5
Shared platforms and integrations4
Choosing which use cases to fund3
Building and changing a use case2
Day-to-day use and review1

How to read this chart

The scores are our planning judgement for a typical small or mid-size company: they show where effort or risk tends to concentrate, not measured data. Replace them with your own once you have looked at your company.

Centralised, hub-and-spoke or federated?

Centralised is fastest to control and slowest to scale. Federated scales fastest and duplicates the most. Hub-and-spoke gives a small company standards without a bottleneck.

  • Centralised: one team builds everything. Fits the first six to twelve months or a company with one main business line.
  • Hub-and-spoke: a small hub sets rules and runs shared pieces; units own use cases. Fits most companies once two or three teams are active.
  • Federated: units run their own programs under light common rules. Fits groups of distinct businesses, such as a holding company.

What does the steering committee do?

It sets priorities, approves funding, removes blockers and reviews results. It does not choose tools or review prompts.

  • Members: the executive sponsor, finance, operations, technology, legal or risk, and the heads of the units with live use cases.
  • It meets monthly while the program is young and quarterly once it is steady.
  • Every meeting reviews the same short scorecard: results against target, spend against budget, incidents and the next decisions.

Do you need an AI centre of excellence?

Only once the work justifies it. A centre of excellence is the hub with a name: the people who keep standards, shared tools and training in one place. In a small company it can be two people part-time.

  • Start with a named AI lead and one technical person.
  • Add a training owner when more than a few teams are using the tools.
  • Keep delivery close to the business; a centre that builds everything becomes a queue.

The NIST AI Risk Management Framework's Govern function asks for the same things in plainer terms: clear roles, accountability and policies that are actually followed.

FAQ

Questions executives ask about this

Who should chair the AI steering committee?

The executive who owns the business results AI is meant to move, usually the CEO or COO. The technology lead should be a member, not the chair, so priorities stay tied to the business.

How big should the central group be?

As small as it can be while still answering requests quickly. Many mid-size companies start with one lead and one builder, and add capacity when the request queue grows.

Where does IT fit?

IT owns identity, security, integrations and the platforms. The business owns the use cases. The operating model exists so those two do not wait on each other.

Can an outside firm act as the hub?

Yes, for a time. A fractional AI lead or a consultancy can set standards and run shared pieces while the company builds its own capability, as long as an internal executive stays accountable.

Primary sources to check against

Frameworks, laws and product details change. Confirm the current text with each publisher and with your own counsel. Consultants in a Box is an independent consultancy; this page is not published or endorsed by any organisation named. Names and logos are trademarks of their owners.

Want to talk this through for your company?

Book a call and we will go through where you are, what to decide first and who should own it. Or start with the free business analysis.

Book a free consultation

Tell us about your team and the software you need help with. We'll follow up to schedule a time to talk.

Open the form on its own page

Talk to a person

The fastest way is to pick a time. Prefer to write? Leave a message and we will email you back, usually the same business day.

Book a free call

By sending this you agree to our Terms and Privacy Policy.