The AI Operating Model
Hub-and-spoke, the CoE, and empowering managers
- Compare centralized, federated, and hub-and-spoke operating models and explain why hub-and-spoke is the emerging default for firms that scale AI
- Define the division of labor: what the central hub owns (standards, guardrails, platforms) versus what the spokes own (execution and outcomes)
- Explain why the hub must be an enabler, not a gatekeeper, and what 'gatekeeper drift' looks like
- Describe why empowering line and middle managers — not a central lab — is what actually drives adoption
- Apply McKinsey's four-pillar approach: concentrate on 2-3 vertical use cases, embed in reimagined workflows, scale with cross-functional teams and governance
- Recognize executive sponsorship with real funding and a unified vision as a top differentiator of AI winners
Once leaders accept that AI value is 70% people-and-process, the next decision is structural: where do AI authority, talent, and standards live? This lesson makes the case for a centralized-federated 'hub-and-spoke' operating model — a lean central hub that owns standards, guardrails, and platforms, with business-unit spokes that own execution and outcomes. It also covers the move that quietly decides success or failure: empowering line and middle managers rather than outsourcing adoption to a central AI lab.
- 1The question every scaling leader must answer
- 2Three operating models — and why one is winning
- 3Drawing the line: what the hub owns, what the spokes own
- 4The failure mode: gatekeeper drift
- 5The overlooked lever: empower managers, not a central lab
- 6Concentrate the spokes: McKinsey's four-pillar approach
The question every scaling leader must answer
You have accepted the hard truth from the previous lesson: roughly 70% of AI value is people and process, not algorithms or data plumbing (BCG 10-20-70). The natural next question is organizational, and it is one only a senior leader can answer:
Where do AI authority, talent, and standard-setting live in your company?
This is not a technology choice; it is an operating-model choice, and it determines whether your AI effort scales or fragments. Get it wrong in one direction and a central team becomes a bottleneck that the business routes around. Get it wrong in the other and every business unit reinvents the wheel, with inconsistent standards and uncontrolled risk.
There are three broad answers, and the evidence increasingly points to one of them. The rest of this lesson is about choosing deliberately — and about the single most-overlooked lever that decides whether the chosen model actually works: your middle managers.
Key insight
Operating model is the 70% made concrete
The 10-20-70 rule tells you where the value is (people and process). The operating model is how you organize for it. Skipping this step is why so many firms have an 'AI strategy' deck but no way to scale beyond scattered pilots.
Three operating models — and why one is winning
Every AI operating model is a variation on three archetypes. The trade-off is always the same tension: central control versus business-unit speed.
| Model | What it is | Strength | Weakness |
|---|---|---|---|
| Centralized | A central AI team owns strategy, build, and delivery | Consistent standards and governance; efficient use of scarce talent | Slow; far from the business; becomes a bottleneck |
| Federated / decentralized | Each business unit owns its own AI talent and delivery; the center is nominal | Speed, business proximity, innovation | Duplication, inconsistent standards, risk sprawl |
| Hub-and-spoke (Center of Excellence) | A lean central hub sets standards, governance, platforms, and guardrails; business-unit 'spokes' own use-case execution | Balances control and speed; shared platforms; consistent governance with local ownership | Requires real funding and a senior mandate, or it becomes a paper committee |
The centralized model is safe but slow; the federated model is fast but ungoverned. Hub-and-spoke — sometimes called a centralized-federated model or a Center of Excellence — is the deliberate middle path, and the 2025-26 evidence says it is what separates firms that scale from those that stall.
Two time-stamped data points (re-verify before quoting — these refresh):
- Firms that successfully scale AI are reportedly ~3x more likely to use hub-and-spoke than any other structure (Dataiku research, cited 2025).
- Chief AI Officers operating in centralized or hub-and-spoke models reportedly achieve ~36% higher ROI than those in fully decentralized structures (IBM research, 2025).
The principle beneath the numbers is durable even as the figures move: federate execution, centralize the guardrails.
Tip
The leadership move: match the model to your maturity
These are not permanent. Early-stage organizations usually need more central push to build the foundation; mature organizations federate delivery on top of a shared platform. Pick the model for where you are now, and plan to shift the balance toward the spokes as capability spreads.
Watch out
Where leaders get it wrong
Defaulting to fully centralized ('let the data-science team handle all of AI') feels controlled but quietly kills adoption — the team becomes a queue, the business loses ownership, and shadow AI fills the gap. Fully federated feels empowering but produces ten incompatible tools and ten unmanaged risk surfaces.
Drawing the line: what the hub owns, what the spokes own
The whole model rests on a clean division of labor. Blur it and you get either a bottleneck or chaos. The rule of thumb: the hub owns the 'how-safely' and the 'on-what'; the spokes own the 'what' and the 'so-what.'
| The central hub owns | The business-unit spokes own |
|---|---|
| Standards and reusable platforms | Use-case selection and prioritization |
| Guardrails, evals, and responsible-AI policy | End-to-end execution and delivery |
| Shared tooling and model access | Workflow redesign in their domain |
| Governance, security, and FinOps (cost control) | The business outcome and its KPI |
| Talent development and AI fluency programs | Local change management and adoption |
Notice what is not on the hub's list: building every use case. A hub that builds everything is just a centralized team wearing a new name — and it recreates the bottleneck you were trying to escape. The hub's product is leverage: platforms, patterns, and permission that make the spokes faster and safer.
The spokes own outcomes because they own the business. A marketing team knows which campaign workflow is worth redesigning; the central hub does not. By making the spoke accountable for the number — revenue, cycle time, CSAT — you ensure AI is aimed at a real business problem rather than a demo.
Key insight
The hub is an enabler, not a gatekeeper
The single most important design principle: the hub exists to make the spokes faster, not to approve their every move. The test — does a business unit experience the hub as a paved road or as a tollbooth? If projects queue for the hub's permission, you have rebuilt the bottleneck.
The failure mode: gatekeeper drift
The most common way a hub-and-spoke model fails is not collapse — it is slow drift from enabler to gatekeeper. It happens for understandable reasons. The central team is accountable for risk, so it adds an approval step. Then another. Soon every spoke project waits in the hub's queue, the business stops feeling ownership, and frustrated teams quietly route around the whole thing with unsanctioned tools.
Watch for these warning signs that your hub has drifted:
- Business units describe the AI team as 'the people you have to get past,' not 'the people who help.'
- The hub's backlog is full of build requests rather than platform and standards work.
- Adoption is flat outside the hub's own projects.
- Shadow AI is rising — a reliable signal that the sanctioned path is too slow.
The fix is structural, not cultural exhortation. Fund the hub to build paved roads (pre-approved tools, templates, guardrails that let teams move fast within policy) rather than to operate tollbooths. Reserve mandatory hub review for genuinely high-risk systems, and let low-risk use cases move on a fast, self-serve track. Risk-based tiering — a chatbot is not a loan-approval model — is what keeps governance from becoming a brake on everything.
Watch out
A lean, well-funded hub — or no hub at all
A hub-and-spoke model requires real funding and a senior mandate. A hub created on paper, with no budget and no authority, becomes a committee that everyone ignores — arguably worse than no hub, because it creates the illusion of governance while delivering none.
The overlooked lever: empower managers, not a central lab
Here is the move that quietly decides success — and the one most executives miss. You cannot scale adoption from the center. A brilliant central AI lab can build platforms and prove use cases, but the people who actually change how work gets done are line and middle managers. They set their team's priorities, model what 'good' looks like, and decide whether a new tool gets used or quietly ignored.
The evidence on this is pointed. HBR (2026) documents an executive-versus-manager reality gap: senior leaders see AI's strategic advantage from the top, while middle managers confront its flaws — unreliable output, unclear workflows, no support — largely unsupported. That gap stalls adoption and costs real money. Top-down mandates ('everyone will use AI') make it worse, because they add pressure without removing friction.
The fix is to treat managers as partners in the operating model, not recipients of a rollout:
- Involve managers in planning, so use cases reflect the real friction in their workflows.
- Reduce their admin burden so adoption is easier, not one more thing on the pile.
- Build feedback channels that carry the front line's reality back up to the hub.
- Equip them to lead the change locally, rather than waiting for the central lab to push it.
This is why the spoke owns local change management in the table above. The hub enables; the manager adopts.
Example
The executive-vs-manager gap (HBR, 2026)
HBR's 2026 research found leaders and managers fundamentally disagree about AI: executives report strategic advantage, while managers — left to operationalize tools that are still rough — bear the costs unsupported. The remedy the authors prescribe is not more mandates but honest readiness diagnosis, involving managers in planning, cutting admin burden, and building feedback channels. (Re-verify findings against the live HBR article before quoting.)
Watch out
Where leaders get it wrong
Relying on a central AI lab to 'drive adoption' across the enterprise. The lab can prove and enable, but adoption is local. If your line managers are not equipped, sponsored, and heard, the most sophisticated platform in the world will sit unused.
Concentrate the spokes: McKinsey's four-pillar approach
An operating model needs a focusing discipline, or the spokes will scatter into a hundred shallow experiments — the exact pattern that produces no measurable impact. The most useful framing here is McKinsey's four-pillar approach for agentic AI value:
- Pick 2-3 high-value vertical use cases — concentrate, do not sprinkle. Winners go deep on a few; laggards run many pilots that never move a number.
- Embed AI into reimagined workflows — do not bolt agents onto legacy processes; redesign the end-to-end workflow around them.
- Scale with infrastructure, cross-functional teams, and strong governance — this is precisely what the hub provides to the spokes.
- Build a new skills mix — domain expertise paired with AI fluency, so the spokes can run and evaluate their own use cases.
The through-line connecting this to the operating model: the hub provides pillar 3 (the platform and governance); the spokes execute pillars 1, 2, and 4 in their own domain. Each chosen use case should tie to a specific operational number — a cycle time, a conversion rate, a cost line — so the spoke can prove value, not just activity.
Above all of it sits the differentiator no structure can substitute for: executive sponsorship. BCG reports that nearly 100% of 'future-built' firms have deeply engaged C-suites with a unified vision, real funding, and leaders who personally use AI daily; McKinsey finds CEO oversight of AI governance the factor most strongly correlated with bottom-line impact (both 2025; re-verify live). The operating model is the machine — sponsorship is the power that runs it.
Tip
The leadership move: concentrate, then sponsor visibly
Resist the urge to greenlight every promising pilot. Pick two or three vertical use cases tied to real numbers, fund them properly, and — critically — be seen using AI yourself. Leaders who delegate AI but never touch it signal that it is optional, and the organization follows that signal.
Example
Scoped and KPI-anchored: JPMorgan
JPMorgan runs 450+ AI use cases in production with benefits reportedly growing ~30-40% year over year — an exemplar of concentrated, KPI-anchored deployment rather than scattered experimentation. The discipline, not the headcount, is the lesson. (Figures are time-stamped; re-verify before quoting.)
Try it: Draft your AI operating model on one page
Goal: produce a one-page operating-model design you could present to your executive team — no technology required. (1) Choose a model. Given your organization's AI maturity today, decide between centralized, hub-and-spoke, or federated, and write one sentence justifying it (early-stage usually needs more central push; mature orgs federate on a shared platform). (2) Draw the line. Make a two-column table: list 5 responsibilities the central hub will own (standards, guardrails, platforms, governance, fluency) and 5 the business-unit spokes will own (use-case selection, workflow redesign, execution, the outcome KPI, local change management). (3) Name the hub's deliverables. Write 3 'paved roads' the hub will ship in its first year that make spokes faster within policy — and one rule that prevents gatekeeper drift (e.g., a risk-based fast track for low-risk use cases). (4) Pick the spokes' focus. Choose 2-3 vertical use cases tied to a specific operational number each, and name the function and the metric. (5) Empower the managers. List 3 concrete actions to equip line/middle managers to drive local adoption (involve in planning, reduce admin burden, build a feedback channel) — and name how front-line feedback will reach the hub. (6) Name the sponsor. Identify the executive sponsor, the funding commitment, and one way they will visibly role-model AI use. Finish by writing three sentences: what would make this model drift into a gatekeeper, how you would detect it early, and what you would change first.
Key takeaways
- 1The core operating-model decision is where AI authority, talent, and standards live — a structural choice only senior leaders can make, and the concrete expression of the 70% people-and-process rule.
- 2Hub-and-spoke (centralized-federated / Center of Excellence) is the emerging default for firms that scale AI: evidence suggests scalers are ~3x more likely to use it and centralized/hub-and-spoke CAIO models reach ~36% higher ROI than fully decentralized ones (re-verify live).
- 3Divide labor cleanly: the lean central hub owns standards, guardrails, platforms, and governance; the business-unit spokes own use-case execution, workflow redesign, and the business outcome.
- 4The hub must be an enabler that builds paved roads, not a gatekeeper that operates tollbooths — guard against 'gatekeeper drift' with risk-based tiering and a fast track for low-risk use cases.
- 5Adoption is local: empower and equip line and middle managers rather than relying on a central AI lab, and close the executive-vs-manager reality gap by involving managers, cutting admin burden, and building feedback channels.
- 6Focus the spokes with McKinsey's four pillars — 2-3 vertical use cases, embedded in reimagined workflows, scaled with cross-functional teams and governance — all powered by visible executive sponsorship with real funding.
Quiz
Lock in what you learned
Check your understanding
0 / 4 answered
1.Which operating model is emerging as the default for firms that successfully scale AI, and what is its core principle?
2.In a healthy hub-and-spoke model, which responsibility belongs to the central hub rather than the business-unit spokes?
3.An AI hub finds that business units now describe it as 'the people you have to get past,' its backlog is full of build requests, adoption is flat, and shadow AI is rising. What has happened, and what is the structural fix?
4.According to HBR (2026) and the operating-model evidence, what is the most reliable way to actually scale AI adoption across an organization?
Go deeper
Hand-picked sources to keep learning
Practical guide to the hub-and-spoke / CoE operating model and the lean-enabler principle.
Source for the four-pillar approach: concentrate on 2-3 vertical use cases, embed in reimagined workflows, scale with cross-functional teams and governance.
Evidence that CEO oversight of AI governance is the attribute most correlated with bottom-line impact. Re-verify the latest figures.
Future-built vs. laggard firms; deeply engaged C-suites with real funding as a top differentiator. Time-stamped — re-verify before quoting.
The executive-vs-manager reality gap and how to close it: involve managers, cut admin burden, build feedback channels.
The 10-20-70 rule that frames why the operating model — the 70% — is the executive's to own.