The Model Is Not the System: Why Curated AI Pipelines Matter
Boards keep asking which model to buy. It is the wrong question, one level too high.
Two AI tools can look identical in the hands of the same analyst and carry entirely different risks. The difference is never the model. It is everything the firm chose to build around it — and how deeply it was willing to change the work underneath.
Much of the current AI debate still starts with the model: which provider, which version, and whether the latest release finally unlocks the value the last one promised. That instinct is understandable. It is also, increasingly, the wrong level of analysis. In a regulated business the model is the least interesting part of the decision, and the evidence that it is has now arrived from an unexpected direction — the data on who AI is actually replacing.
An AI service is far more than a model. The model sits inside a wider harness — approved data, prompts, tools, permissions, rules, validation, monitoring, and human intervention — and a pipeline determines how work moves through those components. Together they define what the system is permitted to do and how much reliance can sensibly be placed on its output. Choosing a model is procurement. Curating the pipeline is governance. The two are not the same decision, and only one of them is yours to be accountable for.
Same Fluency, Different Control Environment
This is why two tools can behave almost identically in use and still present very different risks. Both may produce fluent summaries and confident recommendations. One may be restricted to approved sources, checked against defined rules, and required to escalate uncertainty to a named person. The other may be a general-purpose model wired directly into business data with no boundary at all. The user experience is similar. The control environment is not remotely comparable.
Fluency is the trap. A model that writes well reads as a model that reasons well, and a model that reasons well reads as a model that can be trusted with a decision. None of those inferences hold. Fluency is a property of the output; trustworthiness is a property of the system around it. Confusing the two is how a productivity tool quietly becomes the mechanism that determines a risk rating, without anyone deciding that it should.
The Same Logic Governs Small Models
The point applies with equal force to small language models. By 2027, more firms are likely to run SLMs locally or inside their own infrastructure — partly to reduce token costs, partly to improve privacy, latency, and resilience. A small model can perform extremely well at extracting names, dates, or clauses from a defined set of documents. That competence says nothing about whether it should interpret policy, resolve a complex ownership structure, or determine whether a customer warrants enhanced due diligence.
Suitability is not a function of model size. It is a function of the task, the evidence available, the surrounding controls, and the consequence of error. A large model is not automatically safer, and a small one is not automatically riskier. The question is always the same: what happens when this component is wrong, and what in the system catches it before the error reaches a customer or a regulator?
A Curated Pipeline Assigns Each Task to the Right Component
A curated pipeline does not ask one model to do everything. It assigns each part of the work to the component best suited to it, decides when work moves between stages, and retains enough evidence to explain afterwards what happened and why. The design choice is not “which model” but “which component for which task, under what control.”
| Component | Best-suited work | Where it must not go alone |
|---|---|---|
| Small language model | Routine extraction from a defined document set — names, dates, clauses, figures. | Interpreting policy or judging materiality. |
| Retrieval over approved sources | Supplying current, sanctioned source material so answers are grounded, not invented. | Deciding which source wins when they conflict. |
| Deterministic code / rules engine | Applying clear, testable policy thresholds and escalation triggers. | Handling genuine ambiguity the rules never anticipated. |
| Stronger general model | Harder interpretation and synthesis across messy, incomplete inputs. | Final sign-off on a material or unusual case. |
| Accountable human | Material judgement, exception handling, and ownership of the outcome. | Being used as a rubber stamp with no evidence trail behind the decision. |
Read down that final column and the design principle becomes obvious: every component has a ceiling, and the pipeline’s job is to know where each ceiling sits. A well-curated system is mostly a set of decisions about what each part is not allowed to do on its own.
Where This Matters Most: Regulated Processes
Nowhere is this more consequential than in a regulated process. In customer onboarding, AI can help identify missing documents, summarise an ownership structure, and prepare a file for review. It should not quietly become the thing that sets the risk rating or decides whether an escalation rule has been met. Fluent output is not controlled policy execution, and the gap between the two is exactly where accountability lives.
The JFSC’s guidance, issued on 14 July 2026, takes a deliberately proportionate view. It creates no new requirements; it expects firms to apply existing obligations according to the impact of the use case. The guidance’s Materiality Ladder makes the same distinction a curated pipeline makes in engineering terms: a low-impact productivity tool may justify lighter controls, while customer onboarding, lending decisions, and investment advice sit at the higher-impact end and warrant independent validation, stronger monitoring, and explicit human oversight. The Commission’s central point is uncomplicated — firms remain accountable for outcomes when they use AI, whatever the model underneath.
Its onboarding scenario is precise about this. AI may flag missing information and surface red flags, but the firm keeps the final decision, routes higher-risk cases to a suitably skilled person, and keeps a competent person responsible for high-impact or unusual cases. That is a pipeline specification written in supervisory language: extraction and triage delegated to the system, judgement and accountability reserved for a named human.
Curation Is a Decision About How Much of the Work Changes
There is a harder truth underneath all of this, and the clearest evidence for it comes from the question everyone actually asks first: how many jobs does the AI remove? Gartner’s analysis of 241,454 disclosed layoffs in the first half of 2025 traced fewer than 1% directly to AI initiatives; the dominant drivers were financial and structural. The earnings-call evidence is starker still. Gartner took the S&P 1200, set aside roughly 200 tech-sector firms whose behaviour differed sharply, and examined the remaining 1,004 non-tech companies’ first-half-2025 calls. Of those, 273 mentioned AI in connection with financial results; only 64 — about 6% — disclosed a specific AI-linked financial return; and just three quantified workforce-productivity value on their financial statements (Gartner, AI Is Coming for Inefficiency, Not People, 2026h). The narrowing from 273 to 64 to three is the point: talking about AI is common, quantifying a return is rare, and evidencing a productivity gain on the financial statements is rarer still. The headline is not that AI does little. It is that efficiency at the level of an individual tool seldom reaches the financial statement at all.
Gartner calls the gap productivity leakage: hours saved by a fluent tool leak away before they become cost taken out or revenue added, because the process around the tool never changed. This is the same “blue money versus green money” distinction this collection has used throughout — and it maps exactly onto the pipeline argument. A model dropped on top of an unchanged workflow produces blue money: a faster version of the old process, with the old control gaps intact. Green money requires redesigning the workflow itself, which is precisely what curating a pipeline is.
The useful part of Gartner’s framing is that it makes “how much do we change” an explicit, gradable decision rather than a vague ambition. Firms sit somewhere on a spectrum of intent, and where they sit determines both the value available and the control burden they take on:
| Depth of change | What the firm actually does | Pipeline and control implication |
|---|---|---|
| Amplify | Keep the process; add a tool to speed up the existing steps. | Mostly blue money. Old controls and old gaps persist behind a faster interface. |
| Recalibrate | Rework parts of the workflow, metrics, and the human/machine split. | Green money becomes reachable; controls must be redesigned around the new steps. |
| Reset / reimagine | Rebuild the process, in places assuming autonomous agents from the start. | Largest value and largest risk; treat as higher-impact, with validation and fallback built in. |
The order of operations matters more than any single choice on that ladder. Gartner’s recommendation is to decide the depth of process change first, then derive the workforce and control consequences — not the reverse. Most firms do it backwards, fixing a headcount target and reverse-engineering a project to hit it. A curated pipeline is the artefact that decision produces: settle how much of the work genuinely changes, and the components, the guard rails, and the human checkpoints follow from that. Choose the model first and you have answered the easy question while leaving the accountable one open.
The Peer Data Says Firms Are Deploying Ahead of Their Evidence
This is not one firm’s anxiety; it is the pattern across the peer group. Gartner’s 2026 Technology Adoption Roadmap, which assessed 44 technologies with 105 large organisations over a 12-to-24-month window, surfaces two findings that speak directly to pipeline discipline. The first is a cost signal: unpredictable cost now affects 67% of cloud-related technologies, up sharply from 14% a year earlier (Gartner, 2026j). Cost volatility is not a billing footnote — it is a control variable. A pipeline whose token, retrieval, and agent-orchestration costs are not understood is a pipeline whose behaviour under load is not understood either, which is why the roadmap’s own advice is to contain cloud risk by partitioning workloads deliberately rather than by assembling ever more complex multicloud estates.
The second finding is sharper for a regulated firm. Roughly 60% of AI-powered digital-workplace tools are rated high-to-medium risk, and yet about 60% are already in deployment — pushed there by their effect on employee productivity, even as organisations admit they struggle to measure the impact (2026j). Read that twice: the market is deploying tools it has itself classified as risky, faster than it can evidence what they deliver. That is the blue-money problem wearing a risk label. It is also the precise failure a curated pipeline is meant to prevent — productivity felt by users, unproven on the financial statement, and un-evidenced against the control the tool quietly sits inside. By contrast, the roadmap shows AI-powered ITSM tools stuck in piloting largely on unpredictable cost, a reminder that the same technology can be held back by cost in one function and waved through despite risk in another. The differentiator, again, is not the tool. It is whether the firm curated the system and the evidence around it before it shipped.
A Worked Example: Agentic KYC in a Regulated Firm
Gartner offers a case that lands squarely in Channel Islands territory. A bank’s know-your-customer process ran to more than five weeks and around a thousand full-time staff; a consulting firm proposed an agent-driven redesign at roughly two weeks and a few hundred staff, and was confident enough to offer to run the process itself (Gartner, 2026h). The bank declined that last part — correctly — because KYC is a regulated process, and outsourcing the mechanism does not outsource the accountability.
That refusal is the whole argument in miniature. The efficiency case for the reset was real; the control question was what made it a board decision rather than a procurement one. Curating this pipeline means deciding which stages agents may own — gathering documents, checking watchlists, assembling the file — and which stay with a named human: the risk rating, the escalation call, the high-impact or unusual case. It means a manual fallback if the agent layer fails, so onboarding does not silently continue with the red-flag checks switched off, exactly the resilience gap the JFSC’s own outage scenario warns about. And it means an evidence trail that survives the speed-up, because a two-week process no one can reconstruct afterwards is faster and less defensible than the five-week one it replaced. Faster is only better once you can still show your work.
The Pipeline Is Also a Workforce Design
PwC’s 2026 Global AI Jobs Barometer, drawn from more than a billion job adverts, describes a two-track labour market: roughly 22% of jobs are being professionalised as AI absorbs their less expert tasks, while around 52% are being democratised as AI takes over the more complex, data-intensive work and shifts people toward strategy and relationship management. Both tracks are visible across the Channel Islands finance sector already, and the KYC example shows why they are two faces of one decision: reset the process and you have simultaneously decided which human judgements remain and how expert they must be.
The peer data shows the same shift in what firms say they value. In Gartner’s roadmap, speed and agility led the value drivers last year at 60%; this year the top drivers are employee productivity at 32% and agility at 30% — a re-weighting the roadmap reads as the rise of human-AI collaboration (2026j). That is the professionalisation track by another name: value is migrating toward augmented people doing higher judgement work, not toward tools running unattended. A curated pipeline is how a regulated firm captures that value without mistaking a productivity feeling for a governed outcome.
Gartner’s companion prediction is that the workforce shape shifts from a pyramid to a diamond — fewer purely junior, routine roles, and a thicker middle of augmented staff doing higher-value work, with absolute headcount potentially flat or rising even as labour’s share of cost falls (Gartner, 2026h). For a regulated firm this is not merely an HR observation. The people left in a curated pipeline are, by design, the ones holding the judgement the JFSC expects a suitably skilled person to exercise: challenging outputs, spotting anomalies, owning material decisions. Pipeline design and workforce design are the same exercise viewed from two angles. Decide which component does which task, and you have also decided which judgements your people must remain genuinely competent to make — not merely present to approve.
There is a speed dimension both sources are candid about. PwC cites the UK AI Security Institute’s estimate that the length of task an AI model can complete with 80% reliability has roughly doubled every 4.7 months since reasoning models emerged in late 2024, while Gartner’s own message is that the binding constraint is rarely the technology — it is organisational debt: process, talent, data, and regulatory debt that AI exposes rather than removes. Capability is moving faster than most firms’ controls, and the components will keep getting more capable. The boundaries around them are the only thing that does not move unless a firm deliberately moves it. That is an argument for curating the pipeline more deliberately, not less.
The Question Boards Should Actually Be Asking
For boards and executive teams, the question is no longer simply which model has been selected. It is whether the pipeline around it has been deliberately curated — and, before that, how much of the work the firm was actually willing to change. Six questions get you most of the way there:
- Depth of change: how much of the process are we genuinely changing — amplify, recalibrate, or reset — and did we decide that before the headcount question?
- Access: which data the system can reach, and on what lawful basis.
- Guard rails: what rules, validation, and testing sit between the output and the decision.
- Human point: where the accountable person sits, and whether they can actually exercise the judgement expected of them.
- Change control: how the pipeline is altered, by whom, with what approval, and with a manual fallback if a component fails.
- Evidence and proportionality: what record survives to explain a decision to an auditor or a customer months later, and does governance depth match the impact tier rather than the vendor’s marketing.
Only the model provider is absent from that list. That is the point. A firm that can answer these has a system it can defend and a workforce that can stand behind it; a firm that can only name its model has bought a capability, banked some blue money, and inherited a risk it has not yet described.
What Curating a Pipeline Costs, and Where to Start
None of this is free, and a briefing that stops at diagnosis has done only half the job. Two cost realities deserve board attention before the first component is chosen. The first is that the model licence is rarely the expensive part: as earlier instalments in this collection have noted, the professional services, integration, and change management around a use case can run to roughly 77% of first-year budget against about 23% for the core technology (Microsoft, 2025), and Gartner’s own casework stresses the recurring cost of curating and maintaining a solution year after year, not just standing it up (2026h). The second is that reset-level change carries capital cost, not merely operating cost; Gartner frames the choice as a capex-versus-opex balance that echoes the earlier shift to cloud (2026h). A pipeline is a budget line with a tail, not a one-off purchase.
Sequencing matters as much as spending. A defensible starting order for a regulated firm is: first, settle the depth of change for the process in question — amplify, recalibrate, or reset — because that decision governs everything downstream; second, map the work to components and fix the “where it must not go alone” boundary for each, so the human checkpoints are designed in rather than bolted on; third, stand up the evidence and monitoring before scaling, not after, so the first material decision the pipeline touches is already auditable. That order keeps the accountable question open at each gate instead of deferring it until an incident forces it.
It would be dishonest to present curation as pure risk reduction, because a curated pipeline introduces its own failure modes and a board should commission the controls for them deliberately. Three recur. Hand-off failure, where a component silently passes flawed output to the next stage — the reason each boundary needs a validation step, not merely a label. Evidence that exists but is never read, which offers the comfort of an audit trail without the scrutiny, and is defeated only by someone being accountable for reviewing it. And automation bias — the most corrosive — where the “accountable human” approves fluent output without genuine challenge, quietly becoming the rubber stamp the design was meant to prevent. This is where the JFSC’s people clause bites hardest: oversight is real only when the person exercising it has the skill, the time, and the standing to overrule the machine. Curation moves risk; it does not abolish it, and the moved risk still has an owner.
Closing question: If those two identical-looking tools landed on your desk tomorrow, could your firm explain — from evidence, not assurance — which one it had actually curated, how much of the work it was prepared to change to make it pay, and why the other one would never have been allowed near an onboarding decision?
A companion briefing in the AI Strategy in Jersey FS collection. The model matters. The curated system around it — and the depth of process change behind it — matters more.
Sources: JFSC, Guidance on the use of AI in Jersey’s financial services sector, 14 July 2026; PwC, 2026 Global AI Jobs Barometer; PwC and World Economic Forum, Artificial Intelligence and the Future of Entry-Level Work, 2026; UK AI Security Institute task-length estimates cited therein; Gartner, AI Is Coming for Inefficiency, Not People (2026h); Gartner, 2026 Technology Adoption Roadmap for Large Enterprises (2026j); Microsoft, 2025; Jersey AI Playbook, March 2026.
Professional disclaimer: The views expressed are my own and are shared for general informational purposes. This content is intentionally non-confidential and does not include proprietary, client-specific, or employer-sensitive information. It is not legal, regulatory, investment, or professional advice; readers should seek appropriate advice for their circumstances.
Financial services leader (20+ years) | Lean Six Sigma Green Belt | London School of Economics (LSE) AI Leadership Accelerator
See where your firm stands
The free diagnostic scores your firm across the twelve operating-model instruments in about eight minutes.
Take the diagnostic →A version of this article was first published on LinkedIn as part of the Sequence body of work. This is the canonical version.
The views expressed are the author's own and shared for general information. This content is intentionally non-confidential and does not include proprietary, client-specific or employer-sensitive information. It is not legal, regulatory, investment or professional advice. © 2026 Paul Soares. Sequence is the trading name of Sequence Advisory Limited (in formation) · hello@sequenceadvisory.com