Beyond plumbing
MCP solved plumbing, not which source answers
Rolling out an assistant for 10,000 people at Netflix taught Utkarsh Shrivastava that chat interfaces and models change quickly; the durable moat lives below the waterline in governed company context:
“The company context is the key here.”Utkarsh Shrivastava · Platform Challenges Beyond MCP · 00:02:11
When two live connectors answered the same live-event question with different numbers—one from analytics, one from transactional metrics—neither tool was buggy. Adding uncurated MCP servers simply multiplies ways an agent can pick an unauthoritative source:
“You would be very disappointed, but the tool was never wrong.”Utkarsh Shrivastava · Platform Challenges Beyond MCP · 00:04:40
“Is another way for the agent to choose wrong.”Utkarsh Shrivastava · Platform Challenges Beyond MCP · 00:04:40
“The M C Ps have made it very cheap to make a lot of information accessible, but.”Utkarsh Shrivastava · Platform Challenges Beyond MCP · 00:06:49
Evidence: Netflix transcript 00:02:11, 00:04:40, 00:06:49
The data stack
Model the warehouse instead of wiring raw apps
George Fraser points out that data teams already spent a decade solving inconsistent definitions for human analysts. Wiring an AI assistant directly to raw operational APIs fails immediately on multi-system questions:
“And you can't even do joins across sources, right?”George Fraser · The new job of the data team · 00:07:04
The high-leverage move is pointing agents at the modeled warehouse tables—and adding a compact AGENTS metadata schema acting as a database map of tables, columns, and safe joins:
“They are using as a source of truth for AI agents for questions about data.”George Fraser · The new job of the data team · 00:03:18
“You're presenting a simplified view of what is probably some very messy and complicated data.”George Fraser · The new job of the data team · 00:05:23
“Local tables in a special schema, a map of the rest of the database that acts as a guide.”George Fraser · The new job of the data team · 00:11:18
Evidence: Fivetran transcript 00:03:18, 00:05:23, 00:07:04, 00:11:18
Unified retrieval
One permission-filtered index jumped 40% to 97%
For unstructured knowledge across Slack, Jira, Drive, and GitHub, Aamir Shakir shows why one-MCP-per-tool breaks down: the agent wastes turns guessing where documents live, and hits the slowest or most rate-limited API in the chain:
“Like getting the right data and access to data is actually the bottleneck, and not intelligence.”Aamir Shakir · How to build agents over your own data · 00:03:12
“And then your agent has the task to guess, basically, what might be the right tool containing this information.”Aamir Shakir · How to build agents over your own data · 00:02:08
“We always say you are only as good as your data, but in this case, you're only as good as your weakest connector.”Aamir Shakir · How to build agents over your own data · 00:04:07
Preparing one unified search layer upfront—with document ACLs attached at ingest—transformed a banking assistant’s accuracy from ~40% to 97%, echoed by Parallel’s requirement to return source citations on every grounded lookup:
“The answer accuracy jumped from very forty percent to ninety-seven percent”Aamir Shakir · How to build agents over your own data · 00:14:19
“Not only do we give you the answer, we also give you the citation, so you can go fact check the source yourself.”Devin Gupta · The first Grounded Decision Model · 00:05:45
Evidence: Mixedbread transcript 00:02:08, 00:03:12, 00:04:07, 00:14:19
Software artifacts
Code, intent, specs, and trajectories are context
Context engineering governs software repositories as tightly as data warehouses. Lauren Tan warns that coding agents treat the existing repo as their primary prompt—replicating messy hacks unless teams keep patterns clean:
“It's now likely to be just copied by the next agent, since it looks like the established pattern in the codebase.”Lauren Tan · All Code Is Slop (Except Mine) · 00:04:26
Three builders model the surrounding decision layer explicitly: Ankit Jain captures why a change happened directly from agent sessions; Thariq Shihipar maintains a linted, English-like spec layer above the agent-written engine; and Fabian Hedin stores task execution in an append-only, Git-like trajectory:
“Intent is why are we making whatever change.”Ankit Jain · One team's path to trusting AI generated code · 00:08:38
“It's supposed to feel like English. It's kind of like a spec, and I'll show you what it looks like. But it's at the density where, if I just read this code, I know what's happening, and I can edit it. I can tweak it. But more importantly, I just like you know can have a bit of a ground truth of like what the what my game looks like.”Thariq Shihipar · Thariq Shihipar, Independent · 00:13:27
“So unlike it, we cannot merge agent trajectories”Fabian Hedin · What it takes to set intelligence free · 00:06:56
Evidence: SpaceXSI · Aviator · Shihipar · Lovable
Curating memory
Reflections, scoring, and dreaming into wikis
Unattended agents that append notes forever degrade into noisy prompts. Vertical AI builder Mihail Eric promotes customer context via structured reflections, while Overcut scores retrospective memories so low-value traces never re-enter context:
“This is where we developed a concept called reflections”Mihail Eric · Learnings from Monaco · 00:10:23
“We are scoring them, so the next run we run only on top of the memories that have the highest score.”Raz Berman Gold · The Software Factory That Needs Zero FDEs · 00:07:30
Lance Martin formalizes this at frontier scale: stronger models know when to read and write memory natively, yet greedy in-session notes still conflict globally—requiring an offline dreaming pass that compiles transcripts into structured wikis (outperforming semantic search alone on the Stainless corpus):
“This is a fundamental paradox of agent memory because agents write memory typically as they go about a task.”Lance Martin · Exploring Claude’s frontier · 00:07:06
“They know intrinsically when to write to memory, and they kind of know intrinsically when to read from memory to retrieve information.”Lance Martin · Exploring Claude’s frontier · 00:08:54
“Dreaming lets you reflect over transcripts and these written notes, and re-represent them.”Lance Martin · Exploring Claude’s frontier · 00:12:13
“The wiki gets better and better and better, allowing Claude answers questions.”Lance Martin · Exploring Claude’s frontier · 00:15:15
Evidence: Anthropic transcript 00:07:06, 00:08:54, 00:12:13, 00:15:15
Counter-claims
Two fault lines: prune memory, scope live apps
While teams agree modeled context beats raw connector sprawl, two counter-claims define the operational limits of passive logs and unified read indexes:
Counter-claim 1 — Append-only memory turns into a garbage dump: Steve Yegge argues that because agents never delete and obey stale notes like gospel, passive accumulation poisons sessions unless engineers actively prune it.
“So you just gotta go in there and just aggressively slash the crap out of it.”Steve Yegge · Escape from Trash Mountain · 00:10:42
Counter-claim 2 — Knowledge-work swarms still need live app access: Karan Vaidya (Composio) notes that when agents execute workflows across CRM, billing, and ticketing rather than merely querying data, they need broad yet granularly scoped access to each app behind an input/action firewall.
“So to be able to do that correctly, you need to give right amount of access to all of these agents.”Karan Vaidya · Run a Company on Agent Swarms · 00:05:49
Evidence: Yegge 00:10:42 · Composio 00:05:49
Playbook
Organize tools by use case—then curate context
Arsalan Bashir (Sentry) bridges read modeling and live API execution: stop handing agents 1:1 raw REST endpoints where they confuse similar tools and loop on pagination. Wrap cross-source ID resolution and deterministic joins inside clean use-case tools:
“The agent starts picking the wrong tools sometimes.”Arsalan Bashir · Let the Agent Cook · 00:01:32
“You know, organize tools by a clear use case.”Arsalan Bashir · Let the Agent Cook · 00:03:01
- Separate reads from writes: route analytical and knowledge queries to one modeled warehouse or ACL-filtered search index; keep scoped per-app tokens solely for governed write actions (
00:03:18, 00:14:19, 00:05:49).
- Push joins and pagination into code: consolidate endpoint sprawl into outcome-oriented tools (
00:03:01).
- Consolidate and slash memory: combine offline dreaming/scoring passes with deliberate pruning so stale notes never harden into dogma (
00:07:30, 00:12:13, 00:10:42).
For TheFocus.AI: When a client asks to “connect an agent to all our tools,” flip the order. First unify truth in their warehouse or one permission-aware index, second wrap multi-step endpoints into deterministic use-case tools, and third install a scored, pruned memory loop—never raw MCP sprawl.
← Back to Conference Themes Overview