Inside-Out Monitors Cut Rogue-Agent Policing From $200,000 to $51 — Goodfire Just Repriced the Stack That CrowdStrike, Palo Alto and Akamai Are Counting On insight cover
Private CompanyCRWD · PANW · AKAM•14 min read

Inside-Out Monitors Cut Rogue-Agent Policing From $200,000 to $51 — Goodfire Just Repriced the Stack That CrowdStrike, Palo Alto and Akamai Are Counting On

On October 8, 2026, Goodfire pushed activation-probe monitors live on Baseten that watch a model's internal signals and only escalate to a frontier LLM judge when something looks wrong — taking monitoring cost from roughly $200,000 per million exchanges to about $185. The shift reframes the defensive moat CrowdStrike Charlotte AI, Palo Alto Networks Prisma AIRS, Akamai AgentGuard, and Cloudflare Workers were pricing against, and reroutes the AI-safety budget toward inference platforms and silicon-level runtimes like NVIDIA's Open Agent Safety Platform.

Published Oct 12, 2026Updated Oct 12, 2026

Cost per 1,500 sessions (Kimi K3)

$51

Goodfire, Oct 8, 2026; ARC-AGI test

Detection rate (recall)

93%

at 5.5% FPR, cascade operating point

Universal jailbreaks blocked

66 → 0

FAR.AI red-team, 140 strategies tested

Compute allocated to monitoring

<1%

vs up to 20% for judge-every-turn

Monitoring cost per 1 million agent exchanges, by approach

Cost per 1M exchanges on the Kimi K3 open-weight model. Source: Goodfire, Oct 8, 2026.

Unit: USD per 1M exchanges

Inside-out probe cascade (Goodfire)

185

Cheap model checking every step

5,420

Top-tier LLM judge every turn (Opus 5)

200,000

Cost per 1,500 sessions (Kimi K3)

$51

Goodfire, Oct 8, 2026; ARC-AGI test

Detection rate (recall)

93%

at 5.5% FPR, cascade operating point

Universal jailbreaks blocked

66 → 0

FAR.AI red-team, 140 strategies tested

Compute allocated to monitoring

<1%

vs up to 20% for judge-every-turn

Added latency per turn (no-reasoning)

2 ms

vs 160 ms for LLM judge baseline

Goodfire, a 2-year-old San Francisco interpretability lab, just turned rogue-agent policing into a budget line and, in the process, knocked the peg out from under the AI-security pricing model that three of the largest cybersecurity stocks were using to justify their multiples. The mechanism is mundane-sounding — small classifiers called activation probes tap into a model's existing forward-pass and only flag a small fraction of turns for a slower, more expensive LLM judge — but the economics break the convention. On Kimi K3, the open-weight model from Moonshot AI, Goodfire's cascade catches 93% of malicious hacking sessions at a 5.5% false-positive rate for $51 in total compute across 1,500 sessions, against roughly $200,000 to run a frontier judge on every turn.

The mechanism that broke the price floor

Until this week, monitoring an autonomous agent for prompt-injection, jailbreaks or reward hacking meant paying a second large model to re-read everything the agent did. That's the architecture baked into every major vendor's \"agent security\" product: a cheap model checks every step for the basics, and an expensive model checks everything when risk is high. The problem is computational. Running Kimi K3 itself costs about $30,000 per million turns; running Opus 5 to judge every turn adds roughly $200,000 on top — a 7x overhead — and the LLM judge itself takes seconds per call, which is incompatible with sub-second agent latency budgets.

Activation probes piggyback on the math the model is already doing — they read the existing forward pass and only escalate when a calibrated threshold trips — so Goodfire's cascade spends less than 1% of total compute on monitoring where a judge-every-turn setup would consume up to 20%.

Independent red-team results published alongside the launch show the architecture matters more than the budget. In FAR.AI testing on the same Kimi K3 deployment, 66 universal jailbreaks and 700 jailbroken interactions showed up with no monitor; with the Goodfire cascade enabled, every one of 140 tested jailbreak strategies failed and only 18 non-universal interactions broke through — a reduction in attack success from 9–40% to 0.1–1.6% depending on reasoning effort. Crucially, latency stayed manageable: average added turn latency was 2 ms without reasoning and 42 ms with reasoning, against 160 ms and 2,750 ms for the equivalent LLM-judge baseline.

The new safety stack is being assembled outside the SOC vendors

The activation-probe monitors are not a science project — they shipped into production on October 8 through Baseten, the $13B-valuation AI inference platform that quietly became the OpenAI-hostile neighbor in the model-serving market. Baseten's \"Base Labs\" research arm paired Goodfire with Hugging Face on September 17 to publish a safety-infrastructure standard for open-weight models, framed as a deliberate counterweight to a proliferation of \"abliterated\" open-weight checkpoints that Hugging Face's own catalog now numbers past 6,000. Goodfire's contribution is the interpretability layer; Hugging Face supplies the publishing pipeline; Baseten provides the inference substrate that connects the two.

  • Baseten raised a $1.5 billion Series F at a $13 billion valuation in June 2026, with Altimeter Capital, Conviction Partners and Spark Capital co-leading.
  • NVIDIA anchored Baseten's $300 million Series E at $5 billion in January 2026, giving it both a strategic interest in inference workloads and a separate platform-level play in agent safety.
  • Hugging Face and Goodfire together cover the training-time (evaluations, fine-tuning) and inference-time (probes, escalation) ends of the safety stack.
  • Goodfire closed a $150 million Series B at a $1.25 billion valuation in February 2026 led by B Capital, with Menlo Ventures, Lightspeed and DFJ Growth participating.

The defensive moats that just got cheaper to bypass

Three of the four companies named in this thesis — CrowdStrike, Palo Alto Networks and Akamai — have been treating agent security as a tier-1 platform extension for the past 18 months, with research-and-development budgets that priced the per-agent monitoring line item assuming high marginal cost. That assumption now looks wrong. Inside-out monitoring pushes per-token safety spend down by roughly three orders of magnitude on a frontier open-weight model, which means the agent-safety workload can be priced into inference rather than sold as a standalone SOC module.

How the listed security incumbents have positioned for agent security
CompanyHeadline agent-security productMost recent disclosed metricPrimary distribution path
CrowdStrikeCharlotte AI AgentWorks (Mar 25, 2026) + Falcon AIDR with NVIDIA NeMo Guardrails (Mar 19, 2026)Q2 FY2027 ARR $5.84B (+25% YoY); revenue $1.47B (+26%); net new ARR $332.8M (+51%)Bundled into the Falcon platform on top of customer endpoints
Palo Alto NetworksPrisma AIRS 3.0 (\"industry's most comprehensive Agent Security Platform\") launched Mar 23, 2026FY2026 NGS ARR $9.10B (+63% YoY); Q4 NGS net new ARR ~$1BPlatformization deals; AIRS rolls into Prisma Cloud
AkamaiAgentic Security Framework (Jun 15, 2026); LayerX workforce-browser acquisition closed Jul 2, 2026 for $205MQ2 2026 security revenue $604M (+10% YoY); total revenue $1.10B (+5%)Edge network + zero-trust; browser-side governance via LayerX
CloudflareWorkers AI + AI Gateway merged into a single control plane (Aug 7, 2026); Dynamic Workers for AI agent code execution (Mar 25, 2026)Q2 2026 revenue $696M (+28% YoY); TTM $2.51B (+35.9%); net loss $170MEdge runtime; agent sandboxed in Workers isolates
None of the SOC incumbents disclose agent-security ARR separately, but the architecture of every product above assumes a per-step LLM judge as the safety floor — the exact component the activation-probe cascade is designed to replace.

The market the incumbents were counting on is bigger than the line item they were pricing

The threat isn't that the agent-security TAM shrinks — multiple private-market and analyst forecasts put it on a steep curve. Gartner's August 2026 forecast sized the market for securing AI at $4.8 billion in 2027, up 68.7% year over year, and MarketsandMarkets projects the agentic-AI-security slice alone from $1.65 billion in 2026 to $13.52 billion by 2032. A separate IGTPS forecast pegs the U.S. AI-agent-security market at $26 billion in 2026, growing to $115.1 billion by 2034. Deloitte's 2026 enterprise survey found only 21% of organizations report fully working guardrails around their deployed AI agents — the remaining 79% are the demand pool.

The risk for the incumbents is that the marginal customer now buys safety from the place where the agent already runs. Baseten-style inference providers can fold inside-out monitoring into the model's serving cost without selling a separate SKU; Cloudflare's Dynamic Workers already push agent code into an isolate per session; and NVIDIA's Open Agent Safety Platform, announced September 28, 2026 with the OpenShell runtime boundary and Sentry in-silicon watchdog on BlueField-4 DPUs and Vera CPUs, is the silico–level embodiment of the same idea. The pricing power the four listed SOC-and-edge vendors were building for agent security now has to be earned against a commodity-grade probe cost, not a frontier-judge cost.

What moves first: a 90-day repricing, not a 24-month migration

Two near-term catalysts will signal whether the bundled security platforms can hold their pricing against the activation-probe alternative. First, Akamai reports Q3 2026 results on a normal cadence and will have the LayerX business inside the line for a full quarter — the dilution guidance of roughly $0.12 to FY2026 non-GAAP EPS, plus any disclosure of agent-security attach rates versus its $604 million security base, will set the read-through. Second, the CrowdStrike and Palo Alto Networks product teams will have to decide whether to license or build inside-out monitoring themselves; both already have native machine-learning detection capabilities, but neither has shipped a probe-cascade architecture into production on a frontier open-weight model.

  • Agent-security attach-rate disclosure in Palo Alto Networks's Q1 FY2027 print (typical late-October window): watch for NGS ARR mix versus standalone AIRS bookings.
  • Cloudflare's next developer-week content: Dynamic Workers pricing per agent session versus Baseten's inference pricing — the spread is the new battleground.
  • Any open-weight model release that ships native probe APIs would extend Goodfire's lead; Kimi K3 (Moonshot AI) and GLM 5.3 are the first two covered models.
  • Deloitte's 21%-covered guardrails stat will become the demand-side justification any incumbent uses for cross-sell — but the unit-cost story is now hostile to that framing.

Where the moat migrates: inference, silicon, or the agent itself

Over a 1–3 year horizon, three camps are positioning to absorb the agent-safety spend that previously attached to SOC platforms. The first is the inference layer: Baseten, Modal and the hyperscalers will package inside-out monitoring as part of the model-serving bill, capturing dollar share at the cost-of-goods line. The second is silicon: NVIDIA's OpenShell + Sentry stack on Vera + BlueField-4 is the first credible attempt to push safety enforcement into the runtime, with a hardware-rooted trust domain that the SOC vendors cannot replicate without a similar DPU footprint. The third is the open-weight model itself: Goodfire's research shows reward-hacking evidence in 50–96% of rollouts across today's most capable open-weight models depending on environment — meaning the next round of model releases is likely to be evaluated, marketed and arguably priced on the strength of the safety stack shipped with it.

The honest read is that none of the listed SOC or edge vendors go to zero — endpoint, identity and runtime isolation remain broadly orthogonal to rogue-agent monitoring — but the AI-agent-security increment the Street was modeling for CrowdStrike, Palo Alto Networks and Akamai looks too rich against a stack where the headline cost line is $51.

Speculation rather than data drives the longer-horizon call. If Baseten-style safety becomes a default line item on every open-weight model hosting bill, NVIDIA's role as both an investor in Baseten and the supplier of the runtime that interprets probe signals makes the data-center tailwind self-reinforcing. Conversely, if a SOC vendor ships an open-weight-integrated probe of its own into Falcon or Prisma before year-end, the activation-probe economics get competed down further and the threat to Baseten's distribution angle is just as real as the threat to the SOC vendors. What is not uncertain is the unit-cost result: from ~$200,000 per million exchanges to ~$185 is a 1,000x compression in the marginal cost of catching an agentic attack, and that is a permanent change to the inputs of the agent-security pricing problem.

Listed names with the most direct read-through to the activation-probe repricing

CCrowdStrikeCRWD--
--Vol --
-
Mixed
  • Charlotte AI AgentWorks (Mar 25, 2026) and Falcon AIDR assume a per-step LLM judge as the safety floor — exactly the component $185-per-1M-turn probes are designed to displace.
  • Q2 FY2027 net new ARR of $332.8M (+51% YoY) keeps the bundle intact, but the AI-agent-security ARR mix inside Falcon is not disclosed and becomes the key variable on the next print.
  • Inside-out monitoring could let CrowdStrike undercut its own AIRS-style competitors while keeping Falcon pricing — a long-term positive if shipped, a near-term overhang if not.
PPalo Alto NetworksPANW--
--Vol --
-
Mixed
  • Prisma AIRS 3.0 (Mar 23, 2026) is the most explicit 'Agent Security Platform' in the incumbents' lineup — the closer inside-out monitors get to feature parity, the more the $9.10B NGS ARR (+63% YoY) multiple depends on broader platformization momentum.
  • Q4 FY2026 NGS ARR growth was driven by record platformizations; pure AIRS attach rate remains undisclosed and is the watch item in the Q1 FY2027 print.
  • Palo Alto Networks has the R&D budget to ship its own probe layer, which would neutralize the threat if executed before competitors do.
AAkamaiAKAM--
--Vol --
-
Bearish
  • Closed the $205M LayerX acquisition Jul 2, 2026 — AgentGuard is exactly the kind of browser-side agent-monitoring product the activation-probe economics pull pricing down on, with dilution guidance of roughly $0.12 to FY2026 non-GAAP EPS.
  • Q2 2026 security revenue of $604M (+10% YoY) is the smallest of the three SOC names, leaving less cushion if new AI-agent wins decelerate.
  • Akamai has the longest incumbent agent-security roadmap of the group (Agentic Security Framework, Jun 15, 2026) but the highest exposure to a price-elastic enterprise buyer.
NCloudflareNET--
--Vol --
-
Mixed
  • Workers AI and AI Gateway were merged into a single control plane on Aug 7, 2026 and Dynamic Workers launched Mar 25, 2026 — making Cloudflare the closest listed peer to Baseten on the runtime-side value chain.
  • Inside-out monitoring could attach to the inference bill automatically; the open question is whether Cloudflare ships its own probe layer or lets partners supply it.
  • Valuation is the widest in the group at 51x TTM sales on a still-loss-making TTM, so any agent-safety repricing is comparatively low-stakes — but the long-term TAM is the same.
NNVIDIANVDA--
--Vol --
-
Bullish
  • NVIDIA anchored Baseten's $300M Series E at a $5B valuation in January 2026 and wins on the inference-substrate side regardless of which safety vendor captures the dollar.
  • Sept 28, 2026 Open Agent Safety Platform (OpenShell + Sentry on Vera CPUs and BlueField-4 DPUs) is the silicon-level embodiment of the same idea — capturing safety spend inside the hardware footprint.
  • Demand-side tailwind doubles up: more agent deployments mean more accelerators, more probe-served inferences, and more OpenShell+Sentry sockets sold per rack.
DDatadogDDOG--
--Vol --
-
Bearish
  • Datadog's Agent Observability product is sold on the assumption that agent traces, model calls and tool workflows need a separate observability tier — exactly the kind of monitoring-plus-judge premium that $51-per-1,500-session inside-out probes undercuts.
  • Competitors in observability have not yet shipped probe-native monitoring; Datadog is exposed if Baseten-style platforms absorb the trace implicitly.
  • Long-term: agent observability still has a place (latency, cost, drift), but the rogue-agent-specific alerting revenue is the segment most directly competed by activation-probe economics.