On September 19, 2026, Andreessen Horowitz publicly unveiled Vals — the independent AI benchmarking startup it had quietly funded at a $400M valuation six weeks earlier — and immediately framed it as the trusted scorekeeper for an industry that has stopped trusting itself. CEO Rayan Krishnan, 25, runs a 25-person team whose results already appear in model cards from OpenAI, Anthropic, Google, Meta, and xAI, and whose federal agency work has produced the only third-party benchmarks cited in U.S. AI policy debates. The \"gold standard\" framing is the venture bet; the timing is the product. With frontier labs beginning to gate their best models — GPT-6 Astra behind Daybreak Access, Mythos 5.1 behind cybersecurity vetting — the buyer is losing the ability to evaluate what it is buying, and a neutral yardstick becomes the most expensive seat in the AI stack.
Vals Series A
$40M / $400M valuation
Led by a16z, Aug 13, 2026; 8VC, Bloomberg Beta, Pear VC, Sequoia, HRT Ventures, Next Ladder Ventures
Vals revenue growth
8x YoY
Reported in Vals Series A blog post, Aug 13, 2026
Vals headcount
8 → 25 in 6 months
Reported by TechCrunch, Sept 19, 2026; further hiring planned
Claude Fable 5.1, Vals Index leader
68.83%
Sept 15, 2026 leaderboard, vals.ai
GPT-6 Astra API price
$10 / $50 per 1M tokens
Launch pricing, Sept 3, 2026; Daybreak Access gates initial rollout
Why now
The hyperscalers' own gating turned third-party evaluation into procurement infrastructure
For most of 2024 and 2025, enterprises could run any frontier model on a free trial and judge it themselves. That window is closing. OpenAI shipped GPT-6 Astra on September 3 behind \"Daybreak Access,\" a staged rollout that sent the model first to vetted cybersecurity customers, kept U.S. government and approved corporations in a roughly 30-day exclusivity window, and pushed general public access to API and to Amazon AWS Bedrock days later. Anthropic mirrored the pattern a week earlier with Claude Fable 5.1 (which is broadly available) and Claude Mythos 5.1 (which stays restricted to vetted cybersecurity and life-sciences buyers). When the labs control who touches their best models, they also control what buyers can know about them — and that asymmetry is what Vals is monetizing.
| Model | Released | Access model | Public list price |
|---|---|---|---|
| Claude Fable 5.1 | Sep 1, 2026 | Generally available to Claude account holders | $10 / $50 per 1M tokens |
| Claude Mythos 5.1 | Sep 1, 2026 | Vetted cybersecurity and life-sciences only | Not publicly listed |
| GPT-6 Astra | Sep 3, 2026 | Daybreak Access — staged to cybersecurity, then US gov / approved corps (~30 days), then API and AWS Bedrock | $10 / $50 per 1M tokens |
| Muse Spark 1.3 Max | Q3 2026 | Open weights plus Meta enterprise channels | Varies by deployment |
What Vals actually sells
Adaptive benchmarks for the work enterprises will actually pay models to do
Vals does not run public exams. It builds benchmarks with domain experts — lawyers, bankers, doctors, security engineers — that test whether a model can produce a final work product at expert standard, not whether it can pass a bar exam. The catalog spans legal research, finance document analysis, software engineering, cybersecurity, mental-health triage, biosecurity, and even law-of-armed-conflict scenarios graded against the Geneva Convention. Tests are private, runs are limited, and grading is automated against expert output. Crucially, Vals retires benchmarks the moment models ace them — SWE-Bench Verified was dropped from the coding bucket on August 13, 2026 because it had become saturated; coding now averages Terminal-Bench 2.1, Vibe Code Bench, and Code Migration equally. This is the \"benchmaxing\" doctrine: a benchmark that can't separate models is a benchmark that has stopped working.
Vals Index — top frontier models, Sept 15, 2026
Composite score across legal, finance, coding, and frontier-risk benchmarks; SWE-Bench Verified removed after saturation on Aug 13, 2026.
Unit: % composite score
Claude Fable 5.1
68.8
Claude Opus 5
67.2
GPT-6 Astra
66.6
Claude Fable 5
66
Muse Spark 1.3 Max
64.5
Gemini 3.8 Flash
62.3
Grok 4.6
59.2
Who pays
The payer stack is small, concentrated, and increasingly willing
Vals runs a demo-led, negotiated contract motion. There is no public price card. Customers fall into three buckets, and each one is paying for a different deliverable. Foundation model labs (OpenAI, Anthropic, Google, Meta, xAI) pay to get scored before release and to cite the result in their model cards — Vals' results are already cited by all five. Enterprise buyers — financial institutions, hospital systems, and AI-native software vendors like Harvey — pay to choose which model to build on and to defend that choice in procurement. Government is the newest bucket: Vals has provided benchmark data to the U.S. Department of Commerce and to NIST, and the company's own public-sector memo frames the work as the missing rigor layer for federal AI adoption.
- Labs pay for pre-release scoring and a citable number to attach to a model card — the marketing ROI is direct because buyers now search for Vals rankings by name.
- Enterprises pay for private evaluation suites and SDK + CI integrations that turn model selection into a repeatable engineering decision instead of a one-off RFP.
- Government pays for domain-specific benchmarks (Public Benefits Bench, CyberBench) that translate vendor claims into something a procurement officer can defend in a budget hearing.
2026 AI capex by hyperscaler — the buyer of every frontier model
Calendar-year 2026 capex guidance, US big four; this is the demand pool any AI procurement tool is selling into.
Unit: $B (mid-point of range)
Amazon
200
Microsoft
190
Alphabet
190
Meta
125
Supply-chain link
CoreWeave is the only listed name inside the room
Vals does not sell hardware, but one listed company has direct skin in the benchmark itself. CoreWeave co-built the Vals RSI Index, which runs every frontier model through the same AI research tasks and scores them on progress toward recursive self-improvement. RSI is the most-watched safety benchmark of the cycle and gets cited in nearly every frontier lab's risk disclosures; CoreWeave's collaboration makes it a supplier to Vals in the same way the hyperscalers are suppliers to the labs. That is a different exposure from simply selling GPU cycles: it makes CoreWeave's brand load-bearing inside the scorekeeper's most cited product.
CoreWeave Q2 FY2026 — the listed conduit
Q2 revenue
$2.57B
+112% YoY
Revenue backlog
~$104.2B
As of Jun 30, 2026
FY2026 revenue guide
$12.4B–$13.2B
Raised Aug 11, 2026
FY2026 adj. op. income
$0.96B–$1.15B
Raised Aug 11, 2026
Convertible notes
$3.7B upsized
Priced Sep 18, 2026
Strategic role
RSI Index co-builder
With Vals AI
Competitive risks
The benchmarker seat has four serious claimants — and one is the vendors themselves
The closest direct competitor is Artificial Analysis, which runs a public composite index across price, latency, output speed, and quality; Scale AI adds a vertically integrated option with proprietary datasets and a large human expert workforce; Braintrust is the most aggressive end-to-end workflow challenger because it bundles observation, annotation, evaluation, and deployment. LangSmith has LangChain distribution, Langfuse has open-source economics, and Arize Phoenix, Patronus AI, and Galileo all push toward always-on production governance. None of them is positioned exactly the way Vals is, but the seats they want are adjacent, and the boundary between public leaderboard and CI/CD evaluation is the one Vals has to defend.
- Vendor-native eval — OpenAI's Evals API and Google Gemini Enterprise's agent evaluation features — is the most dangerous long-term threat because it ships bundled with the model the buyer already pays for.
- Artificial Analysis undercuts Vals on public reach and a faster update cadence; Vals' defense is depth (private test sets, expert-built rubrics) and the fact that labs already cite Vals in their cards.
- Scale AI can outbid Vals on raw expert labor; Vals' defense is that Scale's evaluation business lives inside a larger data-labeling P&L and has weaker perceived independence.
- Government procurement moving to NIST-led evaluation could either entrench Vals or replace it with a public-sector alternative — the next 12 months of federal AI standards work will be dispositive.
Horizons
What moves in days–quarters, and what compounds over 1–3 years
Short-term (days–quarters): the first post-Daybreak GPT-6 Astra enterprise contract will be watched for whether it cites Vals rankings; if it does, Vals moves from a brand-asset buyer to a procurement dependency. The Claude Mythos 5.1 vetting program will be the test of whether a private cyber-channel can coexist with a public Vals score without forcing a fight over numbers. The next NIST AI standards deliverable is the catalyst that either makes Vals the federal default or opens the door to a public-sector alternative.
Long-term (1–3 years): if Vals holds, it becomes the bond-rating agency of AI — a permanent fixture on which labs, buyers, and governments all depend. The economics of that seat scale with the dollar volume it audits: enterprise AI procurement is already moving from \"which model\" to \"which model on which task,\" and a vendor that controls the rubric controls the answer. The four-way hyperscaler dynamic — Microsoft holding OpenAI IP rights through 2032, Amazon holding $100B+ of Anthropic's compute commitment, Alphabet carrying Gemini, Meta carrying open weights — guarantees that no single hyperscaler will be allowed to set the rubric alone. That structural fact is what makes the third-party seat venture-grade in2026 rather than 2024.
How to play the AI-yardstick thesis
- Direct co-builder of the Vals RSI Index, the most-cited frontier-risk benchmark of the cycle — turns CoreWeave into a supplier to the scorekeeper, not just a GPU renter.
- Q2 FY2026 backlog of ~$104.2B and revenue guidance of $12.4B–$13.2B (raised Aug 11, 2026) already priced in AI capex digestion; RSI exposure is incremental upside that the market has not yet mapped to Vals' $400M valuation.
- Near-term: each new frontier-lab evaluation that uses RSI pulls CoreWeave compute into the workstream; long-term: if Vals becomes a procurement standard, RSI becomes regulatory-grade infrastructure (1–3 year horizon).
- Azure exclusivity for stateless OpenAI APIs survived the April 27, 2026 partnership rewrite; Microsoft reported $24.1B in OpenAI-derived revenue in FY2026, but is now also a buyer of independent validation to defend GPT-6 Astra's claims against Anthropic.
- Short-term (days–quarters): helps on procurement defensibility as GPT-6 Astra moves from Daybreak Access to general API; long-term (1–3 years): the more credible Vals becomes, the more Microsoft loses its ability to set the rubric alone for Azure customers.
- Trailing P/E of 27.5x and a $3.67T market cap leave little room for a Vals-driven re-rating; thesis is more about protecting AI gross margin than expanding it.
- Anthropic just signed a 10-year, $100B+ AWS commitment on April 20, 2026, on top of an additional $5B investment (up to $20B more tied to milestones) — Vals' Vals Index rank of Claude Fable 5.1 at 68.83% directly supports Amazon's $33B+ Anthropic bet.
- Bedrock is also a Daybreak Access endpoint for GPT-6 Astra; Amazon is now the distribution layer for both gated frontier models, and an independent yardstick raises the switching cost for buyers considering alternative clouds.
- Trailing P/E of 20.4x on a $2.73T market cap is the cheapest of the four hyperscalers; thesis aligns with the $200B 2026 capex guide that already bakes in AI infrastructure digestion.
- Gemini 3.8 Flash ranks fifth on the Vals Index at 62.25% — Vals is an honest scorekeeper, and Alphabet has to accept the gap to Claude and GPT rather than set the rubric itself.
- Short-term (days–quarters): Gemini Enterprise's bundled agent evaluation feature is the most credible vendor-native threat to Vals; long-term (1–3 years): the more credible Vals becomes, the harder Alphabet has to compete on independent grounds.
- FY2026 capex raised to $175–205B after the Q2 report panned by analysts; a stronger third-party benchmark ecosystem is bullish for utilization and bearish for cloud pricing power — net mixed on the multiple.
- Muse Spark 1.3 Max ranks fourth on the Vals Index at 64.53% — a credible independent number for an open-weights model is the strongest marketing asset Meta has in the enterprise procurement fight against OpenAI and Anthropic.
- Q3 FY2026 capex guide of $115–135B (up from $72B in 2025) is the largest year-over-year jump of the four; Vals-style independent benchmarking makes that capex easier to defend in earnings calls and at investor days.
- Trailing P/E of 25.1x on a $1.70T market cap is reasonable; the Vals angle is incremental — a third-party benchmark that consistently ranks open weights inside the top five is a structural advantage for Meta's monetization push.
- Every model on the Vals Index — Claude Fable 5.1, GPT-6 Astra, Muse Spark 1.3 Max — was trained and served on NVIDIA hardware; Vals' RSI Index specifically grades whether models can autonomously improve the AI research stack that runs on those GPUs.
- Short-term (days–quarters): the catalyst is whether Vals' enterprise-evaluation revenue model scales with adoption; long-term (1–3 years): if the third-party yardstick becomes procurement infrastructure, NVIDIA is the substrate under every score.
- Trailing P/E of 28.1x on a $5.38T market cap leaves no room for execution missteps — the Vals angle is a watch item (binary catalyst: NIST-led federal AI evaluation standard, expected within 12 months), not a near-term re-rating driver.
