Notes on AI startups Close
AUGUST 2026 · 9 MIN READ

To scale AI infrastructure startups, become the default first

Inference and search for agents is the most crowded, best-funded corner of AI, and the price of a token falls every quarter. The companies pulling ahead have one thing in common: they became the default — the API a developer reaches for first, and the tool an agent calls without being told to. Five of them, and how each got there — including Keenable, which launched this month with its own web index built for agents.

Jump to the six proven sales plays →
THE DEFAULTwhere agents send their calls
Fireworks AI · Baseten · Together AI · OpenRouter · Keenable
$17.5B
Fireworks' valuation, on $1B+ in run-rate revenue
25T
tokens a week through OpenRouter, up 5× in six months
$1.15B
Together AI's annual bookings last quarter
$26M
Keenable's seed to index the web for agents
01 · THE IDEA

The price of a token keeps falling. The value of being the default keeps rising.

Every company here sells something buyers can switch away from with a few lines of code: an API call. That should make this a race to the bottom. It hasn't been, because volume is exploding faster than prices are falling — and most of that volume flows through whoever is already wired in. Agents make the effect stronger: an agent doesn't shop around, it calls the tool it was given.

Volume is compounding at the gateways
Fireworks · tokens served per daylast round → July 2026
Before15T
Now40T+
OpenRouter · tokens routed per weeksix months → May 2026
Before5T
Now25T
Fireworks · annualized revenue (US$)16 months
Before0.1B
Now1B+
Company-reported figures; the revenue ramp is Bessemer's description of Fireworks' growth.
Why switching is cheap, and still rare
Changing providers takes an afternoon of engineering. Changing a default takes much more: re-testing quality, re-tuning prompts and fine-tunes, re-negotiating capacity, and convincing every team that already built on the old one. The switching cost isn't in the API. It's in everything around it.
THE NEXT DEFAULT SLOT
Inference already has crowded defaults. Search for agents doesn't yet. Agents need the live web, and builders want an index they can rely on long term. That opening is exactly what Keenable was built for.
MY VIEW

I read this market as a toll road where the toll keeps dropping. That's fine for whoever owns the busiest on-ramp, and brutal for everyone else. So the question I'd ask of any company here isn't “are you cheaper?” It's “what makes you the first call?”

02 · WHY DEFAULT COMES FIRST

Every agent call passes through a stack. Each layer has one default slot.

An agent's request moves down a short stack: something routes it, something runs the model, something fetches live information. At each layer, the agent's builder picks one default and rarely revisits it. Winning that slot is worth more than winning any single price comparison.

Agent
The software making the calls
Frameworks and SDKs — where defaults get set in code
Router
Picks the model for each call
OpenRouter
Inference cloud
Runs and specializes the models
Fireworks AIBasetenTogether AI
Search and retrieval
Fetches the live web for the model
Keenable
DEFAULT IN CODE
Ship the one-line integration in the frameworks developers already use.
DEFAULT IN THE BUNDLE
Come built into someone else's product, so choosing them means choosing you.
DEFAULT IN THE ROUTER
Rank well on price, speed and quality where routers pick providers automatically.
DEFAULT FOR AGENTS
Let agents discover, pay for and start using you without a human sign-up.
Share of new customers arriving through an integration or partner
Share of traffic from customers who never compared vendors
Tokens per customer, month over month
Accounts that run a second workload on you within 90 days
The four numbers I'd watch weekly to know whether a company is becoming the default.
03 · THE PLAYBOOKPROVEN SALES STRATEGIES · THE PART WORTH SAVING

How AI infrastructure startups win the default: six proven plays

Each play leads with the number that proves it. None of them is “be cheaper” — price matters, but here it's the door opener, not the reason customers stay.

PLAY 01 · FIREWORKS AI
95%
of Fireworks' tokens come from specialized models
Sell the specialized model, not the generic one
Fireworks says 95% of the tokens it serves now come from models customers have specialized on their own data, for companies like Uber and Shopify. Its pitch is that enterprises want models trained on their own workflows and customer knowledge, faster and cheaper, with more control over their IP.
Why it works: a generic model is a commodity anyone can serve. A model tuned on your data, running in production, is something you don't move on a whim.
Run it:
  1. Make fine-tuning and serving one workflow
  2. Measure quality on the customer's own tasks
  3. Price so the tuned model is cheaper than the closed one
MEASURE
share of revenue from customized models
AVOID
racing on the price of off-the-shelf models
PLAY 02 · FIREWORKS · TOGETHER AI
16 mo
from $100M to $1B+ in annualized revenue
Grow with the customers who are growing fastest
Cursor and Harvey build on Fireworks; Together AI counts Cursor, Cognition, Decagon, ElevenLabs and Suno as customers. Bessemer says Fireworks went from $100 million to more than $1 billion in annualized revenue in 16 months.
Why it works: infrastructure revenue grows with the customer's usage. Land the fastest-growing AI apps early, and their growth becomes yours without a new sale.
Run it:
  1. Find apps where inference is the main cost
  2. Win them with speed and engineering help
  3. Grow capacity ahead of their launches
MEASURE
net revenue retention in the top 20 accounts
AVOID
concentration — one customer leaving can sink a quarter
PLAY 03 · OPENROUTER
400+
models behind one OpenRouter API
Be the neutral switch between everyone else
OpenRouter gives developers one API to more than 400 models and claims 8 million users. It routes 25 trillion tokens a week, five times more than six months earlier, and Sacra estimates it takes roughly a 5% markup on inference spend. Its pitch is neutrality: it doesn't push its own models.
Why it works: when buyers refuse to bet on a single model maker, the company that lets them avoid choosing becomes the default — and sees demand across every provider.
Run it:
  1. Make switching models a one-line change
  2. Publish usage rankings developers trust
  3. Stay neutral, even toward investors
MEASURE
share of traffic that changes models each month
AVOID
a big supplier going direct and undercutting you
PLAY 04 · FIREWORKS AI
Microsoft
customers can reach Fireworks' models
Get distributed by a giant
In March 2026, Fireworks partnered with Microsoft so Microsoft's customers can access models through Fireworks' platform, which draws on compute from more than 20 suppliers.
Why it works: enterprises buy through the clouds they already have contracts with. Being inside that catalog removes procurement, the slowest step in the sale.
Run it:
  1. Pick one cloud marketplace and go deep
  2. Make billing count toward existing cloud commitments
  3. Co-sell with their field team
MEASURE
revenue that arrives through the partner
AVOID
a partner that learns from you and builds the same thing
PLAY 05 · KEENABLE
100K
free requests before anyone has to pay
Let agents find, try and buy you on their own
Keenable launched in August with something no search incumbent offers: a storefront written for agents. Its llms.txt page lists prices and payment steps so an agent can sign itself up, with or without a human approving. Developers get an MCP endpoint and 100,000 free requests to start.
Why it works: the next wave of customers won't fill in a sign-up form. A company that agents can discover, test and pay for on their own becomes the default before competitors even get a sales call.
Run it:
  1. Publish pricing and limits in a format agents read
  2. Give a free allowance big enough for a real test
  3. Turn usage into a paid plan automatically
MEASURE
share of new accounts created by agents, not people
AVOID
a self-serve path that dead-ends in a sales form
PLAY 06 · TOGETHER AI
6–60×
savings Together AI says customers see vs closed models
Make the cost difference impossible to ignore
Together AI says customers save between 6× and 60× by running open models on its platform instead of proprietary ones, and that open-model usage across the industry tripled in twelve months.
Why it works: finance teams are now in the AI decision. A savings number they can verify on their own bill opens the door, and the default follows the budget.
Run it:
  1. Benchmark on the customer's own workload
  2. Show the savings on their invoice, not a slide
  3. Offer reserved capacity once they switch
MEASURE
share of deals won on a cost comparison
AVOID
customers who leave as soon as a cheaper option appears
A 90-day plan to become one account's default
Wk 0Wk 1Wk 4Wk 8Wk 12 Find where requests flowShip the default integrationRun side by side, show the billSpecialize on their dataCommit capacity, add workload into quarter 2
MY VIEW

The plays split into two families. Fireworks and Together win by being where the customer's model runs; OpenRouter and Keenable win by being where the request passes through. The second family needs far less capital and gets a view across the whole market — which is why I think the gateways are the better product businesses, even if the clouds have the bigger revenue today.

If I had one quarter, I'd run play 5 first. Keenable's agent storefront is the most forward-looking go-to-market move in this whole group: it treats the agent as the customer, which is where the volume is heading.

04 · WHAT PROTECTS THEM

Investors are paying most for the companies that own the routing, not the GPUs

Valuation divided by revenue tells you what the market believes about each moat. The ranking is the opposite of what you'd expect from size.

OpenRouter26×$1.3B on ~$50M est. revenue
Baseten22×$13B on ~$600M est. revenue
Fireworks AI17.5×$17.5B on $1B+ run-rate
Together AI7×$8.3B on $1.15B bookings
Revenue figures for OpenRouter and Baseten are outside estimates (Sacra, ai2.work); Together's uses bookings. Keenable is pre-scale and not shown.
Fireworks AIWHAT IT OWNSSpecialized models running in production at Uber, Shopify, Cursor and HarveyWHAT COULD BREAK ITCustomers taking tuned open models in-house once their teams mature
BasetenWHAT IT OWNSEngineers who work directly with customers on model performance, paired with managed inferenceWHAT COULD BREAK ITA >20× multiple that assumes services-heavy revenue keeps scaling
Together AIWHAT IT OWNSIts own data centers and a broad open-model catalogWHAT COULD BREAK ITThin margins — Sacra estimates gross margin around 45% — while it builds capacity
OpenRouterWHAT IT OWNSNeutral position and a view of demand across 400+ modelsWHAT COULD BREAK ITSuppliers going direct, and keeping neutrality with Alphabet's fund as lead investor
KeenableWHAT IT OWNSIts own 100B+ document index built for agents, sub-250ms search, and point-in-time search no rival offersWHAT COULD BREAK ITProving at scale that a lean, expert team can win the default against bigger-budget search APIs
MY VIEW

The pattern I see: the more a company owns the decision of where a request goes — rather than the hardware that serves it — the higher the multiple. OpenRouter is the extreme case: a small revenue base priced like a platform, because it sees every model's demand at once.

For the GPU-heavy clouds, the defensible asset is the specialized model running in production. That's why Fireworks leads with “specialized intelligence” rather than speed or price.

RISING STARKEENABLE · LAUNCHED AUGUST 2026

Keenable is building the search default for agents

Keenable came out of stealth in August with its own crawler, index and ranking — not a wrapper around someone else's search. The timing is sharp: the big search engines have been narrowing third-party access just as agents need the live web more than ever. Its founders know this territory: CEO Andrey Styskin ran search and ads at Yandex and web infrastructure at Amazon AGI, and chief scientist Matthias Petri built Alexa's web grounding. The company says it already has signed contracts with several AI labs.

100B+
documents in its own web index
<250ms
p95 latency for search
$1 / 1K
requests at frontier-lab scale
$26M
seed led by Accel, with Conviction
Four products on one index
Search API
Search and page fetch built for agents, with an MCP endpoint and agent-native pricing.
Time Machine
Search the web as it looked on any past date — corpus and ranking rewind together.
SELECT
Turns thousands of web pages into a table of values, with a source on every row.
NEEDLE
An open benchmark comparing search providers on quality per dollar.
MY VIEW

What I like most is that Keenable picked a layer where the default isn't settled yet, and showed up with real infrastructure instead of a thin API. A team that has built web-scale search before, an index it owns, and products like Time Machine that nobody else offers — that's a strong hand for a seed-stage company.

The work ahead is distribution: turning lab contracts and a clever agent storefront into the search agents use by default. The playbook above shows what that looks like.

05 · WHAT SHIPS NEXT

Product roadmap predictions

OpenRouter
BY MID 2027
Enterprise cost controls — budgets, policies and automatic routing to the cheapest model that passes a quality bar
Grounded in: Agent token bills are exploding; Uber's CTO said it used its whole 2026 AI budget within months
70%
Together AI
BY 2027
Long-term capacity contracts on its own data centers become its main enterprise offer
Grounded in: It plans to grow its infrastructure footprint roughly 50-fold over five years
65%
Fireworks AI
BY MID 2027
A managed, continuous fine-tuning product sold as its flagship enterprise offer
Grounded in: 95% of its tokens already come from specialized models
60%
Baseten
BY END 2026
Web search becomes a native part of its inference, most likely through a partner such as Keenable
Grounded in: Agents built on its platform need live web access, and partnering is faster than building an index
60%
Keenable
BY 2027
Time Machine becomes a paid standard for labs testing and training models on a frozen web
Grounded in: It is the only provider built to rewind both the web and its ranking to a past date
55%
Keenable
BY END 2026
Its search becomes a built-in default inside at least one agent framework or inference platform
Grounded in: Its MCP endpoint and agent storefront make one-line integrations easy
60%
A hyperscaler or chip maker
BY 2027–28
Buys one of the inference clouds
Grounded in: Clouds and chip makers already partner with, and invest in, all three
40%
Odds are my own estimates, sorted from most to least likely.
In infrastructure for agents, the cheapest provider wins the comparison. The default wins the year.
← Back to all notes