1d:I[70616,["/_next/static/chunks/0kcf5dt6yxdox.js","/_next/static/chunks/1su5n1uv1ti4s.js","/_next/static/chunks/0gvke1wv6udfg.js","/_next/static/chunks/1dfrle3jgmlzh.js","/_next/static/chunks/162lgvduyr-fa.js","/_next/static/chunks/2gcnnopam8e9w.js","/_next/static/chunks/2g60iab5a1pkg.js"],"Breadcrumb"] 1e:I[90762,["/_next/static/chunks/0kcf5dt6yxdox.js","/_next/static/chunks/1su5n1uv1ti4s.js","/_next/static/chunks/0gvke1wv6udfg.js","/_next/static/chunks/1dfrle3jgmlzh.js","/_next/static/chunks/162lgvduyr-fa.js","/_next/static/chunks/2gcnnopam8e9w.js","/_next/static/chunks/2g60iab5a1pkg.js"],"ArticleGrid"] 1f:T1d30,

Two numbers from Vercel's September AI Gateway Production Index only make sense together. In August, open-weight models processed 56% of every token routed through the gateway — the first month they held a majority. They accounted for 14% of what teams paid.

That gap is the whole story of enterprise inference right now. Volume has migrated to models teams can run cheaply; money has not followed it. Nine months ago open weights handled fewer than one token in ten. They have gained share every month since April, climbing from 13% to 56%, and the frontier labs have lost almost none of the revenue.

Key takeaways

Open-weight models ran 56% of August gateway tokens but drew only 14% of spend, after sitting at 7% of volume in December 2025.
Average price per token fell 23.2% in August, a third consecutive monthly decline, with the median high-volume team paying 7.6% less.
Anthropic kept 64 cents of every dollar spent on the gateway even as its flagship Fable 5 lost two-thirds of its spend share to the cheaper Opus 5.

What cheaper tokens are actually buying

The price collapse is the clearest signal in the report. Average cost per token dropped 23.2% during August — the third straight monthly decline and the sharpest since April. Among teams that pushed more than ten million tokens in both July and August, the median one paid 7.6% less per token, compared with a 2.9% decline the month before. The rate of decline itself is accelerating.

Vercel's reading is that capability has finally caught up at the cheap end, so routine production work no longer justifies frontier pricing. Teams get more inference from a fixed budget and reserve the expensive tier for the jobs that repay it. That is a structural change in how budgets are allocated, not a temporary discount.

Why losing its flagship cost Anthropic nothing

Fable is the most capable model Anthropic sells; Opus sits one tier below at roughly half the price. When the US export control on Fable 5 was lifted and access resumed on July 1, its share of gateway spend jumped to 13.2%. Opus 5 arrived at the end of that same month, and by August Fable 5 was down to 4.9% while Opus 5 had climbed to 22.5%.

Nine in ten teams running Fable cut back, and more of them landed on Opus 5 than on anything else. The verdict was about value, not quality — double the price did not buy a proportional result on the workloads these teams were running. Crucially, the traffic stepped down a tier rather than crossing to a competitor. Anthropic has taken at least 61 cents of every gateway dollar every month since December, 64 cents of it in August, and has held the top two spots by spend throughout that stretch even as the models occupying them changed.

Google's Gemini 3 Flash lost 95% of its volume

The counterexample is severe. Gemini 3 Flash has shed 95% of its share of gateway tokens since May, and more than three-quarters of the volume it lost went to other labs entirely — Google's own full-size Flash successors recovered under a tenth of it.

Where it went is instructive. Roughly half moved to cheaper options, led by GPT-5.6 Luna at less than half the price per token. Most of the rest went the other direction, to Claude Opus 5 and Sonnet 5 at roughly nine and three times Gemini 3 Flash's price. Teams were not chasing a price point; they were chasing fit, and they were willing to move in either direction to find it. Google's overall share of gateway token volume fell from 30% to 5% over the period, with Gemini 3 Flash alone responsible for 22 of the 25 points lost.

The same pattern shows up on the way up. Within five days of Z.ai shipping GLM-5.3-Flash, it was running three times GLM-5.2's daily volume, and by August 31 it carried two-thirds of Z.ai's tokens. Continuity of model profile, not brand loyalty, is what keeps traffic in place — a dynamic also visible in how quickly routing layers have reorganized around Chinese open-weight releases.

Astra outspent Fable 5.1 two to one at the top

The report's special section covers the premium tier, where two flagships launched two days apart at the same price. Anthropic shipped Fable 5.1 on September 1; OpenAI put GPT-6 Astra on the gateway on September 3 at two and a half times the price of GPT-5.6 Sol.

Astra took one in every three dollars spent on OpenAI models within two days, and its share has stayed between 28% and 39% since. Measured over each model's first twelve days, Astra collected 7.7% of all gateway spend against Fable 5.1's 3.7%, and was used by twice as many teams. Inside OpenAI's own lineup the split is stark: Astra and Sol handled 27% of tokens but 71% of spending from September 4 to 16, while Luna and Nano moved more than twice the tokens for about a ninth of the cost.

Elsewhere in the data, Google's Nano Banana led image spend for the first time at 50% against GPT Image's 44%, even though GPT Image generated more images, 46% to 39%. Veo rose to second in video spend at 20%, up from 15% in July, behind Seedance. The share of videos generated by xAI's Grok Imagine has more than halved since June, sliding from 42% to 31% to 19%.

How much weight the figures carry

These are anonymized aggregates from traffic that Vercel routes, not an industry census, and the caveats matter. Spend is estimated from labs' published list prices, so negotiated enterprise rates are invisible. Token counts include reasoning and cached-input tokens. The open-weight classification is broader than in earlier editions of the report, which inflates comparisons against the oldest figures. Prior months get revised as methodology changes.

Even discounted, the direction holds. If open weights carry the majority of production volume while frontier models keep the majority of revenue, the two markets have split: one competing on price for routine work, the other on capability for the minority of tasks that justify it. Next month's index will show whether Astra's early lead over Fable 5.1 was a launch effect or a durable position.

FAQ

What is the AI Gateway Production Index?

It is a monthly report from Vercel based on anonymized, aggregate traffic routed through its AI Gateway, which sits between production applications and AI labs. The September 2026 edition covers data collected through August 2026, with the special report on GPT-6 Astra extending into mid-September.

Do open-weight models now dominate AI spending?

No. They ran 56% of gateway tokens in August but accounted for just 14% of spend. Frontier closed-weight models still take the large majority of the money because they cost far more per token and handle the workloads teams are willing to pay a premium for.

Why did Anthropic keep its revenue share after Fable 5 declined?

Because the workloads moved down a tier rather than to another lab. Fable 5 fell from 13.2% to 4.9% of gateway spend in August while Opus 5, priced at roughly half, rose to 22.5%. Anthropic ended the month with 64% of all gateway spend.

a:["$","div",null,{"className":"mx-auto max-w-7xl px-4 py-8 sm:px-6","children":[["$","script",null,{"type":"application/ld+json","dangerouslySetInnerHTML":{"__html":"{\"@context\":\"https://schema.org\",\"@type\":\"BreadcrumbList\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https://ainewsway.com\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"#inference-costs\",\"item\":\"https://ainewsway.com/tag/inference-costs\"}]}"}}],["$","script",null,{"type":"application/ld+json","dangerouslySetInnerHTML":{"__html":"{\"@context\":\"https://schema.org\",\"@type\":\"ItemList\",\"@id\":\"https://ainewsway.com/tag/inference-costs#itemlist\",\"name\":\"#inference-costs Articles\",\"numberOfItems\":1,\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"url\":\"https://ainewsway.com/articles/open-weight-models-now-run-most-of-vercels-traffic-and-barely-move-its-bill-mu69fwdx\",\"name\":\"Open-Weight Models Now Run Most of Vercel's Traffic — and Barely Move Its Bill\"}]}"}}],["$","$L1d",null,{"items":[{"label":"# inference-costs"}]}],["$","h1",null,{"className":"mb-8 text-3xl font-bold text-zinc-900 dark:text-zinc-100","children":["#","inference-costs"]}],[["$","$L1e",null,{"articles":[{"id":"da8b76db-7af4-4541-9caa-7abf1d4cb0aa","slug":"open-weight-models-now-run-most-of-vercels-traffic-and-barely-move-its-bill-mu69fwdx","title":"Open-Weight Models Now Run Most of Vercel's Traffic — and Barely Move Its Bill","subtitle":"September's AI Gateway Production Index shows a 56% volume majority worth 14% of spend, while Anthropic holds 64 cents of every dollar","content":"$1f","excerpt":"Two numbers from Vercel's September AI Gateway Production Index only make sense together. In August, open-weight models processed 56% of every token routed thro...","coverImage":"https://cdn.ainewsway.com/uploads/2026/09/4cd39c14-695f-466e-b98b-1a92cbbd0d0e.webp","coverImageCaption":"Open-weight models crossed a majority of production inference traffic on Vercel's AI Gateway for the first time in August 2026.","authorId":"6773f67d-d7fa-4b19-8f38-384f10ac761b","status":"PUBLISHED","publishedAt":"2026-09-18T01:09:27.141Z","viewCount":0,"likeCount":0,"readingTime":6,"isFeatured":false,"isBreakingNews":false,"metaTitle":"Open-Weight Models Cross 56% of Vercel Gateway Tokens","metaDescription":"Vercel's September index: open-weight models ran 56% of August gateway tokens but 14% of spend, as per-token prices fell 23.2% for a third month.","metaKeywords":["open-weight models","Vercel AI Gateway","AI Gateway Production Index","inference costs","Claude Opus 5","GPT-6 Astra","Gemini 3 Flash","token pricing"],"ogImage":null,"aiSummary":"Vercel's September 2026 AI Gateway Production Index reports that open-weight models processed 56% of all gateway tokens in August, their first majority, while accounting for only 14% of spend. Average price per token fell 23.2%, a third straight decline. Anthropic retained 64% of gateway spend as traffic shifted from Fable 5 to the cheaper Opus 5, and Gemini 3 Flash lost 95% of its token share since May.","aiTags":[],"sentiment":null,"articleType":"ANALYSIS","videoEmbed":null,"videoType":null,"seoScore":85,"isAutoGenerated":true,"isBackfill":false,"pipelineStage":null,"copyrightScore":null,"similarityScore":null,"matchedSourceId":null,"createdAt":"2026-09-18T01:08:55.606Z","updatedAt":"2026-09-18T03:11:46.133Z","contentUpdatedAt":"2026-09-18T03:11:46.132Z","deletedAt":null,"author":{"id":"6773f67d-d7fa-4b19-8f38-384f10ac761b","name":"Seung Jung","username":"Seung Jung","avatar":null},"categories":[{"id":"8126f4b3-ce4a-464f-bc70-7c3c39d5540b","name":"Tech & Business","slug":"tech-business"}],"tags":[{"id":"8f53dcab-42a9-4682-919c-83b14fb9aa5a","name":"Open-Weight Models","slug":"open-weight-models"},{"id":"c16baead-a8cc-4e3e-8cbc-ac5240e5775e","name":"Vercel","slug":"vercel"},{"id":"e9d9ed20-6211-4e4c-a2af-eb3c5eced7c7","name":"AI Infrastructure","slug":"ai-infrastructure"},{"id":"eaa81767-e9c5-4dbe-a19d-ecc77b21e3ac","name":"Inference Costs","slug":"inference-costs"},{"id":"e7379407-151f-4d29-9e48-c8358175275e","name":"Model Pricing","slug":"model-pricing"}],"translations":[{"id":"d0c9962a-5773-43ed-9e7e-2a54be6a7795","language":"es","title":"Los modelos de pesos abiertos ya mueven la mayoría del tráfico de Vercel, y casi no tocan la factura","subtitle":"El índice de producción del AI Gateway de septiembre muestra una mayoría del 56% del volumen que equivale al 14% del gasto, mientras Anthropic retiene 64 centavos de cada dólar","excerpt":"Dos cifras del índice de producción del AI Gateway de Vercel de septiembre solo cobran sentido juntas. En agosto, los modelos de pesos abiertos procesaron el 56% de los tokens.","metaTitle":"Pesos abiertos superan el 56% de los tokens de Vercel","metaDescription":"Índice de septiembre de Vercel: los modelos de pesos abiertos movieron el 56% de los tokens de agosto pero el 14% del gasto, con precios por token 23,2% más bajos."},{"id":"66d98d84-76c0-4983-a45e-7c3483d05683","language":"ja","title":"オープンウェイトモデルがVercelのトラフィック過半に、それでも請求額はほぼ動かず","subtitle":"9月のAI Gateway Production Indexでは、トークンの56%が支出の14%にとどまり、Anthropicが1ドルあたり64セントを確保","excerpt":"VercelのAI Gateway Production Index 9月版の二つの数字は、並べて初めて意味が通ります。8月、オープンウェイトモデルがゲートウェイのトークンの56%を処理しました。","metaTitle":"オープンウェイト、Vercelゲートウェイの56%を処理","metaDescription":"Vercelの9月版指数では、オープンウェイトモデルが8月のトークンの56%を処理しながら支出は14%。トークン単価は3カ月連続で下がり23.2%減となりました。"},{"id":"35063fc5-d791-443f-a90c-b8f3d7b2e719","language":"ko","title":"오픈웨이트 모델이 Vercel 트래픽 절반을 넘겼다, 그런데 비용은 그대로다","subtitle":"9월 AI Gateway Production Index에서 토큰 56%가 지출의 14%에 그쳤고, Anthropic은 1달러당 64센트를 챙겼다","excerpt":"Vercel의 9월 AI Gateway Production Index에서 나온 두 숫자는 나란히 놓아야 뜻이 통한다. 8월 게이트웨이를 지난 토큰의 56%를 오픈웨이트 모델이 처리했다.","metaTitle":"오픈웨이트 모델, Vercel 게이트웨이 토큰의 56% 차지","metaDescription":"Vercel 9월 지수에서 오픈웨이트 모델이 8월 게이트웨이 토큰의 56%를 처리하고도 지출은 14%에 그쳤다. 토큰당 단가는 석 달 연속 떨어져 23.2% 하락했다."},{"id":"eded8e13-b2b4-4f2c-9c83-321a9c54bf7e","language":"zh","title":"開放權重模型拿下 Vercel 逾半流量，帳單卻幾乎沒動","subtitle":"9 月 AI Gateway Production Index 顯示，56% 的 token 只換來 14% 支出，Anthropic 仍握有每一美元中的 64 美分","excerpt":"Vercel 9 月 AI Gateway Production Index 的兩個數字，要放在一起看才說得通：8 月經過閘道的 token 有 56% 由開放權重模型處理。","metaTitle":"開放權重模型突破 Vercel 閘道 56% token","metaDescription":"Vercel 9 月指數：開放權重模型處理 8 月閘道 56% 的 token，支出卻只占 14%；每 token 單價連三個月下滑，8 月跌 23.2%。"}],"celebrities":[{"id":"9724a300-6f50-4a1f-8e3a-7520410887f8","nameKo":"버셀","nameEn":"Vercel","slug":"vercel","profileImage":"https://ui-avatars.com/api/?name=Vercel&size=400&background=000000&color=fff&bold=true"},{"id":"0632936d-a299-490f-b5e5-dfa87ba3eaa0","nameKo":"Anthropic","nameEn":"Anthropic","slug":"anthropic","profileImage":"https://ui-avatars.com/api/?name=Anthropic&size=400&background=84CC16&color=fff&bold=true"},{"id":"b086135e-3126-46cd-b591-67f073dff1bb","nameKo":"OpenAI","nameEn":"OpenAI","slug":"openai","profileImage":"https://ui-avatars.com/api/?name=OpenAI&size=400&background=F97316&color=fff&bold=true"},{"id":"5c572908-2f5b-47b3-95e2-13ed3e298bf7","nameKo":"구글","nameEn":"Google","slug":"google","profileImage":null}]}]}],"$L20"]]}]

#inference-costs

오픈웨이트 모델이 Vercel 트래픽 절반을 넘겼다, 그런데 비용은 그대로다

뉴스레터 구독

#inference-costs

오픈웨이트 모델이 Vercel 트래픽 절반을 넘겼다, 그런데 비용은 그대로다