From Citadel, October 28:
Consumption weighted token prices have declined approximately 50% over six months and average token prices have declined 62% at the frontier, reflecting both the growing share of cheaper open-weight models and price cuts by proprietary providers, likely driven by some combination of improved inference efficiency and competitive pressure. Increased competition from open-weight models may exert pressure on margins at the frontier through time, but the expansion of token volume suggests overall inference demand is accelerating.Token Prices Have Declined SignificantlyToken Expenditure Index, Level and 21d Log Growth Rate
Source: Bloomberg, Silicon Data, Ornn, Citadel Securities, data as of Oct 2026. Figures are for illustrative purposes only. Past performance does not guarantee future returns.Open-weight models now account for around 65-70% of smart routing token volume, potentially putting pressure on excess rents at the frontier as cheaper models become “good enough” for a growing range of enterprise tasks, especially given US-developed open-weight models offer greater flexibility around customisation, hosting and data control. Caution is warranted in extrapolating from OpenRouter and Vercel data, since users who self-select into model-routing platforms may be more willing to experiment with and switch between models, exhibiting less inertia than the broader AI customer base; however the direction of travel is nevertheless informative, especially as we expect adoption to become increasingly cost-conscious through time.
Open Weight Volumes Are Becoming Dominant on Smart Routers
Open Weight Volume and Total Spend, Percentages of Total AI Gateway Volume (Vercel)The recent stall in total expenditure in Ramp’s monthly spend data provides some further grounds for caution, as it shows essentially no growth in overall enterprise spend in the last two months (Aug and Sept), likely reflecting the interaction of lower token prices with increased volume. The data also implies that 80% of spend on frontier labs is driven by 1% of firms, and that the top 1% spent $9,568 per employee per month in Sept vs the median firm that spent $15.7 per employee per month, illustrating how concentrated spending remains. The recent plateau may prove important as total expenditure determines the revenues available to remunerate the AI investment cycle, and it appears that some combination of lower prices and increased competition from open-source may be causing total spend to flatline. The upcoming October release will be important as more timely token volume data from October imply a further acceleration of inference demand, but the implications for total spend remain unclear given shifts in token prices and composition of spend....
Source: Vercel, Citadel Securities, data as of Oct 2026. Figures are for illustrative purposes only. Past performance does not guarantee future returns.
....MUCH MORE
This was the point of October 25's link and one-line introduction:
"IBM CEO says open weight models are now irresistibly good and cheap on-prem"
Anthropic and OpenAI have to get the cost of their offerings down to compete with the Chinese, and if they do that their hopes of GAAP profitability recede toward the horizon....
None of the concerns are new, I'm guessing Jensen Huang woke up in a cold sweat one night three or four years ago, thought it through, adjusted Nvidia's plan and went back to bed.
Fortunately there is a lot more to AI than chatbots and OpenAI and all the rest of the retail consumer-facing stuff.


