AI costs

Palantir CEO Alex Karp criticizes the “token model” used by AI labs like OpenAI and Anthropic, deeming it unsustainable and inefficient for businesses due to escalating operational costs. He advocates for open-weight models and proprietary AI development for greater control and ROI. Karp also expresses concern over China’s rapid AI advancements. Palantir’s partnership with Nvidia to develop custom AI for U.S. agencies highlights this strategic shift.

AI spending is increasing as companies race to integrate AI. This has led to surging costs, with some reporting astronomical bills. In response, some companies are shifting to more cost-effective alternatives, while others are implementing spending caps. OpenAI and Anthropic, the leading AI model developers, are reportedly preparing for IPOs amidst growing demand for ROI and competition from giants like Microsoft, Amazon, and Google, who are developing their own more affordable AI models.

Engram has secured $98 million to revolutionize enterprise AI. The startup’s technology acts as “learned memory” for AI models, enabling them to retain and recall organizational workflows and context. This significantly reduces AI operational costs, allowing Engram’s models to achieve comparable or superior performance to leading AI models using far fewer tokens. The funding will fuel compute resources and talent acquisition, addressing the growing concern over expensive AI.

Corporate America is shifting towards fiscal prudence in AI spending. CFOs and boards are scrutinizing escalating costs, leading to a move away from using top-tier AI for all tasks. Model routing, which matches tasks to appropriate AI models, is emerging as a cost-saving solution, directing simpler jobs to more economical alternatives. This strategy aims to optimize AI expenditure and demonstrate tangible ROI, potentially reshaping the AI market and influencing vendor pricing power.

AI’s rapid expansion presents CFOs with a budget dilemma: AI tokens or human talent. Escalating per-token costs are depleting annual AI budgets within months, forcing a choice between technology and personnel. Companies are re-evaluating the need for premium AI models for all tasks, as ROI currently lags behind expenditure. Optimizing model selection and routing less complex tasks to cheaper alternatives could significantly reduce costs. The market may underestimate AI’s price sensitivity.

The escalating costs of AI are impacting corporate profits, challenging the high IPO valuations of OpenAI and Anthropic. Cheaper, efficient AI solutions from Chinese and Western competitors are emerging, undermining the assumption of market dominance and premium pricing. Enterprise AI spending is surging, but cost-saving strategies like the “advisor model” are becoming prevalent, potentially limiting growth for premium AI services and impacting future valuations.