Linux Foundation launches Tokenomics Foundation to standardize AI infrastructure spending

Source Domain: www.sdxcentral.com

,The Linux Foundation has unveiled plans to launch a new foundation centered around open industry standards, benchmarks, and best practices for ‘tokenomics’ – the economics of AI infrastructure.

The aptly named Tokenomics Foundation will intersect both the buyer and supplier sides, working to create frameworks around token-based spending models. The likes of Google Cloud, Oracle, Microsoft, and Salesforce are among those to have expressed initial support, with it set to work closely with the FinOps Foundation, another Linux effort, to bring the practice of managing variable tech costs to token-driven AI.

“As enterprises move generative and agentic AI workloads from pilot to production, tokens have become the new unit of technology spend,” said Jim Zemlin, CEO of the Linux Foundation.

“Measuring and benchmarking token efficiency across different models and vendors is critical to how organizations make business decisions, but until now, there was no neutral home to develop the standards needed to measure token economics transparently across the entire supply chain. The Tokenomics Foundation provides that neutral home, ensuring these standards remain open and community-driven.”

For those unaware, tokens are fundamentally the building blocks of text used as input when using Large Language Models (LLMs). The underlying models used for platforms like Claude or ChatGPT break text down into chunks – tokens. There’s no preset definition as to how many words or letters constitute a token, but the general line of thinking is that one token equates to around four to five characters on average.

With the inherent complexity of the prompts required for use in actual enterprise use cases, like inputting reports or sales data, for example, those token numbers quickly add up.

Enterprises like Disney and Visa have admitted their engineers have been raking up token amounts in the tens of thousands, while the AI-obsessed firms have been encouraging staff to use the…

Source