中文翻译

摘要: Skip to content

AI in Action

The math behind the OpenAI Jalapeño chip

Dashveenjit Kaur

June 25, 2026

Share this story:

AI infrastructure costs

ASIC chip design

Broadcom AI chip

LLM inf...

正文

Skip to content

AI in Action

The math behind the OpenAI Jalapeño chip

Dashveenjit Kaur

June 25, 2026

Share this story:

AI infrastructure costs

ASIC chip design

Broadcom AI chip

LLM inference hardware

Nvidia tax

OpenAI custom silicon

OpenAI Jalapeño chip

Categories:

AI Business Strategy

AI Hardware & Chips

AI in Action

Artificial Intelligence

Infrastructure & Hardware

Inside AI

Manufacturing & Engineering AI

OpenAI’s financial trajectory hinges heavily on infrastructure costs, a reality that drove the development of the new custom OpenAI Jalapeño chip. Developed in collaboration with Broadcom, the application-specific integrated circuit (ASIC) represents a direct attempt to mitigate the heavy capital expenditure associated with third-party hardware.

While Nvidia currently commands an estimated 75% profit margin on its high-end processors, OpenAI operates on tighter margins, keeping roughly 33 cents of profit on each dollar generated after accounting for its massive operational expenses. The financial burden of running large language models at scale is severe.

Last year, keeping ChatGPT servers responsive had cost OpenAI a staggering US$8.4 billion. With the platform now attracting 900 million weekly users, that operational cost is projected to reach approximately US$14 billion this year. Over the next eight years, OpenAI has committed roughly US$1.4 trillion to computing power, a massive bet for a company currently generating US$25 billion in annual revenue.

Designing Hardware for LLM Inference

The OpenAI Jalapeño chip, dubbed as the company’s first “Intelligence Processor”, is built specifically for large language model (LLM) inference rather than general-purpose AI workloads. OpenAI provided the core architectural design based on its specific model roadmaps and serving systems, while Broadcom managed the silicon engineering and high-performance networking integration.

TSMC handles the physical manufacturing in Taiwan, and Celestica

来源: Brave/artificialintelligence-news.com

采集时间: 2026-06-26 20:17:03