OpenAI’s Jalapeño chip is Big Tech’s spiciest move away from Nvidia
What's happening
OpenAI announced a custom inference processor called Jalapeño, designed with Broadcom to power current and future large language models. The chip is an ASIC built specifically for LLM inference, and OpenAI says early testing shows the first-generation accelerator will deliver performance per watt substantially better than current state-of-the-art. OpenAI and Broadcom developed the design to production in nine months and positioned Jalapeño as part of a broader move by big tech to reduce dependence on Nvidia.
Why it's trending
Because companies are racing to cut Nvidia single-supplier risk and improve inference efficiency as LLM demand soars.
SignalHolding at its usual pace, confirmed across 3 independent source types.
Momentum
Score per dayStory volume
Stories per dayAngles you could write
If you think Nvidia will stay unchallenged, OpenAI and Broadcom just proved you wrong, meet Jalapeño, a custom inference ASIC built in nine months to beat state-of-the-art performance per watt.
+2 more angles for this topic with an account — all it takes is your email.
Original sources8
- Why everyone from OpenAI to SpaceX is building their own chips (and turning up the heat on Nvidia)
Nvidia has dominated the AI chip market for years, but the era of total dependence might be ending. OpenAI just shared its plans to spice things up with Jalapeño, its custom inference chip built with Broadcom, joining Google, Apple, and SpaceX in a growing list of companies building their way out of single-supplier risk. The goal is less of a […]
TechCrunch AIJun 26 - OpenAI Unveils Custom Chip It Designed With Broadcom to Boost Its AI Infrastructure
OpenAI's engineers designed the chip, called Jalapeño, together with Broadcom to perform a specific AI task known as inference, during which data is crunched in order to answer a user's query to a chatbot like ChatGPT.
r/artificialJun 24 - OpenAI and Broadcom unveil LLM-optimized inference chipHackerNewsJun 24
+5 more sources for this topic
Create an account to follow the full coverage in the live radar.
More rising in AI & Tech
- 'AI runs on semiconductors': Why chips have become the world's most valuable technologyClimbing2.4Climbing2.4 momentum
- AI leaders sign statement asking the government to do something about automated AIClimbing1.9Climbing1.9 momentum
- Google just had its first negative cash flow quarter due to massive AI spendingClimbing2.8Climbing2.8 momentum
- How AI guardrails are impeding the work of offensive cybersecurity researchersSteady0.8Steady0.8 momentum
- Korean chip stocks tumble with SK Hynix below US listing price amid China competition fearsClimbing1.9Climbing1.9 momentum
- AMD vs. Nvidia: What AMD’s Major $5 Billion AI-Chip Deal With Anthropic Means for InvestorsSteady0.5Steady0.5 momentum