OpenAI and Broadcom unveil LLM-optimized inference chip

Openai··Submitted by Mads Kristian Nylund
Open Source AIAI InfrastructureAI Platforms

Jalapeño is an LLM-optimized inference chip developed by OpenAI and Broadcom, designed to enhance AI performance per watt and support large-scale deployment in data centers. It is built with OpenAI’s deep understanding of LLM fundamentals, leveraging nine months of accelerated development and combining compute, memory, and networking optimization to approach theoretical peak performance. The chip expands OpenAI’s full-stack platform, aiming to make AI faster, more reliable, and affordable, while enabling interactive LLM products at scale.

Read Article

More from Openai

Related Articles