OpenAI VP details Jalapeño ASIC’s AI-assisted design and efficiency focus
OpenAI’s VP of Hardware, Richard Ho, discussed the company’s custom Jalapeño inference ASIC in an interview with Tom’s Hardware, emphasizing efficiency and AI-driven design. The chip, revealed at Hot Chips 2026, cuts design timelines to nine months from scratch—half the industry standard—thanks to AI tools like Codex and GPT-6 Astra optimizing microarchitecture and compiler work. Ho clarified…
Key points
- Jalapeño’s design took **nine months** from scratch, aided by AI tools like Codex and GPT-6 Astra, cutting industry timelines in half
- OpenAI prioritizes internal compute needs but could license Jalapeño’s design flow to the industry, per Ho’s comments
- Pairing Jalapeño with Nvidia’s Turing (not Vera) balances speed and risk; speculative decode is implemented but unbenchmarked
Ho also addressed supply constraints, noting OpenAI secured early commitments for wafers and memory. The chip pairs with Nvidia’s Turing (not Vera) for pragmatic de-risking. Future iterations depend on tech readiness (e.g., HBM generations, optical links). Jalapeño’s speculative decode is implemented but unbenchmarked; multi-token prediction could boost performance 3–5x. Rollout begins in 2027, with Jalapeño Gen 2 in development but no fixed cadence—tape-outs will target step-function improvements, not calendar schedules.
Model page: GPT-6 Astra →
The story so far
2 episodes →- OpenAI VP details Jalapeño ASIC’s AI-assisted design and efficiency focusthis story
OpenAI Jalapeño design interview transcript
Tom's Hardware · 28 September 2026
Loading the full article…
This text was published by Tom's Hardware and written by Jake Roach. It is reproduced here with attribution so you can read it in full; the rights remain with the publisher. Read it at the source ↗
Coverage and discussion
4sources- ‘This is how AI should be used’ — OpenAI head of hardware breaks down the AI-assisted design of its Jalapeño ASICPress · Tom's Hardware ·
- Silicon is starting to design silicon — how AI is being used in chipmaking, from EDA tools to OpenAI's Jalapeño and beyondPress · Tom's Hardware ·
- OpenAI's custom Jalapeno AI inference ASIC is for OpenAI’s internal use, but company leaves the door open to broader rolloutPress · Tom's Hardware ·
The headline, key points and digest above were generated by Digest AI's editorial model from the linked sources. Automated summaries can contain errors: the sources are the record. Spotted a mistake? Tell us. Published by Martin K., who runs Digest AI and handles corrections.
More in Hardware & Compute
All →- Micron’s AI memory stock may jump 89% in 2027, analysts say · 3 src
- GitHub - W61k3r/LexiSuite-Releases: does qwen and gemma ok. · 2 src
- Nvidia shares fall 6% to 9% as AI selloff follows Democratic midterm sweep · 22 src
- Chinese AI lab Moonshot seeks Nvidia Blackwell access via European data centers, sources say · 6 src
- Asus zenbook a16 outperforms Nvidia RTX Spark for local AI · 1 src
Comments
via GitHub Discussions