MP Marc Pope Let's Talk
AMD Helios: 72 GPUs, Open Standards, and a 6-Gigawatt OpenAI Bet Against Nvidia

AMD Helios: 72 GPUs, Open Standards, and a 6-Gigawatt OpenAI Bet Against Nvidia

AMD's Helios rack packs 72 MI455X GPUs and 31TB of HBM4 into a $5.25M open-standards system—backed by a 6-gigawatt OpenAI supply agreement that signals a genuine shift in AI infrastructure.

When I ran hosting infrastructure in the early days, the one thing you learned quickly was that the stack you chose locked you in for years. Vendor-specific interconnects, proprietary management planes, firmware update cycles that depended entirely on one company's roadmap — the decisions you made at rack selection time became load-bearing walls you'd be working around a decade later.

That history is why I've been paying close attention to AMD's Advancing AI 2026 event this week at the Moscone Center in San Francisco. On Tuesday morning, Lisa Su took the stage and announced something that doesn't just challenge Nvidia on spec sheets — it challenges the structural premise of how hyperscale AI infrastructure gets built.

The headline product is Helios: a 72-GPU rack-scale system built around the new Instinct MI455X accelerator, combined with sixth-generation EPYC Venice CPUs and Pensando networking — all tied together with open standards instead of proprietary interconnects. Engineering samples ship in the second half of this year. Mass production starts Q2 2027.

But the number that stopped me cold wasn't the GPU count. It was the partnership disclosure: OpenAI and AMD announced a 6-gigawatt supply agreement beginning in H2 2026. Sam Altman appeared on stage with Su. Oracle has committed to 50,000 MI450-series units in Q3. That's not a competitive announcement. That's a market reorientation.

What the MI455X Actually Is

Let me walk through the silicon first, because the specs deserve a careful read rather than a bullet-point summary.

The MI455X is AMD's CDNA 5 architecture built on TSMC's N2 (2nm) process, with 12 compute chiplets paired to 3nm base dies — 320 billion transistors in total. Each accelerator carries 432GB of HBM4 memory with 19.6 TB/s of memory bandwidth, and delivers approximately 40 petaflops of FP4 inference performance at a 900W TDP.

For comparison, Nvidia's Vera Rubin GPU carries 288GB of memory — making AMD's advantage roughly 50% more HBM capacity per accelerator. In an era where model weights alone can exceed 100GB for mid-sized deployments, that gap is not academic. Memory capacity determines which models you can run without offloading — and offloading kills throughput.

The chiplet count matters architecturally. Twelve compute tiles means AMD can yield-manage the production process differently than a monolithic die, which historically helps AMD control costs and reduce defect sensitivity as a node matures. It also means the thermal envelope is distributed across a more complex package — which is the trade-off when you're pushing 900W in a dense rack.

The Helios Rack: What 72 GPUs Actually Looks Like

A Helios rack houses 18 compute trays. Each tray contains four MI455X accelerators and one EPYC Venice CPU. Across the full rack, that's 72 GPUs, 18 CPUs, and 31 terabytes of HBM4 — the most high-bandwidth memory ever packed into a single rack system.

Aggregate claimed performance lands at 2.9 exaflops of FP4 inference and 1.4 exaflops of FP8 per rack. Scale-up bandwidth within the rack is 260 TB/s using UALink over Ethernet. Scale-out bandwidth between racks is 43 TB/s via Pensando networking. Pricing sits between $5 million and $5.5 million per rack.

Here's the design decision worth focusing on: all of that interconnect is built on open standards.

For scale-up GPU-to-GPU communication within the rack, AMD uses UALink over Ethernet rather than a proprietary fabric. For scale-out rack-to-rack connectivity, they're using the Ultra Ethernet Consortium specification. The physical form factor follows OCP Open Rack Wide.

Nvidia's NVL72, by contrast, uses NVLink — a proprietary interconnect that only Nvidia controls, only Nvidia's hardware supports, and only Nvidia can upgrade. If you buy into NVLink at scale, you're buying into Nvidia's roadmap cadence, Nvidia's upgrade pricing, and Nvidia's definition of what features matter.

Why Open Standards Matter to Infrastructure Operators

I know what the counterargument sounds like: NVLink works, it's battle-tested at hyperscale, and CUDA's ecosystem is so mature that open standards don't close the software gap. All of that is true right now. But it's a snapshot argument, and the infrastructure decisions you make in 2026 will run in your data centers through 2032.

When I was running hosting infrastructure, we had a decade-long hangover from proprietary SAN fabrics. The hardware worked fine. The problem was renewal pricing. Once you've built your automation, monitoring, staffing knowledge, and vendor relationships around a proprietary stack, the incumbent has enormous leverage over you at renewal time — and they know it.

UALink over Ethernet means your switch fabric, your network monitoring tools, your capacity planning, and your cabling all live on commodity infrastructure. You can source networking equipment from multiple vendors. Your interconnect runs on the same protocols your operations team already understands. That's not a small thing at $5 million per rack across a thousand-node cluster.

The Software Gap Is Still Real — but It's Narrowing

ROCm 7.14, released alongside the event, is the most honest barometer of where AMD's software stack actually stands. The release adds PyTorch 2.12, JAX 0.10.0, and vLLM 0.23 support, along with a new modular build system called TheRock that significantly simplifies how ROCm is packaged and deployed. The profiling infrastructure was modernized — rocprofiler-SDK now backs the PyTorch Profiler directly, replacing a legacy stack that had been a persistent pain point.

But I want to be direct about what ROCm still isn't: it isn't CUDA. CUDA has two decades of optimization, a library ecosystem that covers essentially every ML primitive, and institutional knowledge embedded in the muscle memory of every ML engineer working today. The code portability ROCm advertises is real in theory and frequently painful in practice — especially when you get into custom kernels, vendor-specific attention implementations, or inference stacks that have been hand-tuned for H100s.

The 6-gigawatt OpenAI commitment is the most significant data point on this question. OpenAI's engineering teams have been running CUDA-native workflows at hyperscale for years. If they're signing that level of commitment to AMD, they've either done the software work to make it viable on their stack, or they're building something new on top of CDNA 5 that starts from AMD rather than adapting from Nvidia. Either scenario implies the software gap is smaller than outsiders think — or that at the volume OpenAI operates, they're willing to build the bridges themselves.

What This Means for Teams Making Infrastructure Decisions Now

Most teams reading this aren't going to order a Helios rack in the next 90 days. Engineering samples aren't shipping until H2 2026. Mass production is Q2 2027. But infrastructure decisions made in 2026 run in data centers through 2028 and beyond, and the competitive landscape this week is materially different than it was last month.

Nvidia's market share in AI training accelerators is still above 80% by most analyst estimates. That's not going to collapse overnight. But the structural conditions for it to erode now exist in a way they didn't before: a competing rack-scale system with comparable or superior memory specs, an open interconnect story that matters to operators, major cloud deployments incoming — Helios is coming to Azure in H2 2026 — and the two largest AI workload buyers on the planet making public commitments to AMD silicon.

If you're building out or expanding AI infrastructure, I'd do two things right now. First, get your hands on MI450 units for real-workload testing before the MI455X ships — Oracle is putting 50,000 into production this quarter, which means the ROCm stack is going to get stress-tested at scale over the next several months. Watch what surfaces in the open-source community and on the ML engineering forums. Second, if you're facing a Nvidia contract renewal in the next twelve months, you have more negotiating leverage today than you did on Sunday. The mere credible existence of Helios at $5.25 million per rack changes the conversation.

The Bottom Line

AMD didn't win the AI infrastructure market on Tuesday. Nvidia's lead is too deep and too broad for one event to flip it. But Helios changes the shape of the competition in ways that matter to people who actually run infrastructure at scale.

The memory advantage is real — 432GB of HBM4 per GPU against Nvidia's 288GB is a 50% edge that shows up directly in which models you can serve without architectural compromises. The open-standards argument is practical, not just political. The software stack is closing, even if it's not there yet. And the biggest AI spender in the world just signed a 6-gigawatt agreement that puts AMD silicon at the center of its next generation of compute.

Spec sheets don't ship models. But they do set the ceiling for what's possible when the software catches up — and that ceiling just moved.

Back to Blog