Qualcomm High Bandwidth Compute aims to compete with High Bandwidth Flash and Memory by stacking LPDDR just above the CPU to 'eliminate HBM tax' | Tech Radar

Overview

News, deals, reviews, guides and more on the newest computing gadgets

Start exploring exclusive deals, expert advice and more

Details

Unlock and manage exclusive Techradar member rewards.

Unlock instant access to exclusive member features.

Get full access to premium articles, exclusive features and a growing list of member rewards.

Qualcomm High Bandwidth Compute aims to compete with High Bandwidth Flash and Memory by stacking LPDDR just above the CPU to 'eliminate HBM tax'

When you purchase through links on our site, we may earn an affiliate commission. Here’s how it works.

Qualcomm introduces High Bandwidth Compute (HBC) memory architecture

It leverages a hybrid design stacking LPDDR memory in a 3D space, leveraging multiple layers to essentially replace what the current generation of High Bandwidth Memory (HBM4) does

The move, which makes use of Qualcomm's extensive experience with LPDDR, is not only power-efficient but also offers massive amounts of bandwidth and up to 768GB of stacked memory for AI workloads

Qualcomm is reigniting its Data Center ambitions, building on its expertise as a chip designer that excels in the low-power compute segment by focusing on an entirely new architecture: High Bandwidth Compute (HPC).

The solution is a hybrid take on existing LPDDR memory that Qualcomm has successfully stacked in 3D vertical space, not unlike the industry-standard High Bandwidth Memory (HBM) and its latest iteration, HBM4, while delivering significant power savings along the way.

The move is possible by Qualcomm offering a near-memory compute architecture that combines memory with a compute-based die, with the former stacked vertically on top of the latter, effectively enabling up to 133 TB/s.

While the current industry standard, HBM4, is already widely used, Qualcomm's promised offering is expected to appear by mid-2027 as part of its next-generation AI inference accelerator, the AI250.

HBC Gen 1 offers a theoretical 768GB of capacity that HBM4 struggles to match, and Qualcomm's published 133TB/s bandwidth is an achievement, given that modern HBM4 solutions offer approximately 3.3TB/s per stack at the higher end.

Qualcomm targets Nvidia, AMD, Huawei with Dragonfly AI accelerator rack loaded with 43TB of LPDDR5x, future generations set to smash 7PB/s bandwidth

Details of Intel's HBM-killer memory tech emerge, revealing nine layers, up to 9GB of DRAM capacity, and almost as much bandwidth as HBM4 that powers Nvidia's Vera Rubin AI platform

Key partner to Nvidia, ASML and TSMC brings next-gen RAM and NAND replacements even closer

Some of these bandwidth claims, however, might be a bit of an unfair comparison, as while HBM4 delivers raw bandwidth, Qualcomm's solution (and its theoretical speeds) is possibly in play only because it performs much of the compute on-die, making for an apples-to-oranges comparison in some ways.

Qualcomm, however, scores important wins with an AI industry increasingly obsessed with power, or rather, the lack of it, to continue many of their planned buildouts by touting its efficiency wins where it claims anywhere between 6x bandwidth per watt versus HBM for larger batch sizes and as much as 200x efficiency gains when it comes to a mix of small and large inference batches, such as coding assistants.

Qualcomm's partner list includes Meta and Microsoft, with the former's multi-generational agreement to use Qualcomm’s processors for AI being highlighted as an important win. Microsoft's CEO, Satya Nadela, reassured investors by detailing the software giant's partnership with the chip designer across the PC, local AI, and data center segments.

Given that Microsoft is increasingly looking to address the environmental footprint of its AI data center rollout, with its CEO already reassuring concerned parties and communities that the Redmond-based tech giant aims to be mindful of the water and power footprints of both currently planned and future data centers, this makes efficiency an even more important theme of late.

Qualcomm's solution to 'eliminate the HBM tax,' however, does not exist in a void; Competing solutions such as High Bandwidth Flash, backed by Samsung, San Disk and SK Hynix, are also shaping up as potential competitors that focus on a low-write, high-read situation that most AI inference workloads tend to be.

Perhaps more importantly, Qualcomm's solution and the impressive numbers it offers do not have any third-party's independent test results yet that could verify its efficiency claims, even as Microsoft's vote of confidence is seen as an important one for one of the most important players in the mobile So C business as it gears up to take a share of a growing, but increasingly competitive datacenter pie in the coming decade.

Follow Tech Radar on Google News and add us as a preferred source to get our expert news, reviews, and opinion in your feeds.

Having built hundreds of gaming PCs and being an avid gamer in his spare time, Rahim tends to have stronger opinions about hardware than most. This is particularly on display when he gets his way with powerful, but minimalistic RGB builds even as Small Form Factor (SFF) PCs come a close second.

You must confirm your public display name before commenting

1 Qualcomm's new High Bandwidth Compute looks to tackle costs of High Bandwidth Memory

2 The Razer Iskur V2 New Gen gaming chair shows that for premium comfort you really do have to pay a premium price

3UBTech just introduced its first full-size Ultra-Bionic humanoid robot, but what it really wants to do is make robot replicas of loved ones — that's a hard no

47 discs new 4K Blu-rays to add to your collection from June 2026

5 How to watch Belgium vs Senegal: Free Streams & TV Channels

Tech Radar is part of Future US Inc, an international media group and leading digital publisher. Visit our corporate site.

Key Takeaways

News, deals, reviews, guides and more on the newest computing gadgets
Start exploring exclusive deals, expert advice and more
Unlock and manage exclusive Techradar member rewards
Unlock instant access to exclusive member features
Get full access to premium articles, exclusive features and a growing list of member rewards