Glossary

HBM

High-Bandwidth Memory — DRAM dies stacked vertically and bonded next to the GPU, trading a very wide bus for enormous bandwidth at low energy per bit.

Modern AI is rarely starved of math — it is starved of bandwidth. Every token a model generates must stream its weights past the cores. HBM answers by stacking DRAM vertically, sitting it next to the GPU, and talking over a very wide bus.

This glossary entry is the short definition. The interactive HBM guide covers stack anatomy, HBM2 → HBM4 generations, the memory wall, and the supply story — without repeating that material here.

TensorLight glossary · Streaming Multiprocessor · Tensor Core · tile · HBM · also called High-Bandwidth Memory, High Bandwidth Memory