Oh My AlgorithmKO
←
Hardware & Memory
← All catalogs

Hardware & Memory

GPU memory layout and data connections

HBM (High Bandwidth Memory)

GDDR · Memory chips around the GPU

First look at GDDR memory, with DRAM chips placed around the GPU on the circuit board.

GDDRDRAMGDDRDRAMGPU / ProcessorMemory ControllerGDDRDRAMGDDRDRAMPCB board · long traces · 32-bit narrow bus × many
↔ Drag to explore

HBM · Vertically stacked DRAM

HBM stacks DRAM dies vertically and places the stack close to the GPU.

HBM stackDRAM DieDRAM DieDRAM DieDRAM DieBase Logic DiePHY · ControlGPU / ProcessorMemory ControllerSilicon Interposer · 1024-bit wide busPackage Substrate
↔ Drag to explore
Principles and uses

Compare the stacked DRAM and interconnect arrangement of HBM with GDDR.

Stack DRAM near the GPU and connect it through a wide bus.

TSVs connect stacked dies, while an interposer connects HBM to the GPU. Bus widths vary by generation; the diagram uses example values.

Use it to understand GPU memory bandwidth, data-transfer costs, and memory packaging.

Learning topics