Claude Community
How a GPU works
Data
Power
Heat
CPU
a few powerful cores, one task after another
GPU
thousands of simple cores, all at once
housing
0.12
-0.80
0.33
0.05
-0.41
0.67
Every piece of text becomes a long list of numbers. Real models use thousands per piece.
your numbers
×
the model's weights
=
new numbers
Each new number can be worked out on its own, so thousands of cores can do them at the same time.
memory
memory
cores
The weights sit in fast memory stacked right next to the cores.
layers
which piece comes next?
fell
rose
held
were
One piece is picked, then the whole pass runs again for the next one.
1
2
3
4
5
6
7
8
one model, split across many chips
The chips are wired together and trade results constantly.
electricity
GPU
heat
Billions of multiplications for every word, each using a little energy.
1 / 7
Back
Next
Arrow keys or space to advance