ENES

Supercomputer

Thousands of computers wired together to work on one huge calculation at once.

Rows of server racks, each full of nodes with CPUs and GPUs, tied together by a fast network and fed one big problem split into many small pieces

A supercomputer is not one giant processor. It is thousands of ordinary-looking servers, called nodes, packed into rows of racks and connected by an extremely fast network so they can behave like a single machine. Each node has its own CPUs, and today most of the computing power comes from GPUs. The total can reach more than a quintillion calculations per second, the level known as exascale.

The trick is splitting one big problem into many small pieces that run at the same time, then combining the results. That works well for simulations: weather and climate forecasts, how a new drug molecule folds, how air flows over a wing, how a nuclear weapon ages without testing it. This field is called high-performance computing, or HPC. The fast network matters as much as the chips, because the pieces constantly need to exchange data with their neighbors.

Twice a year, the TOP500 list ranks the fastest public supercomputers in the world; the top spots usually belong to national laboratories in the United States, Europe, Japan and China. The line with AI has blurred: the clusters that big companies build to train large language models use the same ingredients (thousands of GPUs, fast networks, heavy cooling) and are, in practice, supercomputers. They also consume a lot of power, often tens of megawatts, roughly what a small town uses.

Keep in mind

Go deeper

Related terms

More in Hardware