What are exaFLOPS?

The computing power of modern computers is measured in FLOPS, which stands for floating point op­er­a­tions per second. Very powerful systems can reach the level of exaFLOPS, which is a quin­til­lion (10¹⁸) op­er­a­tions per second. This enormous computing capacity is crucial for complex cal­cu­la­tions.

What are FLOPS and what are they used for?

FLOPS stands for floating point operations per second. Floating point arith­metic in computers is essential for sci­en­tif­ic cal­cu­la­tions, sim­u­la­tions, ar­ti­fi­cial in­tel­li­gence and other computing-heavy ap­pli­ca­tions. Unlike simple op­er­a­tions with integers, floating point numbers make it possible to calculate and represent decimal numbers very precisely.

A computer’s per­for­mance in FLOPS is measured using spe­cial­ized bench­marks that test how many floating point op­er­a­tions can be performed per second. That often involves programs like LINPACK and HPCG, which perform complex math­e­mat­i­cal cal­cu­la­tions and measure computing speed under realistic con­di­tions. Actual per­for­mance can vary based on hardware, software op­ti­miza­tion and the type of cal­cu­la­tion.

How many FLOPS are in an exaFLOPS?

One exaFLOP cor­re­sponds to exactly 10¹⁸ FLOPS or one quin­til­lion floating point op­er­a­tions per second. By way of com­par­i­son, one petaFLOPS (10¹⁵ FLOPS) is a thousand times smaller than an exaFLOPS, and one teraFLOPS (10¹² FLOPS) is a million times smaller.

What are some other FLOPS units and how are they converted to exaFLOPS?

There are many FLOPS units, which differ in how many op­er­a­tions per second they refer to.

These units make it easier to compare the computing power of different systems to each other.

How many FLOPS do modern computers and GPUs reach?

Modern high-per­for­mance computers now reach the levels of exaFLOPS. The first exaFLOPS su­per­com­put­er was the Tianhe-3 in the Chinese National Su­per­com­put­er Center in Guangzhou, which delivers up to 1.7 exaFLOPS. Other su­per­com­put­ers like the Frontier in the US now also work in exaFLOPS.

High-end graphics cards like those used for gaming and machine learning also have high FLOPS values, even if they don’t get anywhere near exaFLOPS:

• NVIDIA RTX 4090: Around 82 teraFLOPS (0.000082 exaFLOPS) for FP32 cal­cu­la­tions; with over­clock­ing it can exceed 1,000 teraFLOPS
• NVIDIA H100 SXM: Around 989 teraFLOPS (0.000989 exaFLOPS) for FP32 Tensor Core cal­cu­la­tions
• NVIDIA A30: Around 10.3 teraFLOPS (0.000010 exaFLOPS) for FP32 cal­cu­la­tions
• AMD Radeon RX 7900 XTX: Around 61 teraFLOPS (0.000061 exaFLOPS) for FP32 cal­cu­la­tions

While GPUs are primarily designed for parallel cal­cu­la­tions in AI and graphics pro­cess­ing, su­per­com­put­ers are used for very complex sim­u­la­tions in science and industry.