TOP500

From HandWiki
Revision as of 17:30, 6 February 2024 by Steve2012 (talk | contribs) (over-write)
(diff) ← Older revision | Latest revision (diff) | Newer revision → (diff)
Short description: Database project devoted to the ranking of computers
TOP500
Top500 logo.svg
Key people
Established24 June 1993; 31 years ago (1993-06-24)
Websitetop500.org

The TOP500 project ranks and details the 500 most powerful non-distributed computer systems in the world. The project was started in 1993 and publishes an updated list of the supercomputers twice a year. The first of these updates always coincides with the International Supercomputing Conference in June, and the second is presented at the ACM/IEEE Supercomputing Conference in November. The project aims to provide a reliable basis for tracking and detecting trends in high-performance computing and bases rankings on HPL benchmarks,[1] a portable implementation of the high-performance LINPACK benchmark written in Fortran for distributed-memory computers.

The 60th TOP500 was published in November 2022. Since June 2022, the United States' Frontier is the most powerful supercomputer on TOP500, reaching 1102 petaFlops (1.102 exaFlops) on the LINPACK benchmarks.[2] The United States has by far the highest share of total computing power on the list (nearly 50%),[3] while China currently leads the list in number of systems with 173 supercomputers, with the U.S. not far behind in second place.

The TOP500 list is compiled by Jack Dongarra of the University of Tennessee, Knoxville, Erich Strohmaier and Horst Simon of the National Energy Research Scientific Computing Center (NERSC) and Lawrence Berkeley National Laboratory (LBNL), and, until his death in 2014, Hans Meuer of the University of Mannheim, Germany .[citation needed]

The TOP500 project also includes lists such as Green500 (measuring energy efficiency) and HPCG (measuring I/O bandwidth).[citation needed]

History

Rapid growth of supercomputer performance, based on data from the top500.org website. The loga­rithmic y-axis shows performance in GFLOPS.
  Combined performance of 500 largest supercomputers
  Fastest supercomputer
  Supercomputer in 500th place

In the early 1990s, a new definition of supercomputer was needed to produce meaningful statistics. After experimenting with metrics based on processor count in 1992, the idea arose at the University of Mannheim to use a detailed listing of installed systems as the basis. In early 1993, Jack Dongarra was persuaded to join the project with his LINPACK benchmarks. A first test version was produced in May 1993, partly based on data available on the Internet, including the following sources:[4][5]

  • "List of the World's Most Powerful Computing Sites" maintained by Gunter Ahrendt[6]
  • David Kahaner, the director of the Asian Technology Information Program (ATIP);[7] published a report in 1992, titled "Kahaner Report on Supercomputer in Japan"[5] which had an immense amount of data.[citation needed]

The information from those sources was used for the first two lists. Since June 1993, the TOP500 is produced bi-annually based on site and vendor submissions only.

Since 1993, performance of the No. 1 ranked position has grown steadily in accordance with Moore's law, doubling roughly every 14 months. In June 2018, Summit was fastest with an Rpeak[8] of 187.6593 PFLOPS. For comparison, this is over 1,432,513 times faster than the Connection Machine CM-5/1024 (1,024 cores), which was the fastest system in November 1993 (twenty-five years prior) with an Rpeak of 131.0 GFLOPS.[9]

Architecture and operating systems

Share of processor families in TOP500 supercomputers by year[needs update]

(As of August 2022), all supercomputers on TOP500 were 64-bit, mostly based on CPUs using the x86-64 instruction set architecture. Of these, 384 are Intel EMT64-based and 101 are AMD AMD64-based, with the latter including the top 8 supercomputers. The remaining 15 supercomputers are all based on RISC architectures, including six based on ARM64 and seven based on the Power ISA used by IBM Power microprocessors.

In recent years heterogeneous computing, mostly using Nvidia's graphics processing units (GPUs) or Intel's x86-based Xeon Phi as coprocessors, has dominated the TOP500 because of better performance per watt ratios and higher absolute performance, while AMD GPUs have taken the top 1 and displaced Nvidia in top 10 part of the list. The recent exceptions include the aforementioned Fugaku, Sunway TaihuLight, and K computer. Tianhe-2A is also an interesting exception, as US sanctions prevented use of Xeon Phi; instead, it was upgraded to use the Chinese-designed Matrix-2000[10] accelerators.

Two computers which first appeared on the list in 2018 were based on architectures new to the TOP500. One was a new x86-64 microarchitecture from Chinese manufacturer Sugon, using Hygon Dhyana CPUs (these resulted from a collaboration with AMD, and are a minor variant of Zen-based AMD EPYC) and was ranked 38th, now 117th,[11] and the other was the first ARM-based computer on the list – using Cavium ThunderX2 CPUs.[12] Before the ascendancy of 32-bit x86 and later 64-bit x86-64 in the early 2000s, a variety of RISC processor families made up most TOP500 supercomputers, including SPARC, MIPS, PA-RISC, and Alpha.

Share of operating systems families in TOP500 supercomputers by time trend

All the fastest supercomputers since the Earth Simulator supercomputer have used operating systems based on Linux. (As of November 2017), all the listed supercomputers use an operating system based on the Linux kernel.[13][14]

Since November 2015, no computer on the list runs Windows (while Microsoft reappeared on the list in 2021 with Ubuntu based on Linux). In November 2014, Windows Azure[15] cloud computer was no longer on the list of fastest supercomputers (its best rank was 165th in 2012), leaving the Shanghai Supercomputer Center's Magic Cube as the only Windows-based supercomputer on the list, until it also dropped off the list. It was ranked 436th in its last appearance on the list released in June 2015, while its best rank was 11th in 2008.[16] There are no longer any Mac OS computers on the list. It had at most five such systems at a time, one more than the Windows systems that came later, while the total performance share for Windows was higher. Their relative performance share of the whole list was however similar, and never high for either. In 2004 System X supercomputer based on Mac OS X (Xserve, with 2,200 PowerPC 970 processors) once ranked 7th place.[17]

It has been well over a decade since MIPS systems dropped entirely off the list[18] though the Gyoukou supercomputer that jumped to 4th place[19] in November 2017 had a MIPS-based design as a small part of the coprocessors. Use of 2,048-core coprocessors (plus 8× 6-core MIPS, for each, that "no longer require to rely on an external Intel Xeon E5 host processor"[20]) made the supercomputer much more energy efficient than the other top 10 (i.e. it was 5th on Green500 and other such ZettaScaler-2.2-based systems take first three spots).[21] At 19.86 million cores, it was by far the largest system by core-count, with almost double that of the then-best manycore system, the Chinese Sunway TaihuLight.

TOP 500

(As of November 2023), the number one supercomputer, Frontier, an AMD-based system, is also the number two system on Green500.[22] The leader on Green500 is the even smaller new Henri, Nvidia-based supercomputer. In June 2022, the top 4 systems of Graph500 both used AMD CPUs and AMD accelerators.

After an upgrade, for the 56th TOP500 in November 2020,

Fugaku grew its HPL performance to 442 petaflops, a modest increase from the 416 petaflops the system achieved when it debuted in June 2020. More significantly, the ARMv8.2 based Fugaku increased its performance on the new mixed precision HPC-AI benchmark to 2.0 exaflops, besting its 1.4 exaflops mark recorded six months ago. These represent the first benchmark measurements above one exaflop for any precision on any type of hardware.[23]

Summit, a previously fastest supercomputer, is currently highest-ranked IBM-made supercomputer; with IBM POWER9 CPUs. Sequoia became the last IBM Blue Gene/Q model to drop completely off the list; it had been ranked 10th on the 52nd list (and 1st on the June 2012, 41st list, after an upgrade).

For the first time, all 500 systems deliver a petaflop or more on the High Performance Linpack (HPL) benchmark, with the entry level to the list now at 1.022 petaflops." However, for a different benchmark "Summit and Sierra remain the only two systems to exceed a petaflop on the HPCG benchmark, delivering 2.9 petaflops and 1.8 petaflops, respectively. The average HPCG result on the current list is 213.3 teraflops, a marginal increase from 211.2 six months ago.[24]

Microsoft is back on the TOP500 list with six Microsoft Azure instances (that use/are benchmarked with Ubuntu, so all the supercomputers are still Linux-based), with CPUs and GPUs from same vendors, the fastest one currently 11th,[25] and another older/slower previously made 10th.[26] And Amazon with one AWS instance currently ranked 64th (it was previously ranked 40th). The number of Arm-based supercomputers is 6, currently all Arm-based supercomputers use the same Fujitsu CPU as in the number 2 system, with the next one previously ranked 13th, now 25th.[27]

Top 10 positions of the 62nd TOP500 in November 2023[28]
Rank (previous) Rmax
Rpeak
(PetaFLOPS)
Name Model CPU cores Accelerator (e.g. GPU) cores Total Cores (CPUs + Accelerators) Interconnect Manufacturer Site
country
Year Operating
system
1,194.00
1,679.82
Frontier HPE Cray EX235a 561,664
(8,776 × 64-core Optimized 3rd Generation EPYC 64C @2.0 GHz)
36,992 × 220 AMD Instinct MI250X 8,699,904 Slingshot-11 HPE Oak Ridge National Laboratory
 United States
2023 Linux (HPE Cray OS-SUSE)
585.34
1,059.33
Aurora HPE Cray EX 565,656
(10,878 × 52-core Intel Xeon Max 9470 @2.4 GHz)
32,634 × 128 Intel Max 1550 4,742,808 Slingshot-11 HPE Argonne National Laboratory
 United States
2023 Linux (HPE Cray OS-SUSE)
561.20
846.84
Eagle Microsoft NDv5 93,600
(1,950 × 48-core Intel Xeon Platinum 8480C @2.0 GHz)
7,800 × 132 Nvidia Hopper H100 1,123,200 NVIDIA Infiniband NDR Microsoft Microsoft
 United States
2023 Linux (Ubuntu 22.04)
4 Decrease 442.010
537.212
Fugaku Supercomputer Fugaku 7,630,848
(158,976 × 48-core Fujitsu A64FX @2.2 GHz)
- 7,630,848 Tofu interconnect D Fujitsu RIKEN Center for Computational Science
 Japan
2020 Linux (RHEL)
5 Decrease 309.10
428.70
LUMI HPE Cray EX235a 186,624
(2,916 × 64-core Optimized 3rd Generation EPYC 64C @2.0 GHz)
11,664 × 220 AMD Instinct MI250X 2,752,704 Slingshot-11 HPE EuroHPC JU
 European Union, Kajaani,  Finland
2022 Linux (HPE Cray OS-SUSE)
6 Decrease 238.70
304.47
Leonardo BullSequana XH2000 110,592
(3,456 × 32-core Xeon Platinum 8358 @2.6 GHz)
15,872 × 108 Nvidia Ampere A100 1,824,768 Nvidia HDR100 Infiniband Atos EuroHPC JU
 European Union, Bologna,  Italy
2023 Linux
7 Decrease 148.600
200.795
Summit IBM Power System
AC922
202,752
(9,216 × 22-core IBM POWER9 @3.07 GHz)
27,648 × 80 Nvidia Tesla V100 2,414,592 InfiniBand EDR IBM Oak Ridge National Laboratory
 United States
2018 Linux (RHEL 7.4)
138.20
265.57
MareNostrum 5 ACC BullSequana XH3000 89,600
(2,240 × 40-core Intel Xeon Platinum 8460Y @2.3 GHz)
4,480 × 132 Nvidia Hopper H100 680,960 Infiniband NDR200 BullSequana EuroHPC JU
 European Union, Barcelona,  Spain
2023 Linux (RedHat 9.1)
121.40
188.65
Eos NVIDIA DGX SuperPOD Nvidia SuperPOD 46,592
(832 × 56-core Intel Xeon Platinum 8480C @3.8 GHz)
3,328 × 132 Nvidia Hopper H100 485,888 Infiniband NDR400 Nvidia Nvidia
 United States
2023 Linux (Ubuntu 22.04.3 LTS)
10 Decrease 94.640
125.712
Sierra IBM Power System
S922LC
190,080
(8,640 × 22-core IBM POWER9 @3.1 GHz)
17,280 × 80 Nvidia Tesla V100 1,572,480 InfiniBand EDR IBM Lawrence Livermore National Laboratory
 United States
2018 Linux (RHEL)

Legend:[29]

  • Rank – Position within the TOP500 ranking. In the TOP500 list table, the computers are ordered first by their Rmax value. In the case of equal performances (Rmax value) for different computers, the order is by Rpeak. For sites that have the same computer, the order is by memory size and then alphabetically.
  • Rmax – The highest score measured using the LINPACK benchmarks suite. This is the number that is used to rank the computers. Measured in quadrillions of 64-bit floating point operations per second, i.e., petaFLOPS.[30]
  • Rpeak – This is the theoretical peak performance of the system. Computed in petaFLOPS.
  • Name – Some supercomputers are unique, at least on its location, and are thus named by their owner.
  • Model – The computing platform as it is marketed.
  • Processor – The instruction set architecture or processor microarchitecture, alongside GPU and accelerators when available.
  • Interconnect – The interconnect between computing nodes. InfiniBand is most used (38%) by performance share, while Gigabit Ethernet is most used (54%) by number of computers.
  • Manufacturer – The manufacturer of the platform and hardware.
  • Site – The name of the facility operating the supercomputer.
  • Country – The country in which the computer is located.
  • Year – The year of installation or last major update.
  • Operating system – The operating system that the computer uses.

Other rankings

Top countries

Numbers below represent the number of computers in the TOP500 that are in each of the listed countries or territories. As of 2023, United States has the most supercomputers on the list, with 161 machines. The United States has the highest aggregate computational power at 3,639 Petaflops Rmax with Japan second (654 Pflop/s) and China third (398 Pflop/s).

Distribution of supercomputers in the TOP500 list by country ((As of November 2023))[31]
Country or Territory Systems
 United States
161
 China
104
 Germany
36
 Japan
32
 France
23
 United Kingdom
15
 Italy
12
 South Korea
12
 Canada
10
 Netherlands
10
 Brazil
9
 Russia
7
 Saudi Arabia
7
 Sweden
6
 Australia
6
 Taiwan
5
 Norway
5
 India
4
 Ireland
4
 Poland
4
 Finland
3
 Spain
3
 Singapore
3
  Switzerland
3
 Czechia
2
Distribution of supercomputers in the TOP500 list by country and by year
Country/Region Nov 2023[32] Jun 2023[33] Nov 2022[34] Jun 2022[35] Nov 2021[36] Jun 2021[37] Nov 2020[38] Jun 2020[39] Nov 2019[40] Jun 2019[41] Nov 2018[42] Jun 2018[43] Nov 2017[44] Jun 2017[45] Nov 2016[46] Jun 2016[47] Nov 2015[48] Jun 2015[49] Nov 2014[50] Jun 2014[51] Nov 2013[52] Jun 2013[53] Nov 2012[54] Jun 2012[55] Nov 2011[56] Jun 2011[57] Nov 2010[58] Jun 2010[59] Nov 2009[60] Jun 2009[61] Nov 2008[62] Jun 2008[63] Nov 2007[64] Jun 2007[65] Nov 2006[66]
 United States 161 150 127 128 149 122 113 114 117 116 109 124 143 168 171 165 199 233 231 232 264 252 251 252 263 255 274 282 277 291 290 257 283 281 309
 EU 112 103 101 92 83 93 79 79 87 92 91 93 86 99 95 93 94 122 110 103 89 97 89 96 95 109 108 126 137 134 140 169 133 115 82
 China 104 134 162 173 173 188 214 226 228 220 227 206 202 160 171 168 109 37 61 76 63 66 72 68 74 61 41 24 21 21 15 12 10 13 18
 Germany 36 36 34 31 26 23 17 16 16 13 17 21 21 28 31 26 33 37 26 22 20 19 19 20 20 30 26 24 27 29 25 46 31 24 18
 Japan 32 33 31 33 32 34 34 29 29 28 31 36 35 33 27 29 37 40 32 30 28 30 32 35 30 26 26 18 16 15 17 22 20 23 30
 France 23 24 24 22 19 16 18 19 18 20 18 18 18 18 20 18 18 27 30 27 22 23 21 22 23 25 26 27 26 23 26 34 17 13 12
 United Kingdom 15 14 15 12 11 11 12 10 11 18 20 22 15 17 13 11 18 29 30 30 23 29 24 25 27 27 25 38 45 44 46 53 48 42 30
 Italy 12 7 7 6 6 6 6 7 5 5 6 5 6 8 6 5 4 4 3 5 5 6 7 8 4 5 6 7 6 6 11 6 6 5 8
 South Korea 12 8 8 6 7 5 3 3 3 5 6 7 5 8 4 7 10 9 9 8 5 4 4 3 3 4 3 1 2 0 1 1 1 5 6
 Canada 10 10 10 14 11 11 12 12 9 8 9 6 5 6 1 1 6 6 6 9 10 9 11 10 9 8 6 7 9 8 2 2 5 10 8
 Netherlands 10 8 8 6 11 16 15 15 15 13 6 9 6 4 3 3 2 3 5 5 3 2 0 0 0 1 2 4 3 3 3 5 6 8 2
 Brazil 9 9 8 6 5 6 4 4 3 3 1 1 0 2 3 4 6 6 4 4 3 3 2 3 2 2 2 1 1 0 2 1 1 2 4
 Russia 7 7 7 7 7 3 2 2 3 2 3 4 3 3 5 7 7 8 9 5 5 8 8 5 5 12 11 11 8 5 8 9 7 5 2
 Saudi Arabia 7 6 6 6 6 6 5 3 3 3 3 4 4 6 5 5 6 7 4 4 3 4 3 3 3 4 6 4 4 2 0 0 0 2 4
 Sweden 6 6 6 5 4 3 2 2 2 2 4 3 5 5 4 5 3 5 5 3 5 7 6 4 3 5 6 8 7 10 8 9 7 10 1
 Australia 6 5 5 5 3 2 2 2 3 5 5 5 4 4 3 5 4 6 9 6 5 5 7 6 4 6 4 1 1 1 1 1 1 4 4
 Taiwan 5 2 2 2 2 2 3 2 2 2 2 1 1 0 0 0 0 1 1 1 1 1 3 3 2 2 0 0 0 1 2 3 11 10 2
 Norway 5 4 3 2 1 3 3 3 2 0 1 1 1 1 1 1 1 2 3 3 3 3 3 3 0 1 3 2 2 2 2 2 3 2 3
 India 4 4 3 3 3 3 3 2 2 3 4 5 4 4 5 9 11 11 9 9 12 11 8 5 2 2 4 5 3 6 8 6 9 8 10
 Ireland 4 5 5 3 1 14 14 14 14 13 12 7 4 2 1 3 0 0 0 1 2 0 0 3 3 1 1 1 1 1 1 1 0 0 1
 Poland 4 3 3 5 4 4 2 1 1 1 4 4 5 6 7 6 6 7 2 2 2 3 4 5 6 5 6 5 3 4 6 3 1 0 0
 Finland 3 3 3 4 3 2 2 2 1 2 1 1 2 3 2 5 2 2 3 2 2 2 3 1 1 2 1 3 2 1 1 1 5 3 1
 Spain 3 1 1 1 1 1 1 1 2 2 2 2 1 1 1 1 2 2 2 2 2 3 2 4 3 2 3 3 6 5 6 7 9 6 7
 Singapore 3 3 3 3 1 4 4 4 4 5 3 2 1 1 1 1 0 0 0 0 0 0 0 1 1 2 2 1 1 1 0 0 1 2 2
  Switzerland 3 4 4 4 3 3 3 2 2 4 2 3 3 3 4 3 6 6 7 6 5 4 4 1 3 4 4 5 5 4 4 6 7 5 5
 Czechia 2 2 2 2 2 2 1 1 1 1 1 1 1 1 1 1 1 1 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
 Slovenia 2 2 2 2 2 2 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 1 1 1 1 1 1 0 0 0
 Austria 2 2 2 2 1 1 1 1 1 1 0 0 2 3 3 5 1 1 1 1 1 1 1 1 2 2 1 2 8 5 0 0 0 0 0
 Bulgaria 2 1 1 1 1 1 0 0 0 0 0 0 0 0 0 0 1 1 0 0 0 0 0 0 0 0 0 0 1 1 1 0 0 0 0
 Luxembourg 2 2 2 2 2 2 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 1 0 0
 Thailand 1 1 1 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
 United Arab Emirates 1 1 2 2 2 2 2 2 2 0 0 0 0 0 0 0 0 0 0 0 0 0 0 1 0 0 0 0 0 0 0 0 0 1 1
 Argentina 1 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
 Morocco 1 1 1 1 1 1 1 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
 Hungary 1 1 1 1 0 0 0 0 0 0 0 0 0 0 0 0 1 1 1 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
 Belgium 1 1 1 0 0 0 0 0 0 0 0 0 0 1 1 2 0 1 1 2 1 1 1 2 1 2 2 0 1 1 2 2 1 4 1
 Hong Kong 0 0 0 0 0 1 1 1 1 1 0 0 0 0 0 0 1 1 1 1 2 1 0 0 0 0 1 1 1 1 0 0 0 0 0
 South Africa 0 0 0 0 0 0 0 0 0 3 2 1 1 1 1 1 0 0 0 0 0 0 0 1 1 0 0 1 1 0 1 0 0 1 2
 Denmark 0 0 0 0 0 0 0 0 0 1 0 0 0 2 2 2 2 2 2 1 1 1 1 1 2 2 2 3 0 0 3 0 1 0 1
 New Zealand 0 0 0 0 0 0 0 0 0 0 1 1 1 1 3 1 1 0 0 0 0 0 0 0 0 0 5 7 8 5 4 6 1 1 1
 Mexico 0 0 0 0 0 0 0 0 0 0 0 0 1 0 0 0 1 1 0 0 0 0 1 0 0 0 0 0 0 1 1 0 0 2 1
 Croatia 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 1 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
 Greece 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 1 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
 Israel 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 1 2 2 2 2 1 3 3 2 0 2 2 1 1 0 0 0 2
 Malaysia 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 1 1 1 0 0 0 0 0 0 0 0 1 1 1 2 3 4 3
 Slovak Republic 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 1 1 0 0 0 0 0 0 0 0 0 0 0
 Turkey 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 1 0 0 0 0 2 1 1
 Cyprus 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 1 0 0 0
 Egypt 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 1 1 0 0
 Indonesia 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 1 1 0
 Philippines 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 1 0
 Vietnam 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 1 0

Fastest supercomputer in TOP500 by country

(As of November 2023[67])

Systems ranked No. 1

Additional statistics

By number of systems (As of June 2021):[75]

Top five accelerators/co-processors
Accelerator Systems
NVIDIA TESLA V100 (Launched: 2017)
80
NVIDIA AMPERE A100 (Launched: 2020)
15
NVIDIA TESLA V100 SXM2 (Launched: 2017)
12
NVIDIA TESLA P100 (Launched: 2016)
8
NVIDIA AMPERE A100 SXM4 40 GB (Launched: 2020)
5
Top five manufacturers by system quantity
Manufacturer Systems
Lenovo
184
Inspur
58
Sugon
45
Hewlett Packard Enterprise
39
Atos
36
Top five operating systems
Operating System Systems
Linux
264
CentOS
89
Cray Linux Environment
31
bullx SCS
12
Red Hat Enterprise Linux
12

Note: All operating systems of the TOP500 systems are Linux-family based, but Linux above is generic Linux.

Sunway TaihuLight is the system with the most CPU cores (10,649,600). Tianhe-2 has the most GPU/accelerator cores (4,554,752). Fugaku is the system with the greatest power consumption with 29,900 kilowatts.

New developments in supercomputing

In November 2014, it was announced that the United States was developing two new supercomputers to exceed China's Tianhe-2 in its place as world's fastest supercomputer. The two computers, Sierra and Summit, will each exceed Tianhe-2's 55 peak petaflops. Summit, the more powerful of the two, will deliver 150–300 peak petaflops.[76] On 10 April 2015, US government agencies banned selling chips, from Nvidia to supercomputing centers in China as "acting contrary to the national security ... interests of the United States";[77] and Intel Corporation from providing Xeon chips to China due to their use, according to the US, in researching nuclear weapons – research to which US export control law bans US companies from contributing – "The Department of Commerce refused, saying it was concerned about nuclear research being done with the machine."[78]

On 29 July 2015, President Obama signed an executive order creating a National Strategic Computing Initiative calling for the accelerated development of an exascale (1000 petaflop) system and funding research into post-semiconductor computing.[79]

In June 2016, Japanese firm Fujitsu announced at the International Supercomputing Conference that its future exascale supercomputer will feature processors of its own design that implement the ARMv8 architecture. The Flagship2020 program, by Fujitsu for RIKEN plans to break the exaflops barrier by 2020 through the Fugaku supercomputer, (and "it looks like China and France have a chance to do so and that the United States is content – for the moment at least – to wait until 2023 to break through the exaflops barrier."[80]) These processors will also implement extensions to the ARMv8 architecture equivalent to HPC-ACE2 that Fujitsu is developing with Arm.[80]

In June 2016, Sunway TaihuLight became the No. 1 system with 93 petaflop/s (PFLOP/s) on the Linpack benchmark.[81]

In November 2016, Piz Daint was upgraded, moving it from 8th to 3rd, leaving the US with no systems under the TOP3 for only the 2nd time ever.[82][83]

Inspur has been one of the largest HPC system manufacturer based out of Jinan, China. (As of May 2017), Inspur has become the third manufacturer to have manufactured 64-way system – a record which has been previously mastered by IBM and HP. The company has registered over $10B in revenues and have successfully provided a number of HPC systems to countries outside China such as Sudan, Zimbabwe, Saudi Arabia, Venezuela. Inspur was also a major technology partner behind both the supercomputers from China, namely Tianhe-2 and Taihu which lead the top 2 positions of TOP500 supercomputer list up to November 2017. Inspur and Supermicro released a few platforms aimed at HPC using GPU such as SR-AI and AGX-2 in May 2017.[84]

In November 2017, for the second time in a row there were no system from the US under the TOP3. No. 1 and No. 2 were installed in China, a system in Switzerland at #3, and a new system in Japan was #4 pushing the top US system to #5.[85]

In June 2018, Summit, an IBM-built system at the Oak Ridge National Laboratory (ORNL) in Tennessee, US, took the No. 1 spot with a performance of 122.3 petaflop/s (PFLOP/s), and Sierra, a very similar system at the Lawrence Livermore National Laboratory, CA, USA took #3. These two system took also the first two spots on the HPCG benchmark. Due to Summit and Sierra, the US took back the lead as consumer of HPC performance with 38.2% of the overall installed performance while China was second with 29.1% of the overall installed performance. For the first time ever, the leading HPC manufacturer is not a US company. Lenovo took the lead with 23.8% of systems installed. It is followed by HPE with 15.8%, Inspur with 13.6%, Cray with 11.2%, and Sugon with 11%. [86]

On 18 March 2019, the United States Department of Energy and Intel announced the first exaFLOP supercomputer would be operational at Argonne National Laboratory by the end of 2021. The computer, named Aurora, is to be delivered to Argonne by Intel and Cray.[87][88]

On 7 May 2019, The U.S. Department of Energy announced a contract with Cray to build the "Frontier" supercomputer at Oak Ridge National Laboratory. Frontier is anticipated to be operational in 2021 and, with a performance of greater than 1.5 exaflops, should then be the world's most powerful computer.[89]

Since June 2019, all TOP500 systems deliver a petaflop or more on the High Performance Linpack (HPL) benchmark, with the entry level to the list now at 1.022 petaflops.[90]

In May 2022, the Frontier supercomputer broke the exascale barrier, completing more than a quintillion 64-bit floating point arithmetic calculations per second. Frontier clocked in at approximately 1.1 exaflops, beating out the previous record-holder, Fugaku.[91][92]

Large machines not on the list

Some major systems are not on the list. A prominent example is the NCSA's Blue Waters which publicly announced the decision not to participate in the list[93] because they do not feel it accurately indicates the ability of any system to do useful work.[94] Other organizations decide not to list systems for security and/or commercial competitiveness reasons. One such example is the National Supercomputing Center at Qingdao's OceanLight supercomputer, completed in March 2021, which was submitted for, and won, the Gordon Bell Prize. The computer is an exaflop computer, but was not submitted to the TOP500 list; the first exaflop machine submitted to the TOP500 list was Frontier. Analysts suspected that the reason the NSCQ did not submit what would otherwise have been the world's first exascale supercomputer was to avoid inflaming political sentiments and fears within the United States, in the context of the United States – China trade war.[95] Additional purpose-built machines that are not capable or do not run the benchmark were not included, such as RIKEN MDGRAPE-3 and MDGRAPE-4. A Google Tensor Processing Unit v4 pod is capable of 1.1 exaflops of peak performance,[96] however these units are highly specialized to run machine learning workloads and the TOP500 measures a specific benchmark algorithm using a specific numeric precision.

Computers and architectures that have dropped off the list

IBM Roadrunner[97] is no longer on the list (nor is any other using the Cell coprocessor, or PowerXCell).

Although Itanium-based systems reached second rank in 2004,[98][99] none now remain.

Similarly (non-SIMD-style) vector processors (NEC-based such as the Earth simulator that was fastest in 2002[100]) have also fallen off the list. Also the Sun Starfire computers that occupied many spots in the past now no longer appear.

The last non-Linux computers on the list – the two AIX ones – running on POWER7 (in July 2017 ranked 494th and 495th[101] originally 86th and 85th), dropped off the list in November 2017.

See also

References

  1. "HPL – A Portable Implementation of the High-Performance Linpack Benchmark for Distributed-Memory Computers". ICL – UTK Computer Science Department. 24 February 2016. https://www.netlib.org/benchmark/hpl/. 
  2. "June 2022 | TOP500". https://www.top500.org/lists/top500/2022/06/. 
  3. "List Statistics | TOP500". https://www.top500.org/statistics/list/. 
  4. "An Interview with Jack Dongarra by Alan Beck, editor in chief HPCwire". https://www.hpcwire.com/archives/10219.html. 
  5. 5.0 5.1 "Statistics on Manufacturers and Continents". http://www.netlib.org/benchmark/top500/reports/report93/section2_16_4.html. 
  6. "The TOP25 Supercomputer Sites". http://www.hoise.com/primeur/PL/96/pl-top500/ES-PL-11-96-4.html. 
  7. "Where does Asia stand? This rising supercomputing power is reaching for real-world HPC leadership.". https://www.thefreelibrary.com/Where+does+Asia+stand%3F+This+rising+supercomputing+power+is+reaching...-a0272245319. 
  8. Rpeak – This is the theoretical peak performance of the system. Measured in PetaFLOPS.
  9. "Sublist Generator". https://www.top500.org/sublist. 
  10. "Matrix-2000 - NUDT". https://en.wikichip.org/wiki/nudt/matrix-2000. 
  11. "Advanced Computing System(PreE) - Sugon TC8600, Hygon Dhyana 32C 2GHz, Deep Computing Processor, 200Gb 6D-Torus | TOP500 Supercomputer Sites". https://www.top500.org/system/179593. 
  12. "Astra - Apollo 70, Cavium ThunderX2 CN9975-2000 28C 2GHz, 4xEDR Infiniband | TOP500 Supercomputer Sites". https://www.top500.org/system/179565. 
  13. "Top500 – List Statistics". November 2017. https://www.top500.org/statistics/details/osfam/1. 
  14. "Linux Runs All of the World's Fastest Supercomputers". The Linux Foundation. 20 November 2017. https://www.linuxfoundation.org/blog/2017/11/linux-runs-all-of-the-worlds-fastest-supercomputers/. 
  15. "Microsoft Windows Azure". https://www.top500.org/site/50454. 
  16. "Magic Cube – Dawning 5000A, QC Opteron 1.9 GHz, Infiniband, Windows HPC 2008". https://www.top500.org/system/176118. 
  17. "System X - 1100 Dual 2.3 GHz Apple XServe/Mellanox Infiniband 4X/Cisco GigE | TOP500". https://www.top500.org/system/173736/. 
  18. "Origin 2000 195/250 MHz". https://www.top500.org/system/167525. 
  19. "Gyoukou - ZettaScaler-2.2 HPC system, Xeon D-1571 16C 1.3 GHz, Infiniband EDR, PEZY-SC2 700 MHz". https://www.top500.org/system/179102/. 
  20. "PEZY-SC2 - PEZY" (in en). https://en.wikichip.org/wiki/pezy/pezy-scx/pezy-sc2. 
  21. "The 2,048-core PEZY-SC2 sets a Green500 record" (in en-US). WikiChip Fuse. 2017-11-01. https://fuse.wikichip.org/news/191/the-2048-core-pezy-sc2-sets-a-green500-record/. "Powering the ZettaScaler-2.2 is the PEZY-SC2. The SC2 is a second-generation chip featuring twice as many cores – i.e., 2,048 cores with 8-way SMT for a total of 16,384 threads. […] The first-generation SC incorporated two ARM926 cores and while that was sufficient for basic management and debugging its processing power was inadequate for much more. The SC2 uses a hexa-core P-Class P6600 MIPS processor which share the same memory address as the PEZY cores, improving performance and reducing data transfer overhead. With the powerful MIPS management cores, it is now also possible to entirely eliminate the Xeon host processor. However, PEZY has not done so yet." 
  22. "November 2023 | TOP500". https://www.top500.org/lists/green500/2023/11/. 
  23. "November 2020 | TOP500". https://www.top500.org/lists/top500/2020/11/. 
  24. "TOP500 Becomes a Petaflop Club for Supercomputers | TOP500 Supercomputer Sites". https://www.top500.org/news/top500-becomes-a-petaflop-club-for-supercomputers/. 
  25. "Explorer-WUS3 - ND96_amsr_MI200_v4, AMD EPYC 7V12 48C 2.45GHz, AMD Instinct MI250X, Infiniband HDR | TOP500". https://www.top500.org/system/180171/. 
  26. "Voyager-EUS2". https://www.top500.org/system/180024/. 
  27. "Wisteria/BDEC-01 (Odyssey) - PRIMEHPC FX1000, A64FX 48C 2.2GHz, Tofu interconnect D | TOP500". https://www.top500.org/system/179962/. 
  28. "November 2023 | TOP500". https://www.top500.org/lists/top500/2023/11/. 
  29. "TOP500 DESCRIPTION". https://www.top500.org/project/top500_description/. 
  30. "FREQUENTLY ASKED QUESTIONS". https://www.top500.org/resources/frequently-asked-questions/. 
  31. "LIST STATISTICS". https://www.top500.org/statistics/list/. 
  32. "TOP500 Supercomputer Sites". November 2023. https://www.top500.org/lists/2023/11/. 
  33. "TOP500 Supercomputer Sites". June 2023. https://www.top500.org/lists/2023/06/. 
  34. "TOP500 Supercomputer Sites". November 2022. https://www.top500.org/lists/2022/11/. 
  35. "TOP500 Supercomputer Sites". June 2022. https://www.top500.org/lists/2022/06/. 
  36. "TOP500 Supercomputer Sites". November 2021. https://www.top500.org/lists/2021/11/. 
  37. "TOP500 Supercomputer Sites". June 2021. https://www.top500.org/lists/2021/06/. 
  38. "TOP500 Supercomputer Sites". November 2020. https://www.top500.org/lists/2020/11/. 
  39. "TOP500 Supercomputer Sites". June 2020. https://www.top500.org/lists/2020/06/. 
  40. "TOP500 Supercomputer Sites". November 2019. https://www.top500.org/lists/2019/11/. 
  41. "TOP500 Supercomputer Sites". June 2019. https://www.top500.org/lists/2019/06/. 
  42. "TOP500 Supercomputer Sites". November 2018. https://www.top500.org/lists/2018/11/. 
  43. "TOP500 Supercomputer Sites". June 2018. https://www.top500.org/lists/2018/06/. 
  44. "TOP500 Supercomputer Sites". November 2017. https://www.top500.org/lists/2017/11/. 
  45. "TOP500 Supercomputer Sites". June 2017. https://www.top500.org/lists/2017/06/. 
  46. "TOP500 Supercomputer Sites". November 2016. https://www.top500.org/lists/2016/11/. 
  47. "TOP500 Supercomputer Sites". June 2016. https://www.top500.org/lists/2016/06/. 
  48. "TOP500 Supercomputer Sites". November 2015. https://www.top500.org/lists/2015/11/. 
  49. "TOP500 Supercomputer Sites". June 2015. https://www.top500.org/lists/2015/06/. 
  50. "TOP500 Supercomputer Sites". November 2014. https://www.top500.org/lists/2014/11/. 
  51. "TOP500 Supercomputer Sites". June 2014. https://www.top500.org/lists/2014/06/. 
  52. "TOP500 Supercomputer Sites". November 2013. https://www.top500.org/lists/2013/11/. 
  53. "TOP500 Supercomputer Sites". June 2013. https://www.top500.org/lists/2013/06/. 
  54. "TOP500 Supercomputer Sites". November 2012. https://www.top500.org/lists/2012/11/. 
  55. "TOP500 Supercomputer Sites". June 2012. https://www.top500.org/lists/2012/06/. 
  56. "TOP500 Supercomputer Sites". November 2011. https://www.top500.org/lists/2011/11/. 
  57. "TOP500 Supercomputer Sites". June 2011. https://www.top500.org/lists/2011/06/. 
  58. "TOP500 Supercomputer Sites". November 2010. https://www.top500.org/lists/2010/11/. 
  59. "TOP500 Supercomputer Sites". June 2010. https://www.top500.org/lists/2010/06/. 
  60. "TOP500 Supercomputer Sites". November 2009. https://www.top500.org/lists/2009/11/. 
  61. "TOP500 Supercomputer Sites". June 2009. https://www.top500.org/lists/2009/06/. 
  62. "TOP500 Supercomputer Sites". November 2008. https://www.top500.org/lists/2008/11/. 
  63. "TOP500 Supercomputer Sites". June 2008. https://www.top500.org/lists/2008/06/. 
  64. "TOP500 Supercomputer Sites". November 2007. https://www.top500.org/lists/2007/11/. 
  65. "TOP500 Supercomputer Sites". November 2007. https://www.top500.org/lists/2007/06/. 
  66. "TOP500 Supercomputer Sites". November 2007. https://www.top500.org/lists/2006/11/. 
  67. "TOP500 Supercomputer Sites". 13 November 2023. https://www.top500.org/lists/top500/list/2023/11/. 
  68. "TOP500 List - June 2022". June 2022. https://top500.org/lists/top500/2022/06/. 
  69. "June 2020". June 2020. https://www.top500.org/lists/2020/06/. 
  70. Summit, an IBM-built supercomputer now running at the Department of Energy's (DOE) Oak Ridge National Laboratory (ORNL), captured the number one spot June 2018 with a performance of 122.3 petaflops on High Performance Linpack (HPL), the benchmark used to rank the TOP500 list. Summit has 4,356 nodes, each one equipped with two 22-core POWER9 CPUs, and six NVIDIA Tesla V100 GPUs. The nodes are linked together with a Mellanox dual-rail EDR InfiniBand network."TOP500 List - June 2018". The TOP500 project. 2018-06-30. https://www.top500.org/lists/2018/06/. 
  71. Advanced reports that Oak Ridge National Laboratory was fielding the world's fastest supercomputer were proven correct when the 40th edition of the twice-yearly TOP500 List of the world's top supercomputers was released today (Nov. 12, 2012). Titan, a Cray XK7 system installed at Oak Ridge, achieved 17.59 Petaflop/s (quadrillions of calculations per second) on the Linpack benchmark. Titan has 560,640 processors, including 261,632 NVIDIA K20x accelerator cores."TOP500 List - November 2012". The TOP500 project. 2012-11-12. https://www.top500.org/lists/2012/06/. 
  72. For the first time since November 2009, a United States supercomputer sits atop the TOP500 list of the world's top supercomputers. Named Sequoia, the IBM BlueGene/Q system installed at the Department of Energy's Lawrence Livermore National Laboratory achieved an impressive 16.32 petaflop/s on the Linpack benchmark using 1,572,864 cores."TOP500 List - June 2012". The TOP500 project. 2012-06-30. https://www.top500.org/lists/2012/06/. 
  73. The DOE/IBM BlueGene/L beta-System was able to claim the No. 1 position on the new TOP500 list with its record Linpack benchmark performance of 70.72 Tflop/s ("teraflops" or trillions of calculations per second). This system, once completed, will be moved to the DOE's Lawrence Livermore National Laboratory in Livermore, Calif."TOP500 List - November 2004". The TOP500 project. 2004-11-30. https://www.top500.org/lists/2004/11/. 
  74. ASCI Red a Sandia National Laboratories machine with 7264 Intel cores nabbed the #1 position in June of 1997."TOP500 List -June 1997". The TOP500 project. 1997-06-30. https://www.top500.org/lists/1997/06/. 
  75. "List Statistics". https://www.top500.org/statistics/list/. 
  76. Balthasar, Felix. "US Government Funds $425 million to build two new Supercomputers". http://newsmaine.net/21403-us-government-funds-425-million-build-two-new-supercomputers. 
  77. "Nuclear worries stop Intel from selling chips to Chinese supercomputers". 2015-04-10. https://money.cnn.com/2015/04/10/technology/security/intel-blocked-nuclear/. 
  78. "US nuclear fears block Intel China supercomputer update". BBC News. 10 April 2015. https://www.bbc.com/news/technology-32247532. 
  79. "Executive Order -- Creating a National Strategic Computing Initiative" (Executive order). The White House – Office of the Press Secretary. 29 July 2015. Archived from the original on 2018-11-30.
  80. 80.0 80.1 Morgan, Timothy Prickett (23 June 2016). "Inside Japan's Future Exascale ARM Supecomputer". https://www.nextplatform.com/2016/06/23/inside-japans-future-exaflops-arm-supercomputer/. 
  81. "Highlights - June 2016 | TOP500 Supercomputer Sites". https://www.top500.org/lists/2016/06/highlights/. 
  82. "Highlights - June 2017 | TOP500 Supercomputer Sites". https://www.top500.org/lists/2017/06/highlights. 
  83. "TOP500 List Refreshed, US Edged Out of Third Place | TOP500 Supercomputer Sites". https://www.top500.org/news/top500-list-refreshed-us-edged-out-of-third-place/. 
  84. "Supermicro, Inspur, Boston Limited Unveil High-Density GPU Servers | TOP500 Supercomputer Sites" (in en). https://www.top500.org/news/supermicro-inspur-boston-limited-unveil-high-density-gpu-servers/. 
  85. "Highlights - November 2017 | TOP500 Supercomputer Sites". https://www.top500.org/lists/2017/11/highlights/. 
  86. "Highlights - June 2018 | TOP500 Supercomputer Sites". https://www.top500.org/lists/2018/06/highlights/. 
  87. "U.S. Department of Energy and Intel to deliver first exascale supercomputer1". 2019-03-18. https://www.anl.gov/article/us-department-of-energy-and-intel-to-deliver-first-exascale-supercomputer. 
  88. Clark, Don (18 March 2019). "Racing Against China, U.S. Reveals Details of $500 Million Supercomputer". The New York Times. https://www.nytimes.com/2019/03/18/technology/china-us-500-million-supercomputer.html. 
  89. "U.S. Department of Energy and Cray to Deliver Record-Setting Frontier Supercomputer at ORNL". 2019-05-08. https://www.ornl.gov/news/us-department-energy-and-cray-deliver-record-setting-frontier-supercomputer-ornl. 
  90. "TOP500 Becomes a Petaflop Club for Supercomputers | TOP500 Supercomputer Sites". https://www.top500.org/news/top500-becomes-a-petaflop-club-for-supercomputers/. 
  91. Emily Conover (June 1, 2022). "The world's fastest supercomputer just broke the exascale barrier". ScienceNews. https://www.sciencenews.org/article/supercomputer-exascale-frontier-speed-record-computing-calculations. 
  92. Don Clark (May 30, 2022). "U.S. Retakes Top Spot in Supercomputer Race". New York Times. https://www.nytimes.com/2022/05/30/business/us-supercomputer-frontier.html. 
  93. Blue Waters Opts Out of TOP500, 16 November 2012, https://www.hpcwire.com/2012/11/16/blue_waters_opts_out_of_top500/, retrieved 30 June 2016 
  94. Kramer, William, Top500 versus Sustained Performance – Or the Ten Problems with the TOP500 List – And What to Do About Them. 21st International Conference On Parallel Architectures And Compilation Techniques (PACT12), 19–23 September 2012, Minneapolis, MN, US 
  95. "Three Chinese Exascale Systems Detailed at SC21: Two Operational and One Delayed". 24 November 2021. https://www.hpcwire.com/2021/11/24/three-chinese-exascale-systems-detailed-at-sc21-two-operational-and-one-delayed/. 
  96. Google demonstrates leading performance in latest MLPerf Benchmarks, 30 June 2021, https://cloud.google.com/blog/products/ai-machine-learning/google-wins-mlperf-benchmarks-with-tpu-v4, retrieved 10 July 2021 
  97. "Roadrunner – BladeCenter QS22/LS21 Cluster, PowerXCell 8i 3.2 GHz / Opteron DC 1.8 GHz, Voltaire Infiniband". https://www.top500.org/system/176027. 
  98. "Thunder – Intel Itanium2 Tiger4 1.4 GHz – Quadrics". https://top500.org/system/173300. 
  99. "Columbia – SGI Altix 1.5/1.6/1.66 GHz, Voltaire Infiniband". https://top500.org/system/175560. 
  100. "Japan Agency for Marine -Earth Science and Technology". https://top500.org/site/49318. 
  101. "IBM Flex System p460, POWER7 8C 3.550 GHz, Infiniband QDR". TOP500 Supercomputer Sites. https://www.top500.org/system/178330. 

External links