Green500 Explained

The Green500 is a biannual ranking of supercomputers, from the TOP500 list of supercomputers, in terms of energy efficiency.[1] [2] The list measures performance per watt using the TOP500 measure of high performance LINPACK benchmarks at double-precision floating-point format.

History

The Green500 List was created by Kirk W. Cameron and Wu-chun Feng, then both associate professors in Computer Science at Virginia Tech, in 2006. The power measurement techniques that form the basis of the run rules were based on Cameron's early work in supercomputer energy efficiency initially funded by the National Science Foundation (Awards: #0347683, #0614705). The first Green500 List was presented at the 2007 ACM/IEEE conference on Supercomputing and described in the December issue of IEEE Computer 40(12): 50-55 (2007).

The list was initially met with some controversy since several key stakeholders (e.g., SGI, DOE Laboratories) failed to submit measurements by the report deadlines and were deprecated in the original list using power estimates based on U/L Ratings. A revised list was posted in February of 2008 to enable those failing to submit to provide updates to the list. Successive, updated Green500 Lists followed independently twice per year, in June at the International Supercomputing Conference (ISC) in Europe and in November at the US-based ACM/IEEE Supercomputing conference. In 2014, the Green500 List merged with the Top500 List and now requires only a single submission to participate in both lists.

, an Appro International, Inc. Xtreme-X supercomputer (Beacon) topped the Green500 list with 2.499 LINPACK GFLOPS/W.[3] Beacon is deployed by NICS of the University of Tennessee and is a GreenBlade GB824M, Xeon E5-2670 based, eight cores (8C), 2.6 GHz, Infiniband FDR, Intel Xeon Phi 5110P computer.[4]

, the Eurotech supercomputer Eurora at Cineca topped the Green500 list with 3.208 LINPACK GFLOPS/W.[5] The Cineca Eurora supercomputer is equipped with two Intel Xeon E5-2687W CPUs and two PCI-e connected NVIDIA Tesla K20 accelerators per node. Water cooling and electronics design allows for very high densities to be reached with a peak performance of 350 TFLOPS per rack.[6]

, the L-CSC supercomputer of the Helmholtz Association at the GSI in Darmstadt Germany topped the Green500 list with 5.271 GFLOPS/W and was the first cluster to surpass an efficiency of 5 GFLOPS/W. It runs on Intel Xeon E5-2690 Processors with the Intel Ivy Bridge Architecture and AMD FirePro S9150 GPU Accelerators. It uses in rack watercooling and Cooling Towers to reduce the energy required for cooling.[7]

, the Shoubu supercomputer of RIKEN outside Tokyo Japan topped the Green500 list with 7.032 GFLOPS/W. The then-top three supercomputers of the list used PEZY-SC accelerators (GPU-like that use OpenCL)[8] by PEZY Computing with 1,024 cores each and 6–7 GFLOPS/W efficiency.[9] [10]

, DGX SaturnV Volta, using "NVIDIA DGX-1 Volta36, Xeon E5-2698v4 20C 2.2GHz, Infiniband EDR, NVIDIA Tesla V100", tops Green500 list with 15.113 GFLOPS/W, while ranked only 469th on Top500.[11] It is only slightly more efficient than the much larger Summit (which ranked 2nd while 1st on Top500 with 14.719 GFLOPS/W), using IBM POWER9 CPUs combined with Nvidia Tesla V100 GPUs.

In June 2022, Hewlett Packard Enterprise took the lead, with all-AMD systems (CPUs and GPUs) in the 4 top positions, with the top position being over 50% more efficient than the previous year's top position.[12] Later, in Nov. 2022, Lenovo took the lead, with a small Intel-Nvidia system.

Green 500 List

Top 10 positions of GREEN500 in November 2024[13]
scope=col data-sort-type="number" Rankscope=col width="50" data-sort-type="number" align="center" Performance
per watt
(GFLOPS/watt)
scope=col class="unsortable" Namescope=col Model
Processors, GPU, Interconnect
scope=col width="40" align="center" Vendorscope=col class="unsortable" Site
Country, year
scope=col width="50" data-sort-type="number" align="center" Rmax
(PFLOPS)
1 JEDIBullSequana XH3000
Grace Hopper Superchip 72C 3GHz, Nvidia GH200 Superchip, Quad-Rail NVIDIA, InfiniBand NDR200,
ParTec[14] /EVIDEN (ex-Atos)EuroHPC/FZJ,
  Germany, 2024
2ROMEO-2025BullSequana XH3000
Grace Hopper Superchip 72C 3GHz, NVIDIA GH200 Superchip, Quad-Rail NVIDIA, InfiniBand NDR200
EVIDEN (ex-Atos)ROMEO HPC Center,
University of Reims Champagne-Ardenne
  France, 2024
3Adastra 2HPE Cray EX255a
AMD Optimized 4th Generation EPYC 28C 1.8 GHz, AMD Instinct MI300A, Slingshot-11
Hewlett Packard EnterpriseGrand Equipement National de Calcul Intensif - Centre Informatique National de l'Enseignement Superieur (GENCI-CINES),
  France, 2024
4Isambard-AI phase 1 HPE Cray EX254n
NVIDIA Grace 72C 3.1GHz, NVIDIA GH200 Superchip, Slingshot-11
University of Bristol,
  United Kingdom, 2024
5 Capella Lenovo ThinkSystem SD650 V3
AMD EPYC 9334 32C 2.7GHz, Nvidia H100 SXM5 94Gb, Infiniband NDR200,
MEGWARE TU Dresden ZIH,
  Germany, 2024
6 JETI
JUPITER Exascale Transition Instrument
BullSequana XH3000
Grace Hopper Superchip 72C 3GHz, NVIDIA GH200 Superchip, Quad-Rail NVIDIA InfiniBand NDR200
ParTec/EVIDEN (ex-Atos)EuroHPC/FZJ,
  Germany, 2024
7Helios GPU HPE Cray EX254n
NVIDIA Grace 72C 3.1GHz, NVIDIA GH200 Superchip, Slingshot-11
Cyfronet,
  Poland, 2024
8 HenriLenovo ThinkSystem SR670 V2
Intel Xeon Platinum 8362 2.8 GHz (32C), Nvidia H100 80 GB PCIe, InfiniBand HDR
LenovoFlatiron Institute,
  United States, 2022
9 HoreKa-Teal ThinkSystem SD665-N V3
AMD EPYC 9354 32C 3.25GHz, Nvidia H100 94Gb SXM5, Infiniband NDR200
LenovoKarlsruhe Institute of Technology (KIT),
  Germany, 2024
10 rzAdamsHPE Cray EX255a
AMD 4th Gen EPYC 24C 1.8GHz, AMD Instinct MI300A, Slingshot-11
Hewlett Packard EnterpriseDOE/NNSA/LANL,
  United States, 2024

Historical development

Energy efficiency of top-ranked computers (gigaflops/watt)(from 2013 to 2024)

Notes and References

  1. Web site: The Green500 . dead . https://web.archive.org/web/20160620115925/http://www.top500.org/green500/. 2016-06-20.
  2. Web site: Green 500 list ranks supercomputers . iTnews Australia . dead . https://web.archive.org/web/20081022193316/http://www.itnews.com.au/News/65619,green-500-list-ranks-supercomputers.aspx . 2008-10-22 .
  3. Web site: University of Tennessee Supercomputer Sets World Record for Energy Efficiency. National Institute for Computational Sciences News. University of Tennessee & Oak Ridge National Laboratory. 21 November 2012.
  4. Web site: Beacon - Appro GreenBlade - Green500 list. top500.org. 21 November 2012.
  5. Web site: Eurotech Eurora, the PRACE prototype deployed by Cineca and INFN, scores first in Green500 list. Cineca. 28 June 2013. 13 July 2013. https://web.archive.org/web/20130713012501/http://www.hpc.cineca.it/news/eurotech-eurora-prace-prototype-deployed-cineca-and-infn-scores-first-green500-list. dead.
  6. Web site: Eurora - Aurora Tigon - Top500 list. top500.org. 28 June 2013.
  7. Web site: The Green500 List - November 2014. dead. https://web.archive.org/web/20150222022522/http://www.green500.org/news/green500-list-november-2014. 2015-02-22.
  8. Web site: The knowns and unknowns of the PEZY-SC accelerator at RIKEN. Hindriksen. Vincent. 2015-08-02. StreamHPC. en-GB. 2019-10-21.
  9. Web site: Japan Takes Top Three Spots on Green500 List. Tiffany . Tiffany . August 4, 2015. HPCWire. 8 January 2016.
  10. Web site: PEZY & ExaScaler Step Up on the Green500 List with Immersive Cooling. September 23, 2015. InsideHPC. 8 January 2016.
  11. Web site: June 2019 TOP500 Supercomputer Sites. www.top500.org. 2019-08-12.
  12. Web site: June 2022 TOP500 . 2022-06-27 . www.top500.org.
  13. Web site: NOVEMBER 2024. www.top500.org. en. 2024-11-19.
  14. Web site: Pioneers in purpose-built supercomputer solutions . 2024-06-05 . ParTec . en-US.