Exascale computing

HPE Frontier at the Oak Ridge Leadership Computing Facility is the world's first exascale supercomputer.

Exascale computing refers to computing systems capable of calculating at least 1018 IEEE 754 Double Precision (64-bit) operations (multiplications and/or additions) per second (exaFLOPS)";[1] it is a measure of supercomputer performance.

Exascale computing is a significant achievement in computer engineering: primarily, it allows improved scientific applications and better prediction accuracy in domains such as weather forecasting, climate modeling and personalised medicine.[2] Exascale also reaches the estimated processing power of the human brain at the neural level, a target of the now defunct Human Brain Project.[3] There has been a race to be the first country to build an exascale computer, typically ranked in the TOP500 list.[4][5][6][7]

In 2022, the world's first public exascale computer, Frontier, was announced.[8] As of November 2024, Lawrence Livermore National Laboratory's El Capitan is the world's fastest exascale supercomputer.[9]

Definitions

Further information: FLOPS, TOP500, and computer performance

Floating point operations per second (FLOPS) are one measure of computer performance. FLOPS can be recorded in different measures of precision, however the standard measure (used by the TOP500 supercomputer list) uses 64 bit (double-precision floating-point format) operations per second using the High Performance LINPACK (HPLinpack) benchmark.[10][1]

Whilst a distributed computing system had broken the 1 exaFLOPS barrier before Frontier, the metric typically refers to single computing systems. Supercomputers had also previously broken the 1 exaFLOPS barrier using alternative precision measures; again these do not meet the criteria for exascale computing using the standard metric.[1] It has been recognised that HPLinpack may not be a good general measure of supercomputer utility in real world application, however it is the common standard for performance measurement.[11][12]

Technological challenges

It has been recognized that enabling applications to fully exploit capabilities of exascale computing systems is not straightforward.[13] Developing data-intensive applications over exascale platforms requires the availability of new and effective programming paradigms and runtime systems.[14] The Folding@home project, the first to break this barrier, relied on a network of servers sending pieces of work to hundreds of thousands of clients using a client–server model network architecture.[15][16]

History

The first petascale (1015 FLOPS) computer entered operation in 2008.[17] At a supercomputing conference in 2009, Computerworld projected exascale implementation by 2018.[18] In June 2014, the stagnation of the Top500 supercomputer list had observers question the possibility of exascale systems by 2020.[19]

Although exascale computing was not achieved by 2018, in the same year the Summit OLCF-4 supercomputer performed 1.8×1018 calculations per second using an alternative metric whilst analysing genomic information.[20] The team performing this won the Gordon Bell Prize at the 2018 ACM/IEEE Supercomputing Conference.[citation needed]

The exaFLOPS barrier was first broken in March 2020 by the distributed computing network Folding@home coronavirus research project.[21][16][22][23][24]

In June 2020[25] the Japanese supercomputer Fugaku achieved 1.42 exaFLOPS using the alternative HPL-AI benchmark.

In 2022, the world's first public exascale computer, Frontier, was announced, achieving an Rmax of 1.102 exaFLOPS in June 2022.[8] As of November 2024, the world's fastest supercomputer is El Capitan at 1.742 exaFLOPS.[9]

Development

United States

In 2008, two United States of America governmental organisations within the US Department of Energy, the Office of Science and the National Nuclear Security Administration, provided funding to the Institute for Advanced Architectures for the development of an exascale supercomputer; Sandia National Laboratory and the Oak Ridge National Laboratory were also to collaborate on exascale designs.[26] The technology was expected to be applied in various computation-intensive research areas, including basic research, engineering, earth science, biology, materials science, energy issues, and national security.[27]

In January 2012, Intel purchased the InfiniBand product line from QLogic for US$125 million in order to fulfill its promise of developing exascale technology by 2018.[28]

By 2012, the United States had allotted $126 million for exascale computing development.[29]

In February 2013,[30] the Intelligence Advanced Research Projects Activity started the Cryogenic Computer Complexity (C3) program, which envisions a new generation of superconducting supercomputers that operate at exascale speeds based on superconducting logic. In December 2014 it announced a multi-year contract with IBM, Raytheon BBN Technologies and Northrop Grumman to develop the technologies for the C3 program.[31]

On 29 July 2015, Barack Obama signed an executive order creating a National Strategic Computing Initiative calling for the accelerated development of an exascale system and funding research into post-semiconductor computing.[32] The Exascale Computing Project (ECP) hopes to build an exascale computer by 2021.[33]

On 18 March 2019, the United States Department of Energy and Intel announced the first exaFLOPS supercomputer would be operational at Argonne National Laboratory by late 2022. The computer, named Aurora is to be delivered to Argonne by Intel and Cray (now Hewlett Packard Enterprise), and is expected to use Intel Xe GPGPUs alongside a future Xeon Scalable CPU, and cost US$600 Million.[34][35]

On 7 May 2019, the U.S. Department of Energy announced a contract with Cray (now Hewlett Packard Enterprise) to build the Frontier supercomputer at Oak Ridge National Laboratory. Frontier is anticipated to be fully operational in 2022 [36] and, with a performance of greater than 1.5 exaFLOPS, should then be the world's most powerful computer.[37]

On 4 March 2020, the U.S. Department of Energy announced a contract with Hewlett Packard Enterprise and AMD to build the El Capitan supercomputer at a cost of US$600 million, to be installed at the Lawrence Livermore National Laboratory (LLNL). It is expected to be used primarily (but not exclusively) for nuclear weapons modeling. El Capitan was first announced in August 2019, when the DOE and LLNL revealed the purchase of a Shasta supercomputer from Cray. El Capitan will be operational in early 2023 and have a performance of 2 exaFLOPS. It will use AMD CPUs and GPUs, with 4 Radeon Instinct GPUs per EPYC Zen 4 CPU, to speed up artificial intelligence tasks. El Capitan should consume around 40 MW of electric power.[38][39]

In May 2022, the United States had its first exascale supercomputer, Frontier. In June 2024, Argonne National Laboratory's Aurora became the country's second exascale computer, followed five months later by El Capitan becoming operational. As of November 2024, the United States remains the only country with exascale supercomputers.

Japan

In Japan, in 2013, the RIKEN Advanced Institute for Computational Science began planning an exascale system for 2020, intended to consume less than 30 megawatts.[40] In 2014, Fujitsu was awarded a contract by RIKEN to develop a next-generation supercomputer to succeed the K computer. The successor is called Fugaku, and aims to have a performance of at least 1 exaFLOPS, and be fully operational in 2021. In 2015, Fujitsu announced at the International Supercomputing Conference that this supercomputer would use processors implementing the ARMv8 architecture with extensions it was co-designing with ARM Limited.[41] It was partially put into operation in June 2020[25] and achieved 1.42 exaFLOPS (fp16 with fp64 precision) in HPL-AI benchmark making it the first ever supercomputer that achieved 1 exaFLOPS.[42] Named after Mount Fuji, Japan's tallest peak, Fugaku retained the No. 1 ranking on the Top 500 supercomputer calculation speed ranking announced on November 17, 2020, reaching a calculation speed of 442 quadrillion calculations per second, or 0.442 exaFLOPS.[43]

In around May 2026, Japan will have its first exascale supercomputer. In other words, the country will get an exascale supercomputer then. Japan will also be the second country to have at least one exascale supercomputer after the United States, which had only one exascale supercomputer for around two years, between May 2022 and May 2024.[citation needed]

China

As of June 2022, China had two of the Top Ten fastest supercomputers in the world. According to the national plan for the next generation of high performance computers and the head of the school of computing at the National University of Defense Technology (NUDT), China was supposed to develop an exascale computer during the 13th Five-Year-Plan period (2016–2020) which would enter service in the latter half of 2020.[44] The government of Tianjin Binhai New Area, NUDT and the National Supercomputing Center in Tianjin are working on the project. After Tianhe-1 and Tianhe-2, the exascale successor is planned to be named Tianhe-3. As of 2023 China is reported to have two operational exascale computers; Tianhe-3 and Sunway OceanLight, with a third being built. Neither are on the Top500.[45][46]

European Union & United Kingdom

See also Supercomputing in Europe

In 2011, several projects aiming at developing technologies and software for exascale computing were started in the European Union. The CRESTA project (Collaborative Research into Exascale Systemware, Tools and Applications),[47] the DEEP project (Dynamical ExaScale Entry Platform),[48] and the project Mont-Blanc.[49] A major European project based on exascale transition is the MaX (Materials at the Exascale) project.[50] The Energy oriented Centre of Excellence (EoCoE) exploits exascale technologies to support carbon-free energy research and applications.[51]

In 2015, the Scalable, Energy-Efficient, Resilient and Transparent Software Adaptation (SERT) project, a major research project between the University of Manchester and the STFC Daresbury Laboratory in Cheshire, was awarded c. £1million from the United Kingdom's Engineering and Physical Sciences Research Council. The SERT project was due to start in March 2015. It will be funded by EPSRC under the Software for the Future II programme, and the project will partner with the Numerical Analysis Group (NAG), Cluster Vision and the Science and Technology Facilities Council (STFC).[52]

On 28 September 2018, the European High-Performance Computing Joint Undertaking (EuroHPC JU) was formally established by the EU. The EuroHPC JU aims to build an exascale supercomputer by 2022/2023. The EuroHPC JU will be jointly funded by its public members with a budget of around €1 billion. The EU's financial contribution is €486 million.[53][54]

In March 2023 the government of the United Kingdom announced it would invest £900 million in the development of an exascale computer.[55] This project was axed in August 2024.[56]

Taiwan

In June 2017, Taiwan's National Center for High-Performance Computing initiated the effort towards designing and building the first Taiwanese exascale supercomputer by funding construction of a new intermediary supercomputer based on a full technology transfer from Fujitsu corporation of Japan, which is currently building the fastest and most powerful A.I. based supercomputer in Japan.[57][58][59][60][61] Additionally, numerous other independent efforts have been made in Taiwan with the focus on the rapid development of exascale supercomputing technology, such as Foxconn Corporation which recently designed and built the largest and fastest supercomputer in all of Taiwan. This new Foxconn supercomputer is designed to serve as a stepping stone in research and development towards the design and building of a state of the art exascale supercomputer.[62][63][64][65]

India

In 2012, the Indian Government proposed to commit US$2.5 billion to supercomputing research during the 12th five-year plan period (2012–2017). The project was to be handled by Indian Institute of Science (IISc), Bangalore.[66] Additionally, it was later revealed that India plans to develop a supercomputer with processing power in the exaFLOPS range.[67] It will be developed by C-DAC within the subsequent five years of approval.[68] These supercomputers will use indigenously developed microprocessors by C-DAC in India.[69] In 2023, in a presentation by CDAC, it plans to have a indigenously developed exascale supercomputer named Param Shankh. The Param Shankh will be powered by an indigenous 96 core, ARM architecture-based processor which has been nicknamed AUM (ॐ).[70]

See also

References

  1. ^ a b c Kogge, Peter, ed. (1 May 2008). ExaScale Computing Study: Technology Challenges in Achieving Exascale Systems (PDF). United States Government. Archived (PDF) from the original on 10 August 2021. Retrieved 28 September 2008.
  2. ^ Gagliardi, Fabrizio; Moreto, Miquel; Olivieri, Mauro; Valero, Mateo (1 May 2019). "The international race towards Exascale in Europe". CCF Transactions on High Performance Computing. 1 (1): 3–13. doi:10.1007/s42514-019-00002-y. hdl:2117/186531. ISSN 2524-4930.
  3. ^ "Brain performance in FLOPS – AI Impacts". aiimpacts.org. 26 July 2015. Archived from the original on 28 December 2017. Retrieved 27 December 2017.
  4. ^ Moss, Sebastian (15 March 2019). "The race to exascale: A story of superpowers and supercomputers". www.datacenterdynamics.com. Archived from the original on 6 July 2020. Retrieved 6 July 2020.
  5. ^ Waters, Richard (5 March 2020). "Opinion: How the US and China are calculating on supercomputer dominance". www.ft.com. Archived from the original on 22 April 2020. Retrieved 6 July 2020.
  6. ^ Anderson, Mark (7 January 2020). "Full Page Reload". IEEE Spectrum: Technology, Engineering, and Science News. Archived from the original on 24 June 2020. Retrieved 6 July 2020.
  7. ^ Nuttall, Chris (9 July 2013). "Supercomputers: Battle of the speed machines". www.ft.com. Archived from the original on 6 July 2020. Retrieved 6 July 2020.
  8. ^ a b Larabel, Michael (30 May 2022). "AMD-Powered Frontier Supercomputer Tops Top500 At 1.1 Exaflops, Tops Green500 Too". www.phoronix.com. Archived from the original on 6 June 2022. Retrieved 1 June 2022.
  9. ^ a b "El Capitan achieves top spot, Frontier and Aurora follow behind". www.top500.org. Retrieved 19 November 2024.
  10. ^ "FREQUENTLY ASKED QUESTIONS". www.top500.org. Archived from the original on 3 April 2021. Retrieved 23 June 2020.
  11. ^ Bourzac, Katherine (November 2017). "Supercomputing poised for a massive speed boost". Nature. 551 (7682): 554–556. doi:10.1038/d41586-017-07523-y. PMID 29189799.
  12. ^ Reed, Daniel; Dongarra, Jack. "Exascale Computing and Big Data: The Next Frontier" (PDF). Archived (PDF) from the original on 18 June 2022. Retrieved 3 June 2022.
  13. ^ Abraham, Erika; Bekas, Costas; Brandic, Ivona; Genaim, Samir; Broch Johnsen, Einar; Kondov, Ivan; Pllana, Sabri; Streit, Achim (24 March 2015), Preparing HPC Applications for Exascale: Challenges and Recommendations, arXiv:1503.06974, Bibcode:2015arXiv150306974A
  14. ^ Da Costa, Georges; et, al. (2015), "Exascale Machines Require New Programming Paradigms and Runtimes", Supercomputing Frontiers and Innovations, 2 (2): 6–27, doi:10.14529/jsfi150201, archived from the original on 20 February 2020, retrieved 20 February 2020
  15. ^ "About – Folding@home". Archived from the original on 28 March 2020. Retrieved 26 March 2020.
  16. ^ a b Alcorn, Paull (26 March 2020). "Folding@Home Network Breaks the ExaFLOP Barrier In Fight Against Coronavirus". Tom's Hardware. Archived from the original on 6 June 2020. Retrieved 26 March 2020.
  17. ^ National Research Council (U.S.) (2008). The potential impact of high-end capability computing on four illustrative fields of science and engineering. The National Academies. p. 11. ISBN 978-0-309-12485-0.
  18. ^ "Scientists, IT community await exascale computers". Computerworld. 7 December 2009. Archived from the original on 12 December 2009. Retrieved 18 December 2009.
  19. ^ Anthony, Sebastian (24 June 2014). "Supercomputer stagnation: New list of the world's fastest computers casts shadow over exascale by 2020". Extremetech.com. Archived from the original on 28 August 2014. Retrieved 25 June 2014.
  20. ^ Hines, Jonathan (8 June 2018). "Genomics Code Exceeds Exaops on Summit Supercomputer". Oak Ridge Leadership Computing Facility. Archived from the original on 17 July 2018. Retrieved 17 July 2018.
  21. ^ Folding@home (25 March 2020). "Thanks to our AMAZING community, we've crossed the exaFLOP barrier! That's over a 1,000,000,000,000,000,000 operations per second, making us ~10x faster than the IBM Summit!pic.twitter.com/mPMnb4xdH3". @foldingathome. Archived from the original on 26 March 2020. Retrieved 26 March 2020.
  22. ^ "Folding@Home Active CPUs & GPUs by OS". www.foldingathome.org. Archived from the original on 12 April 2020. Retrieved 8 April 2020.
  23. ^ "Folding@Home Crushes Exascale Barrier, Now Faster Than Dozens of Supercomputers - ExtremeTech". www.extremetech.com. 27 March 2020. Archived from the original on 17 April 2020. Retrieved 4 April 2020.
  24. ^ "Folding@Home exceeds 1.5 ExaFLOPS in the battle against Covid-19". TechSpot. 26 March 2020. Archived from the original on 2 July 2020. Retrieved 4 April 2020.
  25. ^ a b "RIKEN selects contractor for basic design of post-K supercomputer", www.aics.riken.jp, 1 October 2014, archived from the original on 13 January 2017, retrieved 22 June 2016
  26. ^ Johnson, R. Colin (4 May 2008), "U.S. launches exaflop supercomputer initiative", www.eetimes.com, archived from the original on 13 August 2016, retrieved 22 June 2016
  27. ^ "Science Prospects and Benefits with Exascale Computing" (PDF). Oak Ridge National Laboratory. Archived from the original (PDF) on 26 May 2012. Retrieved 18 December 2009.
  28. ^ "Intel Snaps Up InfiniBand Technology, Product Line from QLogic". 23 January 2012. Archived from the original on 14 August 2014. Retrieved 10 August 2014.
  29. ^ "Obama Budget Includes $126 Million for Exascale Computing". Archived from the original on 24 February 2011.
  30. ^ "Proposers' Day Announcement for the IARPA Cryogenic Computing Complexity (C3) Program - IARPA-BAA-13-05(pd) (Archived)". Federal Business Opportunities. 11 February 2013. Archived from the original on 11 December 2014. Retrieved 11 October 2015.
  31. ^ "US intel agency aims to develop superconducting computer". CNBC. Reuters. 3 December 2014. Archived from the original on 16 December 2014. Retrieved 3 December 2014.
  32. ^ "Executive Order Creating a National Strategic Computing Initiative". whitehouse.gov. 29 July 2015. Archived from the original on 30 November 2018. Retrieved 11 October 2015 – via National Archives.
  33. ^ "U.S. Bumps Exascale Timeline, Focuses on Novel Architectures for 2021". The Next Platform. 8 December 2016. Archived from the original on 20 December 2016. Retrieved 13 December 2016.
  34. ^ "U.S. Department of Energy and Intel to deliver first exascale supercomputer". Argonne National Laboratory. 18 March 2019. Archived from the original on 8 July 2019. Retrieved 27 March 2019.
  35. ^ Hemsoth, Nicole (23 September 2021). "A Status Check on Global Exascale Ambitions". The Next Platform. Archived from the original on 16 October 2021. Retrieved 15 October 2021.
  36. ^ "First Look At Oak Ridge's "Frontier" Exascaler, Contrasted To Argonne's "Aurora"". Next Platform. 4 October 2021. Archived from the original on 3 January 2022. Retrieved 3 January 2022.
  37. ^ "U.S. Department of Energy and Cray to Deliver Record-Setting Frontier Supercomputer at ORNL". Oak Ridge National Laboratory. 8 May 2019. Archived from the original on 8 May 2019. Retrieved 8 May 2019.
  38. ^ "HPE, AMD win deal for U.S. supercomputer to model nuclear weapons". Reuters. 5 March 2020. Archived from the original on 11 April 2020. Retrieved 11 April 2020 – via www.reuters.com.
  39. ^ Smith, Ryan. "El Capitan Supercomputer Detailed: AMD CPUs & GPUs To Drive 2 Exaflops of Compute". www.anandtech.com. Archived from the original on 4 March 2020. Retrieved 9 April 2020.
  40. ^ Thibodeau, Patrick (22 November 2013). "Why the U.S. may lose the race to exascale". Computerworld. Archived from the original on 3 September 2014. Retrieved 27 August 2014.
  41. ^ "Fujitsu picks 64-bit ARM for Japan's monster 1,000-PFLOPS super", www.theregister.co.uk, 20 June 2016, archived from the original on 19 September 2017, retrieved 27 August 2017
  42. ^ "Results — HPL-AI 0.0.2 documentation". icl.bitbucket.io. Archived from the original on 12 April 2021. Retrieved 26 February 2021.
  43. ^ No contest: Japan's Fugaku again fastest supercomputer, archived from the original on 10 February 2023, retrieved 8 January 2021
  44. ^ "China's Exascale Supercomputer Operational by 2020---Chinese Academy of Sciences". english.cas.cn. Archived from the original on 20 June 2016. Retrieved 23 June 2016.
  45. ^ "China pushes supercomputing goal despite US curbs". 22 September 2023.
  46. ^ IEEE
  47. ^ "Europe Gears Up for the Exascale Software Challenge with the 8.3M Euro CRESTA project". Project consortium. 14 November 2011. Archived from the original on 23 December 2011. Retrieved 10 December 2011.
  48. ^ "Booster for Next-Generation Supercomputers Kick-off for the European exascale project DEEP". FZ Jülich. 15 November 2011. Archived from the original on 3 September 2014. Retrieved 10 December 2011.
  49. ^ "Mont-Blanc project sets Exascale aims". Project consortium. 31 October 2011. Archived from the original on 5 December 2011. Retrieved 10 December 2011.
  50. ^ "MaX website". project consortium. 25 November 2016. Archived from the original on 26 November 2016. Retrieved 25 November 2016.
  51. ^ "EoCoE website". Project consortium. 29 April 2020. Archived from the original on 5 August 2020. Retrieved 29 April 2020.
  52. ^ "Developing Simulation Software to Combat Humanity's Biggest Issues". Scientific Computuing. 25 February 2015. Archived from the original on 14 April 2015. Retrieved 8 April 2015.
  53. ^ "EuroHPC - Europe's journey to exascale HPC". Archived from the original on 30 October 2018. Retrieved 9 February 2019.
  54. ^ "The European High-Performance Computing Joint Undertaking - EuroHPC". 11 January 2018. Archived from the original on 28 December 2018. Retrieved 9 February 2019.
  55. ^ Milmo, Dan; Hern, Alex (15 March 2023). "UK to invest £900m in supercomputer in bid to build own 'BritGPT'". TheGuardian.com.
  56. ^ "Government shelves £1.3bn UK tech and AI plans". bbc.co.uk. August 2024.
  57. ^ "Fujitsu to build world-class AI supercomputer". Archived from the original on 8 January 2018. Retrieved 3 March 2018.
  58. ^ "Fujitsu to Build Japan's Fastest Supercomputer | TOP500 Supercomputer Sites". Archived from the original on 11 October 2017. Retrieved 3 March 2018.
  59. ^ "Fujitsu to Build 3-PFLOPS Supercomputer for Taiwan NCHC". Archived from the original on 8 January 2018. Retrieved 3 March 2018.
  60. ^ "Asetek Receives Order from Fujitsu to Cool Japan's Fastest AI Supercomputer System - Asetek". Archived from the original on 8 January 2018. Retrieved 3 March 2018.
  61. ^ "Fujitsu Receives Order for Japan's Fastest Supercomputer System for AI Applications - Fujitsu Global". Archived from the original on 22 February 2018. Retrieved 3 March 2018.
  62. ^ "Foxconn Builds Taiwan's Largest Supercomputer | TOP500 Supercomputer Sites". Archived from the original on 10 February 2018. Retrieved 3 March 2018.
  63. ^ "Taiwan-based firm reveals supercomputer". Archived from the original on 8 January 2018. Retrieved 3 March 2018.
  64. ^ "Hon Hai unveils Taiwan's fastest superc". 28 December 2017. Archived from the original on 8 January 2018. Retrieved 3 March 2018.
  65. ^ "Hon Hai unveils supercomputer system | Tech | FOCUS TAIWAN - CNA ENGLISH NEWS". 26 December 2017. Archived from the original on 2 February 2018. Retrieved 3 March 2018.
  66. ^ "India Aims to Double R&D Spending for Science". HPC Wire. 4 January 2012. Archived from the original on 12 January 2012. Retrieved 29 January 2012.
  67. ^ "C-DAC and Supercomputers in India". Archived from the original on 3 March 2016. Retrieved 6 January 2016.
  68. ^ "India plans 61 times faster supercomputer by 2017". The Times of India. 27 September 2012. Archived from the original on 28 January 2013. Retrieved 9 October 2012.
  69. ^ "India to build 11 new supercomputers, with indigenous processors developed by C-DAC". ThePrint. 22 December 2019. Archived from the original on 27 October 2021. Retrieved 21 September 2021.
  70. ^ Morgan, Timothy Prickett (17 May 2023). "India Declares CPU Independence With Aum HPC Processor". The Next Platform. Retrieved 26 May 2023.

Sources