Christofari

From HandWiki
Short description: Supercomputer


Computer racks in a datacentre, with the name 'Christofari' on the end covers
The Christofari
The Christofari inside the Sberbank DC

Christofari — are Christofari (2019), Christofari Neo (2021) supercomputers of Sberbank based on Nvidia corporation hardware Sberbank of Russia and Nvidia. Their main purpose is neural network learning. They are also used for scientific research and commercial calculations.[1]

The supercomputers are named after Nikolai Christofari [ru][1], the first customer of Sberbank, holder of the Bank's first savings account passbook.[2] The supercomputers are listed in the Top 500 ranking of most powerful commercially available computer systems.

Development

Sberbank presented the supercomputers together with its subsidiary SberCloud.[3][4] In December 2019, Sberbank and SberCloud commercially launched the Christofari supercomputer.[5] Within a year, the power of Christofari became the foundation of a cloud based ML Space platform. It was configured to work with machine learning models. Sberbank and SberCloud announced this platform in December 2020.[6]

The more powerful Christofari Neo supercomputer was presented at the AI Journey international conference in November 2021 by David Rafalovsky, the CTO of Sberbank Group.[4] Currently David Rafalovsky is not a member of Sberbank Group.[7]

Usage

The supercomputers can be used by scientific, commercial and government organizations working in the various sectors of the economy. The machines were developed to work with artificial intelligence algorithms, neural network learning, and inference of various models.[1]

Sber uses Christofari for internal tasks e.g. speech recognition and autoresponder voice generation in a call center[8] (40% of customer inquiries are already answered automatically by bots[9]). Also they use it for analysis of CT scan images of the lungs. The SberDevices and Sber AI teams were the first who received access to Christofari Neo. They developed the first service based on the DALL-E neural network that generates images from queries in Russian.[10]

The power of supercomputers is also provided to other organizations when connecting the services of the cloud platform SberCloud ML Space.[11]

Christofari

The first supercomputer was presented by Herman Gref, CEO of Sberbank, and David Rafalovsky, CTO of Sberbank Group, on 8 November 2019, at the AI Journey conference in Moscow.[12][13]

As of March 2020, this is the only supercomputer in Russia designed specifically for working with artificial intelligence algorithms.[14] It is capable of training software models based on complex neural networks in unprecedentedly short time, it's Russia's fastest supercomputer.[15]

The Christofari machines are based on Nvidia DGX-2 nodes equipped with Tesla V100[16] graphics accelerators. The InfiniBand network based on Mellanox hardware is used for an interconnection. Effective performance is about 6.7 petaflops, which makes it the 40th most powerful system in the world (at the time of launch on 8 November 2019),[17] the 7th in Europe, and the 1st in Russia (the results of the previous Russian leader — the Lomonosov-2 system — were exceeded by more than two times). This is the first supercomputer of a financial organization in the world available for third-party users. It is also the first supercomputer certified in Russia to work with personal data.[18]

DGX-2 single node specifications

  • Maximum Power Usage — 10 kW
  • CPU — Dual Intel Xeon Platinum 8168, 2.7 GHz, 24-cores
  • GPUs — 16X NVIDIA Tesla V100
  • GPU Memory — 512GB total
  • NVIDIA CUDA Cores — 81920
  • NVIDIA Tensor cores — 10240
  • System Memory — 1.5TB[19]

The DGX servers are connected via Mellanox switches with 36-ports, supporting up to four InfiniBand EDR connections at 100 Gbit/s.

Almost the entire machine learning stack in use is oriented on the Ubuntu operating system as the base platform. The machines utilize a modified server version of an Ubuntu 18.04 LTS operating system. It is supported by Nvidia including graphics accelerators drivers, network software stack, and the necessary tools for maintenance and diagnostics. The package also includes proprietary software from Nvidia CUDA Toolkit, cuDNN, NCCL, and Docker Engine Utility for GPU Nvidia (the entire main machine learning stack runs in containers).

The supercomputer is located in the Sberbank data center (DC) in the Skolkovo Innovation Center in Moscow, Russia. It occupies one machine room and was built in less than a year.[20]

Positions in rankings

  • September 2021 — 1st of the 50th most powerful computers in CIS;[21]
  • June 2022 — 80th among the 500th most powerful computers in the world (November 2021 — 72nd).[22]

Christofari Neo

The second supercomputer is also built on the basis of Nvidia technologies and is equipped with Nvidia A100 GPUs with 80 GB of memory.[23] For an interconnection is used the high-speed switching InfiniBand network, which provides the speed of data exchange up to 1600 GB/s per each compute node and minimal latency. The actual performance is 11,95 petaflops.[24][25]

DGX A100 single processor specifications

  • Maximum Power Consumption — 6,5 kW
  • CPU — Dual AMD Rome 7742, 128-cores, 2.25 GHz (base), 3.4 GHz (maximum)
  • GPUs — 8X Nvidia A100, 80 GB
  • GPU memory — 640 GB
  • System memory — 2 TB

Positions in rankings

  • November 2021 — 7th place in the HPL-AI rating of supercomputers and artificial intelligence;[26]
  • June 2022 — 46th place among the 500 most powerful computers in the world (November 2021 — 43rd).[27]

See also

References

  1. 1.0 1.1 "Several dozens of Russian companies have already started working on the supercomputer run by Sberbank". 16 December 2019. https://tass.ru/ekonomika/7356311. 
  2. "Sberbank announced the most powerful supercomputer of Russia - Christofari" (in ru). 2019-11-08. https://hightech.fm/2019/11/08/cristofer. 
  3. "Сбербанк объявил о создании самого мощного в России суперкомпьютера" (in ru). February 8, 2019. https://www.rbc.ru/technology_and_media/08/11/2019/5dc45b3d9a79475ce6cda125. 
  4. 4.0 4.1 ""Сбер" представил второй суперкомпьютер". November 11, 2021. https://www.vedomosti.ru/technology/news/2021/11/11/895430-sber-predstavil-vtoroi-superkompyuter. 
  5. "В России запустили самый мощный суперкомпьютер "Кристофари"" (in ru). December 17, 2019. https://iz.ru/954930/2019-12-17/v-rossii-zapustili-samyi-moshchnyi-superkompiuter-kristofari. 
  6. "Сбербанк и SberCloud открыли свое суперкомпьютерное облако для всех разработчиков" (in ru). December 4, 2020. https://www.cnews.ru/news/top/2020-12-04_sber_otkryl_svoe_superkompyuternoe. 
  7. "Vice President Rafalovsky, who was responsible for high technologies, left Sberbank". February 26, 2022. https://time.news/vice-president-rafalovsky-who-was-responsible-for-high-technologies-left-sberbank/. 
  8. "Давид Рафаловский: "Весь мир уже в облаке, и Россия там будет"" (in ru). August 17, 2020. https://trends.rbc.ru/trends/industry/5e8b0dd59a79476c30d8ff23. 
  9. "Tech-Konzern statt Bank". https://www.nzz.ch/wirtschaft/russiche-sberbank-tech-konzern-statt-bank-von-kremls-gnaden-ld.1540161. 
  10. "Нейросеть Сбера создаст картинки на заданную тему" (in ru). November 11, 2021. https://www.gazeta.ru/business/news/2021/11/11/n_16838785.shtml. 
  11. "Тарифы на услуги" (in ru). 2021. https://cdn.sbercloud.ru/backend/docs/Prilozheniye_%E2%84%967_Tarify_na_Uslugi.pdf. 
  12. "Sberbank presents Russia's fastest supercomputer". Sberbank. 8 November 2019. https://www.finextra.com/pressarticle/80545/sberbank-presents-russias-fastest-supercomputer. 
  13. "AIJ Conference in Moscow". November 2019. https://ai-journey.ru/en/conference-moscow. 
  14. "Christofari by SberCloud". https://sbercloud.ru/christofari-en. 
  15. "Sberbank presents Russia's fastest supercomputer" (in en). 2019-11-08. https://www.finextra.com/pressarticle/80545/sberbank-presents-russias-fastest-supercomputer. 
  16. "SberCloud | TOP500". https://www.top500.org/site/50820/. 
  17. "TOP500 List - November 2019 | TOP500 Supercomputer Sites". https://www.top500.org/list/2019/11/?page=1. 
  18. "Суперкомпьютер "Кристофари" первым в РФ аттестовали для работы с персональными данными" (in ru). March 31, 2020. https://tass.ru/ekonomika/8121173. 
  19. "NVIDIA DGX-2 THE WORLD’S MOST POWERFUL DEEP LEARNING SYSTEM". 2018. https://www.nvidia.com/content/dam/en-zz/es_em/Solutions/Data-Center/dgx-2/nvidia-dgx-2-datasheet.pdf. 
  20. "Давид Рафаловский: мощности суперкомпьютера Christofari доступны всем" (in ru). November 15, 2019. https://www.forbes.ru/forbes-agenda/ai-journey/387457-david-rafalovskiy-moshchnosti-superkompyutera-cristofari-dostupny. 
  21. "Top50 | Суперкомпьютеры". http://top50.supercomputers.ru/list. 
  22. "TOP500 List - June 2022 | TOP500". https://www.top500.org/system/179778/. 
  23. "Sberbank run the most powerful supercomputer in Russia". 7 February 2022. https://www.cnews.ru/news/top/2021-11-11_sberbank_zapustil_samyj. 
  24. "CHRISTOFARI NEO - NVIDIA DGX A100, AMD EPYC 7742 64C 2.25GHZ, NVIDIA A100 80GB, INFINIBAND". 7 February 2022. https://www.top500.org/system/180028/. 
  25. "Sber has announced its brand new supercomputer". 7 February 2022. https://secretmag.ru/technologies/sber-predstavil-svoi-novyi-superkompyuter-11-11-2021.htm. 
  26. "Results". https://hpl-ai.org/doc/results. 
  27. "Christofari Neo - NVIDIA DGX A100, AMD EPYC 7742 64C 2.25GHz, NVIDIA A100 80GB, Infiniband | TOP500". https://www.top500.org/system/180028/. 
  28. "Three Russian supercomputers entered top 500 of most powerful world computers". 19 November 2019. https://russkiymir.ru/en/news/265243/.