Yang Liang 2023-07-23 20:14:55
DoNews news on July 23, Abu Dhabi Technology Holding Group G42 recently announced the launch of the world’s fastest supercomputer Condor Galaxy-1 (CG-1), which has 54 million cores and a processing capacity of 4 exaFLOPS (4 exaFLOPS per second), which can be used to train the most advanced artificial intelligence models. The computer is located in Santa Clara, California, and is operated by American artificial intelligence company Cerebras.
It is reported that CG-1 shared 72704 AMD EPYC processors, the overall on-chip memory capacity reached 82TB, and the bandwidth rate between each system was as high as 388Tbps.
Under 16-bit computing, the system can provide 4 exaFLOPS of computing power, which is four times the speed of the world’s fastest supercomputer. It can be used to train 600 billion parameter models and is scalable to support 100 trillion parameter models. For comparison, OpenAI’s GPT-4 model was trained with 1.7 trillion parameters.
Cerebras and G42 also plan to introduce two more supercomputers, CG-2 and CG-3, in the US in early 2024, while making CG-1 available to customers as a cloud service.
CG-1 can handle 50000 tokens natively without any special software libraries. Programming on the CG-1 eliminates the need for complex distributed programming languages, saving valuable time distributing workflows on the GPU.
G42 and Cerebras believe the fastest supercomputers will help address challenges such as healthcare, energy and climate change.
2023-07-23 12:14:55
#worlds #powerful #supercomputer #launched #million #coresDoNews
