Abu Dhabi’s G42 and Cerebras Systems have collaborated to launch an impressive supercomputer for AI training. The Condor Galaxy, consisting of a network of nine interconnected supercomputers, aims to revolutionize AI compute by significantly reducing AI model training time. The first supercomputer on this network, named Condor Galaxy 1 (CG-1), boasts a remarkable 4 exaFLOPs and a whopping 54 million cores.
With plans to release two more supercomputers, CG-2 and CG-3, in the US by early 2024, Cerebras and G42 are making significant strides in advancing AI technology. Located in Santa Clara, California, CG-1 connects 64 Cerebras CS-2 systems into a single, convenient AI supercomputer with a training capacity of 4 exaFLOPs. This collaboration enables customers to enjoy the performance of an AI supercomputer without the complexities of managing or distributing models across physical systems.
The partnership between Cerebras and G42 introduces a novel approach to AI training by combining their expertise in vast datasets, specialized AI knowledge, and high-performance compute. The result is a democratization of AI, allowing easy access to leading AI compute within the industry.
G42’s involvement with diverse datasets across healthcare, energy, and climate studies further enhances the capabilities of these supercomputing systems. By training new cutting-edge foundational models, this collaboration has the potential to generate impactful applications that benefit society as a whole.
Notably, CG-1, referred to as a game-changer, is optimized for Large Language Models and Generative AI, delivering an impressive 4 exaFLOPs of 16-bit AI compute. It can support up to 600 billion parameter models, with the potential to expand to configurations that accommodate up to 100 trillion parameter models.
Featuring 54 million AI-optimized compute cores, 388 terabits per second of fabric bandwidth, and powered by 72,704 AMD EPYC processor cores, CG-1 outperforms any known GPU cluster. Its near-linear performance scaling from 1 to 64 CS-2 systems via data parallelism further demonstrates its capabilities.
The Cerebras-G42 collaboration promises groundbreaking results and will undoubtedly accelerate numerous AI projects worldwide. By bringing together a team of experts in hardware engineering, data engineering, AI science, and industry specialists, they offer a comprehensive AI solution to address customers’ specific challenges.
In summary, Abu Dhabi’s G42 and Cerebras Systems have united their expertise to introduce the Condor Galaxy supercomputing network, which aims to revolutionize AI compute. With the launch of their first supercomputer, CG-1, they have demonstrated their commitment to simplifying AI model training and fostering innovation. By democratizing AI and providing access to leading AI compute, Cerebras and G42 are driving the advancement of cutting-edge technology across various industries.