– Cerebras has developed the world’s largest computer chip called the Wafer Scale Engine 3 (WSE-3). It contains 4 trillion transistors on a single silicon wafer that is 8.5 inches by 8.5 inches in size.
– The WSE-3 chip is twice as powerful as Cerebras’ previous WSE-2 chip, containing 2.6 trillion transistors. It has adhered to Moore’s Law with the number of transistors doubling every two years.
– The WSE-3 chip will be used to power the upcoming Condor Galaxy 3 supercomputer in Dallas, Texas. When completed, it will produce 8 exaFLOPs of computing power with 64 AI systems powered by the WSE-3 chip.
– Combined with existing Condor Galaxy supercomputers, the entire network will reach 16 exaFLOPs of power, making it 8 times faster than the current most powerful 1 exaFLOP Frontier supercomputer.
– The Condor Galaxy 3 will be used to train future massive AI systems with up to 24 trillion parameters, 10 times larger than current systems like GPT-4.
– Cerebras claims the WSE-3 chip uses the same amount of power as the previous WSE-2 chip, despite being twice as powerful, showing efficiency improvements.
Source: livescience
