Nvidia showcased more details of its Blackwell server platform prior to the Hot Chips 2024 conference, including photos of Blackwell systems being installed in data centers.
Blackwell is Nvidia’s new AI and data center platform that significantly enhances networking and memory bandwidth compared to existing solutions like Hopper. It is scheduled to launch next year.
Nvidia reiterated its AI data center roadmap which includes Blackwell Ultra in 2025 with new Vera CPUs and Rubin GPUs, followed by Vera Ultra in 2027.
The company demonstrated FP16 and FP4 workloads on Blackwell that achieve similar accuracy while using significantly less bandwidth thanks to its new quantization techniques.
Nvidia also discussed its work on warm water cooling solutions for data centers which can reduce power usage by up to 28% by recirculating waste heat for other uses.
Additional details on the large scale of Blackwell servers, enhanced networking bandwidth, and Nvidia’s use of AI to aid its own chip design process were provided.
Nvidia will present more on Blackwell architecture, generative AI uses, and liquid cooling at the upcoming Hot Chips conference.
Source: Toms Hardware
