Thursday, June 20, 2024

Big Chips: "Cerebras to Collaborate with Dell, and AMD, on AI Model Training"

From Inside HPC, June 12:

Specialty AI processor company Cerebras Systems today announced a collaboration with Dell Technologies to deliver AI compute infrastructure for generative AI.

The collaboration includes a new memory storage solution powered by Dell and AMD EPYC CPUs for Cerebras AI supercomputers, enabling enterprises to train models “orders of magnitude larger than the current state of the art,” according to the companies.

Leveraging AMD EPYC 9354P CPUs and Dell PowerEdge R6615 servers, Cerebras accelerates memory-intensive compute, “extending its 82TB streaming memory supercomputers clusters almost infinitely to train models of any size,” Cerebras said.

The Cerebras-Dell offering includes AI systems and supercomputers, large language model training and machine learning support services....

....MUCH MORE

Previously on Cerebras:
March 2024
Chips: "Cerebras Introduces ‘World’s Fastest AI Chip’..." (it's as big as your head)
All their chips are as big as your head.

July 2023
Big Deal: "Cerebras Sells $100 Million AI Supercomputer, Plans Eight More"
January 2020
"Cerebras’ Giant Chip Will Smash Deep Learning’s Speed Barrier"
Computers using Cerebras’s chip will train these AI systems in hours instead of weeks

https://spectrum.ieee.org/image/MzUzNTc5Mg.jpeg
The world’s largest chip, the Wafer Scale Engine, is more than 50 times the size of the largest GPU. 

That's a big chip. 

 May 2018 
"Artificial intelligence chips are a hot market." (NVDA; GOOG)
August 2019 
Artificial Intelligence: The World's Largest Chip Is As Big As Your Head and Contains 1.2 Trillion Transistors
August 2019 
Chips: "Two contrasting approaches to AI chips emerged at Hot Chips Conference..." (AMD; NVDA; XLNX)
September 2019 
Chips: The World's Largest Semiconductor Chip Will Power "Supercomputing hog U.S. Department of Energy"

October 2020
A Mini-Masters Class On What's What In AI Chips, Machine Learning and Programming

And many more, use the 'search blog' box if interested.