Wednesday, March 6, 2024

WSJ: An in-depth look at Nvidia's DGX H100 setup: 32 DGX boxes, each weighing 300lb, that house eight individual $25K H100 GPUs, cooling, and other chips....

Earlier this morning the stock got to $889.68 and we are still pitching the "ride the bubble" approach—up $220 since the last mention, Feb. 6—but that could change anywhere between today and the end of the NVDA GTC conference (Mar. 21)

From the Wall Street Journal, March 6:

The Nvidia Chips Inside Powerful AI Supercomputers

Built to drive the graphics of videogames including ‘Call of Duty, ’ they now also power ChatGPT and other AI tools Nvidia is having a moment over its graphics processing units, or GPUs—hot commodities that are essential in creating AI systems such as ChatGPT. But what exactly are GPUs?

Unlike the circuitry on standard computer chips, which handle one computation at a time, in what is called serial processing, GPUs handle much more complex tasks by making many calculations at the same time, an approach known as parallel processing. Originally designed to make videogames run better, GPUs started to be widely used in AI around 2012. 

“They are able to do more computations per unit of energy consumed by being able to incorporate huge numbers of smaller and smaller transistors,” said Hanna Dohmen, research analyst at Georgetown University’s Center for Security and Emerging Technology.

Tech companies working on those systems, including Meta Platforms and Microsoft, are shelling out for them, pushing the revenue of Nvidia to unprecedented heights. The company recently said it expected around $24 billion in sales in its current quarter, which would be a record for the company and more than three times the amount for the same period a year earlier....

....MUCH MORE (some pretty fancy graphic renderings)