Thursday, February 15, 2024

"Armored Cars and Trillion Dollar Price Tags: How Some Tech Leaders Want to Solve the Chip Shortage"

From the Wall Street Journal, February 14:

Companies looking to leverage cutting-edge AI are taking steps to secure their chips and hardware, even as they remain optimistic about the future of chip availability

Some corporate technology leaders expect the shortage of advanced artificial-intelligence chips to improve next year, but until then, are not taking chances securing the hardware that will allow them to leverage new generative AI applications. 

Graphics processing units, or GPUs, which are primarily produced by chip giant Nvidia, have been the engine behind the AI boom because they enable parallel processing, or the ability to run lots of computations at the same time.

Access to those chips was top of mind for chief information officers and tech leaders who convened this week at The Wall Street Journal’s annual CIO Network Summit in Menlo Park, Calif., on Tuesday.

“Those GPUs arrive by armored car,” said

CIO Fletcher Previn, speaking at the summit. Cisco and last week announced a joint effort to provide AI infrastructure products, including networking, software and servers to businesses.

The availability of GPUs and other so-called AI accelerator chips could be one of the key limiting factors in exploiting generative AI’s true potential. Manufacturing chips is enormously capital intensive. It is also one of the most intricately complex industries in the world, with a history of sharp cyclical swings that have made companies wary of radical expansion

The Wall Street Journal earlier reported that OpenAI Chief Executive Sam Altman was pursuing investors including the United Arab Emirates for a project requiring up to $7 trillion to reshape the global semiconductor industry. 

“He’s a smart guy,” said Andrew Ng, managing general partner of AI Fund, referring to Altman’s plans at the summit. “I don’t know where we find $7 trillion…That’s an interesting figure to try to raise.”

But Ng also said he is optimistic that chip availability could improve over the next year. Other offerings in the market beyond chips made by Nvidia, including those provided by Intel and Advanced Micro Devices, are rapidly improving. 

So far Nvidia’s moat has been its programming language that works in tandem with its hardware, but that is an area where AMD’s open-source offering is increasingly working to compete, he said.

Hasmukh Ranjan, CIO of AMD, said at the summit that the chip giant is using AI to improve its own computing capabilities, and has seen a 5% improvement in efficiency. AMD in December began rolling out its newest AI chips—presenting perhaps the toughest challenge yet to Nvidia’s dominance in the space....

....MUCH MORE

As noted in the outro from January 21's Chips: "Now OpenAI CEO Sam Altman wants billions for AI chip fabs"

Chips appear to have become a high-value currency substitute.

Possibly related, December 30, 2023:

"I Saw the Face of God in a Semiconductor Factory"