Monday, July 10, 2023

Billions and Billions Of Dollars: AI as “kind and supportive companion,”

I looked at Inflection AI for a split second and saw that Reid Hoffman was involved. No interest. 

Many folks will have a different opinion of the Bill Gates, Eric Schmidt,, Nvidia, and Microsoft funded venture.

From EE Times, July 5:

The Cost of Compute: Billion-Dollar Chatbots 

Silicon Valley generative AI startup Inflection AI has raised $1.3 billion in a bid to take on OpenAI’s ChatGPT with its AI personal assistant, Pi, which it plans to make available both directly to consumers and via an API. Pi is a “kind and supportive companion,” designed to offer “fast, relevant and helpful information and advice,” according to the company. It launched in May.

While there’s no official public figure for how much OpenAI has raised, Microsoft has reportedly invested as much as a whopping $10 billion in OpenAI over several years. OpenAI and Inflection competitor Anthropic has raised a similar amount to Inflection.

Where is all the money going?

The answer is compute. OpenAI’s ChatGPT has been trained and deployed in Microsoft’s Azure cloud, while Anthropic has trained and now runs its Claude LLM in Google’s cloud. By contrast, Inflection plans to build its own supercomputer to deploy Pi.

The winning entry in last week’s MLPerf benchmark for training GPT-3 turned out to be Inflection’s supercomputer, which is still a work-in-progress. When finished, Inflection’s installation will be 22,000 Nvidia H100 GPUs, making it both the largest AI cluster and one of the largest computing clusters in the world. All for a chatbot. Nvidia’s own AI supercomputer, Eos, a 4,600-GPU monster, is still in the bring-up phase, but will be dwarfed by Inflection’s cluster....