Thursday, March 21, 2024

A Very Indian Advance In AI: Build A Model That Can Talk To My Wife's Parents In My Voice

From the always interesting Analytics India Magazine*, February 20:

NVIDIA Researchers Make Indic AI Model to Talk to their Spouses’ Indian Parents 

The four researchers triumphed in the LIMMITS ’24 challenge, which tasked participants with replicating a speaker’s voice in real-time in different languages. 

NVIDIA researchers, Akshit Arora and Rafael Valle, wanted to speak to their wives’ families in their native languages. Arora, a senior data scientist supporting one of NVIDIA’s major clients, speaks Punjabi, while his wife and her family are Tamil speakers, a divide he has long sought to bridge. Valle, originally from Brazil, faced a similar challenge as his wife and family speak Gujarati.

“We’ve tried many products to help us have clearer conversations,” said Valle. This motivation led them to build multilingual text-to-speech models that could convert their voice into different languages in real time, which led them to winning competitions.

Arora, in an exclusive interview with AIM, shed more light on this. “When this competition came to our radar, it occurred to us that one of the models that we had been working on called P-Flow, would be perfect for this kind of a competition,” said Arora, which is also narrated in his latest blog.

Arora and Valle, along with Sungwon Kim and Rohan Badlani, triumphed in the LIMMITS ’24 challenge, which tasked participants with replicating a speaker’s voice in real-time in different languages. Their innovative AI model achieved this feat using only a brief three-second speech sample....

This is the Internet Archive version of the article. The original URL (https://analyticsindiamag.com/get-over-q-openai-takes-agi-to-the-next-level-with-ppo/)began redirecting so much that the poor browser couldn't follow and just quit trying....

And:

"OpenAI is reportedly working on a project Q* (pronounced Q-Star), capable of solving unfamiliar math problems."It's the last of three stories linked in that post.