Groq raises $650M as its AI inference cloud takes center stage

Groq has confirmed a new $650 million funding round after Nvidia licensed its technology and hired away key leaders. The AI chipmaker is now emphasizing its neocloud business while rebuilding its executive team.

WTF Index NEUTRAL
◄ Terminator 1 Idiocracy 0 ►

This is mainly a routine AI infrastructure funding and strategy story, with only a mild tilt toward more powerful AI compute capacity.

Groq raises $650M as its AI inference cloud takes center stage

Groq is trying to define its next phase after a major deal with Nvidia changed the shape of the company. The AI chipmaker confirmed a new $650 million funding round and is now putting more emphasis on its neocloud business, while also adding new senior leaders.

The shift follows a period in which Nvidia signed a non-exclusive licensing agreement for Groq's technology and hired away founder and CEO Jonathan Ross, president Sunny Madra, and other employees. Groq has not disclosed its new valuation.

A new raise after a major Nvidia deal

On Monday, Groq announced the $650 million raise, confirming earlier reports. The funding comes roughly six months after Nvidia's agreement for Groq technology and the departure of several important executives.

The company had last been valued at $6.9 billion following a $750 million round in September. This time, Groq did not say what valuation investors assigned to the business.

The timing matters because the company is operating after what has been described as a not-acqui-hire deal. In that kind of arrangement, a rival does not buy the company outright, but pays for access to intellectual property while hiring away important talent.

For Groq, the practical result is a company with fresh capital, a changed leadership roster, and a new strategic emphasis. Investors who participated before the Nvidia agreement were said to have profited handsomely after that December deal.

How Groq got here

Groq was founded a decade ago by Jonathan Ross and Doug Wightman, both connected to Google engineering backgrounds. Ross was already known in the AI chip world for his role in helping create Google's AI chip, the Tensor Processing Unit.

The company built a chip it called a language processing unit, or LPU. Groq positioned LPUs for inference, the part of AI computing that handles running models after they have been built.

Groq sold its technology in two main ways: as part of a cloud service and as an on-premises hardware cluster. That meant customers could use Groq's inference hardware through hosted infrastructure or deploy it more directly.

After Nvidia licensed Groq's technology, Nvidia announced its own inference hardware system at its GTC event in March. That system is called the Nvidia Groq 3 LPX inference hardware system.

The source material states that Nvidia now owns the IP for LPUs. That creates an unusual competitive situation: Groq is still operating in inference, but the key hardware IP is now also in the hands of the dominant GPU company.

The neocloud pivot

Groq says it has pivoted to its neocloud business. That unit had been run by Sunny Madra after Groq acquired his AI data analytics company Definitive Intelligence, in 2024.

The neocloud business gives Groq a different way to compete. Rather than focusing only on selling a specific chip or hardware cluster, the company can sell access to infrastructure used by developers and AI companies.

According to the company, the neocloud business has expanded to 13 data centers across North America, Europe, the Middle East and APAC. Groq also says it serves over five million developers and thousands of AI companies.

The company says it is processing trillions of tokens each week. Those figures show why the cloud side of the business is now central to Groq's story: demand for inference is not abstract for the company, but tied to a large operating footprint.

This pivot also makes the competitive question sharper. If Nvidia can use Groq-related IP in its own inference hardware system, Groq's challenge is to prove that its cloud service can remain useful and differentiated for customers.

Rebuilding the leadership bench

Groq is also adding executives after the leadership changes tied to the Nvidia deal. Doug Wightman stayed with the company and became CEO after Jonathan Ross left.

The company added Alan Rice as COO. Rice previously worked at xAI and Meta, after a career in the U.S. Navy.

Groq also brought in Sinclair Schuller as CTO and Rakesh Malhotra as CPO. The two had worked together before at Apprenda, an enterprise cloud software company founded by Schuller.

Schuller and Malhotra later co-founded Nuvalence, a software-engineering firm acquired by EY in 2024. Malhotra also previously spent about a decade working on Microsoft's cloud products.

Those hires fit the company's current direction. Groq is emphasizing cloud infrastructure, developer use, and AI company customers, so leaders with experience in cloud software and engineering services are directly relevant to the business it now highlights.

The hard question for Groq

Groq's path now depends on whether its inference cloud can stay competitive while Nvidia also has access to important Groq hardware IP. The source article frames that as the central uncertainty for the company after the Nvidia agreement.

There are reasons Groq still has an opening. Inference-related technology is seeing tremendous demand and VC investment, according to the source. At the same time, the area is also drawing more innovation and competition.

Groq is not the only AI company to face this kind of disruption. Scale AI's CEO Jason Droege told Forbes that business has rebounded after Meta did a $14.3 billion not-acqui-hire about a year ago, and that the company is on track to do $1 billion in revenue.

That comparison does not guarantee Groq's outcome. It does show that a company can keep operating after a large rival takes talent and access to important assets.

For now, Groq's story is about capital, continuity, and a bet on cloud demand. The $650 million raise gives it more resources, the new hires refill part of the executive team, and the neocloud pivot gives the company a clearer business focus after a complicated Nvidia deal.