Aramco backs Groq’s Saudi AI inference center plan

Groq and Aramco plan to build a major AI inference center in Saudi Arabia, with 19,000 LPUs expected at launch and a possible path to 200,000 LPUs. The project is tied to Saudi Arabia’s push to expand its technology base and reduce reliance on oil.

WTF Index TERMINATOR
◄ Terminator 2 Idiocracy 0 ►

Large-scale AI inference infrastructure modestly increases AI capability and concentration of power, though no direct harm or autonomy is described.

Aramco backs Groq’s Saudi AI inference center plan

Groq, the California-based AI chip company, is teaming up with Saudi oil giant Aramco on a large data center in Saudi Arabia. The project is designed to expand the kingdom’s AI capabilities and, according to Groq, could become the world’s largest AI inference center.

What Groq and Aramco are building

Groq CEO Jonathan Ross says the Saudi data center should be operating by year’s end. At launch, the facility is expected to house 19,000 language processing units, or LPUs.

The plan may grow far beyond that first phase. The partners are considering an expansion to 200,000 LPUs in the future, which would make the site a major piece of AI infrastructure if completed at that scale.

Aramco will fund the project. Ross estimates the cost will be in the nine-figure range, placing the effort among the more ambitious AI infrastructure bets described in the source article.

Why inference matters

Groq’s focus is not general-purpose computing. Founded in 2016, the company develops specialized hardware for AI applications, and its LPUs are built to run language models at high speeds.

That matters because AI inference is the stage where a model responds to users after it has already been trained. Groq’s LPUs are described as processing hundreds of tokens per second, which points to fast language model output as the key value proposition.

The source article makes an important distinction: Groq’s LPUs could serve as an alternative to Nvidia’s chips for AI inference, but not for training models. Nvidia chips remain in high demand for both tasks.

Why Saudi Arabia is central to the plan

The partnership fits Saudi Arabia’s broader effort to become a technology hub and diversify its economy. Ross framed Aramco’s role in those terms, saying the company is “planning to do massive capital deployments for this, and it is a way to help diversify the economy away from oil.”

Groq is also looking at practical advantages. The company aims to use Saudi Arabia’s cheap energy and available land, two factors that can matter heavily for large data center projects.

The location also offers a network advantage. According to the source article, it can provide low-latency access to four billion people within 100 milliseconds, making the site potentially useful for serving AI responses across a broad region.

Groq’s position in the AI chip market

The Saudi project arrives as Groq is riding strong investor interest in AI chips. The company recently raised $640 million in funding, valuing the company at $2.8 billion.

BlackRock led that funding round, while Cisco Systems and Samsung Electronics also invested. That backing gives Groq more visibility as companies search for AI inference capacity beyond the most widely used chip suppliers.

The article also notes that Ross does not expect US export restrictions to block the Saudi plans. He said Groq has been transparent with the Commerce Department, and the company has chosen not to sell to Chinese firms or entities.

What could come next

The Groq-Aramco relationship may not end with this single data center. Ross said, “The expectation is that we’re going to partner with Aramco Digitial for quite a bit of our deployment in this region and anywhere we can.”

That suggests the Saudi inference center may be part of a larger regional deployment strategy. For Groq, the project could demonstrate the scale of its LPU approach. For Aramco, it places capital behind a technology direction that is separate from its traditional oil business.

The immediate test is execution. If the facility comes online by year’s end with 19,000 LPUs, it will give Groq and Aramco a concrete platform for high-speed AI inference in Saudi Arabia, with a much larger expansion still under consideration.