[–] dyslexit 3 days ago
[–] throwaway2037 3 days ago
[–] Silhouette 3 days ago
If progress with frontier models doesn't continue at the same pace then the investments and funny money deals might start to look very fragile.
If progress does continue then that progress might be towards smaller models more than quantum steps up in quality or capability that would increase the risk of the scenario above.
All of this is set against a backdrop of public hostility and political problems that I can only imagine increasing in the near term as well.
This feels like an unusually high stakes game of poker. I don't think I'd want to bet on Big AI right now if I had a few billion lying around. Then again - maybe that's why I don't have a few billion lying around!
[–] BlobberSnobber 3 days ago
[–] Silhouette 3 days ago
I saw an interesting observation the other day that Jensen Huang has played this game the best because his company is the one actually selling real products and making real money in return. If all the AI giants are buying up huge amounts of hardware speculatively because they assume they will need those data centres in the future and then the bottom falls out of the market then it's the AI companies left holding the baby. And if we do get to a point where local models are competitive then the OpenAIs and Anthropics of the industry might face real difficulties but it would just be a different market for Nvidia to also be selling real hardware and still in exchange for real money.
[–] mike_hearn 3 days ago
[–] vlovich123 2 days ago
[–] edmundsauto 1 day ago
For intelligence, I bet if inference got 90% more efficient they would just increase the “thinking” by 90%.
[–] acchow 2 days ago
[–] pierreb-aiva 2 days ago
And thats just the inference side of things. For training, the big players like Anthropic would still be able to benefit from cheaper compute, by generating more RL rollouts, running more RL environments, and thus still providing frontier intelligence that would justify the markup.
Many customers cancelling would only be a risk if the compute expenditure was more decentralized. But its not
[–] solyin 3 days ago
[–] chrisweekly 3 days ago
Is that really a viable path? (Honest question)
[–] burnerRhodov3 3 days ago
[–] vel0city 3 days ago
[–] burnerRhodov3 2 days ago
According to the U.S. Energy Information Administration (EIA), in 2024:
- *Texas natural gas production:* 27.5 billion cubic feet per day. - *Texas natural gas consumption:* 14.6 billion cubic feet per day.
So Texas produces nearly twice as much natural gas as it consumes domestically.
Natural gas contains approximately 1,025 BTU per cubic foot. Assuming 50% efficiency in a natural gas power plant, and 1 kWh equals 3,412 BTU.
27.5 − 14.6 = *12.9 billion cubic feet per day.*
12.9 billion × 1,025 BTU × 50% efficiency ÷ 3,412 BTU/kWh ÷ 24 hours = *approximately 80.7 GW of continuous electrical generation.*
That's the equivalent of more than EIGHT 10-GW AI computing campuses operating around the clock.
Lastly, a significant amount of natural gas is produced alongside crude oil. When producers can't economically capture or transport that gas, some of it is burned off through a process called flaring. Those flames you sometimes see at oil and gas facilities are an example, although refinery flares also serve important safety functions.
Seems like you just like to say snarky things about Elon, but can't be asked to do any actual math.
[–] vel0city 2 days ago
I do agree and understand we flare a lot of natural gas, waste because there's just not the economics to transfer it elsewhere. I definitely agree, it would be nice for that to be put to some economic use if we're pulling it out of the ground.
> Texas produces nearly twice as much natural gas as it consumes domestically.
And it exports that other half it doesn't consume domestically. It's not like half of what is produced just sits around forever. We've massively scaled up LNG exports. We export to surrounding states. But hey just act like we've got billions of cubic feet lying around doing nothing ready to go for datacenters.
> approximately 80.7 GW of continuous electrical generation.
Ooh wow. There's 420.8 GW of demand sitting in the ERCOT connection queue specifically for data centers today. All that "extra" and we'll cover like 20%. A good gas power plant will do better than 50%, but that's still not enough. And I imagine there will be even more datacenter demand coming soon. And that's just at the grid connection levels, not behind-the-meter generation like what we're talking about.
I've also lived through continued cost increases of natural gas in Texas. What does adding an additional 420GW of demand for just datacenters do to our rates? How much more am I going to spend to heat my home this winter? How much more will I spend on my electric bill next summer?
I've also lived through the collapse of natural gas supplies in 2021. I wonder if these datacenters will turn off their turbines or let people freeze it something similar happened again?
Seems like you make a big point about doing the math but only doing half of it. Keep going, see where it takes you.
[–] burnerRhodov3 2 days ago
420.8 GW is alot of compute... like an ungodly amount. A vera rubin rack is like 220KW.. so 1.9m racks. a rack is 72 GPU's per rack so 420.8GW of power is 137.7M GPU's. So lets say about 60% of the power goes to infra, we get 55.08M GPU's. So, with each GPU costing around 55k, that gives us a final cost of compute for the 420GW is 3.0294 trillion.
Obviously that is not real... Eithier double booked, or fake corps making a bunch of requests from thousand different vectors to resell access.
Also, companies like Base are making a killing off taking all the excess energy generated by wind at Night and selling it back to the grid.
So in final, we can support around a $6T AI buildout in Texas just on our exported Natural Gas alone before we really need to start expanding LNG supply.
[–] solyin 2 days ago
[–] me-vs-cat 3 days ago
[–] jordanb 2 days ago
Then Elon goes to Memphis, buys a warehouse and fires up 30 jet turbines in the parking lot, and you start getting reports about the incessant noise and being able to smell it from 5 miles away.
It seems like there's a fundamental problem with realizing other people have agency and if you fuck them hard enough they will fight back.
[–] wbl 3 days ago
[–] burnerRhodov3 3 days ago
[–] ethagknight 3 days ago
[–] lumost 3 days ago
[–] runako 3 days ago
Those vendors would very much like to retain as much of that business as possible. If the space goes sideways, I would very much expect some kind of renegotiation/work out.
SpaceX was the only one mentioned as cancelable. These are listed under "Infrastructure Service Arrangements" on page 170.