#economics
- 4 min read
Power Is the Bottleneck: A Back-of-Envelope Model for AI Data Center Capacity
How many GPUs fit in a 100 MW data center? A simple, honest model from utility power to GPU count, with the assumptions spelled out so you can swap in your own.
#power#cooling#data-centers#economics
- 4 min read
Hyperscaler Capex: The $730 Billion Question
Amazon, Alphabet, Microsoft, and Meta guided to roughly $720–745B of 2026 capex. Capex now exceeds operating cash flow at two of them. A look at the numbers, the accounting quirks, and what to watch going into Q3 prints.
#economics#capex#hyperscalers#finance#data-centers
- 4 min read
GPU Cloud Economics: What a GPU-Hour Really Costs
H100 rental prices went up in 2026, not down. A bottoms-up model of $/GPU-hr for a GB200 build, CoreWeave's P&L as a case study in depreciation and interest, and why $2.50 vs $3.50 is the line between a dud and a deal.
#economics#gpu-cloud#neoclouds#tco#finance
- 4 min read
Training vs Inference: Two Different Infra Problems
Same GPUs, very different clusters. Training is a synchronized throughput problem. Inference is a memory-bandwidth and KV-cache problem, which is why prefill/decode disaggregation is taking over. The math, with Llama 3 70B as the example.
#training#inference#gpu-clusters#kv-cache#economics
- 4 min read
Checkpoint Storage That Doesn't Stall Training
Meta's Llama 3 run hit an interruption every ~3 hours on 16K GPUs. At 100K GPUs, checkpoint and restart time decide your goodput. A worked model of checkpoint size, bandwidth, and optimal interval, plus what it costs when you get it wrong.
#storage#training#gpu-clusters#reliability#economics
- 3 min read
HBM Is the Real Capacity Constraint
GPU supply gets the headlines, but memory is the gating item. SK hynix just posted a 76% operating margin, Micron is booked through 2027, and Amazon raised capex because memory got expensive. What that means for how you plan clusters.
#hbm#memory#gpus#supply-chain#economics
- 5 min read
Why Liquid Cooling Is No Longer Optional at AI Densities
The average data center rack still pulls about 9 kW. A GB200 NVL72 pulls 120+. Here's the physics, the facility changes, and the money behind direct-to-chip liquid cooling.
#cooling#liquid-cooling#data-centers#racks#economics