gpu
5 articles
An LLM Needs More Than Parameters: GPUs Want Neatly Tiled Models
With the same parameter count, matrix dimensions and layer count decide whether a GPU computes at full speed or wastes work moving data and processing edge tiles. Near-square dimensions aligned to 128, 256, or 512—and often wider, shallower models—fit hardware better without sacrificing accuracy.
InferenceX v2: NVIDIA Blackwell's Benchmark Massacre and AMD's Software Debt
SemiAnalysis benchmarked ~1,000 GPUs across NVIDIA and AMD lineups. GB300 NVL72 hits 100x over H100 — Jensen's 30x was an underestimate. AMD FP8 competes, but FP4+disagg+wideEP combo falls apart in software.
GPU Shortage 2.0: When Renting GPUs Is Harder Than Renting an Apartment—H100 Rates Up 40% in Six Months
SemiAnalysis examines the 2026 GPU rental crunch: H100 one-year lease rates jumped from $1.70 to $2.35 per GPU-hour, on-demand capacity sold out, and Blackwell deployments filled through September as a self-reinforcing shortage took hold.
NVIDIA GPU Rental Prices Are Rising Again — and Customers Are Losing Bargaining Power
SemiAnalysis reports that NVIDIA GPU rental prices are rising rapidly again and capacity is being sold out. Compared to mid-2024 through Q3 2025, customers now have much less negotiating power with Neoclouds — driven by surging agentic coding demand and rising DRAM prices.
The Hidden Second Half of AI Compute Leasing: What Happens After the 5-Year Contract Expires?
Everyone stares at the first 5 years of AI compute profits. But the real game is decided by what happens after the contract expires.