Nvidia's GPU rental prices have skyrocketed to $4.08 per hour this week, a 48% increase from just two months ago. This surge has forced companies like CoreWeave to raise their own prices by 20% and extend minimum contracts from one year to three years.
The scarcity of computing power is already limiting access to cutting-edge AI models. OpenAI's CFO, Sarah Friar, stated that her company is making "tough trades" due to the shortage, and Anthropic has restricted its newest model to only about 40 organizations.
This shift marks a significant change in the industry, where access to top-of-the-line AI models will become increasingly exclusive. Companies with deep pockets or strong profit margins will have an advantage, while startups and smaller organizations may struggle to keep up.
As demand for computing power continues to outpace supply, prices are likely to rise further. This will drive companies to adopt new strategies, such as procurement and margin management, and force developers to explore alternative models or on-premise deployments until the infrastructure catches up.
