Companies are turning to alternative clouds for cost-effective access to GPUs.

by

in

1. CoreWeave, Lambda Labs, and Together AI are alternative cloud providers receiving significant investments for their GPU infrastructure services.
2. Generative AI is driving the demand for alternative clouds as GPUs are necessary for training and running models at scale.
3. The growth of alternative cloud providers may be sustainable in the short term but could face challenges in the future as incumbents invest in custom hardware and the generative AI market evolves.

The alternative cloud market is booming, with companies like CoreWeave raising billions in funding and attracting investors like Coatue, Fidelity, and Altimeter Capital. Other players in this space, like Lambda Labs, Voltage Park, and Together AI, are also securing significant amounts of financing to meet the growing demand for GPU infrastructure due to the generative AI boom.

Generative AI models require GPUs for training and inferencing, making them a popular choice for developers and organizations. While major cloud providers like AWS, Google Cloud, and Microsoft Azure offer GPU instances, alternative cloud providers like CoreWeave can offer cheaper prices and better availability for some projects. For example, renting an Nvidia A100 40GB on CoreWeave costs less than on Azure or Google Cloud.

Some tech firms are turning to alternative cloud providers like CoreWeave to meet their compute capacity challenges. These challenger cloud vendors have an advantage in focusing on premium AI services without the infrastructure baggage of incumbents, according to analysts like Lee Sustar of Forrester.

The sustainability of the alternative cloud market remains uncertain, as incumbent providers invest in custom hardware like TPUs and custom chips to run and train models. There is also a risk of the generative AI bubble bursting, potentially leaving providers with surplus GPUs. However, in the short term, analysts predict a steady stream of upstart clouds offering competition and innovation in the market.

Source link