Cloud Computing and the Economics of Infrastructure

Why renting computing power from a handful of giant providers replaced most companies owning their own servers, and what that shift changed.

Not long ago, a company that needed computing power to run its website or store its data generally had to buy and maintain its own physical servers, sitting in its own building. Today, the large majority of that computing power is rented instead, from a small number of giant providers running massive data centers on a company’s behalf. This shift to cloud computing - accessing computing power, storage, and software over the internet rather than owning the physical hardware yourself - is a quieter but genuinely enormous change in the economics of building a business.

From a fixed cost to a flexible one

Owning physical servers is a fixed cost - a large expense that has to be paid regardless of how much the equipment actually gets used, similar to renting a whole warehouse whether it ends up half-full or bursting at capacity. A young company had to guess in advance how much computing power it would need, buy that much hardware upfront, and then live with the consequences of guessing wrong: wasted money on unused capacity if the guess was too high, or a crashing website if the guess was too low right as a product suddenly became popular.

Cloud computing turns this fixed cost into a flexible one. A company pays only for the computing power it actually uses at any given moment and can scale up or down almost instantly as demand changes. This dramatically lowers the upfront cost of starting a technology company - which is a major reason the number of new tech startups accelerated once cloud computing became widely available, since founders no longer needed to raise money for physical hardware before writing a single line of a real product.

A retailer's website on the busiest shopping day of the year

Imagine an online retailer that gets normal traffic most of the year but experiences ten times its usual visitors on the single biggest shopping day of the year. Owning enough physical servers to handle that one massive spike would mean paying to keep nearly nine-tenths of that capacity sitting idle for the other 364 days. Renting cloud computing instead lets the retailer automatically scale up servers only for that one day and scale back down immediately afterward, paying for the extra capacity only when it's actually needed rather than year-round.

Why cloud computing became another winner-take-most market

Building and running a data center at a massive scale requires enormous upfront investment in real estate, hardware, and specialized engineering - the kind of economies of scale covered earlier in this module, where a bigger operation can spread its costs across more customers and offer lower prices than a smaller rival could. This is a major reason cloud computing itself is dominated by a small number of very large providers, echoing the same winner-take-most pattern seen elsewhere in the digital economy, just one layer further down in the technology stack.

"Renting from the cloud is always cheaper than owning hardware"

Cloud computing lowers the barrier to getting started and offers valuable flexibility, but it isn't automatically the cheapest option for every company at every size. A company with very large, highly predictable, steady computing needs can sometimes save money over the long run by owning its own hardware outright, the same way a business with extremely stable, predictable space needs might save money buying a building instead of renting one indefinitely. Cloud computing trades some potential long-run savings for flexibility and a lower upfront cost - a trade that makes sense for some companies and not others.

Vendor lock-in as a hidden cost

Once a company builds its systems around one cloud provider’s specific tools, moving to a different provider later can be expensive and technically difficult - a form of the switching costs covered earlier in this module, here called vendor lock-in. This gives dominant cloud providers some of the same durable pricing power seen in other winner-take-most digital markets, even in a business built around renting rather than owning.

Key takeaways

Cloud computing turns computing power from a fixed upfront cost into a flexible, pay-for-what-you-use expense.
This flexibility lowered the barrier to starting a technology company and helped fuel a wave of new startups.
Massive economies of scale in data centers push cloud computing itself toward a winner-take-most market structure.
Cloud computing isn't automatically cheaper for every company - very large, steady, predictable needs can sometimes favor owning hardware.
Vendor lock-in, a form of switching cost, gives dominant cloud providers durable pricing power over their customers.