Skip to main content
DCS Global

Data Center Power and Cooling: Beginner Overview

Foundational All levels 8 min

Data Center Power and Cooling: The Foundation of Everything

A plain-language introduction to power and cooling infrastructure, written for decision-makers who need to understand the domain before approving infrastructure investments.

Executive Summary

Power and cooling are the foundation of every data center. Every other infrastructure component: compute, storage, network: depends on reliable power and adequate cooling. The shift to AI workloads has made power and cooling the primary constraint in most enterprise data centers: GPU servers require 10–30 kW per rack, compared to 3–5 kW for traditional servers. Understanding power and cooling infrastructure is no longer optional for IT leaders, it is a prerequisite for AI adoption.

Key Takeaways

  • Power and cooling are the primary constraints for AI workload adoption, GPU servers require 3–6x the power density of traditional servers.
  • UPS systems protect against power quality events and brief outages, generators protect against extended utility outages.
  • PUE (Power Usage Effectiveness) measures data center energy efficiency: lower is better, with 1.0 being perfect.
  • Cooling technology must match power density, air cooling is inadequate above 10 kW/rack.
  • Power redundancy topology (N, N+1, 2N) determines the facility's availability ceiling.

Power Infrastructure Basics

Data center power infrastructure converts utility power (typically medium voltage) to the clean, conditioned power that IT equipment requires. The path from utility entrance to server power supply passes through: utility transformer, main switchgear, UPS system, power distribution units (PDUs), and rack-level PDUs.

1

Utility Transformer

Steps down medium voltage (13.8 kV typical) to low voltage (480V or 208V) for distribution within the facility.

2

Main Switchgear

Distributes power from the transformer to UPS systems and other loads. Provides overcurrent protection and isolation capability.

3

UPS System

Provides clean, conditioned power and battery backup. Protects against power quality events (sags, surges, harmonics) and brief outages.

4

Power Distribution Units (PDUs)

Distributes power from UPS to rack-level PDUs. Provides metering and monitoring for power consumption by zone.

5

Rack PDUs

Distributes power to individual servers within a rack. Smart PDUs provide per-outlet metering and remote switching.

UPS Systems

UPS (Uninterruptible Power Supply) systems protect IT equipment from power quality events and provide battery backup during brief utility outages. Double-conversion UPS provides the cleanest power: it continuously converts AC to DC and back to AC, isolating the load from all power quality events. Line-interactive UPS is less expensive but provides less protection.

UPS runtime is not the primary purpose

UPS systems are designed to provide clean power and bridge the gap between a utility outage and generator startup, typically 10–15 minutes. They are not designed to power a data center for hours. Organizations that rely on UPS runtime as their primary outage protection strategy are not protected against extended utility outages.

Generator Systems

Generator systems provide power during extended utility outages. Diesel generators are the most common for data centers, they start within 10–15 seconds and can run for days with adequate fuel supply. Natural gas generators eliminate fuel storage requirements but depend on gas supply availability during emergencies.

Generator sizing is critical: generators must be sized for the full facility load plus startup surge, not just the average load. Undersized generators that cannot carry the full load during a utility outage are the most common power infrastructure failure mode in enterprise data centers.

Cooling Infrastructure Basics

Every watt of power consumed by IT equipment is converted to heat that must be removed from the data center. Cooling infrastructure removes this heat: maintaining safe operating temperatures for all equipment. The cooling system must be sized for the maximum power load, not the average load.

CRAC/CRAH Units

Up to 5 kW/rack

Computer Room Air Conditioning/Handling units. Standard for traditional data centers. Inadequate for high-density deployments.

In-Row Cooling

5–15 kW/rack

Cooling units placed between server rows. More efficient than perimeter cooling for medium-density deployments.

Rear-Door Heat Exchangers

10–30 kW/rack

Attaches to rack rear, captures heat at source. Requires chilled water. Effective for high-density compute.

Direct-to-Chip Liquid

20–60 kW/rack

Delivers coolant directly to CPU/GPU heat spreaders. Required for sustained GPU operation at full TDP.

PUE: Measuring Energy Efficiency

PUE (Power Usage Effectiveness) measures how efficiently a data center uses energy. PUE = Total Facility Power / IT Equipment Power. A PUE of 1.0 is perfect: all power goes to IT equipment. A PUE of 2.0 means the facility uses as much power for cooling, lighting, and other overhead as it uses for IT equipment.

1.0–1.2

Excellent

Hyperscale data centers

1.2–1.5

Good

Modern enterprise facilities

1.5–2.0

Average

Typical enterprise data centers

2.0+

Poor

Legacy facilities

AI Workload Power Density

AI workloads have fundamentally changed the power density requirements of enterprise data centers. A single NVIDIA H100 GPU has a 700W TDP. An 8-GPU server (DGX H100) consumes approximately 10.2 kW, 2–3x the power of an entire rack of traditional servers. A rack of 4 DGX H100 servers requires 40+ kW, far beyond the capacity of air cooling.

Most facilities cannot support AI workloads without upgrades

The majority of enterprise data centers built before 2020 cannot support AI workloads without significant power and cooling infrastructure upgrades. Before committing to AI deployments, verify that the facility has adequate power capacity and cooling capability for the planned GPU density.

More Power and Cooling Guides

Strategic

Executive Brief

Business case, risk exposure, investment framing, and the three questions every executive should ask before approving a project.

Technical

Technical Overview

Architecture, components, design patterns, and the engineering decisions that determine long-term performance and reliability.

Decision

Buying Guide

Vendor evaluation criteria, RFP requirements, contract terms to negotiate, and the questions that separate qualified vendors from unqualified ones.

Implementation

Planning Checklist

Pre-project checklist covering site readiness, stakeholder alignment, compliance requirements, and the decisions that must be made before work begins.

Strategic

Common Mistakes

The ten most expensive mistakes organizations make — and the specific decisions that prevent each one.

Foundational

Frequently Asked Questions

Direct answers to the questions procurement teams, IT leaders, and executives ask most often.

Implementation

Implementation Roadmap

Phase-by-phase delivery plan with milestones, dependencies, go/no-go criteria, and the decisions that determine schedule performance.

Decision

Comparison Guide

Side-by-side comparison of approaches, vendors, and architectures — with the criteria that matter for enterprise procurement decisions.

Strategic

Related Solutions

How this category connects to adjacent infrastructure domains — and the DCS Global solutions that address the full scope.

Decision

Recommended Next Steps

A decision tree for your specific situation — what to do next based on where you are in the planning or procurement process.

Related Categories

Apply This Knowledge

Ready to move from research to decision?

DCS Global engineers can review your specific requirements and give you a direct assessment, not a sales pitch. Our infrastructure specialists have delivered a broad portfolio of projects across North America, Europe, the Middle East, and Asia-Pacific.