The heat wave that this week pushed energy demand to record-setting levels and caused brownouts and scattered outages in some regions also put datacenter managers on guard for problems and re-emphasized the need for strategies to deal with datacenter heat issues.
Datacenters are generally well prepared for these extremes with uninterruptible power supply (UPS) systems and generators, but the stress that a heat wave puts on power supplies can still reveal heretofore unknown issues. That's what happened to Kern Weissman, director of infrastructure and network systems at CD&L, a logistics and delivery company in South Hackensack, N.J.
Power supply problems in New York this week affected a three-phase power supply at a secondary datacenter in CD&L's Manhattan office. But the UPS system didn't immediately alert the IT staff to reduce voltage on one of the phases. "The heat wave exposed an area of risk that I hadn't considered," said Weissman. There was no system downtime, but new automated alert procedures were quickly established, he said.
Unfortunately, there wasn't anything Weissman could do about the brownout affecting his Queens home, which was into its third day today. "The majority of sockets in your house get low amperage and low voltage," said Weissman. "I only have two active full sockets that are working -- it's pretty miserable."
As with many energy providers, the relentless heat has Xcel Energy, a Minneapolis power company with some 1.5 million customers, breaking demand-generation records. It reached a record peak demand on July 14 of 8,622 megawatts; the previous record of 8,596 megawatts in peak demand was set in 2004, a utility spokeswoman said. The heat was causing some outages, and Excel was asking business customers such as Slumberland to help cut usage.
Slumberland is based in nearby Little Canada, Minn., and operates 100 furniture stores in 10 states. To help Xcel meet demand, it removed its corporate headquarters, distribution center and a retail outlet from the power grid and supplied power to them via a generator during the worst of the heat wave, said Seth Mitchell, infrastructure team manager.
The datacenter remained connected to the power grid and was unaffected by the heat, said Mitchell. The company is using American Power Conversion monitoring and UPS hardware and can switch over to a generator in 12 seconds if needed. The company is seeking more protection from energy problems, began installing a second air cooling system in its datacenter this week and has plans for second generator. "Pretty much every year, the power in this season is not reliable," said Mitchell.
Dealing with heat also means containing demand, and that's one of the reasons why insurance provider Aflac in Columbus, Ga., is moving toward virtualization.
"We're trying to have zero server growth while meeting the needs of a growing business, and we think that is achievable," said John Blalock, senior manager of distributed server management at Aflac. The company has about 620 physical x86 servers and has moved its development and disaster recovery operations into virtualized environments, something it will eventually do with its production servers as well.
"I think the benefit will be in manageability and containing the cost of managing the physical boxes," Blalock said.
Power reliability problems will increase for datacenters because reserve electric capacity is declining nationally, according to Kenneth Brill, executive director of The Uptime Institute in Santa Fe, N.M. He said the U.S. is not investing enough in building new power generation capacity, and the message for datacenter managers is: "You better know that your engine generators work."
Another thing that datacenter managers can do is investigate whether their cooling systems are delivering at their rated capacity, said Brill. He said half of the cooling units do not work efficiently for a variety of reasons, including clogged filters, belts slipping and refrigerant that's not fully charged. If the air cooling system isn't meeting a datacenter's needs, "the day they would discover that is on a hot day," said Brill.