Jay Ries Regional Sales Manager Liebert Thermal Management Emerson Network Power Agenda Where is energy consumed in the data center Energy consumption example Cooling energy consumption breakdown ID: 162415
Download Presentation The PPT/PDF document "Data Center Thermal Management and Effic..." is the property of its rightful owner. Permission is granted to download and print the materials on this web site for personal, non-commercial use only, and to display it on your personal computer provided you do not modify the materials and that you retain all copyright notices contained in the materials. By downloading content from our website, you accept the terms of this agreement.
Slide1
Data Center Thermal Management and Efficiency
Jay RiesRegional Sales ManagerLiebert Thermal ManagementEmerson Network Power Slide2
AgendaWhere is energy consumed in the data center?
Energy consumption exampleCooling energy consumption breakdownStrategies for saving energyLow cost strategiesMedium cost strategiesHigher cost strategiesTaking it a step further (beyond cooling)SummarySlide3
3Slide4
Where is Energy Consumed in the Data Center?
48% is consumed by power and cooling support 52% is consumed by IT equipmentSlide5
Energy Consumption Example
Energy Consumption ExampleBaseline Building designExisting buildingLimitation to physical changes that can be madeBest suited for modifications to existing equipmentFull equipment replacement is a last resort1MW of facility power usage (all data center)
Baseline Cooling design
Centrifugal water cooled chiller
No economization
Standard computer room cooling units
No variable speed fans or advanced controls
Return air control
45° F chilled water
72° F return air, 50% RHSlide6
Energy Consumption Example
Energy Consumption ExamplePower UsageProcessors – 150kWOther Services – 150kWServer Power Supply – 140kWStorage – 40kW Communication Equipment – 40kW
Cooling – 380kW
UPS – 50kW
MV Transformer and Switchgear – 30kW
Lighting – 10kW
PDU – 10kW
IT Power Usage = 520kW
Support Power Usage = 480kW
Total Facility Power Usage = 1000kW
Annualized Facility PUE = 1.92
Work our way to 1.35
Cooling is the only area that will be modified. In the real world, each variable will have an impact on the othersSlide7
Cooling Energy Consumption Breakdown
Air Cooled SystemWater Cooled SystemChilled Water SystemSlide8
Low Cost StrategiesImplementing best practices
Adjust the unit control methodsDew point controlUnit operating rangeChange to supply air controlRunning at higher chilled water temperaturesSlide9
If you have a raised floor, use it properly. Underfloor resistance wastes energy.
Utilize hot aisle / cold aisle, regardless if you have a raised floorLow Cost Strategies1. Implementing Best PracticesSlide10
Get air where it is supposed to go.Blanking panels
Fix unplanned outside infiltrations and any unecessary gaps in the raised floorReturn plenums to the cooling unitIsolate the room, particularly if you want to control humidityLow Cost Strategies1. Implementing Best PracticesSlide11
Dew PointStandard design points used to be 72° return air temperature and 50% relative humidity (RH)New, more aggressive design points can be 90°+ return air temperature and an unspecified relative humidity
Why shouldn’t you fix at 50% relative humidity (RH)Dew point @ 72°, 50% = 52°Dew point @ 95°, 50% = 74° If the return temperature is increased at a fixed RH, the dew point will rise, requiring the equipment to waste energy to remove moisture that didn’t need to be there in the first placeLow Cost Strategies2. Adjust Unit SettingsSlide12
Unit operation settingsExpanding the operating range for the temperature and humidity keeps unit components from cycling too frequently.Higher return air temperatures allow CRAH units to run more efficiently
Capacity increase up to 70% for chilled water unitsCapacity increase up to 50% for compressor based unitsThe more efficiently the units operate, the fewer that are required to control the space, saving energy.Low Cost Strategies2. Adjust Unit SettingsSlide13
Low Cost Strategies
2. Adjust Unit Settings
Increased Capacity at Higher TempsSlide14
Supplies a consistent temperature to the cold aisleSaves energy because it allows the return air temperature to be increased, allowing the CRAH unit to run more efficiently.
Low Cost Strategies3. Supply Air ControlSlide15
45° chilled water temperature has been the standard design point for many years
Higher chilled water temperatures are starting to become more prevalentWhy? At higher temperatures, there are huge potential savings on the chiller For every 1 degree increase in the chilled water supply temperature, a 2% energy savings can be realized on the chiller plant45°chilled water = Baseline55°chilled water = 20% energy savingsLow Cost Strategies4. Running At Higher Water TemperaturesSlide16
Low Cost Strategies
The Results of ImplementationApplying Low Cost StrategiesChanges to cooling systemBest practices implementedSupply air control50° F chilled water85° F return air with dew point control
Support Power Usage = 480kW
Total Facility Power Usage = 1000kW
Annualized Facility PUE = 1.92
Total cooling power usage drops from
380kW
to
314kW
. The number of units stay the same, but some units can be turned off.
414kW
934kW
1.79Slide17
Medium Cost StrategiesVariable speed fan retrofits (EC Fan / VFD)
Aisle containmentControl retrofitsRack level sensorsSlide18
Floor-mount cooling fans typically run at 100% rated rpmBy utilizing variable speed technology, fan speed can be varied based upon room conditionsEnergy savings based on a single 10HP motor
18Fan Speed Energy Consumed Savings
100%
8.1kWH
90%
5.9kWH
27%
80%
4.2kWH
48%
70%
2.8kWH
65%
60%
1.8kWH
78%
Medium Cost Strategies
1. Variable speed fan retrofits (EC Fan / VFD)Slide19
Medium Cost Strategies
2. Aisle ContainmentAllows for proper air separationAble to be done either the hot or cold aisle, though it is easier to retrofit the cold aisle of an existing roomPhysical containment varies from simple curtains to a pre-fabricated system designed to match the racks.Slide20
Containment Strategies
Contained hot aisleRequires full containment to trap hot airCan be difficult to retrofit in perimeter designsEasier to retrofit in row cooling designsOverhead fire suppression concerns on full containmentContained cold aisleMultiple containment optionsDoors only
Curtains only
Full containment
Can be easier to retrofit in all cooling designs
Overhead fire suppression concerns on full containment
Medium Cost Strategies
2. Aisle ContainmentSlide21
Medium Cost Strategies
3. Control RetrofitsAllows for upgraded control schemes that save energyNew controls allow units to be networked togetherGive more visibility of full systemEliminate fighting of units, - one cooling while one is heatingSlide22
Usually associated with a control retrofit or a designed scheme through a building management system
Increased visibility and quicker reaction to changes at the rackGenerally applied with supply air sensors“Bath tub effect”Medium Cost Strategies4. Remote SensorsSlide23
Low + Medium Cost Strategies
The Results of ImplementationApplying Low + Medium Cost StrategiesChanges to cooling systemBest practices implementedSupply air control+55° F chilled water+90° F return air with dew point control
+ Remote sensors
+ Aisle containment
+ Variable speed fans
+ Control retrofits
Support Power Usage = 414kW
Total Facility Power Usage = 934kW
Annualized Facility PUE = 1.79
Total cooling power usage drops from
314kW
to
184kW
. All units are now on, running at a reduced speed.
284kW
804kW
1.55
ROI is generally less than 1 year for these strategiesSlide24
Higher Cost Strategies (Major Capital Expenditures)
Bringing cooling closer to the sourceVariable capacity compressorsEconomizationAir economizersWater economizersRefrigerant EconomizersSlide25
Bring the cooling closer minimizes the need for large fans, reducing energy
Some rear door designs don’t have fans, instead utilizing the server fans to move the airGenerally produce a better sensible cooling to power ratio than a typical system – more cooling for less energy
Row-based
configuration
Rack-based
configuration
Rear door configuration
Higher Cost Strategies
1. Bringing Cooling Closer to the SourceSlide26
Base Infrastructure
(160 kw)
Cooling Modules
(mix and match)
Dew Point Controlled
Pumped Refrigerant
Cooling
Higher Cost Strategies
1. Bringing Cooling Closer to the Source
Rack Based Solutions
Pump
Refrigerant TechnologySlide27
Refrigerant Based Rear Door
Refrigerant based, rear door heat exchangerA rear door with 10kW to 40kW of coolingConnect up to 16 doors onto a single pumped refrigerant loopDesigned to accommodate various racksEnergy story – passive door (no fans) that uses the server fans to transfer air through the coilPerformanceProvides room neutral high density rack coolingApplicable for atypical room layouts and rooms without hot aisle / cold aisle configurationRear Door Solutions
Higher Cost Strategies
1. Bringing Cooling Closer to the SourceSlide28
Chilled Water Based Rear Door
Chilled water based, rear door heat exchangerA rear door with 16kW to 35kW of coolingDesigned to accommodate various racksEnergy story – passive door (no fans) that uses the server fans to transfer air through the coilPerformanceProvides room neutral high density rack coolingApplicable for atypical room layouts and rooms without hot aisle / cold aisle configurationRear Door Solutions Higher Cost Strategies1. Bringing Cooling Closer to the SourceSlide29
Row Based Solutions
Precise temperature and Humidity control12” or 24” wide designsAir, Water, Glycol and Chilled Water modelsEnergy efficient, load matchingDigital scroll compressor, 20-100% cooling capacity modulationVariable speed EC plug fans
Performance
Real-time environment control
Automatic performance optimization
Adaptive component monitoring
Adjustable air baffle direction
Row Based Solutions
Higher Cost Strategies
1. Bringing Cooling Closer to the SourceSlide30
Fan Energy for 30kW of Cooling
Higher Cost Strategies1. Bringing Cooling Closer to the Source
Row-based
configuration
Rack-based
configuration
Rear door configuration
Perimeter Unit = 4.24 kW
Row-Based Unit = 1.38 kW
Rack Based =
0.54 kW
Rear Door =
0.00
kW (no fans)Slide31
Digital Scroll CompressorsMatches room load in unlimited step incrementsReliable
Not field repairable. Must be replaced.4-step Semi-Hermetic CompressorsMatches room load in 4 step incrementsReliable Field repairableCompressors w/ VFD ControlMatches room load in unlimited step incrementsReliableUsually not field repairable. Higher Cost Strategies2. Variable Capacity Compressors
Intended for partially loaded rooms. May be used in conjunction with variable speed fans for even greater energy savings. Slide32
Air side economizers
For chilled water or compressorized systemsUtilize outside air based on dew point, minimizing compressor and/or chiller usageHigher Cost Strategies3. Economization
Water side economizers
For chilled water systems
Uses water cooled by a cooling tower or a dry cooler (fluid cooler) in low temperature conditions to minimize chiller operation
Pumped refrigerant economizers
New technology for compressorized systems
Uses refrigerant cooled in low temperature conditions to minimize condenser and compressor operation
Similar utilization as water side economizersSlide33
Liebert DSE with EconoPhase Pumped Refrigerant Economizer
Cooling PUE1.3 - 1.05Annual Utility Cost ($1000’s)60%
Reliable, Low-Maintenance Operation
No water usage
No water treatment
No outside air contamination
No dampers and louvers to maintain
Instant, automatic economizer changeover
Liebert DSE
–The Most Efficient DX Data Center Cooling System
Higher Cost Strategies
3. Economization – Pumped RefrigerantSlide34
Liebert DSE Indoor Unit
Next generation data center cooling systemLiebert EconoPhaseFirst ever pumped refrigerant economizerLiebert MC
Intelligent, high efficiency condensers
Thermal System Manager with iCOM
Liebert Proprietary Data Center Management Intelligence and Optimized Aisle
Liebert DSE System Overview
Higher Cost Strategies
3. Economization – Pumped RefrigerantSlide35
8.5 kW
8.5 kW3.2 kW3.9 kW
Check Valve
Compressor
Evaporator
Electronic expansion valve
Check Valve
Check Valve
Refrigerant
Pump
Solenoid
Valve
Circuit 2
Circuit 1
DSE
MC Condenser
8.7 kW
8.7
kW
3.4
kW
4.1 kW
Liebert DSE System:
DX Operation Mode
Cooling
Mode
Outdoor
Temp
Cooling
pPUE
SCOP
System kW
DX
95º F
1.26
3.8
24.9Slide36
Check Valve
Compressor
Evaporator
Electronic expansion valve
Check Valve
Check Valve
Refrigerant
Pump
Solenoid
Valve
EconoPhase
Circuit 2
Circuit 1
DSE
9.8
kW
0.0
kW
3.4 kW
0.3kW
3.9 kW
MC Condenser
0.1
kW
Liebert DSE System:
DX + Pump Operation Mode
Cooling
Mode
Outdoor
Temp
Cooling
pPUE
SCOP
System kW
DX
95º F
1.26
3.8
24.9
Partial
60º F
1.14
7.0
13.6Slide37
Check Valve
Compressor
Evaporator
Electronic expansion valve
Check Valve
Check Valve
Refrigerant
Pump
Solenoid
Valve
EconoPhase
Circuit 2
Circuit 1
DSE
0.0
kW
0.0
kW
3.4
kW
0.4 kW
3.9 kW
MC Condenser
4.8 kW
Liebert DSE System:
Pump Operation Mode
0.4 kW
Cooling
Mode
Outdoor
Temp
Cooling
pPUE
SCOP
System kW
DX
95º F
1.26
3.8
24.9
Partial
60º F
1.14
7.0
13.6
Full
45º F
1.09
10.6
9.0Slide38
Check Valve
Compressor
Evaporator
Electronic expansion valve
Check Valve
Check Valve
Refrigerant
Pump
Solenoid
Valve
EconoPhase
Circuit 2
Circuit 1
DSE
0.0 kW
0.0
kW
3.4
kW
0.5 kW
3.9 kW
MC Condenser
0.2
kW
Liebert DSE System:
Pump Operation Mode
0.5 kW
Cooling
Mode
Outdoor
Temp
Cooling
pPUE
SCOP
System kW
DX
95º F
1.26
3.8
24.9
Partial
60º F
1.14
7.0
13.6
Full
45º F
1.09
10.6
9.0
Full
30º F
1.05
20.7
4.6Slide39
Minneapolis, MN Bin Data – EconoPhase, Partial,
CompressorSlide40
1MW of IT load
90°F return air; 20% + redundancy; No humidity controlWhich is best? It depends on the customer driversFirst cost/capital costEnergy savings/PUETotal cost of ownershipRedundancy/availabilityReliability
LIEBERT® DSE
Higher Cost Strategies
3. EconomizationSlide41
Low + Medium + Higher Cost Strategies
The Results of ImplementationApplying Low + Medium + Higher Cost StrategiesKey cooling system featuresSupply air control90° F return air with dew point controlRack level sensorsAisle containment
Variable Speed Fans
Advanced Controls
+ Pumped Refrigerant Economizers
+ Variable Capacity Compressors
Support Power Usage = 284kW
Total Facility Power Usage = 804kW
Annualized Facility PUE = 1.55
Total cooling power usage drops from
184kW
to
83kW
. All CW units have been replaced with new units.
183kW
703kW
1.35
ROI is generally less than 3 years for these strategiesSlide42
Taking It a Step Further
The annualized cooling PUE for cooling only is 1.09 for the last scenario. Why is the overall PUE 1.35?Not implementing virtualization with the serversInefficiencies in the power distribution: UPS modulesPDUsGeneratorsBatteriesSwitchgear
Lighting
Lack of monitoring
Not having real time data means you cannot react quicklySlide43
Taking It a Step Further
How can I get an even better cooling PUE?Raise water and air temperatures even higherImplement alternate technologies that remove or greatly reduce cooling
Improve server monitoring
RISK
PUE
AVAILABILITY
PUE
SERVER LOADSSlide44
Implementing the Strategies
Multiple strategies to considerLow costMedium costHigher costCombination of any or all of the aboveImplementing any of these strategies can be somewhat difficultWhere do I start?
What can I implement?
Can the current equipment be upgraded?
Do I have budget for equipment upgrades?
Do I need outside help?Slide45
You don’t have to spend a fortune to get energy savingsHowever, to get to a world class level, major changes generally have to be madeTotal energy consumption needs to be considered along with PUE
Focusing only on PUE can increase risk and availabilityWorks with some data center models, but not for allSummaryFor more information on this topic, please check out the updated vendor neutral Energy Logic 2 white paper, available on the Emerson Network Power websiteSlide46
Thank you!
Questions ? jay.ries@emerson.comOr call Uptime Solutions Inc.937-237-3400