Abstract

The ability of traditional room-conditioning systems to accommodate expanding information technology loads is limited in contemporary data centers (DCs), where the storage, storing, and processing of data have grown quickly as a result of evolving technological trends and rising demand for online services, which has led to an increase in the amount of waste heat generated by IT equipment. Through the implementation of hybrid air and liquid cooling technologies, targeted, on-demand cooling is made possible by employing a variety of techniques, which include but are not limited to in-row, overhead, and rear door heat exchanger (HX) cooling systems. One of the most common liquid cooling techniques will be examined in this study based on different conditions for high-power density racks (+50 kW). This paper investigates the cooling performance of a liquid-to-air in-row coolant distribution unit (CDU) in test racks containing seven thermal test vehicles (TTVs) under various conditions, focusing on cooling capacity and HX effectiveness under different supply air temperatures (SAT). This test rig has the necessary instruments to monitor and analyze the experiments on both the liquid coolant and the air sides. Moreover, another experiment is conducted to assess the performance of the CDU that runs under different control fan schemes, as well as how the change of the control type will affect the supply fluid temperature and the TTV case temperatures at 10%, 50%, and 100% of the total power. Finally, suggestions for the best control fan scheme to use for these systems and units are provided at the conclusion of the study.

References

1.
Tradat
,
M. I.
,
Manaserh
,
Y. M. A.
,
Sammakia
,
B. G.
,
Hoang
,
C. H.
, and
Alissa
,
H. A.
,
2021
, “
An Experimental and Numerical Investigation of Novel Solution for Energy Management Enhancement in Data Centers Using Underfloor Plenum Porous Obstructions
,”
Appl. Energy
,
289
, p.
116663
.10.1016/j.apenergy.2021.116663
2.
Wang
,
X.
,
Li
,
H.
,
Wang
,
Y.
,
Zhao
,
J.
,
Zhu
,
J.
,
Zhong
,
S.
, and
Li
,
Y.
,
2021
, “
Energy, Exergy, and Economic Analysis of a Data Center Energy System Driven by the CO2 Ground Source Heat Pump: Prosumer Perspective
,”
Energy Convers. Manag.
,
232
, p.
113877
.10.1016/j.enconman.2021.113877
3.
Manaserh
,
Y. M.
,
Tradat
,
M. I.
,
Gharaibeh
,
A. R.
,
Sammakia
,
B. G.
, and
Tipton
,
R.
,
2021
, “
Shifting to Energy Efficient Hybrid Cooled Data Centers Using Novel Embedded Floor Tiles Heat Exchangers
,”
Energy Convers. Manag.
,
247
, p.
114762
.10.1016/j.enconman.2021.114762
4.
Shehabi
,
A.
,
Smith
,
S.
,
Sartor
,
D.
,
Brown
,
R.
, and
Herrlin
,
M.
,
2016
, “
United States Data Center Energy Usage Report
,” accessed Apr. 14, 2023, https://escholarship.org/content/qt84p772fc/qt84p772fc.pdf
5.
Google Scholar
,
2023
, “
Data Center Power Equipment Thermal Guidelines and Best Practices
,” accessed Apr. 14, 2023. http://tc0909.ashraetcs.org/documents/ASHRAE_TC0909_Power_White_Paper_22_June_2016_REVISED.pdf
6.
Vincent
,
M.
,
Ghaffari
,
O.
,
Nabavi Larimi
,
Y.
,
Grenier
,
F.
,
Jasmin
,
S.
,
Fréchette
,
L.
, and
Sylvestre
,
J.
,
2024
, “
Experimental Investigation of the Thermal Resistance of Advanced Two-Phase Thermosyphon Heatsinks
,”
Appl. Therm. Eng.
,
238
, p.
122108
.10.1016/j.applthermaleng.2023.122108
7.
Ghaffari
,
O.
,
Vincent
,
M.
,
Grenier
,
F.
,
Larimi
,
Y. N.
,
Jasmin
,
S.
,
Fréchette
,
L.
, and
Sylvestre
,
J.
,
2023
, “
Pushing the Limits of Air Cooling With Novel Two-Phase Prototypes for High Power Microprocessors
,” accessed Mar. 14, 2024, https://ieeexplore.ieee.org/abstract/document/10177612/?casa_token=rVNo-0SPY-kAAAAA:RFY4d6-6wv49aJB7H_M79iNuCO2NFV9NKrbN66Qb1EpCIVUbjNk1ZAdkSn539PlZ2wElbDZjVJA
8.
Oró
,
E.
,
Garcia
,
A.
, and
Salom
,
J.
,
2016
, “
Experimental and Numerical Analysis of the Air Management in a Data Centre in Spain
,” accessed Apr. 14, 2023. https://www.sciencedirect.com/science/article/pii/S0378778816300366
9.
Dai
,
J.
,
Ohadi
,
M. M.
,
Das
,
D.
, and
Pecht
,
M. G.
,
2014
,
Optimum Cooling of Data Centers: Application of Risk Assessment and Mitigation Techniques
,
Springer
,
New York
, pp.
1
186
.
10.
Kadam
,
S.
, and
Kumar
,
R.
,
2014
, “
Twenty First Century Cooling Solution: Microchannel Heat Sinks
,” Elsevier, Amsterdam, The Netherlands, accessed Apr. 14, 2023, https://www.sciencedirect.com/science/article/pii/S129007291400163X?casa_token=1wbE4brXT-4AAAAA:7QgmBX4aNXy_9o0EwZ2foiPsj1ic5NISwBzALA7zIzlyPNgF84HlXvsPRDD2b15DuAg90M3sOxpD
11.
Sauciuc
,
I.
,
Chrysler
,
G.
,
Mahajan
,
R.
, and
Szleper
,
M.
,
2003
, “
Air-Cooling extension - Performance Limits for Processor Cooling Applications
,”
Annual IEEE Semiconductor Thermal Measurement and Management Symposium
, San Jose, CA, Mar. 11–13, pp.
74
81
.10.1109/STHERM.2003.1194342
12.
Gharaibeh
,
A. R.
,
Manaserh
,
Y. M.
,
Tradat
,
M. I.
,
AlShatnawi
,
F. W.
,
Schiffres
,
S. N.
, and
Sammakia
,
B. G.
,
2022
, “
Using a Multi-Inlet/Outlet Manifold to Improve Heat Transfer and Flow Distribution of a Pin Fin Heat Sink
,”
ASME J. Electron. Packag.
,
144
(
3
), p.
031017
.10.1115/1.4054461
13.
Tuckerman
,
D. B.
, and
Pease
,
R. F. W.
,
1981
, “
High-Performance Heat Sinking for VLSI
,”
IEEE Electron Device Lett.
,
2
(
5
), pp.
126
129
.10.1109/EDL.1981.25367
14.
Gullbrand
,
J.
,
Luckeroth
,
M. J.
,
Sprenger
,
M. E.
, and
Winkel
,
C.
,
2019
, “
Liquid Cooling of Compute System
,”
ASME J. Electron. Packag.
,
141
(
1
), p.
010802
.10.1115/1.4042802
15.
Radmard
,
V.
,
Gharaibeh
,
A. R.
,
Tradat
,
M. I.
,
Hoang
,
C. H.
,
Manaserh
,
Y. Y.
,
Nemati
,
K.
,
Schiffres
,
S. N.
, and
Sammakia
,
B. G.
,
2023
, “
Performance Analysis of Corrosion Resistant Electroless Nickel-Plated Impinging Computer Numerical Control Manufactured Liquid Cooling Cold Plate
,”
ASME J. Electron. Packag.
,
145
(
2
), p.
021001
.10.1115/1.4054972
16.
Simon
,
V. S.
,
Modi
,
H.
,
Sivaraju
,
K. B.
,
Bansode
,
P.
,
Saini
,
S.
,
Shahi
,
P.
,
Karajgikar
,
S.
,
Mulay
,
V.
, and
Agonafer
,
D.
,
2022
, “
Feasibility Study of Rear Door Heat Exchanger for a High Capacity Data Center
,” accessed Dec. 4, 2023, https://asmedigitalcollection.asme.org/InterPACK/proceedings-abstract/InterPACK2022/V001T01A018/1153380?casa_token=BqdCvJnmy0wAAAAA:1ZQuZJlB1w73v6So_T93OPwlt_HaHCLa8waYpeWzGTgnuRDLt6RTFbdpyGniaJDUcjs4ofpaXw
17.
Gao
,
T.
,
Tang
,
H.
, and
Cui
,
Y.
,
2018
, “
A Test Study of Technology Cooling Loop in a Liquid Cooling System
,” accessed Apr. 15, 2023, https://ieeexplore.ieee.org/abstract/document/8419519/
18.
Schmidt
,
R.
,
Iyengar
,
M.
,
Porter
,
D.
,
Weber
,
G.
,
Graybill
,
D.
, and
Steffes
,
J.
,
2010
, “
Open Side Car Heat Exchanger That Removes Entire Server Heat Load Without Any Added Fan Power
,” accessed June 28, 2023, https://ieeexplore.ieee.org/abstract/document/5501423/?casa_token=CCCi1PsOjVAAAAAA:at8SWiOd2YdZ_LOjxcIGiSkLi8Dbth8W8tNt87q1qIWLayYWCFtbFx2p6DWx4xBumL1mT_szdfo
19.
Chowdhury
,
U.
,
Hendrix
,
W.
,
Craft
,
T.
,
James
,
W.
,
Sutaria
,
A.
, and
Agonafer
,
D.
,
2019
, “
Optimal Design and Modeling of Server Cabinets With in-Row Coolers and Air Conditioning Units in a Modular Data Center
,” accessed Apr. 15, 2023, https://asmedigitalcollection.asme.org/InterPACK/proceedings-abstract/InterPACK2019/V001T02A009/1071704?casa_token=g0Za9sKN9ucAAAAA:PgUSeqlPRDpyocqKdSYcYDiR2VnFVdUzK8Dipz4dYK8Yl_fe4Zb19YDUqew-eInQXmcHMw6KbA
20.
Shahi
,
P
,
Saini
,
S.
,
Bansode
,
P.
, and
Agonafer
,
D.
,
2021
, “
A Comparative Study of Energy Savings in a Liquid-Cooled Server by Dynamic Control of Coolant Flow Rate at Server Level
,” accessed Apr. 15, 2023, https://ieeexplore.ieee.org/abstract/document/9381248/?casa_token=EXMgRhyKF8QAAAAA:otSk-9uabaS9fj3LhCnyDE6vC1kLaW_4zo5WVPnkF7ElRVLh0pYLkuNOBdqIiOoVLktAkWnqdaQ
21.
Iyengar
,
M.
,
David
,
M.
,
Parida
,
P.
,
Kamath
,
V.
,
Kochuparambil
,
B.
,
Graybill
,
D.
, and
Schultz
,
M.
,
2012
, “
Server Liquid Cooling With Chiller-Less Data Center Design to Enable Significant Energy Savings
,”
Annual IEEE Semiconductor Thermal Measurement and Management Symposium
, San Jose, CA, Mar. 18–22, pp.
212
223
.10.1109/STHERM.2012.6188851
22.
Gao
,
T.
,
David
,
M.
,
Geer
,
J.
,
Schmidt
,
R.
, and
Sammakia
,
B.
,
2015
, “
Experimental and Numerical Dynamic Investigation of an Energy Efficient Liquid Cooled Chiller-Less Data Center Test Facility
,”
Energy Build.
,
91
, pp.
83
96
.10.1016/j.enbuild.2015.01.028
23.
Bhalerao
,
A.
,
Ortega
,
A.
, and
Wemhoff
,
A. P.
,
2014
, “
Thermodynamic Analysis of Hybrid Liquid-Air-Based Data Center Cooling Strategies
,” accessed June 28, 2023, https://asmedigitalcollection.asme.org/IMECE/proceedings-abstract/IMECE2014/V08BT10A080/262039?casa_token=vD0bFOziF7YAAAAA:qGrtOSicgAPnqvYEv9uJv8RSZPP6kl6mppvl4xmXLZO8hWUegE7l8AKfY9a8Q9F_GbbWnbVDnw
24.
Heydari
,
A.
,
Shahi
,
P.
,
Radmard
,
V.
,
Eslami
,
B.
,
Chowdhury
,
U.
,
Saini
,
S.
,
Bansode
,
P.
,
Miyamura
,
H.
,
Agonafer
,
D.
, and
Rodriguez
,
J.
,
2022
, “
Liquid to Air Cooling for High Heat Density Liquid Cooled Data Centers
,”
ASME
Paper No. IPACK2022-97386.10.1115/IPACK2022-97386
25.
Heydari
,
A.
,
Gharaibeh
,
A. R.
,
Tradat
,
M.
,
Manaserh
,
Y.
,
Soud
,
Q.
,
Radmard
,
V.
,
Eslami
,
B.
,
Rodriguez
,
J.
, and
Sammakia
,
B.
,
2023
, “
Guidelines and Experimental Hydraulic Performance Evaluation for Single-Phase CDUs Under Steady and Transient Events
,” InterSociety Conference on Thermal and Thermomechanical Phenomena in Electronic Systems,
ITHERM
, Orlando, FL, May 30–June 2, pp.
1
5
.10.1109/ITherm55368.2023.10177633
26.
Shah
,
J. M.
,
Dandamudi
,
R.
,
Bhatt
,
C.
,
Rachamreddy
,
P.
,
Bansode
,
P.
, and
Agonafer
,
D.
,
2019
, “
CFD Analysis of Thermal Shadowing and Optimization of Heatsinks in 3rd Generation Open Compute Server for Single-Phase Immersion Cooling
,”
ASME
Paper No. IPACK2019-6600.10.1115/IPACK2019-6600
27.
Steinbrecher
,
R.
, and
Schmidt
,
R.
,
2011
, “
Data Center Environments
,”
ASHRAE J.
,
53
(
12
), p.
e9
.https://www.researchgate.net/publication/297488350_Data_Center_Environments_ASHRAE's_Evolving_Thermal_Guidelines
28.
Schmidt
,
R. R.
,
Belady
,
C.
,
Classen
,
A.
,
Davidson
,
T.
,
Herrlin
,
M.
,
Novotny
,
S.
, and
Perry
,
R.
,
2004
, “
Evolution of Data Center Environmental Guidelines
,” accessed Apr. 24, 2023, http://ancis.us/images/AN-04-9-1.pdf
You do not currently have access to this content.