Using Four RTX 2080 Ti in a Single Workstation

Author: Greg Gutmann

Affiliation: Tokyo Institute of Technology

The Process of Solving Thermal Issues

Initial Test

I started by installing the four ZOTAC GAMING GeForce RTX 2080 Ti Blower (ZT-T20810A-10P) cards in an X299 ROG Rampage VI Extreme motherboard. Then I proceeded to run my own VR simulation on two GPU as a thermal test, within a minute the two GPU reached 91C.

My first reaction was to download Firestorm, Zotac’s GPU tuning application, and manually set the fan speeds higher. This resulted in nearly no change even when setting the fan speed to 75%, higher fan speeds were not tested for noise reasons. This result was not a very big surprise though, as the cards were literally pressed together. It was actually a bit curious how there was any airflow. Next, I took apart the GPU to better understand the cooling design. As well as to send PCB pictures to EKWB, a liquid cooling company, to see if they had any compatible GPU water blocks. 

 

A look at a put together GPU on the left and a GPU opened up on the right

Over the Top Idea (optional reading):

Since the issue was the airflow, my first idea was cutting holes in strategic locations to create an air intake while not greatly impacting the blower’s ability to force air down the inside of the card and out the back of the case. After a bit of googling it seemed like this hasn’t been tested. Results could be hypothesized though based on past computational fluid dynamics(CFD) simulations and knowledge of pressure around these types of fans.

After this I actually got excited, my reaction was I can simulate this with my code and test to see if it is a viable solution, as well as test where new air intakes would provide the greatest benefit. While I may try this if I have time in the future, I decided to take a simpler approach. 

Solution

To increase the amount of air flow near the blower fan intake I removed all of the backplates from the GPU, then reinstalled the GPU into the desktop.

 

Backplates: Left image to show the height taken up by the backplate. Right image: the removed backplates

This created about 4.5mm of spacing between each card. I used the plastic HDMI caps from the GPU, with some electric tape for friction, as spacers to ensure that all of the GPU were evenly spaced. (not necessarily recommended, but it works and it is free) After this modification, I reran my simulation on two GPU for ten minutes using default GPU settings. The result of this test was temperatures between 74C and 86C with the fans running at about 50% (very quiet but not silent).

 

End result: GPU with backplate removed and equal spacing between each card.

Conclusion

Removing the backplates appears to be the best solution and sufficient for reducing the temperatures to reasonable levels. With this modification,the Zotac 2080 Ti blower cards become a good option if four 2080 Ti are needed in a single workstation. I was actually surprised at how well the minor change worked.

  • Before: 91C at 75% fan speed
  • After: ~80C at ~50% fan speed

 

Nvidia-smi is on the left, a command line tool for monitoring Nvidia GPU. Which shows the fan speed, temperature, power, memory and utilization during my test. In the background is a view of my simulation which I used as a stress test. It is a general purpose particle simulation which may be discussed in future post
Video: https://www.youtube.com/watch?v=h8S8Yb9BW78 
Presentation: http://www.sigmbi.jp/?p=254

These results show that water cooling or other drastic modifications are not needed to run four RTX 2080 Ti in a workstation, assuming that room temperatures are low enough. The room was 21C during the test. Might need to retest when summer comes.

 Future Work

Later I will run my multi-GPU simulation to stress all of the GPU and update this post with those results. I will also check for a standardized multi-GPU stress test, to provide some results that others can reproduce. I ran FurMark, but that only tested the top GPU plugged into the monitor. 

 

Ran a short 6 minute test which seemed stable at 88C. This test was not a focus since it only used one GPU

Side Note:

I have also tested two triple fan open-air cooled 2080 Ti pressed together, more or less out of curiosity. I do not recommend this as they became very hot. If there were four in a case the airflow would be fairly non-uniform around the cards, not an ideal circumstance, and that is assuming they are still able to move air. Using that assumption, it might be feasible if the PC case has very high airflow coming into the case and out of the case. However, by using blower style cards there is a more uniform and predictable flow of air, in the case and past the GPU heat sink, which is typically beneficial when cooling.

The post’s contents can be used as long as the source and URL are cited. Thanks 🙂

This Post Has 4 Comments

  1. Hi, I have a similar setup (4x RTX 2080Ti blower) and experience similarly high temperatures. Did you keep your workstation in this configuration, and if so, did you experience any issues (thermal or any hardware failures) later on? Thanks!

    1. I had no temperature issues after the change (stayed below 85C). In March 2020 I had one card start to fail, however there is nothing to show that it failed due to the four card configuration. No failures for 1 year 3 months, and three of the four are still working well.

      If I was pushing the cards hard I would manually turn up the fan speed as a precaution.

  2. Hi,
    came here because of the exact same issue. I use those cards for 3d rendering (cuda) and i have three of the zotac blowers. My board layout does not allow space in between so they have to be pressed togehter as you already mentioned. 😉
    Today i googled for ‘Zotac rtx2080ti blower air flow’ and luckily found your website. I curious if it would help to cut out a whole on the side which faces the front fans of the case, so air could potentially be sucked in through the card and out of the back. Basically like the 1080ti’s air flow design. I guess the asus 2080ti blower would be a better choice since they made some modifications to the shroud to get more air in between two cards.
    Let me know what you think before i destroy them. 🙂

    Cheers
    René

    1. Hello René,

      Cutting a hole may help, but without a ton of background on blower fan fluid dynamics I am not certain. Also, I would assume the location of the cut would be very important. For my cards I reached okay temperatures so I didn’t feel the need to cut into them. Another option my be mounting a server fan on the back of the case to suck air out of the case like they do when server cards (Tesla) are put in workstations.

      -Greg

Leave a Reply

Close Menu