jucor
New Member
- Total Posts : 9
- Reward points : 0
- Joined: 2016/11/29 13:11:44
- Status: offline
- Ribbons : 0
Hi EVGA fans I just received a quad-GPU machine, water cooled, 4x EVGA 1080, mounted by professionals who know better than me, to use for machine learning purposes. However, I'm a bit worried about the temperatures I'm seeing: 76-79 C after ~30 minutes at full load, room temperature 22C. I'm using to test the cards, on an Ubuntu 16.04 with latest nvidia 375 driver and Cuda 8.0. Does that range look normal to you who have more expertise about GPUs than I do? Below's the full log of 1 hour of gpu-burn, so every 10% log line is 6 extra minutes at full-load. You can see it rises quickly. Thanks for any feedback! julien@supercompute:gpu-burn ((v0.4.5))$ ./gpu_burn 3600 GPU 0: GeForce GTX 1080 (UUID: GPU-ffd4fe51-559d-3445-1aa0-c92532aaa961) GPU 1: GeForce GTX 1080 (UUID: GPU-f391c01d-725d-0ad5-e673-b7998e7aa613) GPU 2: GeForce GTX 1080 (UUID: GPU-5ed87307-ecfe-d18d-2a3b-c73324705a33) GPU 3: GeForce GTX 1080 (UUID: GPU-0b43300e-1e96-2b4d-bf42-9eac51761b9d) Initialized device 0 with 8145 MB of memory (7990 MB available, using 7191 MB of it), using FLOATS Initialized device 1 with 8145 MB of memory (7990 MB available, using 7191 MB of it), using FLOATS Initialized device 3 with 8142 MB of memory (7977 MB available, using 7179 MB of it), using FLOATS Initialized device 2 with 8145 MB of memory (7990 MB available, using 7191 MB of it), using FLOATS 10.0% proc: 1.01M/1.01M/1.00M/994K err: 0/0/0/0 tmp: 68C/71C/69C/74C Summary at: Tue 29 Nov 17:35:12 GMT 2016
20.1% proc: 2.02M/2.02M/2.01M/1.99M err: 0/0/0/0 tmp: 70C/73C/71C/75C Summary at: Tue 29 Nov 17:41:13 GMT 2016
30.1% proc: 3.02M/3.04M/3.01M/2.98M err: 0/0/0/0 tmp: 72C/75C/72C/78C Summary at: Tue 29 Nov 17:47:14 GMT 2016
40.1% proc: 4.02M/4.05M/4.01M/3.98M err: 0/0/0/0 tmp: 71C/76C/73C/79C Summary at: Tue 29 Nov 17:53:15 GMT 2016
50.1% proc: 5.03M/5.05M/5.00M/4.97M err: 0/0/0/0 tmp: 73C/76C/74C/78C Summary at: Tue 29 Nov 17:59:16 GMT 2016
60.2% proc: 6.03M/6.06M/6.00M/5.96M err: 0/0/0/0 tmp: 73C/76C/73C/79C Summary at: Tue 29 Nov 18:05:17 GMT 2016
70.2% proc: 7.03M/7.07M/7.00M/6.95M err: 0/0/0/0 tmp: 72C/76C/74C/79C Summary at: Tue 29 Nov 18:11:18 GMT 2016
80.2% proc: 8.03M/8.07M/7.99M/7.95M err: 0/0/0/0 tmp: 73C/76C/74C/79C Summary at: Tue 29 Nov 18:17:19 GMT 2016
90.2% proc: 9.03M/9.08M/8.99M/8.94M err: 0/0/0/0 tmp: 73C/76C/73C/79C Summary at: Tue 29 Nov 18:23:20 GMT 2016
100.0% proc: 10.01M/10.06M/9.96M/9.91M err: 0/0/0/0 tmp: 73C/76C/73C/79C Killing processes.. done
Tested 4 GPUs: GPU 0: OK GPU 1: OK GPU 2: OK GPU 3: OK
|
Sajin
EVGA Forum Moderator
- Total Posts : 49218
- Reward points : 0
- Joined: 2010/06/07 21:11:51
- Location: Texas, USA.
- Status: online
- Ribbons : 199
Re: Temperature Quad-1080 Water-cooled
2016/11/29 13:25:50
(permalink)
76-79c on water? That isn't right at all.
|
bcavnaugh
The Crunchinator
- Total Posts : 38516
- Reward points : 0
- Joined: 2012/09/18 17:31:18
- Location: USA Affiliate E5L3CTGE12 Associate 9E88QK5L7811G3H
- Status: offline
- Ribbons : 282
Re: Temperature Quad-1080 Water-cooled
2016/11/29 13:32:14
(permalink)
Sajin 76-79c on water? That isn't right at all.
Welcome to the Forum jucor I agree, you maybe would see 46C-52C but no were in the 70's. Post some Photos of this Custom Water Setup. It might be that only your CPU is under Water.
post edited by bcavnaugh - 2016/11/29 16:41:07
|
jucor
New Member
- Total Posts : 9
- Reward points : 0
- Joined: 2016/11/29 13:11:44
- Status: offline
- Ribbons : 0
Re: Temperature Quad-1080 Water-cooled
2016/11/29 13:45:31
(permalink)
Thanks for the prompt answer, and the warm (no pun intended) welcome. Below is a pic of the setup. All four GPUs are supposed to be water-cooled -- does it look right to you? I got it assembled by a shop which is quite well known in the UK for assembling high-perf gaming PCs, as I would not trust myself with such an assembly of pipes :)
|
bcavnaugh
The Crunchinator
- Total Posts : 38516
- Reward points : 0
- Joined: 2012/09/18 17:31:18
- Location: USA Affiliate E5L3CTGE12 Associate 9E88QK5L7811G3H
- Status: offline
- Ribbons : 282
Re: Temperature Quad-1080 Water-cooled
2016/11/29 13:53:46
(permalink)
Can you read what your Water Temperatures are and the Flow Rate of the Water? Are the Fans on the Radiator Push/Pull and Pulling Air into the Case? What is your Radiator? What size is it? It looks like a 3x120 and you should have at least 1x120 Per Water Bock and you have 5, 1 CPU and 4 GPU. What are your CPU Core Temperatures?
post edited by bcavnaugh - 2016/11/29 13:57:01
|
jucor
New Member
- Total Posts : 9
- Reward points : 0
- Joined: 2016/11/29 13:11:44
- Status: offline
- Ribbons : 0
Re: Temperature Quad-1080 Water-cooled
2016/11/29 14:12:46
(permalink)
All very good question, and I'm not quite sure how to answer these: - Water temperatures and flow rate: how can I find these out, please?
- Correct, 3 fans at the front on the radiator, and 1 larger at the rear of the case. I believe the three fans on the radiator are pushing air out, as far as I can tell by the draft. Not sure about the one at the rear.
- The fan at the back: no idea.
- Radiator model and size: not detailed on the list of components I received from the assembler (the invoice just says "Watercooling system").
- CPU Core Temperatures: 38-56C at mostly idle (instant load average 3.52, for 6 cores hyperthreaded)
julien@supercompute:gpu-burn ((v0.4.5))$ sensors coretemp-isa-0000 Adapter: ISA adapter Physical id 0: +56.0°C (high = +90.0°C, crit = +100.0°C) Core 0: +52.0°C (high = +90.0°C, crit = +100.0°C) Core 1: +38.0°C (high = +90.0°C, crit = +100.0°C) Core 2: +56.0°C (high = +90.0°C, crit = +100.0°C) Core 3: +48.0°C (high = +90.0°C, crit = +100.0°C) Core 4: +56.0°C (high = +90.0°C, crit = +100.0°C) Core 5: +40.0°C (high = +90.0°C, crit = +100.0°C)
Apologies for the lack of detailed answers: I'm new to water cooling, and haven't assembled a machine myself in ... aoutch, 13 years. I trusted the assembler to dimension the water-cooling properly especially as the extra price to get water-cooling was quite stiff.
post edited by jucor - 2016/11/29 14:23:06
|
jucor
New Member
- Total Posts : 9
- Reward points : 0
- Joined: 2016/11/29 13:11:44
- Status: offline
- Ribbons : 0
Re: Temperature Quad-1080 Water-cooled
2016/11/29 14:14:15
(permalink)
Update: after a few minutes at load 4, CPU temps have risen to 52C (coldest core) to 71C (hottest core).
|
the_Scarlet_one
formerly Scarlet-tech
- Total Posts : 24080
- Reward points : 0
- Joined: 2013/11/13 02:48:57
- Location: East Coast
- Status: offline
- Ribbons : 79
Re: Temperature Quad-1080 Water-cooled
2016/11/29 15:09:29
(permalink)
You have a 360 radiator cooling 5 components? You should have a MINIMUM of 120mm per component, so 5x120 or 600mm equivalent, and then you should, if possible, have 120mm extra, for 720mm total.. You should have 2x360 radiators at least. You should provide more pictures, because what you show currently, you should not have that many components on just one small radiator. Whomever built that, didn't do what they should have. Also, is the pump built into the radiator? If so, is it at the top of the radiator right now? Lastly, are you getting good water flow while it is on or does it get bubbly and loud? You can see in the picture that I attached that there is already bubbles in the line, circled. What company did this? Your rear fan is clearly blowing in, and you stated the front fans are blowing out (through the radiator?)...
post edited by Scarlet-Tech - 2016/11/29 15:15:25
Attached Image(s)
|
Cool GTX
EVGA Forum Moderator
- Total Posts : 31313
- Reward points : 0
- Joined: 2010/12/12 14:22:25
- Location: Folding for the Greater Good
- Status: offline
- Ribbons : 123
Re: Temperature Quad-1080 Water-cooled
2016/11/29 15:30:27
(permalink)
To answer your original question = your system seems very warm - this is what I get on my system Rig 1 in signature Phanteks Enthoo Primo full tower, Alpha Cool radiators 420 rad top, 360 rad bottom My CPU + 3-way GPU set up Folding at OC settings = lots of power = 900 - 1000 Watts as measured/ displayed by the UPS GPUs : 2 are Pascal Titan X and one is EVGA 1080 SE, all are running 2100MHz with no OC on the RAM - Folding with EK blocks and a serial adapter. EK-FC Terminal Triple serial block connects the GPU Water Blocks Rad 1 Alpha Cool UT60 - 140mm x 420mm with 6 140 EK F3 Vardar fans running @ 2000RPM - blowing Out the Top Rad 2 Alpha Cool XT45 - 120mm x 360mm with 6 120 EK F4 Vardar fans running @2200 RPM - blowing In, mounted in bottom of case 3 additional 140 Fans blowing in and one 140 blowing out the back of case D5 pump running at full speed, 1/2 inch ID soft hose 5960X CPU, Folding 12 cores @ 3.8 GHz, EK block in the loop after the GPUs Room 68 F or this would be 20 C The cooling ability is best represented by the Delta (difference) between the Room (ambient) and the part being cooled Part temp - Room temp = Delta temp GPU 1 is at 35 C = Delta of 15 C GPU 2 is at 33 C = Delta of 13 C GPU 3 (1080 SE) is 36 C = Delta of 16 C CPU (Folding with 12 of 16 Cores at 3.8 GHz) is 51 C = Delta of 31C Folding seems to push a system very hard dare I say to 100% Flow of loop: D5 to 360 rad to 3-way GPUs to CPU to 420 rad to reservoir If I slow the D5 pump the temps rise If I slow the rad fans the temps rise - have been folding strong for a month with current settings Rig #2 in my signature XT45 Alpha Cool radiator 120mm x 360mm with 6 - 120 EK F4 Vardar fans blowing In and 3 case fans - 140 fans blowing Out of case D5 pump, 1/2 hose - Not folding with CPU, Temp 39 C = Delta of 19 C Those EVGA Titan X SC are being pushed over 1400 MHz, system pulls around 650 - 800 watts - per UPS display
post edited by Cool GTX - 2016/11/29 17:32:25
Learn your way around the EVGA Forums, Rules & limits on new accounts Ultimate Self-Starter Thread For New Members
I am a Volunteer Moderator - not an EVGA employee
Older RIG projects RTX Project Nibbler
When someone does not use reason to reach their conclusion in the first place; you can't use reason to convince them otherwise!
|
Cool GTX
EVGA Forum Moderator
- Total Posts : 31313
- Reward points : 0
- Joined: 2010/12/12 14:22:25
- Location: Folding for the Greater Good
- Status: offline
- Ribbons : 123
Re: Temperature Quad-1080 Water-cooled
2016/11/29 15:53:42
(permalink)
Scarlet-Tech You have a 360 radiator cooling 5 components? You should have a MINIMUM of 120mm per component, so 5x120 or 600mm equivalent, and then you should, if possible, have 120mm extra, for 720mm total.. You should have 2x360 radiators at least. You should provide more pictures, because what you show currently, you should not have that many components on just one small radiator. Whomever built that, didn't do what they should have. Also, is the pump built into the radiator? If so, is it at the top of the radiator right now? Lastly, are you getting good water flow while it is on or does it get bubbly and loud? You can see in the picture that I attached that there is already bubbles in the line, circled. What company did this? Your rear fan is clearly blowing in, and you stated the front fans are blowing out (through the radiator?)...
The large black band my be allowing the transfer of heat from the CPU tube to the radiator out (cooled) tube if the tubes are held against each other
Learn your way around the EVGA Forums, Rules & limits on new accounts Ultimate Self-Starter Thread For New Members
I am a Volunteer Moderator - not an EVGA employee
Older RIG projects RTX Project Nibbler
When someone does not use reason to reach their conclusion in the first place; you can't use reason to convince them otherwise!
|
the_Scarlet_one
formerly Scarlet-tech
- Total Posts : 24080
- Reward points : 0
- Joined: 2013/11/13 02:48:57
- Location: East Coast
- Status: offline
- Ribbons : 79
Re: Temperature Quad-1080 Water-cooled
2016/11/29 16:27:30
(permalink)
Cool GTX
Scarlet-Tech Also, is the pump built into the radiator? If so, is it at the top of the radiator right now? Lastly, are you getting good water flow while it is on or does it get bubbly and loud? You can see in the picture that I attached that there is already bubbles in the line, circled.
The large black band my be allowing the transfer of heat from the CPU tube to the radiator out (cooled) tube if the tubes are held against each other
Black band? Not sure that had anything to do with the bubble question. The band just holds the two lines together. There is no transfer of anything.. I am pretty sure it was just a rubber band for shipping to keep the lines from shifting.
post edited by Scarlet-Tech - 2016/11/29 16:30:27
|
bcavnaugh
The Crunchinator
- Total Posts : 38516
- Reward points : 0
- Joined: 2012/09/18 17:31:18
- Location: USA Affiliate E5L3CTGE12 Associate 9E88QK5L7811G3H
- Status: offline
- Ribbons : 282
Re: Temperature Quad-1080 Water-cooled
2016/11/29 16:44:52
(permalink)
"The fan at the back: no idea." It is Pull Air Into the Case. My findings after adding a water block to one of my GTX 1080 Cards. The Max Temp I could get on water was 53C and only after I turned off all the Fans on the Radiators. GPU 1 on Water | GPU 2 on Air. Idle Running Full Boar Running Full Boar with Fans Turned Off. Took me a little longer to get the Block install and test. And all what the Great Members Above has posted.
post edited by bcavnaugh - 2016/11/29 17:01:44
|
wmmills
CLASSIFIED Member
- Total Posts : 4688
- Reward points : 0
- Joined: 2006/01/04 20:47:29
- Location: New Jersey
- Status: offline
- Ribbons : 40
Re: Temperature Quad-1080 Water-cooled
2016/11/29 18:43:38
(permalink)
Was there controller software for the gpu/cpu cooling system they installed from whichever manufacturer? You need to control those rad fans when in different situations to get the cooling you need cause the temps are def high. You can always get a custom fan controller and mount it anywhere in/on the case and have direct access to the fans and bypass windows entirely, if that appeals to you. Everything looks good from here in NJ,...... im just kidding man. :P :) Seriously, from what i can see its looks done well. With four cards together like that, even on water, the pcb boards still release heat, so some ambient air circulation def needs to be run thru the box, which it looks like they did. Im not a big fan of rads on the inside of a case with other components, theres just too many issues and the cooling is not optimal since your pulling heated case air through a rad. They need there own section of the case that's sealed off from the rest of the components or a external custom mount if necessary. @Scarlet.... they were probably thinking that because they were cooler running 10xx series with lower voltages the typical 1 120/Compo wasn't as necessary, especially if he wasn't going to be benchmarking, gaming or overclocking. As far as the bubbles, i cant tell!!! lol. I cant tell if its bubbles or just the tubes reflecting and distorting the gcards pcb solder pinouts on the backs of the cards. Another photo with a piece of L shaped cardboard covering them would be great, right?!? :) Edit: I just realized something else while looking at the blowup in Paint, shouldn't the tube going out to the gpu's be in the lower left corner of the cpu block, not at the top left, so your working with gravity and not against it pushing the water up to the top corner?
post edited by wmmills - 2016/11/29 19:19:33
MOBO: EVGA x299 Dark, CPU: I9 10900X, RAM: Patriot Viper RGB 3600 32gb, SSD: Samsung 860 EVO 1TB, M2: Samsung 970 EVO+ 1TB, PSU: CoolerMaster M2 1500, CPU HSF: EVGA 240 CLC HSF~ P/P EK Furious Vardar, G-CARD:EVGA RTX3090 FTW3 Ultra Gaming w/Hybrid kit and Noctua IPPC 3000 P/P, CASE: LIAN-LI PC-V2010B w/ Window mod, OS: Windows 10 Pro 64bit, MON: Alienware AW3821DW New EVGA product? Register it NOW with this link: http://www.evga.com/register/default.asp?affiliatecode=4QFQRAMOII Help Our Vets From K-2! [link=https://strongholdfreedom
|
the_Scarlet_one
formerly Scarlet-tech
- Total Posts : 24080
- Reward points : 0
- Joined: 2013/11/13 02:48:57
- Location: East Coast
- Status: offline
- Ribbons : 79
Re: Temperature Quad-1080 Water-cooled
2016/11/29 19:20:10
(permalink)
wmmills Was there controller software for the gpu/cpu cooling system they installed from whichever manufacturer? You need to control those rad fans when in different situations to get the cooling you need cause the temps are def high. You can always get a custom fan controller and mount it anywhere in/on the case and have direct access to the fans and bypass windows entirely, if that appeals to you. Everything looks good from here in NJ,...... im just kidding man. :P :) Seriously, from what i can see its looks done well. With four cards together like that, even on water, the pcb boards still release heat, so some ambient air circulation def needs to be run thru the box, which it looks like they did. Im not a big fan of rads on the inside of a case with other components, theres just too many issues and the cooling is not optimal since your pulling heated case air through a rad. They need there own section of the case that's sealed off from the rest of the components or a external custom mount if necessary. @Scarlet.... they were probably thinking that because they were cooler running 10xx series with lower voltages the typical 1 120/Compo wasn't as necessary, especially if he wasn't going to be benchmarking, gaming or overclocking. As far as the bubbles, i cant tell!!! lol. I cant tell if its bubbles or just the tubes reflecting and distorting the gcards pcb solder pinouts on the backs of the cards. Another photo with a piece of L shaped cardboard covering them would be great, right?!? :) Edit: I just realized something else while looking at the blowup in Paint, shouldn't the tube going out to the gpu's be in the lower left corner of the cpu block, not at the top left, so your working with gravity and not against it pushing the water up to the top corner?
Definitely need more pictures, but 4 gpu's and 1 CPU, there is no way for a 360 to cool all of that efficiently, unless he turns two of the cards off. Especially with an 8 core CPU that loves to get warm.
|
loveha
Omnipotent Enthusiast
- Total Posts : 10302
- Reward points : 0
- Joined: 2009/09/26 01:51:22
- Location: Beulah Michigan
- Status: offline
- Ribbons : 65
Re: Temperature Quad-1080 Water-cooled
2016/11/29 19:54:36
(permalink)
Like stated, unless you have 120mm of radiator per water block, +1 extra 120mm of radiator, then you will have unusual high temps for water. Should have two 360mm radiators for your configuration.
Also if I am not mistaken, shouldn't that top fitting on the water bridge be the left port?
Case - Phanteks Enthoo Evolv XMobo - EVGA X570 FTWCPU - AMD Ryzen 9 5900XRAM - 32GB Trident Z Royal 3600MHz 14-14-14-34GPU - EVGA RTX 3080 Ti FTW3 Ultra GamingPSU - Seasonic Prime TX-1000Heatkiller IV CPU Waterblock / Heatkiller V GPU WaterblockHeatkiller V EBC Active Backplate / Two Heatkiller Rad 360 L Six Noctua NF-A12x25 / Heatkiller D5 Pump
|
bcavnaugh
The Crunchinator
- Total Posts : 38516
- Reward points : 0
- Joined: 2012/09/18 17:31:18
- Location: USA Affiliate E5L3CTGE12 Associate 9E88QK5L7811G3H
- Status: offline
- Ribbons : 282
Re: Temperature Quad-1080 Water-cooled
2016/11/29 20:12:12
(permalink)
loveha Also if I am not mistaken, shouldn't that top fitting on the water bridge be the left port?
For Parallel it would be OK, but Not for Serial.
|
bcavnaugh
The Crunchinator
- Total Posts : 38516
- Reward points : 0
- Joined: 2012/09/18 17:31:18
- Location: USA Affiliate E5L3CTGE12 Associate 9E88QK5L7811G3H
- Status: offline
- Ribbons : 282
Re: Temperature Quad-1080 Water-cooled
2016/11/29 20:12:12
(permalink)
To Fast On the Mouse Button Tonight!
|
the_Scarlet_one
formerly Scarlet-tech
- Total Posts : 24080
- Reward points : 0
- Joined: 2013/11/13 02:48:57
- Location: East Coast
- Status: offline
- Ribbons : 79
Re: Temperature Quad-1080 Water-cooled
2016/11/29 20:59:44
(permalink)
bcavnaugh
loveha Also if I am not mistaken, shouldn't that top fitting on the water bridge be the left port?
For Parallel it would be OK, but Not for Serial.
Like BCav states, that is a semi parallel block, so both ports are on the right side, since the series portion is on the left.
|
ksgnow2010
iCX Member
- Total Posts : 466
- Reward points : 0
- Joined: 2015/09/21 17:56:35
- Status: offline
- Ribbons : 0
Re: Temperature Quad-1080 Water-cooled
2016/11/30 06:51:15
(permalink)
As stated above...70C+ is way to high for a water cooled solution. Also, 360 mm of radiator is too small to cool 4 x 1080 cards and a CPU. The general rule is 1x120 mm of radiator for 100 W of cooling to get your GPU temps sub 40 C. If you do 1x120 mm radiator per water block, your GPU temps will be sub 50 C. So, you would need AT LEAST 5x120 mm worth of radiator. The guys that built that should have known that. The back fan is definitely pushing air in. Can you verify (or show a picture) of the fans on the front radiator...are you sure they are pushing out? I can see what looks like a fan wire on the middle fan...the fan wires come out of the back of the fan...which means they are pulling air into the case. The easiest way to determine if you have an air-flow issue is to remove the side of the case and see if your temperatures drop. The top of the case is sealed off. I think this type of case lets you remove the top panels. You should try that to let the heat escape. Also, if the front fans on the radiator are blowing in, reverse the direction of the back fan to let it blow out. You could also add fans to the top of the case to exhaust more heat. Do you know how to control the pump and fan speeds? If you can, I would set them to 100% and see if that lowers temps.
|
jucor
New Member
- Total Posts : 9
- Reward points : 0
- Joined: 2016/11/29 13:11:44
- Status: offline
- Ribbons : 0
Re: Temperature Quad-1080 Water-cooled
2016/11/30 07:51:01
(permalink)
Wow, thanks a lot everyone for such detailed feedback! Here are some more details, hoping it helps. - Pics: I have uploaded extra pictures below, including zoom on the fan's label.
- Fan size: 120 fans on the front, 1x160 (or 150) at the back. I'm not sure if there are 3 or 6x120 fans on the front: on the pictures, it looks like the front fans are on both sides of the radiators, which would make 2x3 = 6 fans. Does that look like it to you too?
- Fan direction: the 3x120 fans on the front were definitely blowing air out during the test (I was feeling the draft of very warm air). The case is sealed at the top. The front fans blow against a plate that then has vents on the sides (ie not straight open in front).
- Tests with case open: I've just flown out of the country for 12 days (going to NIPS machine learning conference next week), so won't be able to do other physical tests before then. Only software tests over SSH :/ [unless I ask my wife to open the case...] Longer term this machine will sit in a datacenter of an NGO I'm helping, not at home, so I'd much rather have it safely closed rather than open-hearted.
- Black bands: The black bands are indeed just ties to hold the pipes cleanly out of the way.
- Bubbles: Thanks for suggesting to check for bubbles : there are none at all, these were just reflexions due to my atrocious photo skills :) I double-checked.
- Pump flow: I do not know of any way to check the flow or the temperature of the coolant, or to set it.
- Assembler name: I've just contacted the assembler today to discuss. They have a very good reputation for gaming rigs, and are very friendly, so I'd much rather give them the chance to be their usual awesome and then sing their praises once they've fixed this, rather than naming then now before they've even had a chance to look at the problem :)
- Assembler's answer: Right now their first answer is that these temperatures are safe and normal on high load (as opposed to gaming), but that I could force the fans to 100% all the time, because the fan speed depends on the CPU temperature which could be small (except that it the CPU was at 70 in the test). I will point them to this thread to see advices from more knowledgeable people than me.
Here are the pics: 3x120 front fans: CPU Side view of the GPU (with CPU on top) Rear fan, 160 Top of the radiator/fan unit on the front Under-view of the GPUs and again the global view to have it all in one post
post edited by jucor - 2016/11/30 08:27:59
|
the_Scarlet_one
formerly Scarlet-tech
- Total Posts : 24080
- Reward points : 0
- Joined: 2013/11/13 02:48:57
- Location: East Coast
- Status: offline
- Ribbons : 79
Re: Temperature Quad-1080 Water-cooled
2016/11/30 09:07:25
(permalink)
Those temps are not good on water. I wouldnt personally consider them acceptable at all for the price you paid, because you could have bought founders edition cards and had the same exact temps for probably around $700 less. Why spend the extra money for the same temps?
They should have used a larger case, and i understand the case was probably your choice, but slamming 5 components into a waterloop without enough rad space should have set off an alarm in their head. Especially putting that mang into what looks to be a midtower. I ran 4 780ti's and an x79 3930k in a midtower, but i had two 360mm rads outside of the case because even with two 360's everything still got hot.
To test waterflow, pinch one of the tubes and listen for the pump to pick up a slight sound as water is restricted. Dont pinch it fully closed, but just enough to slow the flow down.
While the builder has a good reputation, they should have definitely said something and tried to persuade you slightly different to get better cooling capacity. What you have is insufficient whether they want to admit it or not.
|
jucor
New Member
- Total Posts : 9
- Reward points : 0
- Joined: 2016/11/29 13:11:44
- Status: offline
- Ribbons : 0
Re: Temperature Quad-1080 Water-cooled
2016/11/30 10:17:11
(permalink)
Thanks Scarlet-Tech. Actually, the case was completely their choice: I don't care for it, and I let it up them to pick what was best for the machine and to design the watercooling -- as I know that I do not know how to design this. I have pointed their tech department to this thread. Hopefully something good will come out of it, because I'm not going to stay with a system like that :)
|
AHowes
CLASSIFIED ULTRA Member
- Total Posts : 6502
- Reward points : 0
- Joined: 2005/09/20 15:38:10
- Location: Macomb MI
- Status: offline
- Ribbons : 27
Re: Temperature Quad-1080 Water-cooled
2016/11/30 11:42:04
(permalink)
Get a new case that can handle a few tripple or quad 120 rads like a thermaltake core x9.. I run daylight triple rads for my sli and cpu. Temps never go above 37c for the top card. Also extra rads means you also can run slower quieter fans insted of noisy fast fans with just enough cooling rads.
post edited by AHowes - 2016/11/30 11:45:39
Intel i9 9900K @ 5.2Ghz Single HUGE Custom Water Loop. Asus Z390 ROG Extreme XI MB G.Skill Trident Z 32GB (4x8GB) 4266MHz DDR4 EVGA 2080ti K|NGP|N w/ Hydro Copper block. 34" Dell Alienware AW3418DW 1440 Ultra Wide GSync Monitor Thermaltake Core P7 Modded w/ 2x EK Dual D5 pump top,2 x EK XE 480 2X 360 rads.1 Corsair 520 Rad.
|
sharkims
New Member
- Total Posts : 25
- Reward points : 0
- Joined: 2016/09/24 20:38:53
- Location: WA, USA
- Status: offline
- Ribbons : 0
Re: Temperature Quad-1080 Water-cooled
2016/11/30 13:34:10
(permalink)
Out of curiosity, is there a reason why you have the plates covering the top fan slots in that case? Where does the ambient air go? How can there possibly be enough fresh cool air being pulled into that case through one rear fan? I bet if those top covers were removed, it would drop a few degrees right away.
|
jucor
New Member
- Total Posts : 9
- Reward points : 0
- Joined: 2016/11/29 13:11:44
- Status: offline
- Ribbons : 0
Re: Temperature Quad-1080 Water-cooled
2016/12/16 04:23:53
(permalink)
Hi Everyone! Thanks again for all your input 3 weeks ago. Here is finally an update: The Beast is now freshly back from the assembler! What the assembler changed: - Removed two closed plates at the case
- Added there 2 large fans blowing *in*, in addition to the back fan that was already doing that.
- Set the CPU fans at a permanent 75% in the BIOS (I'm none too comfortable about having a fixed setting, but if it does the job...)
- Removed some large air bubbles in the water blocks (why they were there in the first place is a mystery to me)
- Removed a dust filter on the out-blowing fans
What the assembler did *not* change: - Kept the same case (no larger case)
- Kept the same setup of fans on the radiator
- Did not add any flowmeter nor water-temperature sensor (for future diagnosis)
He explained that any other change would take several weeks, mid-January at best, so we are trying this way, seeing how it works. With this setup, I am now seing temperatures of 61C/63C/61C/66C after 30 minutes full-GPU-load, CPU 4 threads full (out of 12 threads), in a room at 22C. That is better a steady 12C better than the original 73C/76C/74C/78C I was seeing. Noise is at 50.5dB at 30cm, 47.6dB at 1m. The question is now whether these new temps will be sustained over days of computing or if they will creep up, and whether they will be good enough for the intended machine learning use. I'll test over the holidays and let you know. If not, I should send it back again and ask for extra work on it. I will keep you posted. Thanks again for all the advice, don't hesitate if you have some more. You EVGA-forumers rock! Here are pics of the case with the 2 new top fans:
post edited by jucor - 2016/12/16 04:33:55
|
Salem13
Superclocked Member
- Total Posts : 179
- Reward points : 0
- Joined: 2016/06/18 07:35:11
- Status: offline
- Ribbons : 0
Re: Temperature Quad-1080 Water-cooled
2016/12/16 04:48:49
(permalink)
My first thought is not enough radiator for the components.
My second thought, including the new fans, reverse the direction of every single fan.
|
AHowes
CLASSIFIED ULTRA Member
- Total Posts : 6502
- Reward points : 0
- Joined: 2005/09/20 15:38:10
- Location: Macomb MI
- Status: offline
- Ribbons : 27
Re: Temperature Quad-1080 Water-cooled
2016/12/16 05:00:49
(permalink)
New case and more radiators!! I wouldn't settle for less then 2x tripple 120fan rads.
You need a thermaltake core x9 or the newer model from them but it's more expensive.
You should be seeing temps in the 40's C on load.
Intel i9 9900K @ 5.2Ghz Single HUGE Custom Water Loop. Asus Z390 ROG Extreme XI MB G.Skill Trident Z 32GB (4x8GB) 4266MHz DDR4 EVGA 2080ti K|NGP|N w/ Hydro Copper block. 34" Dell Alienware AW3418DW 1440 Ultra Wide GSync Monitor Thermaltake Core P7 Modded w/ 2x EK Dual D5 pump top,2 x EK XE 480 2X 360 rads.1 Corsair 520 Rad.
|
loveha
Omnipotent Enthusiast
- Total Posts : 10302
- Reward points : 0
- Joined: 2009/09/26 01:51:22
- Location: Beulah Michigan
- Status: offline
- Ribbons : 65
Re: Temperature Quad-1080 Water-cooled
2016/12/16 05:33:59
(permalink)
Honestly if it was me, I would ditch them, and never step foot in there again. If you are a handy person, and can get the parts you need, it is something anybody can do. Watercooling Just takes patience.
Case - Phanteks Enthoo Evolv XMobo - EVGA X570 FTWCPU - AMD Ryzen 9 5900XRAM - 32GB Trident Z Royal 3600MHz 14-14-14-34GPU - EVGA RTX 3080 Ti FTW3 Ultra GamingPSU - Seasonic Prime TX-1000Heatkiller IV CPU Waterblock / Heatkiller V GPU WaterblockHeatkiller V EBC Active Backplate / Two Heatkiller Rad 360 L Six Noctua NF-A12x25 / Heatkiller D5 Pump
|
ksgnow2010
iCX Member
- Total Posts : 466
- Reward points : 0
- Joined: 2015/09/21 17:56:35
- Status: offline
- Ribbons : 0
Re: Temperature Quad-1080 Water-cooled
2016/12/16 05:40:51
(permalink)
That's an improvement (you are down to good air cooling temperatures), but still not enough radiator.
|
jucor
New Member
- Total Posts : 9
- Reward points : 0
- Joined: 2016/11/29 13:11:44
- Status: offline
- Ribbons : 0
Re: Temperature Quad-1080 Water-cooled
2017/01/20 03:38:34
(permalink)
Allright everyone, happy 2017! Back for more on this sage: the assembler and I are working on changing the case, cooling, fans, radiator, anything to get where I want this machine to be. I'm going to need your help :) You've already chimed plenty of great ideas, and I'm very much looking forward to your suggestions. What I'd like to achieve: - really quiet , otherwise my better half is going to be very sad of having our living room super noisy. The slower fans the better, the more noise-proofed case the better too.
- Watercooling the 4 GPU *and* the CPU.
- ideally temps of 40-55C on full load. I don't need ultra cool capacities, but these babies are going to work a lot (machine learning applications)
- I do *not* plan to overclock.
So, from a blank slate, what do you recommend: - Case:
- @AHowes, you suggested Thermaltake Core X9. Will it be enough for Quad-GPU?
- Separate fans compartment seems great, but is that compartment silenced? The assembler suggested to not use it as it's not silenced, and to put the fans in the main part of the case. Does that make sense to you?
- Fans: how many, what size? brands?
- Radiator: what size? do you recommend brands?
- Flow monitoring: do you recommend temperature sensors, flow sensors, in the loop?
- Anything else : am I forgetting anything?
Thanks a lot for any ideas, you guys have been great so far!
|