EVGA

New 5 GPU's 1 PC Build

Page: < 12345.. > >> Showing page 4 of 10
Author
Ali Man
Superclocked Member
  • Total Posts : 244
  • Reward points : 0
  • Joined: 2012/08/01 12:13:06
  • Status: offline
  • Ribbons : 0
Re: New 5 GPU's 1 PC Build 2016/09/19 10:20:16 (permalink)
Chris21010
Ali Man
CPU has got nothing to do with it since x99 CPU's don't have a built-in GPU, so using a d-GPU that's folding would definitely stutter at max load.
 
My PPD is fine, it's impossible to get all the same WU's that really give you a high PPD, that's why I used the term 'average'.

 
CPU has nearly just as much to do with it as your GPU. if you try and run 5 instances for FahCore21.exe on a quad core CPU your PC will be complete unresponsive. even on a 6 core CPU with proper affinity management 5 instances of FahCore21.exe will leave only 1 core for windows and all other apps. not to mention if you are running a 28 lane CPU your 5 GPU's will only be running in x8, x8, x4, x4, x4. meaning your PPD on 3 of your GPU's will be restricted due to poor bandwidth to your CPU.
 
if you didn't know F@H is not a GPU standalone application. it requires 1 physical CPU core per instance and good bandwidth for the data going to and from the CPU/GPU. and again for your PPD i was getting ~2.2 Million with my 4 1070's for over the 2 weeks i had them running, and that was with them not fully boosted due to poor thermals, 95C at times.
 



My 4790k is running @ 75% with all cards, however, the bandwidth for two of my cards has slightly dropped since they're on risers.
 
I downgraded from a 24-core x99 platform just because finding a decent mobo to run 4-cards was a pain in the ass. 
#91
Chris21010
FTW Member
  • Total Posts : 1587
  • Reward points : 0
  • Joined: 2006/05/03 07:26:39
  • Status: offline
  • Ribbons : 9
Re: New 5 GPU's 1 PC Build 2016/09/19 10:30:50 (permalink)
that CPU has only 16 lanes.... no wonder your PPD and CPU utilization are soo poor. well you have proven that limited PCI-e lanes will bottleneck your system with that layout. later this week i'll record a video in OBS while folding on 5 gpu's and show what the 1070's can do with proper hardware.


#92
bcavnaugh
The Crunchinator
  • Total Posts : 38977
  • Reward points : 0
  • Joined: 2012/09/18 17:31:18
  • Location: USA Affiliate E5L3CTGE12 Associate 9E88QK5L7811G3H
  • Status: offline
  • Ribbons : 282
Re: New 5 GPU's 1 PC Build 2016/09/19 10:36:48 (permalink)
Removed
post edited by bcavnaugh - 2017/06/12 21:05:03

Associate Code: 9E88QK5L7811G3H


 
#93
Ali Man
Superclocked Member
  • Total Posts : 244
  • Reward points : 0
  • Joined: 2012/08/01 12:13:06
  • Status: offline
  • Ribbons : 0
Re: New 5 GPU's 1 PC Build 2016/09/19 10:37:40 (permalink)
Chris21010
that CPU has only 16 lanes.... no wonder your PPD and CPU utilization are soo poor. well you have proven that limited PCI-e lanes will bottleneck your system with that layout. later this week i'll record a video in OBS while folding on 5 gpu's and show what the 1070's can do with proper hardware.




I actually mine more than I fold, so in that case, the setup is fine.
 
I just started folding more recently for FoldingCoin, just to see how it goes. I fold a couple of days a month for EVGA.
#94
Cool GTX
EVGA Forum Moderator
  • Total Posts : 31014
  • Reward points : 0
  • Joined: 2010/12/12 14:22:25
  • Location: Folding for the Greater Good
  • Status: offline
  • Ribbons : 122
Re: New 5 GPU's 1 PC Build 2016/09/19 10:41:06 (permalink)
bcavnaugh
 
One Thread Per GPU will also work when HT is turned on.



HT ?

Learn your way around the EVGA Forums, Rules & limits on new accounts Ultimate Self-Starter Thread For New Members

I am a Volunteer Moderator - not an EVGA employee

https://foldingathome.org -->become a citizen scientist and contribute your compute power to help fight global health threats

RTX Project EVGA X99 FTWK Nibbler EVGA X99 Classified EVGA 3080Ti FTW3 Ultra


#95
Cool GTX
EVGA Forum Moderator
  • Total Posts : 31014
  • Reward points : 0
  • Joined: 2010/12/12 14:22:25
  • Location: Folding for the Greater Good
  • Status: offline
  • Ribbons : 122
Re: New 5 GPU's 1 PC Build 2016/09/19 10:42:23 (permalink)
Chris21010
that CPU has only 16 lanes.... no wonder your PPD and CPU utilization are soo poor. well you have proven that limited PCI-e lanes will bottleneck your system with that layout. later this week i'll record a video in OBS while folding on 5 gpu's and show what the 1070's can do with proper hardware.


Where are you posting your "Case issue" video and the above mentioned video when done?

Learn your way around the EVGA Forums, Rules & limits on new accounts Ultimate Self-Starter Thread For New Members

I am a Volunteer Moderator - not an EVGA employee

https://foldingathome.org -->become a citizen scientist and contribute your compute power to help fight global health threats

RTX Project EVGA X99 FTWK Nibbler EVGA X99 Classified EVGA 3080Ti FTW3 Ultra


#96
Chris21010
FTW Member
  • Total Posts : 1587
  • Reward points : 0
  • Joined: 2006/05/03 07:26:39
  • Status: offline
  • Ribbons : 9
Re: New 5 GPU's 1 PC Build 2016/09/19 10:49:36 (permalink)
Cool GTX
Where are you posting your "Case issue" video and the above mentioned video when done?


i do not have a PC that can handle video editing until i finish the build, kinda a catch-22 there.
 
Cool GTX
HT ?


that is Hyper-Threading, a way intel makes 2 virtual cores for every single core on the chip. as for HT and F@H you should disable it. its just like gaming in that the extra overhead to make the extra virtual cores will actually hurt PPD, if you have a x8 or x16 pci-e lane GPU that is. in Ali man's particular use case with only a 4 core system and trying to run 5 GPU's on a bottle necked pci-e bus having HT enabled actually helps him. because with it that 5th FahCore21.exe instance doesn't have to fight for CPU time.
post edited by Chris21010 - 2016/09/19 10:54:46


#97
notfordman
Omnipotent Enthusiast
  • Total Posts : 10345
  • Reward points : 0
  • Joined: 2007/08/09 23:52:23
  • Location: In a van, down by the
  • Status: offline
  • Ribbons : 28
Re: New 5 GPU's 1 PC Build 2016/09/19 11:17:39 (permalink)
Such a great looking build Chris!! The shot of the GPU stack is epic... She's a looker, not only that, is a performer. I don't think I would have the guts to go through the DVI mod. How much "fun" was the hardline bending? I am gathering still for my first try at the hard line tube. Very nice job on your build, I hope that's the last of the leaks for you.
#98
Chris21010
FTW Member
  • Total Posts : 1587
  • Reward points : 0
  • Joined: 2006/05/03 07:26:39
  • Status: offline
  • Ribbons : 9
Re: New 5 GPU's 1 PC Build 2016/09/19 11:57:50 (permalink)
notfordman
Such a great looking build Chris!! The shot of the GPU stack is epic... She's a looker, not only that, is a performer. I don't think I would have the guts to go through the DVI mod. How much "fun" was the hardline bending? I am gathering still for my first try at the hard line tube. Very nice job on your build, I hope that's the last of the leaks for you.



as you have probably heard for others double the amount of tubing you purchase from how much is actually required. i did this and i used 3/4 of it. and i also want to redo nearly every bend because they are all off by fractions of an inch. though they look fine for most to me knowing they are off i want to fix them. but considering i am still at stage 2 of the 3 stage build process, with stage making it look perfect, i will let it slide for now so i can have a functional desktop again. also i like PETG, it was quite easy to work with imho.
post edited by Chris21010 - 2016/09/19 11:59:20


#99
Cool GTX
EVGA Forum Moderator
  • Total Posts : 31014
  • Reward points : 0
  • Joined: 2010/12/12 14:22:25
  • Location: Folding for the Greater Good
  • Status: offline
  • Ribbons : 122
Re: New 5 GPU's 1 PC Build 2016/09/19 12:38:37 (permalink)
Chris21010
Cool GTX
Where are you posting your "Case issue" video and the above mentioned video when done?


i do not have a PC that can handle video editing until i finish the build, kinda a catch-22 there.
 
Cool GTX
HT ?


that is Hyper-Threading, a way intel makes 2 virtual cores for every single core on the chip. as for HT and F@H you should disable it. its just like gaming in that the extra overhead to make the extra virtual cores will actually hurt PPD, if you have a x8 or x16 pci-e lane GPU that is. in Ali man's particular use case with only a 4 core system and trying to run 5 GPU's on a bottle necked pci-e bus having HT enabled actually helps him. because with it that 5th FahCore21.exe instance doesn't have to fight for CPU time.


OK got it.
 
I know what Hyper threading is ---> just the way bc threw "HT" out there I did not follow what he abbreviated with HT.
 
Interesting, looks like I'm leaving some points on the Folding table:
(i7-4970K & Z97 MB) (i7-5960X & X99 MB)
 
"F@H you should disable it. its just like gaming in that the extra overhead to make the extra virtual cores will actually hurt PPD"
 
You disabled HT in the BIOS ? 
 
I'm not using the CPU to Fold or Crunch; just enjoying the 4 GPUs churning out the PPD

Learn your way around the EVGA Forums, Rules & limits on new accounts Ultimate Self-Starter Thread For New Members

I am a Volunteer Moderator - not an EVGA employee

https://foldingathome.org -->become a citizen scientist and contribute your compute power to help fight global health threats

RTX Project EVGA X99 FTWK Nibbler EVGA X99 Classified EVGA 3080Ti FTW3 Ultra


ipkha
CLASSIFIED Member
  • Total Posts : 2308
  • Reward points : 0
  • Joined: 2015/02/10 21:01:40
  • Location: Indiana
  • Status: offline
  • Ribbons : 6
Re: New 5 GPU's 1 PC Build 2016/09/19 12:47:43 (permalink)
The hyperthreading has some shared resources in each core which can cause contention in heavy workloads. It's probably better to have faster cores for folding as some units max out my 3.4ghz system while others don't.


Chris21010
FTW Member
  • Total Posts : 1587
  • Reward points : 0
  • Joined: 2006/05/03 07:26:39
  • Status: offline
  • Ribbons : 9
Re: New 5 GPU's 1 PC Build 2016/09/19 12:49:04 (permalink)
Cool GTX
Chris21010F@H you should disable it. its just like gaming in that the extra overhead to make the extra virtual cores will actually hurt PPD

 
You disabled HT in the BIOS ? 
 
I'm not using the CPU to Fold or Crunch; just enjoying the 4 GPUs churning out the PPD



correct it is under your motherboard bios. now by hurt PPD i mean only a couple percent, not a whole lot. (here is my source) F@H is an instance that needs faster single cores and not many slower cores, which is what hyper threading kinda does.


bcavnaugh
The Crunchinator
  • Total Posts : 38977
  • Reward points : 0
  • Joined: 2012/09/18 17:31:18
  • Location: USA Affiliate E5L3CTGE12 Associate 9E88QK5L7811G3H
  • Status: offline
  • Ribbons : 282
Re: New 5 GPU's 1 PC Build 2016/09/19 13:22:57 (permalink)
Removed
post edited by bcavnaugh - 2017/06/12 21:05:17

Associate Code: 9E88QK5L7811G3H


 
bcavnaugh
The Crunchinator
  • Total Posts : 38977
  • Reward points : 0
  • Joined: 2012/09/18 17:31:18
  • Location: USA Affiliate E5L3CTGE12 Associate 9E88QK5L7811G3H
  • Status: offline
  • Ribbons : 282
Re: New 5 GPU's 1 PC Build 2016/09/19 13:29:43 (permalink)
Removed
post edited by bcavnaugh - 2017/06/12 21:05:30

Associate Code: 9E88QK5L7811G3H


 
Chris21010
FTW Member
  • Total Posts : 1587
  • Reward points : 0
  • Joined: 2006/05/03 07:26:39
  • Status: offline
  • Ribbons : 9
Re: New 5 GPU's 1 PC Build 2016/09/19 14:10:39 (permalink)
interesting but old and outdated information pertaining to dual core CPU's if you have a newer generation 6+ core i7 hyper threading doesn't do anything for you. as FahCore21.exe is not a process that benefits from improved parallelization, its a very single threaded process. quad core CPU's are on the borderline if it helps or not so i would leave it on, just so windows and other processes have some breathing room if you are folding with more than 1 GPU. i guess i should have clarified that tiny tidbit of information. you do not always turn HT off for every use case, just if you have more than 4 physical cores on your CPU or if your machine is doing nothing but GPU folding.
post edited by Chris21010 - 2016/09/19 14:15:02


Chris21010
FTW Member
  • Total Posts : 1587
  • Reward points : 0
  • Joined: 2006/05/03 07:26:39
  • Status: offline
  • Ribbons : 9
Re: New 5 GPU's 1 PC Build 2016/09/20 15:16:50 (permalink)
Welp i got the flex tubing installed and added a little green dye so i can see if it leacks and now i wait for 2 hours and then connect everything and then try and boot... i hope i didnt kill anything durring this rebuild.



Ali Man
Superclocked Member
  • Total Posts : 244
  • Reward points : 0
  • Joined: 2012/08/01 12:13:06
  • Status: offline
  • Ribbons : 0
Re: New 5 GPU's 1 PC Build 2016/09/20 18:05:36 (permalink)
How much rad space is that to cool those 5 cards?
Chris21010
FTW Member
  • Total Posts : 1587
  • Reward points : 0
  • Joined: 2006/05/03 07:26:39
  • Status: offline
  • Ribbons : 9
Re: New 5 GPU's 1 PC Build 2016/09/20 20:00:05 (permalink)
parts list say two EK 420mm rads, equivalent of 8x 120mm rads. 
 
Also i am running and everything is working BUT EVGA Precision will not work past 4 GPU's, bummer  will have to get EVGA to patch me in or i'll have to try other software. temps are OK, ambient air temp is ~26, liquid is 38C after 5-7 min of folding, GPU's range from 44-53C big range here, and CPU is 50C. just wish i could OC these things and really push them to their limits...
 
note: temps drop 4C after removing the right panel with air filter completely. this allows much more air into the intake 420mm radiator.
 

 
EDIT: oh and i am not pulling but ~900W from the wall, CRAZY
 

post edited by Chris21010 - 2016/09/20 20:26:14


Madmaxneo
New Member
  • Total Posts : 43
  • Reward points : 0
  • Joined: 2014/01/07 20:06:11
  • Status: offline
  • Ribbons : 0
Re: New 5 GPU's 1 PC Build 2016/09/20 20:35:57 (permalink)
Awesome build! One question though. How are those Corsair ML 140 fans working out for you? I know they are supposed to be very silent but how is the cooling and air flow?
 
I was thinking of getting a couple to replace some fans in my current rig. 
Ali Man
Superclocked Member
  • Total Posts : 244
  • Reward points : 0
  • Joined: 2012/08/01 12:13:06
  • Status: offline
  • Ribbons : 0
Re: New 5 GPU's 1 PC Build 2016/09/20 20:46:22 (permalink)
44-53C is a super big range, I'd say something is not right since they all are in parallel?
Chris21010
FTW Member
  • Total Posts : 1587
  • Reward points : 0
  • Joined: 2006/05/03 07:26:39
  • Status: offline
  • Ribbons : 9
Re: New 5 GPU's 1 PC Build 2016/09/20 21:15:23 (permalink)
Ali Man
44-53C is a super big range, I'd say something is not right since they all are in parallel?



no they are not, EK made this block a simi parallel block. basically it starts with lower 2 in parallel and then it goes through the upper 3 in parallel, so its both series and parallel. plus if you look i have spaces and back plates for 3 of the cards and then 2 of them are right up against another card. so at this point i think i am fine as the hottest card is the middle most card and the coldest is the lowest.
 
as for the fans, they perform great. sounds are ok, but i tend to always run my fans on the louder side so i can not really speak to how "quiet" they are just that they are not as loud as my last case fans.
 
OH, and i forgot! it GLOWS!
 

 
just wish i bought the right sleeved cables and once i get pastel fluid it will really pop.
post edited by Chris21010 - 2016/09/20 21:20:28


erickliban
New Member
  • Total Posts : 96
  • Reward points : 0
  • Joined: 2014/03/09 22:22:55
  • Status: offline
  • Ribbons : 0
Re: New 5 GPU's 1 PC Build 2016/09/20 21:27:24 (permalink)
Crazy awesome build.
 
Is that a nixie clock on your desk?

 

 
mektacular
iCX Member
  • Total Posts : 331
  • Reward points : 0
  • Joined: 2011/03/09 14:58:14
  • Status: offline
  • Ribbons : 0
Re: New 5 GPU's 1 PC Build 2016/09/20 21:39:49 (permalink)



Chris21010
FTW Member
  • Total Posts : 1587
  • Reward points : 0
  • Joined: 2006/05/03 07:26:39
  • Status: offline
  • Ribbons : 9
Re: New 5 GPU's 1 PC Build 2016/09/20 21:51:08 (permalink)
erickliban
Is that a nixie clock on your desk?



it is a high school electronics project that i built and installed in a 3d printed case, still use that thing 9 years later. but alas its just a standard 7 seg led clock, no tubes for me.
post edited by Chris21010 - 2016/09/20 21:57:57


Chris21010
FTW Member
  • Total Posts : 1587
  • Reward points : 0
  • Joined: 2006/05/03 07:26:39
  • Status: offline
  • Ribbons : 9
Re: New 5 GPU's 1 PC Build 2016/09/21 05:47:17 (permalink)

 
i do not know what happened last night but i literally had 8 finished projects which would not send. i rebooted and windows installed updates and then it worked so i'll blame windows for now.


Cool GTX
EVGA Forum Moderator
  • Total Posts : 31014
  • Reward points : 0
  • Joined: 2010/12/12 14:22:25
  • Location: Folding for the Greater Good
  • Status: offline
  • Ribbons : 122
Re: New 5 GPU's 1 PC Build 2016/09/21 11:43:30 (permalink)
Yep, good old MS, we know how to hose your PPD
 
 
Same thing last night on my old Titan X SC; PC rebooted in the night ---> stopped Folding

Learn your way around the EVGA Forums, Rules & limits on new accounts Ultimate Self-Starter Thread For New Members

I am a Volunteer Moderator - not an EVGA employee

https://foldingathome.org -->become a citizen scientist and contribute your compute power to help fight global health threats

RTX Project EVGA X99 FTWK Nibbler EVGA X99 Classified EVGA 3080Ti FTW3 Ultra


bcavnaugh
The Crunchinator
  • Total Posts : 38977
  • Reward points : 0
  • Joined: 2012/09/18 17:31:18
  • Location: USA Affiliate E5L3CTGE12 Associate 9E88QK5L7811G3H
  • Status: offline
  • Ribbons : 282
Re: New 5 GPU's 1 PC Build 2016/09/21 12:21:34 (permalink)
Removed
post edited by bcavnaugh - 2017/06/12 21:05:49

Associate Code: 9E88QK5L7811G3H


 
bcavnaugh
The Crunchinator
  • Total Posts : 38977
  • Reward points : 0
  • Joined: 2012/09/18 17:31:18
  • Location: USA Affiliate E5L3CTGE12 Associate 9E88QK5L7811G3H
  • Status: offline
  • Ribbons : 282
Re: New 5 GPU's 1 PC Build 2016/09/21 13:54:11 (permalink)
Removed
post edited by bcavnaugh - 2017/06/12 21:06:02

Associate Code: 9E88QK5L7811G3H


 
ipkha
CLASSIFIED Member
  • Total Posts : 2308
  • Reward points : 0
  • Joined: 2015/02/10 21:01:40
  • Location: Indiana
  • Status: offline
  • Ribbons : 6
Re: New 5 GPU's 1 PC Build 2016/09/21 15:59:33 (permalink)
That info is old now. You can only delay nonsecurity updates with the anniversary builds. Feature updates can be delayed almost indefinitely. Security updates are able to be delayed but not forever. Easiest option is a calendar entry for 2nd Tuesday of every month, 12noon pacific time, to download updates and then manually restart and login.


Chris21010
FTW Member
  • Total Posts : 1587
  • Reward points : 0
  • Joined: 2006/05/03 07:26:39
  • Status: offline
  • Ribbons : 9
Re: New 5 GPU's 1 PC Build 2016/09/26 19:11:18 (permalink)
OK, got home today and was able to start the OC process and so far this is my first dry run test clocks.
 

 
i know i can push all but GPU5 farther than what it is currently. GPU5 will throw bad sector errors left and right any higher than it is now but the others are just at +100 on core clock.
 
EDIT: oh, temp1 is the CPU and the liquid temp is 36C
post edited by Chris21010 - 2016/09/26 19:35:29


Page: < 12345.. > >> Showing page 4 of 10
Jump to:
  • Back to Mobile