EVGA

What Does 30 Million PPD look like?

Author
Chris21010
FTW Member
  • Total Posts : 1587
  • Reward points : 0
  • Joined: 2006/05/03 07:26:39
  • Status: offline
  • Ribbons : 9
2017/10/07 22:10:19 (permalink)
well here is one example:

 
i finally finished this two month old project and i gotta say
 


 
it feels great knowing that what was once simply a passionate hobby can now become something much more.
 
now a little into the details, each machine follows my guide i posted a while back though with some slight differences in software. this time i am using a different flavor of linux coupled with custom code to automate and monitor the process, which is still under development. but internally each machine is virtually identical and look like this:
 

 
each tower is plugged into 208V source as the subpanel is 120V 3 phase and all together they are pulling ~7.2 KW. the higher voltage nearly halves the amperage going to each power supply allowing for better efficiencies. the towers are against an air wall, where fresh cooler air is blown in and exhausts out the back of all the towers for uniform airflow to prevent recirculation of hot air. they are not under A/C and rely strictly on lots of airflow, enough fan noise to be over 80dB. and with an empty rack beside the populated one i can easily double production with very little effort.
 
that random VGA monitor is one i had lying around for years and finally came in handy as i needed a VGA monitor to connect to my 32 port KVM Switch i got off ebay for $40. this thing is awesome and allows me to individually control any machine via a single mouse/keyboard/monitor. the racks themselves are cheap things from lowes and make great shelves for holding the towers as well as a lot of ways to manage all the power/network/KVM cables.


#1

16 Replies Related Threads

    Ranmacanada
    SSC Member
    • Total Posts : 992
    • Reward points : 0
    • Joined: 2011/09/22 10:44:47
    • Status: offline
    • Ribbons : 3
    Re: What Does 30 Million PPD look like? 2017/10/07 22:29:54 (permalink)
    So are you the reason ppd jumped by 100 million yesterday? :P

     

    ASUS TUF GAMING X570-PLUS (WI-FI)
    AMD Ryzen 2700
    Fold for the CURE!
    EVGA 1080 FTW
    EVGA 1080Ti Hybrid

    #2
    mrhankey946
    iCX Member
    • Total Posts : 269
    • Reward points : 0
    • Joined: 2008/08/18 12:41:56
    • Location: Pennsylvania
    • Status: offline
    • Ribbons : 0
    Re: What Does 30 Million PPD look like? 2017/10/08 07:49:56 (permalink)
    Wow man that's awesome, I hope it all works out well with no issues!


    Affiliate Code: CTAHVSY60U
    Heatware
    Ebay
    #3
    bcavnaugh
    The Crunchinator
    • Total Posts : 38977
    • Reward points : 0
    • Joined: 2012/09/18 17:31:18
    • Location: USA Affiliate E5L3CTGE12 Associate 9E88QK5L7811G3H
    • Status: offline
    • Ribbons : 282
    Re: What Does 30 Million PPD look like? 2017/10/08 08:13:42 (permalink)
    "well here is one example:" Still Ming IMO  Should have gone under Cryptocurrency

    Nice Second Rig, now that is a Folding Rig

     
    post edited by bcavnaugh - 2017/10/08 08:17:23

    Associate Code: 9E88QK5L7811G3H


     
    #4
    Chris21010
    FTW Member
    • Total Posts : 1587
    • Reward points : 0
    • Joined: 2006/05/03 07:26:39
    • Status: offline
    • Ribbons : 9
    Re: What Does 30 Million PPD look like? 2017/10/08 09:10:34 (permalink)
    mrhankey946
    Wow man that's awesome, I hope it all works out well with no issues!



    the only real issue i am constantly running into are the F@H clients stalling on an upload/download and needing to be restart every now and again. really wish we would get a new and improved client...
     
    bcavnaugh
    "well here is one example:" Still Ming IMO  Should have gone under Cryptocurrency


    well that pic with them all on the boxes was for a hardware test to making sure there wasn't any parts to RMA before i put it all into the towers. but even so i had to RMA two parts after the fact anyway.


    #5
    bcavnaugh
    The Crunchinator
    • Total Posts : 38977
    • Reward points : 0
    • Joined: 2012/09/18 17:31:18
    • Location: USA Affiliate E5L3CTGE12 Associate 9E88QK5L7811G3H
    • Status: offline
    • Ribbons : 282
    Re: What Does 30 Million PPD look like? 2017/10/08 09:53:57 (permalink)
    "i had to RMA two parts after the fact anyway" That is a bummer, was it the GPUs?
    I knew others used Bread Racks at Home
    post edited by bcavnaugh - 2017/10/08 09:56:13

    Associate Code: 9E88QK5L7811G3H


     
    #6
    yodap
    CLASSIFIED Member
    • Total Posts : 4642
    • Reward points : 0
    • Joined: 2011/05/15 06:13:40
    • Location: NY, Upstate
    • Status: offline
    • Ribbons : 8
    Re: What Does 30 Million PPD look like? 2017/10/08 10:45:52 (permalink)
    Be sure to show us what a 30 million PPD electric bill looks like if you can, if you're drawing from the grid.


     

     
    #7
    Chris21010
    FTW Member
    • Total Posts : 1587
    • Reward points : 0
    • Joined: 2006/05/03 07:26:39
    • Status: offline
    • Ribbons : 9
    Re: What Does 30 Million PPD look like? 2017/10/08 12:44:52 (permalink)
    power costs is estimated ~ $208 and yea two GPU's would boot but not fold.


    #8
    tank1023
    CLASSIFIED ULTRA Member
    • Total Posts : 5366
    • Reward points : 0
    • Joined: 2009/02/19 06:44:05
    • Location: Colorado
    • Status: offline
    • Ribbons : 16
    Re: What Does 30 Million PPD look like? 2017/10/08 14:18:21 (permalink)
    Nice!

    Folding whatever I can :o)     
    http://www.heatware.com/eval.php?id=67403
        
      

    #9
    notfordman
    Omnipotent Enthusiast
    • Total Posts : 10345
    • Reward points : 0
    • Joined: 2007/08/09 23:52:23
    • Location: In a van, down by the
    • Status: offline
    • Ribbons : 28
    Re: What Does 30 Million PPD look like? 2017/10/09 08:44:12 (permalink)
    That is one serious project Chris!!!!! I want one! lol  
    Is the $208 on top of the normal bill?? 
    #10
    Chris21010
    FTW Member
    • Total Posts : 1587
    • Reward points : 0
    • Joined: 2006/05/03 07:26:39
    • Status: offline
    • Ribbons : 9
    Re: What Does 30 Million PPD look like? 2017/10/09 09:12:35 (permalink)
    yea, those towers alone cost ~$208 to run a month.


    #11
    Cool GTX
    EVGA Forum Moderator
    • Total Posts : 31005
    • Reward points : 0
    • Joined: 2010/12/12 14:22:25
    • Location: Folding for the Greater Good
    • Status: online
    • Ribbons : 122
    Re: What Does 30 Million PPD look like? 2017/10/09 09:36:55 (permalink)
    Chris21010
      the towers are against an air wall, where fresh cooler air is blown in and exhausts out the back of all the towers for uniform airflow to prevent recirculation of hot air. they are not under A/C and rely strictly on lots of airflow, enough fan noise to be over 80dB.




    Interesting concept "air wall" maybe you could share more details on the airflow ?
     
    What case are you using / airflow with 2 ACX type cards & cases so very close to each other ?
     
    Cases on top of shelf run much warmer than those on bottom of rack ?
     
    Congrats on the KVM, sound like an exceptional deal
     
    So, 30 1080 Ti GPU & configured for conserving power getting 30 Million PPD ?

    Learn your way around the EVGA Forums, Rules & limits on new accounts Ultimate Self-Starter Thread For New Members

    I am a Volunteer Moderator - not an EVGA employee

    https://foldingathome.org -->become a citizen scientist and contribute your compute power to help fight global health threats

    RTX Project EVGA X99 FTWK Nibbler EVGA X99 Classified EVGA 3080Ti FTW3 Ultra


    #12
    Chris21010
    FTW Member
    • Total Posts : 1587
    • Reward points : 0
    • Joined: 2006/05/03 07:26:39
    • Status: offline
    • Ribbons : 9
    Re: What Does 30 Million PPD look like? 2017/10/09 12:32:30 (permalink)
    Its actually 28x 1080ti as one of those boxes is a dedicated control box. The case itself is the same on my linux guide where it has 360mm front intake, so all air goes in the front out the back, easy to see on the inside case pic above. I also use high cfm delta fans and because of this no case really runs any hotter than the others.

    That air wall is basically a box with a screen on the face of it with a large blower pressurizing the whole thing. The air is then pulled into the cases from the intake fans and out the back. Normally you do not put things like this against a wall but I had no choice and i needed to find a good way to control the airflow.
    post edited by Chris21010 - 2017/10/09 12:35:00


    #13
    kougar
    CLASSIFIED Member
    • Total Posts : 3034
    • Reward points : 0
    • Joined: 2006/05/08 10:11:19
    • Status: offline
    • Ribbons : 22
    Re: What Does 30 Million PPD look like? 2017/10/09 16:12:36 (permalink)
    Lucky! Looks like a lot of fun to do, and the PPD is just the bonus 
     
    I'm curious though, why not go with that ASUS B250 mining board that has 19 graphics slots on it? My understanding is x1 slots wouldn't bottleneck F@H. Or are you using them for other things besides folding?


    Have water, will cool. 
    #14
    QuintLeo
    SSC Member
    • Total Posts : 946
    • Reward points : 0
    • Joined: 2016/04/16 23:05:09
    • Status: offline
    • Ribbons : 3
    Re: What Does 30 Million PPD look like? 2017/10/09 16:41:50 (permalink)
    1x slots DO bottleneck F@H at least somewhat - and I don't want to THINK about what the CPU bottleneck would be like trying to run more than about 8 x 1080ti cards on it.
     
    You HAVE to go with a "riser" rig type build to make that particular motherboard worthwhile.
     
    I just ordered one to experiment with as the base of a mining rig - though the initial planned build-out it's kinda overkill for, I like the built-in multi power supply management and I do have a longer-term plan to more fully use the 1x slots.
     
     

    Now that vorsholk has stopped his abuse, I'm returning to folding.
     I no longer MOO due to abuses by certain "whales" in the Gridcoin community - so I now work the Distributed.net project directly again.
     
    #15
    Ranmacanada
    SSC Member
    • Total Posts : 992
    • Reward points : 0
    • Joined: 2011/09/22 10:44:47
    • Status: offline
    • Ribbons : 3
    Re: What Does 30 Million PPD look like? 2017/10/10 09:36:42 (permalink)
    Instead of having a dedicated control client couldn't you have just added the clients to one of the boxes? There is the option to have clients added to the sidebar on FAH and you can control them 100% from there, mind you not the whole computer, but you get 100% control of the FAH client on your host machine.  I have even been able to do it with machines across the city as it also allows the use of hostnames for dynamic ips.  As an aside, I've noticed that HFM keeps monitoring the machine with the dynamic IP and I no longer have to continually update the IP whenever it changes now that I have added it to the clients in my FAH sidebar.

     

    ASUS TUF GAMING X570-PLUS (WI-FI)
    AMD Ryzen 2700
    Fold for the CURE!
    EVGA 1080 FTW
    EVGA 1080Ti Hybrid

    #16
    Chris21010
    FTW Member
    • Total Posts : 1587
    • Reward points : 0
    • Joined: 2006/05/03 07:26:39
    • Status: offline
    • Ribbons : 9
    Re: What Does 30 Million PPD look like? 2017/10/10 11:14:21 (permalink)
    oh that control box is much more than simply a F@H client. its my access to the farm from the outside world and it'll be access to a webapp for monitoring/control. i am working on writing a lot of fancy code to make running it simple and convenient.


    #17
    Jump to:
  • Back to Mobile