EVGA

A workstation (work in progress)

Page: 12 > Showing page 1 of 2
Author
schmorblatz
Superclocked Member
  • Total Posts : 147
  • Reward points : 0
  • Joined: 2014/05/01 07:29:50
  • Status: offline
  • Ribbons : 5
2014/06/28 18:34:57 (permalink)
Hello !
 
(English is not my mother tongue, so be indulgent !)
 
This is my first loop, for a worstation with gaming capacities. Finding a case was not easy, as I need at least 7 removable HDDs. I run 6 to 8 HDD for a while and always fried disks every and each summer due to overheating... I needed a large case, with good cooling. I choosed the Lian Li PC-D600 : 10 5.25", 9 free (one is for the shield).
 
This rig is intended for CADing, video editing, programming. And some gaming ! The last game I played was Half Life, 15 years ago, and I discovered what modern gaming is, a couple of month ago : Crysis 1 and Crysis 3. I first got a used Samsung SyncMaster 2233RZ (120Hz) with NVidia 3D Vision. I was amazed, and found 2 other monitors to replace my 2232BWs. Surround, 3D ! I was running two 770 in SLI and needed some more power. After some hesitation, I got 3 x EVGA 780ti rather than 2 x Titans (more CUDAs, even if actualy Adobe can only use 2 graphics cards).
 
Case : Lian Li PC-D600WB
2 x 4HDD expansion kits : Lian Li 4xHDD EX-H34B
RAID 0 and RAID 10 : 4 x Western Digital Green WD20EZRX (4 x 2TB)
RAID 0 : 2 x Samsung HD253GJ (2 x 250GB)
Device bay converter for slim DVD burner + SSD : Lian Li EX-553X
SSD : Intel SSDSC2BW12 (120GB)
RAID 10 : 4 x WD20EZRX
RAID 0 : DVD/ BR burner(slim)  LG GH22NS50
5.25 to 3.5 adapter : Lian Li MF-515B
Card reader with blutooth adapter
PSU : Platimax Enermax EPM1350EWT
Motherboard : Asus P9X79-E WS
Processor : Intel i7 4930K 6C 12T 3,4 GHz
RAM : Kingston HyperX BEAST PC1920 ("1600") CAS11
Graphics cards : 3-way SLI EVGA GeForce GTX 780 Ti - 3 GB (03G-P4-2881-KR, refernce design)
+ Nvidia Quadro FX 3700
 
I first used it with the provided fans and coolers...  Noisy, and GPUs reached very high temperatures : 82°C for the GTX, 90+ for the Quadro ! Watercooling was absolutely necessary.
 
Initially, I wanted to machine my own waterblocks. But I renounced. First, machining the O-ring grooves need a CNC milling machine or very good skills on a conventionnal machine. Retrofitting one axis on a Bridgeport class machine would cost more than one of these little chinese CNC milling machines. Second, industrial made waterblocks are relatively inexpensive.
 
It's not worth it. But some do it : http://forums.evga.com/100-Copper-GTX-580-Classified-Waterblock-COMPLETED-m1496855.aspx ; amazing !
 
I got :
 
CPU waterblock : EK WB Supremacy acetal / copper Clean CSQ
GPU waterblocks : 3 x EKWB acetal copper Clean CSQ
SLI bridge : EKWB Terminal Triple Parallel
GPU waterblock Danger Den IONE (for the Quadro FX3700)
1 x Alphacool NexXxos ST30 240
1 x Alphacool NexXxos ST30 420
1 x Alphacool NexXxos UT60 420
Reservoir : XSPC D5 Photon 270 combo
Pump : XSPC D5 PWM
Fittings : Alphacool
Fans : all BeQuiet Shadow Wings PWM, except for the PSU (non PWM)
 
These rads are designed for low static pressure fans. I assume it is true, and they will be efficient...
 

Lian Li provide nice accessories :

(I dont post pics to describe the case itself, as very good reviews and videos can easily be found on the web)
This case is not that huge ! There's no much room inside. But it fits easily on a desktop. Putting such a computer under the desk is a no-no : it would be absolutely unbearable in summer.
 
Here's a pic with 240x30mm and 420x30mm rad in the motherboard compartment (test mount) :

The other side ; with a 420x60mm. The HDDs fans have been removed, and there is no more room for a push pull.

With the HDDs fans removed, they reach ~45°C. HDD rack with its noisy fan :

The only solution will be to put the res/pump outside.
My first goal is to get a quiet computer. Be Quiet Shadow Wings are perfect. Some people say they cannot be mounted on a radiator. This is untrue ! On the contrary, they fit (nearly) perfectly. They are designed to be mounted using push pins. These push pins can be replaced with M3 screws or studs. As they fit tight, some silicon grease may help. The only problem is for the 120mm fans : in fact, they are 124 mm due to the gaskets. As is, they wont fit on a rad :

Easy to fix : I just had to slightly cut off the gasket :

The 140 mm fit perfectly :

For the 420x60mm push pull, I made studs from M3 threaded round : they are also used to bolt the rads to the case, and to bolt the res/pump.

I wanted to use these fans everywhere, and particularly for the PSU. The fan was emitting ennoying ticks. But the provided fan is an exotic 135x25mm. Need to make an adapter plate.

Under the fan can be seen a deflector. This deflector is here to avoid an airflow shortcut. I had to adapt it on the new fan, a Shadow Wings Hi Speed (2200 RPM) that gives nearly the same CFM, but not the noise.

After some basic milling... (such a tool can be used on a good drill press)

...I got a nice adapter plate :

And the PSU is now perfectly silent :

Plumbing has been the most dificult part of the work, as I wanted it to be hidden as far as possible. CAD helped a lot.
The case is divided in 2 compartments, one for the motherboard, the other for the drives. The top cant be taken apart.
Images with the "bulkhead" :


Views without the separation :



The old Quadro FX3700 (wich will be replaced later) is cooled by a Danger Den IONE designed for the GT9800. It fits perfectly. I found it on eBay...

It is a very low loss of charge waterblock. The only solution was to put it in series with the 3 x GTX, the GTX being connected parallel. It works fine.
 
Views of the rig. Work is still in progress : cable management is uggly !

The bulkhead fittings are from Alphacool. They are the only ones I found that can fit : there is very little room, and holes have to be precisely drilled.

The pump/res is mounted on the rear pannel, using the radiator studs and anti vibration silent blocks. I opened the res/pump plate to reduce airflow restriction .

I first used 90° fittings on the pump. Bleeding has been very difficult. Just replacing them with 45° fittings made a huge difference !

Details of the res/pump mountings : absolutely no vibration is transmitted to the case. The pump runs nearly perfectly silent from 800 to 4800 RPM. Most of the noise now comes from the HDDs, not from the pump.
The rubber mountings are standard M4 / 10mm, and can be purchased from any industrial supply... or from XSPC (cheap). The mountings themselves have been machined from aluminium.


Work is in progress (cable management). I re-sleeve cables, not because it is cool, but because it makes cable management much more easy than Rilsan cable ties.
Below, the 6-way splitter for the push pull, made from two 3-way splitters. The tutorial on EVGA forums helped a lot !


All the fans, except the PSU one, are PWM because they make it easy to manage from within Windows, and they will be VERY easy to control with the fan controller I plan to make ; actually, I use Asus Fan Xpert+ to adjust RPM, for silence or performance.
 
CPU_FAN : pump
CHA_FAN1 : left rear and top fans for the 240x30mm
CHA_FAN2 : left front 420x30mm
CHA_FAN3 : right rear push pull 420x60mm
CHA_FAN4 : HDD cases ; without these fans, the HDDs reach 40~45°C ; with the 120mm fans at lower speed, they run 10°C lower. But they wont help the push pull in any way : even at max RPM, GPUs and CPU wont gain even 1°C.
 
Some tests...
 
Idle, with fans and pump at minimum speed. Ambiant = 27°C :
GPU1 31°C
GPU2 32°C
GPU3 28°C


Unigine Heaven, all fans and pump at 100% RPM, all 3 x GPU power at 85% :
GPUs 49°C/52°C/47°C, CPU 44°C, MB 45°C


Unigine Heaven, all fans and pump at minimum RPM, all 3 x GPU power at 85% :
GPUs 63°C/65°C/60°C, CPU 56°C, MB 56°C


Call of Duty Ghosts, extreme settings, all fans and pump at 100% RPM, all 3 x GPU power at 55% :
GPUs at 37°C for the hottest GPU (#2) ; the others are slightly cooler (2~3°C)
 
Disconnecting the pull fans of the push pull increases the temps by 10°C !!!
 
I have to say that I got a lot of stuttering with Unigine Heaven, but not with Ghosts, Crysis 3, or Bioshock. I tested the setup for latency : no problem. PCIE 16x GEN 3 is enabled, and shown by GPUZ. Everything seems to work fine, except a proble with the Quadro : it is deactivated at boot time when NVidia surround is enabled. I have to manualy reactivate it. This is anoying, as my 4th monitor is connected to it (an old analogue LCD tha, cannot be connected to the GTX according to NVidia instructions, and according to some more testing)
 
More pics will be posted, when cable management will be completed (I have to get some more cables)
 
 
 
 
post edited by schmorblatz - 2014/06/28 19:02:13

why make it simple when it can be complicated ????
 
rig 1 : Asus P9X79-E WS / i7 4930k / 3-way SLI EVGA 780ti / Quadro K2000 / watercooled / 3D Vision Surround / 3 x Samsung 2233RZ + HP ZR22W
rig 2 : Asus P9X79 WS / i7 4930k / 2-way SLI 770 / aircooled / 3D Vision / Samsung 2233RZ + Samsung 2232BW + HP ZR22W
rig 3, 4 5, etc. : uninteresting !
#1

36 Replies Related Threads

    bcavnaugh
    The Crunchinator
    • Total Posts : 38977
    • Reward points : 0
    • Joined: 2012/09/18 17:31:18
    • Location: USA Affiliate E5L3CTGE12 Associate 9E88QK5L7811G3H
    • Status: offline
    • Ribbons : 282
    Re: A workstation (work in progress) 2014/06/28 19:16:13 (permalink)
    Sweet +1
    Please setup a

    Associate Code: 9E88QK5L7811G3H


     
    #2
    schmorblatz
    Superclocked Member
    • Total Posts : 147
    • Reward points : 0
    • Joined: 2014/05/01 07:29:50
    • Status: offline
    • Ribbons : 5
    Re: A workstation (work in progress) 2014/06/29 03:21:23 (permalink)
    could'nt find how to do that...
    no option in my user profile...

    why make it simple when it can be complicated ????
     
    rig 1 : Asus P9X79-E WS / i7 4930k / 3-way SLI EVGA 780ti / Quadro K2000 / watercooled / 3D Vision Surround / 3 x Samsung 2233RZ + HP ZR22W
    rig 2 : Asus P9X79 WS / i7 4930k / 2-way SLI 770 / aircooled / 3D Vision / Samsung 2233RZ + Samsung 2232BW + HP ZR22W
    rig 3, 4 5, etc. : uninteresting !
    #3
    rjohnson11
    EVGA Forum Moderator
    • Total Posts : 102260
    • Reward points : 0
    • Joined: 2004/10/05 12:44:35
    • Location: Netherlands
    • Status: online
    • Ribbons : 84
    Re: A workstation (work in progress) 2014/06/29 03:27:12 (permalink)

    AMD Ryzen 9 7950X,  Corsair Mp700 Pro M.2, 64GB Corsair Dominator Titanium DDR5  X670E Steel Legend, MSI RTX 4090 Associate Code: H5U80QBH6BH0AXF. I am NOT an employee of EVGA

    #4
    rjohnson11
    EVGA Forum Moderator
    • Total Posts : 102260
    • Reward points : 0
    • Joined: 2004/10/05 12:44:35
    • Location: Netherlands
    • Status: online
    • Ribbons : 84
    Re: A workstation (work in progress) 2014/06/29 03:27:41 (permalink)
    I'm interested in the final pics when you get the cable management done.
     

    AMD Ryzen 9 7950X,  Corsair Mp700 Pro M.2, 64GB Corsair Dominator Titanium DDR5  X670E Steel Legend, MSI RTX 4090 Associate Code: H5U80QBH6BH0AXF. I am NOT an employee of EVGA

    #5
    Ntrain96
    FTW Member
    • Total Posts : 1013
    • Reward points : 0
    • Joined: 2014/02/03 06:53:35
    • Status: offline
    • Ribbons : 4
    Re: A workstation (work in progress) 2014/06/29 04:17:30 (permalink)
    Impressive. 3 1080p monitors? 60 or 120hz?
    #6
    rjbarker
    CLASSIFIED Member
    • Total Posts : 3214
    • Reward points : 0
    • Joined: 2008/03/20 10:07:05
    • Location: Vancouver Isle - Westcoast Canada
    • Status: offline
    • Ribbons : 21
    Re: A workstation (work in progress) 2014/06/29 10:56:56 (permalink)
    Very nice..!!....I've got the smaller 170 Photon..the 270 is a monster...the pump is a standard D5 Laing Variant with speed control, likely the best pump out there!!
    You are absolutely correct...the Photon doesnt bode well with 90's in / out...I had mine set up that way and onstant micro bubbles due to cavitation if pump speed higher than 3000 RPM, switching to 2x45's is the ticket!!
    Keep posting pics....nice HW ;)

    I9 12900K EK Velocity2 / ROG Z690 Apex/ 32G Dominator DDR5 6000/ Evga RTX 3080Ti FTW3  EK Vector / 980 Pro 512G / 980 Pro 1TB/ Samsung 860 Pro 500G/ WD 4TB Red / AX 1600i /  Corsair 900D & XSPC 480 * 360 * 240 Rads   XSPC Photon 170 Rez-Vario Pump Combo - Alienware 3440*1440p 120Hz/ W11
     
    #7
    schmorblatz
    Superclocked Member
    • Total Posts : 147
    • Reward points : 0
    • Joined: 2014/05/01 07:29:50
    • Status: offline
    • Ribbons : 5
    Re: A workstation (work in progress) 2014/06/29 18:45:57 (permalink)
    Thanks !

    Monitors are old Samsung, the very first ones to be "NVidia GeForce 3D Vision Enabled" : 22", 1050x1680, 120Hz.

    Special thanks to rjbarker who helped a lot. What do you think about my temps ?

    Today, I did some benchmarking. I was able to run 3DMark, but with many problems : freezes, reboots, and even a "DXGI_ERROR_DEVICE_REMOVED". I killed background processes, disabled some peripherals. The tests completed only once : http://www.3dmark.com/3dm/3422825 3DMark11 won't even start ! I'm not familiar with benchmarks, since the last large tests I've done where in the late 90s with ZD WinMark, and I have no much time to investigate...
     
    I'll probably complete this build next week. It will be time to take better pics and create an entry in the Mod Rigs database. But this buid is far to be as aesthetic and performant than most of those than can be seen on this section !

    why make it simple when it can be complicated ????
     
    rig 1 : Asus P9X79-E WS / i7 4930k / 3-way SLI EVGA 780ti / Quadro K2000 / watercooled / 3D Vision Surround / 3 x Samsung 2233RZ + HP ZR22W
    rig 2 : Asus P9X79 WS / i7 4930k / 2-way SLI 770 / aircooled / 3D Vision / Samsung 2233RZ + Samsung 2232BW + HP ZR22W
    rig 3, 4 5, etc. : uninteresting !
    #8
    rjbarker
    CLASSIFIED Member
    • Total Posts : 3214
    • Reward points : 0
    • Joined: 2008/03/20 10:07:05
    • Location: Vancouver Isle - Westcoast Canada
    • Status: offline
    • Ribbons : 21
    Re: A workstation (work in progress) 2014/06/29 19:35:08 (permalink)
    I would say your temps look pretty good considering your running Tri SLi GPU's.....I would think you shouldnt have to run your pump at Max...see if you can leave it around 3200 RPM....
    Really like your CAD drawings...very meticulous...glad I could be of some help :)
     
    Fun aint it !!! Once you get wet, you'll never go back !!
    Oh congrats on the blue ribbon !!

    I9 12900K EK Velocity2 / ROG Z690 Apex/ 32G Dominator DDR5 6000/ Evga RTX 3080Ti FTW3  EK Vector / 980 Pro 512G / 980 Pro 1TB/ Samsung 860 Pro 500G/ WD 4TB Red / AX 1600i /  Corsair 900D & XSPC 480 * 360 * 240 Rads   XSPC Photon 170 Rez-Vario Pump Combo - Alienware 3440*1440p 120Hz/ W11
     
    #9
    schmorblatz
    Superclocked Member
    • Total Posts : 147
    • Reward points : 0
    • Joined: 2014/05/01 07:29:50
    • Status: offline
    • Ribbons : 5
    Re: A workstation (work in progress) 2014/06/30 03:38:40 (permalink)
    You are absolutely right ! In fact, I ran a total of 6 tests. I just reported tests #1 and #2.
    Test #4 has been run with pump at PWM 50% (->3100 RPM), and fans at 100%. Temps are exactly the same tahn those with pump at 100%. I think this cooling system is "fan limited", and the pump could probably run even slower with no change. I still have to find this limit. I would not be surprised to find 2500 or even 2000 RPM. I will edit this post whith new results.
     
    I still have to test a push pull on the front rad (420x30mm), with push fans running and not running. (front rad is the most audible). I have also to discover why 3DMark won't work. I suspect the Asus utilities and Windows Update.
     
    These tests will be done this afternoon (it's 12 o'clock here Western Europe).
     
    [EDIT]
    pump : 3000 RPM vs 4800 RPM = no diffrence ; 2500 vs 3000 : +1°C (Unigine Heaven, GPUs at 80-85%)
    push pull with the front left 420x30mm rad : -3°C ; if the push fans are not running, no increase, so no significant airflow perturbation. It will be possible to power them or not depending on what the rig is doing.
    Conclusion : I will go for push pull on front rad, and pump will not run at more than 3000 RPM. Tests were done with the stock Lian Li fans, the Shadow Wings are probably slightly less efficient (but much more silent !).
    CAD drawings were very usefull, as one can define a min curve radius for the tubings (here 40mm), so you see immediately if a routing can fit or not. More : in this case, there is no access other than right and left doors, and the openings for the front and top fans, and the 5.25 rack. So it is difficult and very time (and tubing) consuming to test different solutions. It's a compact case, but difficult to work on !
    [/EDIT]
     
    I put a temp probe on the loop just before the pump, and wanted to put another one at the output of the waterblocks. Unfornunately, I destroyed the wires of the second one. These probes are cheap (XSPC), and I will soon get another one. I am wondering if it is possible to regulate the loop with just 3 informations : temps at input and input of the waterblocks + room... It is more or less the way cooling is managed in automotive... I imagine a controller with 3 analogue inputs for the temps, and 5 PWM outputs to control the fans. If I find how to communicate with motherboard and GPUs (SMBIOS and/or WMI Win32 API), it would be much better, but code samples are hard to find as these interfaces are intended for device drivers developpers. Any help will be appreciated ! At this time, I had no time to do extensive research with Google.
    post edited by schmorblatz - 2014/06/30 09:34:16

    why make it simple when it can be complicated ????
     
    rig 1 : Asus P9X79-E WS / i7 4930k / 3-way SLI EVGA 780ti / Quadro K2000 / watercooled / 3D Vision Surround / 3 x Samsung 2233RZ + HP ZR22W
    rig 2 : Asus P9X79 WS / i7 4930k / 2-way SLI 770 / aircooled / 3D Vision / Samsung 2233RZ + Samsung 2232BW + HP ZR22W
    rig 3, 4 5, etc. : uninteresting !
    #10
    rjbarker
    CLASSIFIED Member
    • Total Posts : 3214
    • Reward points : 0
    • Joined: 2008/03/20 10:07:05
    • Location: Vancouver Isle - Westcoast Canada
    • Status: offline
    • Ribbons : 21
    Re: A workstation (work in progress) 2014/06/30 10:16:31 (permalink)
    Sounds like you have it "cased", what I have found:
    - Pump running between 2500 - 2900 RPM keeps temps in check and no Micro Bubbles in Rez (no cavitation)
    - Rads set up (when possible) in push / pull should allow lower Fan speeds with same cooling effect as single set of fans at higher fan speeds.....of course there is more noise with more fans, but perhaps less noise considering lower RPM....
     
    As for checking temps, I have no probes at all, I rely on 2 things to let me know how mt Coolant Temps are:
    - CPU Temp via Core Temp....always runs in the background with a Desktop Gadget, so anytime at a glance I know my CPU Temp.
    - GPU Temps via Onscreen Display thru MSI Afterburner while gaming, also allows me to monitor "real time" GPU Temps at a glance.
     
    Provided both my CPU and GPU Temps are good, I can only assume my Coolant Temps are fine ;)
    Cheers

    I9 12900K EK Velocity2 / ROG Z690 Apex/ 32G Dominator DDR5 6000/ Evga RTX 3080Ti FTW3  EK Vector / 980 Pro 512G / 980 Pro 1TB/ Samsung 860 Pro 500G/ WD 4TB Red / AX 1600i /  Corsair 900D & XSPC 480 * 360 * 240 Rads   XSPC Photon 170 Rez-Vario Pump Combo - Alienware 3440*1440p 120Hz/ W11
     
    #11
    schmorblatz
    Superclocked Member
    • Total Posts : 147
    • Reward points : 0
    • Joined: 2014/05/01 07:29:50
    • Status: offline
    • Ribbons : 5
    Re: A workstation (work in progress) 2014/06/30 10:46:04 (permalink)
    With the Asus P9X79-E WS, the temps for the CPU are *ABSOLUTELY NOT* reliable. Even with SpeedFan. At this time, I have 24°C in the room, and... 24°C for the CPU ! I often have CPU cooler than room ! It seems to be a known issue. And electronics and programming are some of my hobbies. I plan also a manual control with a rotary coder to tell the microcontroller to power and push fans and pump one after the other.
     
    I have huge problems with benchmarking. Even with Unigine Heaven. Tesselation crashes the PC, and I get BIOS error messages at reboot saying "o/c failed". I never enabled any o/c !!! I will have a try after deinstalling Asus utilities. As far as I remember I always had problems with Asus utilities, and always uninstalled them...
     
    [EDIT] problems seem to be solved, Heaven and 3DMark ! No more freezes. No stutering, tesselisation works fine. All tests run smooooth. It seems to be PSU related. I negligted to mix / cross the PCIe rails to the GPUs, as recommanded on the manufacturer's website. I even let Asus do auto o/c, and no problem. Got 20028 at FireStrike. Hope the problem is really solved. Strange : I never had problems before...[/EDIT]
     
    3 pics :
     
    (problems with dust due to a paper shredder, and filters are not that efficient)

    case without the front panel, and with push fans on the left rad :

    I realize I never posted a pic with the closed case ! It's nicer than the uggly temporary cable non-management ! And I also realize it could be possible to combine the card reader and the DVD burner in one 5"1/4 unit...

     
    post edited by schmorblatz - 2014/06/30 17:47:59

    why make it simple when it can be complicated ????
     
    rig 1 : Asus P9X79-E WS / i7 4930k / 3-way SLI EVGA 780ti / Quadro K2000 / watercooled / 3D Vision Surround / 3 x Samsung 2233RZ + HP ZR22W
    rig 2 : Asus P9X79 WS / i7 4930k / 2-way SLI 770 / aircooled / 3D Vision / Samsung 2233RZ + Samsung 2232BW + HP ZR22W
    rig 3, 4 5, etc. : uninteresting !
    #12
    schmorblatz
    Superclocked Member
    • Total Posts : 147
    • Reward points : 0
    • Joined: 2014/05/01 07:29:50
    • Status: offline
    • Ribbons : 5
    Re: A workstation (work in progress) 2014/07/12 19:21:00 (permalink)
    I had a lot of work on cable management. The case hosts 10 SATA units and a total of 17 fans.
     
    It was nearly impossible to take pics with the integrated flash, so I got a pair of cheap photo lightings. They work great, and also provide a very good light for working on the rig :
     

     
    I could'nt manage the motherboard cables on the right side of the chassis : no room. So I used spiral sleeving to hold and hide them :
     

     
    I also got a turning table, it makes things easier when I have to move 30 kg.
     
    You can see a huge bunch of cables going front right.
     

     

     
    All these cables are held with adhesive ties and velcro ties (I hate Rilsan ties). I had to make a lot of custom cables.
     

     
    All these cables are :
     
    - from the motherboard : CPU_FAN, CHA_FAN1, CHA_FAN2, CHA_FAN3, CHA_FAN4
    - from the graphics card : water temp sensor on the output of GPU 4, and PWM OUT (fan) of GPU 2
    - to the rads : rear chassis fan, front push (3 fans), front pull (3 fans), top pull (2 fans), rear push (3 fans), rear pull (3 fans), HDD fans (2 fans), water temp sensor on the output of the rads, just before the pump
    - pump
    - ambient temp sensor
     
    I want to experiment easily with watercooling regulation, and I have to connect a breadboard, a scope, and a signal generator. This is the reason why there are so much cables. There will be less when the circuitery and the program will be working (microcontroller).  But I think it will take several months.
     
    I plan to base regulation on CPU and GPU temps. PWM signals from fan outputs can give this information. For example, with EVGA Precision X, it is possible to adjust the fan curve to give 0% duty cycle at 0°C, 100% duty cycle at 100°C, and a linear response. This makes the fan output a thermometer : temp = duty cycle. I'll try with the hottest GPU (n°2 on my parallel loop). I had to slightly remachine the waterblock's cover. If it works, I will do the same with the others, in order to take into account the all 4 GPUs. I also want to know the thermal resistance of the loop depending on fans and pump conditions : this is the reason why I put 3 temp sensors ("hot" water, "cold" water, ambient). Knowing this temps and the power dissipated by the GPUs (Precision-X), it's possible to calculate. Naturally, all this is absolutely unnecessary. This is the reason why I absolutely want to do it.
     
    I will soon post more pics, and more explanations about the problems I had with cable management. This case seems to be huge, but it is definitely not.
     
    I found a name for this project : JAWS (Just A Work Station). Richard Kiel could help to cut cables and wires.
     

    why make it simple when it can be complicated ????
     
    rig 1 : Asus P9X79-E WS / i7 4930k / 3-way SLI EVGA 780ti / Quadro K2000 / watercooled / 3D Vision Surround / 3 x Samsung 2233RZ + HP ZR22W
    rig 2 : Asus P9X79 WS / i7 4930k / 2-way SLI 770 / aircooled / 3D Vision / Samsung 2233RZ + Samsung 2232BW + HP ZR22W
    rig 3, 4 5, etc. : uninteresting !
    #13
    schmorblatz
    Superclocked Member
    • Total Posts : 147
    • Reward points : 0
    • Joined: 2014/05/01 07:29:50
    • Status: offline
    • Ribbons : 5
    Re: A workstation (work in progress) 2014/07/13 19:15:02 (permalink)
    A little modification of the GPU 2 waterblock : the connector for the fan is occulted by the full cover. Some basic milling.

    POM (Delrin, Acetal, etc.) is tricky to machine : it melts !

    Now, the adapter (made by Gelid) can be connected :

    Doing this, I had to unmount the waterblock. I will soon open a thread about what I have discovered...
     
    I also made a deflector for the bottom pull fan of the front rad (aluminium)

    I also had to slightly modify the Lian Li slim DVD adapter. This adapter is intended for 2 x SSD or 2.5" HDD. The SSD do not install parallel to the DVD. I use only one SSD, and this makes the SATA cables routing difficult.

    I drilled 4 countersunk M3 holes in order to mount the SSD parallel to the DVD burner.

    The cables will be easier to manage.

    I also installed an internal USB active hub. 3 more internal ports + 2 type A internal ports. The P9X79-E WS offers only 1 double internal USB 2.0, and I needed 5 (3 x USB 2.0 + 1 x Bluetooth + 1 card reader). And I will be able to install my dongle in the rig (the motherboard's USB type A is occulted by the 4th GPU). This usefull accessory is made by NZXT.

    Because of the 4th GPU, the CLEAR CMOS is no more accessible. I installed an external switch (made by Silverstone)

    Initially, the front rad was only pull. I installed 3 more fans. The Shadow Wings are exactly 26mm thick, and the distance between the front bezel and the chassis is... 26 mm. So it is not possible to hold them with screws. On each fan, I removed 2 rubber blocks. I put 6 studs to hold them. I also installed filters (Silverstone) between the rad and the chassis.

    The rad is held with only 6 x M3 screws. No problem. I installed 6x M3 studs in the remaining holes. Then, the fans are just pushed on the studs.
    The front bezel is removable without tooling. The fans too ! So it will be very easy to access the filters and clean them with a vac.

    Most of people say that the Shadow Wings are not suitable for watercooling due to their reubber fittings. In my opinion they are absolutely perfect, at least mechanically (the rubber blocs have a inner diameter of 2.5mm, this makes them perfect for M3 studs.

    Just push to hold !

    In the left side of the rig, cable management is 100% completed.

    I installed this deflector to get rid of the dead zone between the bottom fan and the PSU. I hope it will help air to go easily to it... It is held with 2 x thumscrews, as it is impossible to use a srewdriver there.
     
    The red arrow shows the NTC  I placed at the output of the waterblocks.  (10k, made by AlphaCool, seems to be perfectly standard after measuring and testing from 20 to 100°C)

    I powered the PGUs according to Enermax recommandations. Previously, not doing this, Unigine crashed immediately if tesselation was activated !

    For a clean routing, I used a rigidifier ; a bit of flat aluminium I placed between the ribbons. Velcro ties are great !

    I did'nt install backplates as they are useless. And I think that it would'nt fit the first GPU : no room due to the optionnal PCIe connector (needed for 3-way and 4-way SLI), the RAM and the heatpipes.

    The cable management in the right side of the chassis is nearly achieved. I am just waiting for missing SATA cables. I want to use Akasa ProSlim, as they are much more manageable than standard cables. But I couldn't get all 10 cables : out of stock everywhere. I had to order in UK, and I am still waiting... I will explain later why these cables are *THE* cables for this case.
     
    I burn tested the rig (remember : no o/c : I need a 100% reliable PC, and I have many things to do with it, far more important than waiting 12+ hours for a RAID rebuild after a crash !!!).
     
    Unigine, 85% power 3way SLI. Ambient = 25°C.
    Pump : 3500 RPM
    All 140mm fans : 450 RPM (lowest speed)
    All 120mm fans 700 RPM (lowest speed)
     
    Absolutely no noise from the watercooling. But the PSU ran its fan at max speed (another Shadow Wings 120mm) : it was the only noise, perfectly acceptable : the shadow Wings are among the most silent fans on the market.
     
    Temps after 1 hour :
     
    GPU temps  51°C / 52°C / 49°C
    [EDIT] something was wrong with fan speeds ! I retested, and got 41/45/44 with fans at full speed. At min speeds, i'ts  15°C higher.
     
    I think this loop works fine.
     
    I said I do'nt o/c, but I had a try... Asus auto o/c, and a light GPU o/c with Precision X :
     
    22352 : http://www.3dmark.com/fs/2382221
    and also exactly 22000 : http://www.3dmark.com/fs/2382103
    post edited by schmorblatz - 2014/07/14 06:23:13

    why make it simple when it can be complicated ????
     
    rig 1 : Asus P9X79-E WS / i7 4930k / 3-way SLI EVGA 780ti / Quadro K2000 / watercooled / 3D Vision Surround / 3 x Samsung 2233RZ + HP ZR22W
    rig 2 : Asus P9X79 WS / i7 4930k / 2-way SLI 770 / aircooled / 3D Vision / Samsung 2233RZ + Samsung 2232BW + HP ZR22W
    rig 3, 4 5, etc. : uninteresting !
    #14
    schmorblatz
    Superclocked Member
    • Total Posts : 147
    • Reward points : 0
    • Joined: 2014/05/01 07:29:50
    • Status: offline
    • Ribbons : 5
    Re: A workstation (work in progress) 2014/07/20 08:04:30 (permalink)
    I received the SATA cables. These cables are far easier to use than standard cables : thiner, more flexible, and they can ben customized as they use IDC connectors. (insulation displacement connectors).
     
    Tutorials can be found on the web :
     
    http://www.casemodcontest...sa-proslim-cables-685/
    http://forums.overclockers.co.uk/showthread.php?t=18607792
     
    It seems to be easy. It is not ! Unlike IDC connectors used with older IDE cables, the blades are very small and fragile : they can very easily be destroyed. I was successfull for the first, the second, and then ruined the third one.
     
    The connectors are small, and can be sleeved without taking them apart.
     


    (I will post later some pics of the rig with cable management)
     
    Now, I am starting the second part of this project : automatic cooling management.
     
    For prototyping, I need lots of I/O, particularly with PWM for pump / fans control : Arduino MEGA 2560 :

    It will need an interface to communicate : commands, temps, RPM etc. This tactile display is perfect : ADA1651. 320x240px.

    There are different ways to manage cooling. Temperature is one of these ways. Another is certainly very interesting : the power at the mains. Intregrating this power over time, it is possible to know the energy to dissipate (Joules, Calories, BTU, Hiroshima equivalent, or even electron volt). Knowing the current drawn at the mains, we can get the apparent power. A good PSU (gold or platinium) has an efficiency of 80-90%, and an power factor nearly equal to 100%. Just have to know the current drawn by the PSU.
     
    A module like this one could work, but 5 amps only ; a 1350W PSU can draw 8 amps peek with a power factor equal to 100% (sqr(2)*1350/230). Will have to find a 10 amps model, or make it from scratch : it's just a coil.
     
    For more information, see here :
    http://www.seeedstudio.co...g_-_Electricity_Sensor
    http://openenergymonitor.org/emon/buildingblocks/ct-sensors-interface
     
     

    It is not that much expensive :
     
    Arduino MEGA 2560 = 39.30€
    tactile color LCD shield : 36.90€
     
    But it is a lot of work and it will take time...

    why make it simple when it can be complicated ????
     
    rig 1 : Asus P9X79-E WS / i7 4930k / 3-way SLI EVGA 780ti / Quadro K2000 / watercooled / 3D Vision Surround / 3 x Samsung 2233RZ + HP ZR22W
    rig 2 : Asus P9X79 WS / i7 4930k / 2-way SLI 770 / aircooled / 3D Vision / Samsung 2233RZ + Samsung 2232BW + HP ZR22W
    rig 3, 4 5, etc. : uninteresting !
    #15
    rjohnson11
    EVGA Forum Moderator
    • Total Posts : 102260
    • Reward points : 0
    • Joined: 2004/10/05 12:44:35
    • Location: Netherlands
    • Status: online
    • Ribbons : 84
    Re: A workstation (work in progress) 2014/07/20 08:10:20 (permalink)
    Excellent work

    AMD Ryzen 9 7950X,  Corsair Mp700 Pro M.2, 64GB Corsair Dominator Titanium DDR5  X670E Steel Legend, MSI RTX 4090 Associate Code: H5U80QBH6BH0AXF. I am NOT an employee of EVGA

    #16
    donta1979
    Primarch
    • Total Posts : 15886
    • Reward points : 0
    • Joined: 2007/02/11 19:27:15
    • Location: In the land of Florida Man!
    • Status: offline
    • Ribbons : 72
    Re: A workstation (work in progress) 2014/07/21 07:59:34 (permalink)
    I would highly suggest swapping out those 780 ti's for titans.... wishing I had gotten a Titan over this 780 TI.... Maya and it do not get along due to the missing computational task cores....

    Heatware   

    Retired from AAA Game Industry
    Jeep Wranglers, English Bulldog Rescue
    USAF, USANG, US ARMY Combat Veteran
    My Build
    Intel Core I9 13900K@6.1ghz, ASUS ROG Ryujin III 360 ARGB, 32gb G.Skill Trident Z5 RGB 7200mhz CL34 DDR5, ASUS Rog Strix Z790-E, ASUS Rog Strix OC 4090, ASUS ROG Wingwall Graphics Card Holder, Seagate limited Edition Cyberpunk 2077 m.2, 2x Samsung 980 m.2 1TB's, 980 & 990 Pro m.2 2TB's, ASUS ROG Hyperion GR701, ASUS ROG Thor 1200W Platinum II, Cablemod RT-Series Pro ModMesh Sleeved 12VHPWR Carbon, ASUS Rog Swift PG35VQ 35", Acer EI342CKR Pbmiippx 34", ROG Harpe Ace Aim Lab Edition mouse, Rog Claymore II keyboard, TCL home entertainment Sound Bar w/Wireless Sub, Steelseries Johnny Silverhand Headset Microsoft Cyberpunk 2077 Xbox controller
    #17
    schmorblatz
    Superclocked Member
    • Total Posts : 147
    • Reward points : 0
    • Joined: 2014/05/01 07:29:50
    • Status: offline
    • Ribbons : 5
    Re: A workstation (work in progress) 2014/07/21 09:33:49 (permalink)
    I don't use Maya, but Solidworks (the reason why I also have a FX3700). For Solidworks, Titans would'nt do anything more than 780 Tis : Quadro required. This card is used only for viewporting. No monitor plugged. Solidworks rendering is CPU only (Photoview 360), and Quadro is required for RealView (GL viewport).
     
    So, I will go for a 4-way SLI Quadro K6000 and a dual 12-core Xeon.
     
    (I'm kidding, unfortunately...)
     
    I just ordered the Arduino stuff.

    why make it simple when it can be complicated ????
     
    rig 1 : Asus P9X79-E WS / i7 4930k / 3-way SLI EVGA 780ti / Quadro K2000 / watercooled / 3D Vision Surround / 3 x Samsung 2233RZ + HP ZR22W
    rig 2 : Asus P9X79 WS / i7 4930k / 2-way SLI 770 / aircooled / 3D Vision / Samsung 2233RZ + Samsung 2232BW + HP ZR22W
    rig 3, 4 5, etc. : uninteresting !
    #18
    donta1979
    Primarch
    • Total Posts : 15886
    • Reward points : 0
    • Joined: 2007/02/11 19:27:15
    • Location: In the land of Florida Man!
    • Status: offline
    • Ribbons : 72
    Re: A workstation (work in progress) 2014/07/21 10:26:35 (permalink)
    ahhh doing production modeling then. Be glad you didn't go autocad then. I am drooling at the new 15 core xeons but not at 3k  a pop if the price point is holding true. Just bites for those of us that work in the gaming industry side of 3d, what NVidia is doing forcing a titan or quadro on us.... Might be going AMD for gpu's next round, really don't want to... But paying 1k-3k workstation card and a min of 3k-5k for its quadro counterpart. Not only for the workstations at work, but home use for doing demo reels, indy work, freelance work is a shady move by NVidia, especially when those of us in the industry want a card that does both gaming and 3d work.

    Heatware   

    Retired from AAA Game Industry
    Jeep Wranglers, English Bulldog Rescue
    USAF, USANG, US ARMY Combat Veteran
    My Build
    Intel Core I9 13900K@6.1ghz, ASUS ROG Ryujin III 360 ARGB, 32gb G.Skill Trident Z5 RGB 7200mhz CL34 DDR5, ASUS Rog Strix Z790-E, ASUS Rog Strix OC 4090, ASUS ROG Wingwall Graphics Card Holder, Seagate limited Edition Cyberpunk 2077 m.2, 2x Samsung 980 m.2 1TB's, 980 & 990 Pro m.2 2TB's, ASUS ROG Hyperion GR701, ASUS ROG Thor 1200W Platinum II, Cablemod RT-Series Pro ModMesh Sleeved 12VHPWR Carbon, ASUS Rog Swift PG35VQ 35", Acer EI342CKR Pbmiippx 34", ROG Harpe Ace Aim Lab Edition mouse, Rog Claymore II keyboard, TCL home entertainment Sound Bar w/Wireless Sub, Steelseries Johnny Silverhand Headset Microsoft Cyberpunk 2077 Xbox controller
    #19
    XrayMan
    Insert Custom Title Here
    • Total Posts : 73000
    • Reward points : 0
    • Joined: 2006/12/14 22:10:06
    • Location: Santa Clarita, Ca.
    • Status: offline
    • Ribbons : 115
    Re: A workstation (work in progress) 2014/07/22 18:13:50 (permalink)
     
    Looks great. Very nice work.       

                My Affiliate Code: 8WEQVXMCJL
     
            Associate Code: VHKH33QN4W77V6A
     
                 
     
     
                      
     
     
     
              
     
       
     
               
     
     
     
     
     
     
     
     
     
     
     
     
     
     
     



     
     
     
     
     
     &nbsp
    #20
    schmorblatz
    Superclocked Member
    • Total Posts : 147
    • Reward points : 0
    • Joined: 2014/05/01 07:29:50
    • Status: offline
    • Ribbons : 5
    Re: A workstation (work in progress) 2014/07/25 16:35:14 (permalink)
    True work can begin !
     
    I received components. But forgot to order a bluetooth adapter : I plan to build a remote with an old PDA (Acer n300 / Windows CE 5.0). The Arduino, the touch screen, a serial/USB adapter for communications with Windows, and the PDA (for future use) :
     

     
    First test : PWM control. The Mega 2560 gives only 9 full control PWM outputs (frequency wich have to be 25kHz + duty cycle). For some obscure hardware limitations. But I need only 8 channels. Tested. Works fine.
     
    At the moment, the speeds have to be hard coded at compilation, or set using a TTY terminal ! Not very usefull ! The most tricky part will probably be the duty cycle measurement of the signals comming from the mobo and the GPUs.
     

     
    Arduino PWM Frequency Library v_05 is great, and saved me a lot of time :
    http://forum.arduino.cc/index.php/topic,117425.0.html
     
    Now I have to find how to use USB virtual serial ports with Win32 (and Arduino)... Never done. Using the mobo serial port and a TTL to serial adapter (MAX232) is easy, but it is not an acceptable solution for this project : not smart, and the connector would interfere with the 4th gfx card. Worse : future mobos will probably not offer this port.

    why make it simple when it can be complicated ????
     
    rig 1 : Asus P9X79-E WS / i7 4930k / 3-way SLI EVGA 780ti / Quadro K2000 / watercooled / 3D Vision Surround / 3 x Samsung 2233RZ + HP ZR22W
    rig 2 : Asus P9X79 WS / i7 4930k / 2-way SLI 770 / aircooled / 3D Vision / Samsung 2233RZ + Samsung 2232BW + HP ZR22W
    rig 3, 4 5, etc. : uninteresting !
    #21
    schmorblatz
    Superclocked Member
    • Total Posts : 147
    • Reward points : 0
    • Joined: 2014/05/01 07:29:50
    • Status: offline
    • Ribbons : 5
    Re: A workstation (work in progress) 2014/07/27 12:04:55 (permalink)
    Work in progress...
     
    First of all, I need a manual fan controller : done ! Not eye candy, it's far to sson for aesthetics considerations.
     

     
    Manual, but under Windows, as I did'nt test the touch screen for the Arduino. And it is my first try with the Arduino, and my second with a micro controller : will maybe take some time...
     
    The Arduino and the Windows app communicate through an USB virtual serial port, using strings : it will be very easy to adapt the interface on other systems (Windows CE , Android...) : USB or Bluetooth is just a matter of channel, communications protocols remaining the same.
     
    Emitting commands from Windows to the Arduino has been very easy. Receiving was much more tricky, but it's done !
     
    Many thanks for this guy : http://www.codeproject.co...2/Serial-library-for-C
     

     
    For testing purpose, I connected the front fans to the µC, but all channels work exactly the same way, and are coded exactly the same. Comparison between the speeds displayed by my app, and Asus Fan XPert ; mobo channel = CHA_FAN3
     

     
    The RPM signal of the (2nd) fan is connected to both the mobo and the µC. Here, 586 for Asus, 580 for me. I had some trouble with unstable signals, as I neglicted to pull up the RPM signal to 12V ! 5V are not enough !
     
     
    This Asus utility is absolutely stupid. It has a calibration procedure wich starts from a 0% PWM and ends at 100%. It retains the fans starting point as zero RPM. But if one starts from 100%, and decreases duty cycle, these fans still rotate until they reach about 10-15% duty cycle, and 90-120RPM. Then, they stall. Asus Fan XPert does'nt seem to know what hysteresis does mean ! The display under about 400RPM is 0RPM, even with running fans. I get 90RPM, and they rotate (less than 2 rev/sec !). Remember : my goal is to reach minimum cooling for acceptable operating temps, exactly the opposite of the rest of the world (minimum temps).
     
    This is very easily manageable : starting from zero, boost to 100% for 2-3 seconds, and then the fans can slow down.
     
    It will be coded.
     
    I will make a video to show this, but I prefer coding ! Maybe tomorrow... Not sure one will understand my bad english, a video would be self explanative.
     
    I still have to measure temps with the 3 thermistors (easy), and try to use the PWM signals from the mobo and te GPUs for evaluation. And also to test the mains current sensor (power integration over time = energy = heat to dissipate).
     
    But I'd prefer to access the SMBIOS...
     
    AFAIK, there are only 3 ways to access the informations provided by system sensors :
     
    - from the OS : irrelevant (the OS has nothing to do with heat dissipation management, this *MUST* be a hardware job)
    - from the PCI/PCIe bus
    - from the RAM slots
     
    There is very little information about SMBIOS, except the fact that it is more or less I2C compliant, like most of the µC in the universe.
     
    If someone has any information, even the most infinitesimal help will be appreciated !
     
    [EDIT]
     
    video : https://www.youtube.com/watch?v=dKtH66yE950&feature=youtu.be
     
    post edited by schmorblatz - 2014/07/27 16:47:30

    why make it simple when it can be complicated ????
     
    rig 1 : Asus P9X79-E WS / i7 4930k / 3-way SLI EVGA 780ti / Quadro K2000 / watercooled / 3D Vision Surround / 3 x Samsung 2233RZ + HP ZR22W
    rig 2 : Asus P9X79 WS / i7 4930k / 2-way SLI 770 / aircooled / 3D Vision / Samsung 2233RZ + Samsung 2232BW + HP ZR22W
    rig 3, 4 5, etc. : uninteresting !
    #22
    Drerex
    CLASSIFIED Member
    • Total Posts : 3892
    • Reward points : 0
    • Joined: 2007/10/26 16:29:58
    • Location: St. Augustine, FL
    • Status: offline
    • Ribbons : 31
    Re: A workstation (work in progress) 2014/07/30 18:56:25 (permalink)
    Looking great bud!  What cad program are you using?


    #23
    schmorblatz
    Superclocked Member
    • Total Posts : 147
    • Reward points : 0
    • Joined: 2014/05/01 07:29:50
    • Status: offline
    • Ribbons : 5
    Re: A workstation (work in progress) 2014/07/31 06:14:44 (permalink)
    For mechanical design, Solidworks. For electronics, EagleCAD (PCB design).
     
    At the moment, work is still in progress : the Arduino fan control software, and particularly the GUI with the tactile display.
     
    I also did some experiments with the watercooling, and the GTX 780 Ti fan controller.
     
    1- even with pump and fans at minimum speeds, the temps are ok : water ~45°C, GPUs 55°-60°C with Unigine
     
    2- the GTX 780 Ti has a double closed loop regulation. First one : temp vs PWM control. Second one : fan speeed vs PWM control. It means that using the PWM output as a temp signal implies the presence of a circuit to fake the gfx card : in order to get a PWM signal other than 100%, the gfx card fan controller must receive a tach signal, and this tach signal must have the same frequency than the signal it would receive from the stock fan. I "discovered" this with the o-scope and different 4-wire fans.
     
    I searched all over the web for something to access SMBIOS/SMBUS at hardware level, but it seems to be impossible (a master/slave story on the SMBUS/I2C). No application examples with Bus Pirate ( http://en.wikipedia.org/wiki/Bus_Pirate ) even if someone pretends he did it. I also had a look to PCI diag cards : these cards seem to act only as slave on the SMBUS, not as master (master mode needed to ask informations from peripherals).
     
    I also searched for a tool that could tweak the GTX 780 Ti at BIOS level, like NiBiTor, to change the registers values in the fan controller intergrated circuit. The only one I found is a tool written by an administrator of the MSI forums. But this tool is'nt free, and I am not sure it could do the trick.
     
    Why do I want to modify the BIOS ???
     
    Because the PWM fan control signal is not very responsive to temperature. The curve is exponential, and between iddle and full load under minimum watercooling, this signal varies from 26% to 30%. Not enough.
     
    I 'd like to mod the BIOS for a linear curve (PWM % = k * °C), without hysteresis.
     
    I did'nt found information on the GTX fan controller IC. On older cards it was the ATD7473...
     
    But the water temp at the output of the waterblocks is not too badly correlated with GPUs temps. With 3-way SLI, all cards running with Unigine, pump and fans at minimum, the difference is 5-15°C. So, it is possible to use this water temp. The same way automotive (and others) engines are cooled...
     
    Under Windows, I could use SMBIOS APIs and NVAPI, but as I sayed before, I think that thermal regulation must be designed at hardware level, and must not depend on values got at OS level.
     
    A workaround could be a thermal response "cartography". After different measures under different loads, pump speeds, fan speeds. Then hardcoding the results in the Arduino. More than 10 parameters, and say 4 values for each,  this makes it nearly impossible as every test would take an hour or so for stabilization. I did'nt calculate, but I think it would take at least one year running 24/7.
     
    I am *VERY* disapointed.
     
     
    post edited by schmorblatz - 2014/07/31 06:17:33

    why make it simple when it can be complicated ????
     
    rig 1 : Asus P9X79-E WS / i7 4930k / 3-way SLI EVGA 780ti / Quadro K2000 / watercooled / 3D Vision Surround / 3 x Samsung 2233RZ + HP ZR22W
    rig 2 : Asus P9X79 WS / i7 4930k / 2-way SLI 770 / aircooled / 3D Vision / Samsung 2233RZ + Samsung 2232BW + HP ZR22W
    rig 3, 4 5, etc. : uninteresting !
    #24
    nikkocortez
    CLASSIFIED Member
    • Total Posts : 2884
    • Reward points : 0
    • Joined: 2010/02/01 10:04:03
    • Status: offline
    • Ribbons : 14
    Re: A workstation (work in progress) 2014/08/13 22:48:54 (permalink)
    Looking great!  The cooling controller solution I am watching with interest.  Hope to see everything together and working!
    #25
    rjohnson11
    EVGA Forum Moderator
    • Total Posts : 102260
    • Reward points : 0
    • Joined: 2004/10/05 12:44:35
    • Location: Netherlands
    • Status: online
    • Ribbons : 84
    Re: A workstation (work in progress) 2014/08/14 00:23:30 (permalink)
    This build continues to amaze me!

    AMD Ryzen 9 7950X,  Corsair Mp700 Pro M.2, 64GB Corsair Dominator Titanium DDR5  X670E Steel Legend, MSI RTX 4090 Associate Code: H5U80QBH6BH0AXF. I am NOT an employee of EVGA

    #26
    BadBertie
    SSC Member
    • Total Posts : 852
    • Reward points : 0
    • Joined: 2012/08/10 17:09:48
    • Location: France
    • Status: offline
    • Ribbons : 1
    Re: A workstation (work in progress) 2014/08/14 03:52:57 (permalink)
    Nice cad work, cunning controller work, and your English is probably better than mine.
    Every bit worth the ribbon.

    KTM Super Duke R EVO
    #27
    schmorblatz
    Superclocked Member
    • Total Posts : 147
    • Reward points : 0
    • Joined: 2014/05/01 07:29:50
    • Status: offline
    • Ribbons : 5
    Re: A workstation (work in progress) 2014/08/25 11:12:09 (permalink)
    Thanks !
     
    I was on vacations until a few days (diving resort ). As soon as I was at home, I worked again on the fan controller, and got interesting results. I post some pics I will comment in a few hours. At the moment, I have a manual fan controller (through tactile screen). The most important part of the software is completed. It will be time to work on hardware (5.25" unit).
     
    Comments will come in a few hours (time for diner)...
     
    For those who are interrested in this fan controller : it will be open hardware and open software on my website (because it is far easier to do : editing, and source downloading).
     
    This fan controller will be easy to build, even for a beginner, or for someone who does't know anything in programming and/or electronics.
     
    Want to see my cable management ? Here you are !
     
    (and examining the PC, you will see how many disks I use ! 1x internal SSD, 7x internal HDD (rackable), and on the top of the case, an Icy Dock RAID with 2x HDD inside : 10 disks !). The reason why I had difficulties to find a compact case, and why I got this Lian Li...
     

     
    Probes :
     
    3 types of "probes".
     
    - 1 - NCT (thermistors) for ambient temp, pump input (rads output), and waterblocks output (rads input).
     
    - 2 - PWM signal decoding from CPU fan ; the measure is not relevant at lower temps, as it can be ssen on pictures : gives the same value than amb temp ! This has always been a problem with my 2 x P9X79. Asus or other monitoring softwares : same problem. Couldn't use OCCT : it reads 127°C, and considers the CPU is overheating !!! Seems to be a common issue with these mobos/CPUs.
     
    - 3 - getting temps from GPUs is another big problem I will discuss further
     
    - 4 - amps entering the PSU : to be done (current transformer). Will display the apparent drawn power. It could even be software compensated after measurement and comparison whith a wattmeter, or using the oscope to determine cos(phi) at diffrent loads.
     
    I think the better solution for cooling regulation is reading the power consumption, the ambient temperature, and adjusting fans and pump according to real life tests, with alarms based on temperature (such as auto shut down).
     
    Now, the touch screen
     
    The fonts provided with the 320x240 display are uggly. But it is possible to use nicer public domain bitmap fonts, or to convert vector fonts. Those that can be seen here are scaled 2x : huge pixellization...
     
    I am somewhat disapointed with the µC and the display. First, display is really slow. I what thinking of using stored bitmaps (µSD) as skins, but it takes 3-4 seconds to display one 320x240 (12bit only, 4 or 8bit not supported). The communication interface is also very slow : SPI interface. Drawing a screen or a dialog takes 0.5-1 second.
     

     
    In order to get a "hardware" CPU temp, I modified the fan curve in FAN Xpert+, and did some math to calculate back temp from PWM. The accuracy is rather good, but the display fluctuates (+-1or2°C). I plan to implement some sort of buffer (FIFO or circular), and calculate a mean value over time. For PWM measuring, the program determines the duty cycle (polling 10 to 20 cycles) for a 5 milliseconds, but still fluctuates ; I think the reason is the µC having a lot of things to do (it generates PWM, measures temps, etc.), and it is not real time multithreaded.
     
    The function : the two pulseIn do *NOT* measure one cycle, but parts of two successive ones ; but it works fine ; LO and HI durations are accumulated for 5ms, then the duty cycle is calculated, a 0 to 99.9 or so value is returned. 0 means "timeout", and 100.
     
    !!! NOTE THAT THIS FUNCTION IS A QUICK AND DIRTY FUNCTION : RISK OF DIVIDE BY ZERO ! SOME IMPROVMENTS ARE TO BE DONE (VERY EASY) !!!
     
    (but I tested extensively, and never crashed the µC when disconnecting the input, giving a 0/0*100 to eat to this animal; the function simply seems to return...  nothing !)
     
    #define SAMPLING_TIME    5000
    #define SAMPLE_TIMEOUT    200


    uint8_t ReadDutyCycle_v2(uint8_t iPin)
    {
        unsigned long pulseHi=0;
        unsigned long pulseLo=0;
        unsigned long totalHi=0;
        unsigned long totalLo=0;
        unsigned long timeStart=micros();
        unsigned long timeElapsed=0;
     
        while(timeElapsed<SAMPLING_TIME)
        {
            pulseHi=pulseIn(iPin, HIGH, SAMPLE_TIMEOUT);
            pulseLo=pulseIn(iPin, LOW, SAMPLE_TIMEOUT);
            if(pulseHi!=0&&pulseLo!=0) // timeout -> 0
            {
                totalHi+=pulseHi;
                totalLo+=pulseLo;
            }
            timeElapsed=micros()-timeStart;
        }

        return (double)pulseHi/(double)(pulseLo+pulseHi)*100;
    }


    There are also fluctuations at analog inputs : on the above pic, the water entering the rads is 0.1°C cooler than the water entering the pump. This pic is caricatural : most of the time, rads input is 1°C hotter than output ! (at idle, of course). A buffer and a mean value would also be the solution (in the todo list).
     
    On the FAN Xpert+ screen capture one can see the same irrelevant processor temp...
     
    Problem : this curve is defined using the OS and the Asus utility. I will have to test the default BIOS curve after uninstalling Asus tools, but chances are it will not work (too high duty cycle / CPU fan speed and flat curve at low temps).
     
    I am pretty sure FAN XPert+ parameters are stored somewhere in the NVRAM : I run 4 systems on my rig. If I change fan profile on one system, the profile is automatically selected when starting FAN XPert+ on the others. But these profiles seem not to be active at POST and boot time. How does it work ??? I found no information, as for NVidia hardware fan control.
     
    Another problem with duty cycle measurement is resolution : displaying 0.1°C from the 7bit or 8bit PWM signal is absolutely stupid ! I must reduce to 1°C resolution. I will do the same for water and amb temps (10bit ADC + little resistance variations for the NTCs = low resolution)
     

     
    More tricky is the PWM generator for the fan speeds control. The Arduino Mega 2560 has PWM outputs. But at 500 Hz, essentially for outputting analog voltage after integration (filtering). It is far too low for fan / pump control. It works, but it is very noisy. I tried some libraries, but none was able to generate 8 simultaneous 25 KHz PWM signals. I had to play with prescalers, and the lowest frequency with this µC is 31372.55 Hz. Typically, a PWM signal for fan control should be 21-28 KHz (Intel specs). But it seems to work fine at 31KHz. The (minor) risk is overheating of the internal motor controller - overclocking !). I think the only way to slow down the PWM outputs is to replace the 16MHz quartz for a 12MHz one (underclocking !). To be tested... or not !
     
    Another solution is to use a specialized PWM generator, and drive it with the µC. I'd preferably test this solution if I ran into problems with 31KHz (low probability, I think !)
     
    How to get 31KHz PWM outputs : this solution can be found everywhere on the web ! I do not touch timer 0 as it is related to time functions, and I need them for measurements.
     
        // timer 1 (controls pin 12, 11)
        TCCR1B &= 0b11111000 | 0b00000001;    // set timer 1 divisor to 1 for PWM frequency of 31372.55 Hz
        // timer 3 (controls pin 5, 3, 2)
        TCCR3B &= 0b11111000 | 0b00000001;    // set timer 3 divisor to 1 for PWM frequency of 31372.55 Hz
        // timer 4 (controls pin 8, 7, 6)
        //TCCR4B &= 0b11111000 | 0b00000001;    // set timer 4 divisor to 1 for PWM frequency of 31372.55 Hz
        // timer 5 (controls pin 44, 45, 46)
        TCCR5B &= 0b11111000 | 0b00000001;    // set timer 5 divisor to 1 for PWM frequency of 31372.55 Hz


    Here, this gives the 8 x 31KHz PWM channels with a 8bit resolution : pins 2, 3, 5, 11, 12, 44, 45, 46
     
    RPM measuring is another problem. I tried different libraries, polled and interrupt based, and finaly made my own. I did it by simply polling and measuring the duration of one pulse every 3 seconds or so, spreading them to avoid lags. Unfortunately, the values I get are slighly incorrect, but proportionnal : I had to multiply the result by a magic number in order to get correct RPMs : the time functions return 15% too short values ! It could be caused by the CPU cycles needed by the function itself. I found some discussion about this, with MEGA assembly langage and exact error calculation, but I am absolutely not interested in µC internals. If a magic number does the trick, it is sufficient.
     
    uint16_t ReadRPM_v7(uint8_t nPin)
    {
        // 100RPM -> 1.67 Hz -> 0.6 s soit 0.15s / impulsion
        // -> timeout 150000
        unsigned long period=pulseIn(nPin, LOW, 200000);
        if(period==0)
            return 0; // timeout
         uint16_t RPM=0.864 * 15000000 / period; // 0.864 = magic number
         if(RPM>9999)
            return 9999;
        else
            return RPM;
    }


    Measurement spreading : 3 measurements per second, this gives a complete display refresh (8 "probes") every 3 second (could be adjusted in future Options dialog)
     
    volatile unsigned long nTimeOld_Fan=0;
    volatile uint8_t bFan=0;

    void UpdateRPMs()
    {
        unsigned long nTime=millis();
        unsigned nElapsed=nTime-nTimeOld_Fan;
        
        if(nElapsed>300) // mesurer un ventilo
        {
            Fans[bFan].MeasureRPM();
            nTimeOld_Fan=nTime;
            bFan++;
            if(bFan==FAN_COUNT)
                bFan=0;
        }
    }


    Surprisingly, pulseIn(nPin, HIGH, timeout) gave more unstable results ! But HIGH or LOW, the mean values are the same. Nearly the same magic number was needed : 0.884(and this proved the TACH signal is nearly perfectly square).
     
    Polling is a problem because when the program polls an input, it cannot do anything else ! Unfortunately, it is not possible to use lots of interruptions with the Arduino Mega ; the Arduino Due could be an interesting alternative : 32bit (Mega=8bit), 84MHz (at least 5 time faster), all 54 digital inputs "interruptable", more memory (Mega=8K). But the Due is 3.3V : need to adapt voltages at inputs and outputs. An interrupt for signal changing -> period, and the µC will not have to wait.
     
    Polling when changing the PWM duty cycle makes the sliders less responsive if the fan runs at low RPM or is not connected : the worst case with 200 ms timeouts always reached every 300ms, so the µC is unresponsive 40% of the time. At low RPMs, the µC has to wait a whole pulse before it can move the cursor on the touch screen...
     
    (images below : RPM are for pump channel ! The D5 turns far higher at 50% duty cycle ! For testing purpose, a group of 3x BeQuiet! Shadow Wings PWM 140mm 1000RPM is connected to this channel)
     
    (and I discover editing this post that I wrote "HDD fan" insteed of "HDDs Fans" : 8x HDDs and 2x Fans...)
     

     
    The fan speed controls : every rounded rectangle is a button, and tapping the screen displays a dialog :
     
     

     

     
    The GPU hardware temps problem...
     
    It seems there is absolutely no information on how to hack the BIOS.
     
    I had a look to NVAPI, and "discovered" that fan controller could be on chip, unlike older (hackable) graphics card.
     
    The old Quadro FX3700 fan parameters and curve *CAN* be hacked with the help of NiBiTor. It uses a well known fan controller.
     
    But for more recent cards, after maybe 20 hours of search on the web, I think there is absolutely no information about fan parameters. The only known leaks are about how to make Quadro drivers recognize for example a 780ti as Quadro K6000 (BIOS mod + SMC resistors to change on the board). (that does not transform a GTX to Quadro - AFAIK, no double precision, and it does not give 12GB GDDR !!!)
     
    The desperating information : "Yes, the "nVidia On-Die" sensor return values directly from the GPU registers.
    Unfortunately the details how to access this is considered confidential and protected by NDA, so I cannot publish it."
     
    By the author of HWINFO, on this thread : http://www.hwinfo.com/forum/Thread-On-Die-GPU-fan-speed-on-GTX-580
     
    Nonetheless, I will have a try with PWM, as for CPU temp. It will need a "fake fan" circuit, in order not to get a 100% duty cycle signal, due to the closed loop fan regulation. Arduino, MEGA or Due, will not have enough PWM outputs : will do that with independant PICAXE µC (they are better at PWM, AFAIR)
     
    But I do not expect good results : fan curve is rather flat, and the temps interval very narrow with watercooling : this should give very bad resolutions. Precision X could help, after OS is loaded, the way I used Fan XPert+ by modifying the curve.
     
    At this time I just got a Asus alarm : CPU 118°C !!! But Probe II (and my fan controller) display a stupid 25°C (water is at 30°C with ambient at 24°C!!!)
     
    Asus software, or... Nuvoton NCT6776F ? This 25°C is reported by this fan controller on the mobo. Is the probe on i7 die, or somewhere on the mobo ???????? Speedfan says CPU=128°C, and cores = from 21 to 27°C... What's the problem with this i7 CPU / X79 mobo ???
     
     
    I am wondering if this thread is in the right place... I avoided case mods : only 4 holes, and I only build a 5.25" fan controller !
     
    post edited by schmorblatz - 2014/08/25 18:04:08

    why make it simple when it can be complicated ????
     
    rig 1 : Asus P9X79-E WS / i7 4930k / 3-way SLI EVGA 780ti / Quadro K2000 / watercooled / 3D Vision Surround / 3 x Samsung 2233RZ + HP ZR22W
    rig 2 : Asus P9X79 WS / i7 4930k / 2-way SLI 770 / aircooled / 3D Vision / Samsung 2233RZ + Samsung 2232BW + HP ZR22W
    rig 3, 4 5, etc. : uninteresting !
    #28
    Sleinous
    EVGA Forum Moderator
    • Total Posts : 7663
    • Reward points : 0
    • Joined: 2010/06/12 12:22:01
    • Location: France
    • Status: offline
    • Ribbons : 32
    Re: A workstation (work in progress) 2014/08/25 11:59:31 (permalink)
    Coming along very nicely indeed! :)
    #29
    rjohnson11
    EVGA Forum Moderator
    • Total Posts : 102260
    • Reward points : 0
    • Joined: 2004/10/05 12:44:35
    • Location: Netherlands
    • Status: online
    • Ribbons : 84
    Re: A workstation (work in progress) 2014/08/25 12:05:05 (permalink)
    So far so good...

    AMD Ryzen 9 7950X,  Corsair Mp700 Pro M.2, 64GB Corsair Dominator Titanium DDR5  X670E Steel Legend, MSI RTX 4090 Associate Code: H5U80QBH6BH0AXF. I am NOT an employee of EVGA

    #30
    Page: 12 > Showing page 1 of 2
    Jump to:
  • Back to Mobile