EVGA

AnsweredMy new Rendering mashine EVGA SR-2 with 7x GTX780

Page: 12 > Showing page 1 of 2
Author
Robbanswe
iCX Member
  • Total Posts : 338
  • Reward points : 0
  • Joined: 2011/09/18 00:19:28
  • Status: offline
  • Ribbons : 4
2016/09/02 09:49:43 (permalink)
EVGA SR-2, with waterblocks.
The rendering per gpu is +16% faster than my old GTX580.
Same GPU as TiTAN, GK110, 7.1 billion transistors
7x GK110  = 49 billion transistors in one pc.
3 powersupplys.
Draw around 2600w +
24GB of ram for stability and speed.  home welded frame.
A separate big watercooled machine with 10x 40mmx40mm Peltier to hold the 2 x cpus at around 18c and 4300mhz   
The cooling systems hold one fat 80mm 4x120mm and a 80mm 3x120mm radiator.
4xrenderslaves with dual dual 56XX with total capacity of 96HT cores and 48GB ram.
 
#1
bcavnaugh
The Crunchinator
  • Total Posts : 38977
  • Reward points : 0
  • Joined: 2012/09/18 17:31:18
  • Location: USA Affiliate E5L3CTGE12 Associate 9E88QK5L7811G3H
  • Status: offline
  • Ribbons : 282
Re: My new Rendering mashine EVGA SR-2 with 7x GTX780 2016/09/02 09:57:19 (permalink)
Please do post some photos of this Monster!

Associate Code: 9E88QK5L7811G3H


 
#2
Robbanswe
iCX Member
  • Total Posts : 338
  • Reward points : 0
  • Joined: 2011/09/18 00:19:28
  • Status: offline
  • Ribbons : 4
Re: My new Rendering mashine EVGA SR-2 with 7x GTX780 2016/09/02 11:14:18 (permalink)
Got 95% of the stuff, it is the biginning of the build,
the graphic cards and mobo is in Place in the chassi,
Also the cpus and waterblocks.  
Can post some pics on sunday.
Regards Robban
#3
Robbanswe
iCX Member
  • Total Posts : 338
  • Reward points : 0
  • Joined: 2011/09/18 00:19:28
  • Status: offline
  • Ribbons : 4
Re: My new Rendering mashine EVGA SR-2 with 7x GTX780 2016/09/04 00:43:42 (permalink)


 
In my previous build, the underclocked and undervolted  2xGTX590 burnup from the heat under rendering so i
Moved the PSU`s for more GPU space.
The chassi will be a big rack version, ( mining style rack )
 
 
 
 
post edited by Robbanswe - 2016/09/04 11:15:05
#4
Gadgety1
Superclocked Member
  • Total Posts : 101
  • Reward points : 0
  • Joined: 2012/11/15 05:02:22
  • Status: offline
  • Ribbons : 0
Re: My new Rendering mashine EVGA SR-2 with 7x GTX780 2016/09/05 16:41:49 (permalink) ☼ Best Answerby Robbanswe 2016/09/08 09:31:23
Impressive, Robban. I kind of expected more than +16% per GPU from the GTX780 compared to the GTX580 for rendering. I don't know which rendering software you're using. However, I was surprised when a quick look at Tom's Hardware showed that the GTX780 was slower than the GTX580 with the rendering software they used, except for Octane where it was about 29% faster.
#5
petauro
New Member
  • Total Posts : 26
  • Reward points : 0
  • Joined: 2016/02/06 09:07:56
  • Status: offline
  • Ribbons : 0
Re: My new Rendering mashine EVGA SR-2 with 7x GTX780 2016/09/06 13:39:09 (permalink)
Really like the place of GPUs, I'm mounting my custom horizontal case and I don't like the pipes of gtx strix above the SR-2 plate fan, so I can get cooler both GPU's and plate fan. Thanks for the idea.
Where will you mount PSUs? Above all or by the side?
Which is your CPUs temperature with the 4X120 radiator?
And you're lucky cause you can leave it open, I've got 3 cats and a dog, so... I can't!!!! 
#6
Robbanswe
iCX Member
  • Total Posts : 338
  • Reward points : 0
  • Joined: 2011/09/18 00:19:28
  • Status: offline
  • Ribbons : 4
Re: My new Rendering mashine EVGA SR-2 with 7x GTX780 2016/09/08 09:59:51 (permalink)
The GTX 580 is doubt a Winner in most of cuda applications.
Really blending fast.
I buy old stuff so for me the 780 is a cheap upgrade, fits my wallet :-)
3GB standard, and for me 100% more Ram.
Future upgrade : 5 old TiTAN 6GB + my 2 gtx 780 strix give me 6GB.
 
Im going to mount the PSU`s behind the GTX if it fits.
But high up so the air flow from 4x120cooler runs under PSU and over SR-2.
 
 
Inside house,, no way !  we have a cat too and the noise is to much.
In a Little garden house on property :-)
 
SR-2 is still a killer when overclocking and 3ds max likes fast cpu´s
A Little welding on case/chassi next week to secure the GPU`s and mobo and build a new PSU holder.
 
The big 4x120 is only the cooler Before the watercooled thermal cooling maschine.
Im not finish with the build yet so
Maby in  1-2 months. 
 
i really want the cpus to go to max 18celsius when rendering.
It is easier to overclock when cpu is cooler. 
My new PSU link adapters.
for multiple PSU 
 
 
 
     
post edited by Robbanswe - 2016/09/08 10:47:20

Attached Image(s)

#7
Gadgety1
Superclocked Member
  • Total Posts : 101
  • Reward points : 0
  • Joined: 2012/11/15 05:02:22
  • Status: offline
  • Ribbons : 0
Re: My new Rendering mashine EVGA SR-2 with 7x GTX780 2016/09/09 04:30:59 (permalink)
Robban, we're the same in the "I buy old stuff" for cheap upgrades for good performance. About using the Titan instead of the GTX780, I saw a thread on the Octane forum discussing that the GTX780 works fine, whereas the GM 200 Titan X (same gen) the IOMEM limitation of the 32bit SR-2 bios made it not run when populating all slots. It might be that it was due to Windows, and switching to Linux might have addressed the issue. I'm not sure. See the thread here: https://render.otoy.com/forum/viewtopic.php?f=40&t=43597&p=248528&hilit=notiusweb#p248528. BTW are those 780s you're using the 6GB version?
post edited by Gadgety1 - 2016/09/09 11:35:29
#8
bcavnaugh
The Crunchinator
  • Total Posts : 38977
  • Reward points : 0
  • Joined: 2012/09/18 17:31:18
  • Location: USA Affiliate E5L3CTGE12 Associate 9E88QK5L7811G3H
  • Status: offline
  • Ribbons : 282
Re: My new Rendering mashine EVGA SR-2 with 7x GTX780 2016/09/09 10:09:21 (permalink)
Where did your Get This Little Bad Boy?

I could use a few myself.

Associate Code: 9E88QK5L7811G3H


 
#9
Robbanswe
iCX Member
  • Total Posts : 338
  • Reward points : 0
  • Joined: 2011/09/18 00:19:28
  • Status: offline
  • Ribbons : 4
Re: My new Rendering mashine EVGA SR-2 with 7x GTX780 2016/09/09 12:00:14 (permalink)
the gpu on old 780/titan is GK110
and they work fine.
got 2x asus 780 strix 6gb
Titan X is a newer model and to expensive fore me.

I tested gtx780 in 3ds max without superoptimize bios and 16% is really good.
render a short ~10sec scen and 780 is 2sec faster than 580.
did a series arion render benchmark and reach over 9000 points with my old gtx580/sr-2 overclocked.




Little Bad boys:
on ebay.
the seller :xyzhou2012.

Link Multiple add2PSU Dual Triple Power Supply Adapter Connector Relay Adapter

A easy and cheap way to make all psus start at same time.
post edited by Robbanswe - 2016/09/09 12:34:22
#10
gordan79
SSC Member
  • Total Posts : 531
  • Reward points : 0
  • Joined: 2013/01/27 00:17:36
  • Status: offline
  • Ribbons : 3
Re: My new Rendering mashine EVGA SR-2 with 7x GTX780 2016/09/10 13:51:43 (permalink)
Are you seriously saying that a 780 is only 20% faster than a 580 for rendering? That doesn't sound like a worthwhile upgrade.

Supermicro X8DTH-6, 2x X5690
Crucial 12x 8GB x4 DR 1.35V DDR3-1600 ECC RDIMMs (96GB)
3x GTX 1080Ti
Triple-Seat Virtualized With VGA Passthrough (KVM)
#11
Robbanswe
iCX Member
  • Total Posts : 338
  • Reward points : 0
  • Joined: 2011/09/18 00:19:28
  • Status: offline
  • Ribbons : 4
Re: My new Rendering mashine EVGA SR-2 with 7x GTX780 2016/09/11 01:48:21 (permalink)
For me it is great upgrade and it is the fun to build it.
16% better rendering time and 100% more ram, upgrade psu starter for less than a gtx1080. Sweet !
And maby in near future a can use all the gpu power better than with todays software.

Serious ?
Using a old 1366 mobo 2016 ?
SR-2 is a old megaperformance mobo.
And for me it is still the best.

A did not buy a 2x22 cores intel working at 2400mhz.


Often a new cpu family offer 5-20% better performance and a lot better watt/core.
People buy it.
New cpu, new mobo, new ddr. Are they not serious.
#12
gordan79
SSC Member
  • Total Posts : 531
  • Reward points : 0
  • Joined: 2013/01/27 00:17:36
  • Status: offline
  • Ribbons : 3
Re: My new Rendering mashine EVGA SR-2 with 7x GTX780 2016/09/11 02:17:07 (permalink)
The SR-2 isn't actually that great, even OC-ed. My seat of the pants perception is that my machine is noticeably more responsive with the non-OC-ed Supermicro X8DTH than it was with the OC-ed SR-2 (all other components exactly the same, as per the sig). And the X8DTH setup runs significantly cooler with 2 fans fewer.

Supermicro X8DTH-6, 2x X5690
Crucial 12x 8GB x4 DR 1.35V DDR3-1600 ECC RDIMMs (96GB)
3x GTX 1080Ti
Triple-Seat Virtualized With VGA Passthrough (KVM)
#13
Robbanswe
iCX Member
  • Total Posts : 338
  • Reward points : 0
  • Joined: 2011/09/18 00:19:28
  • Status: offline
  • Ribbons : 4
Re: My new Rendering mashine EVGA SR-2 with 7x GTX780 2016/09/11 07:06:49 (permalink)
A lot of stuff is better than SR-2 Gordon and it is ok
I own a few Supermicro X8DT and it as u say. probably a better choice.
my X8DT only have 1 pcie x16 so multigpu is out.
It is Quiet, much better with heat, the cpu fans runs very slow     
And the best: X8DT also handle the 96GB of ram better than SR-2.
  
 
 
 
 



 
 
 
 
 
 
 
 
 
 
 
 
post edited by Robbanswe - 2016/09/11 09:55:16
#14
gordan79
SSC Member
  • Total Posts : 531
  • Reward points : 0
  • Joined: 2013/01/27 00:17:36
  • Status: offline
  • Ribbons : 3
Re: My new Rendering mashine EVGA SR-2 with 7x GTX780 2016/09/11 11:21:38 (permalink)
X8DTH series has 7 PCIe slots, same as the SR-2, although you lose 2 DIMM sockets if you want to use a full length card in slot #1. You may be able to work around that by using ultra low profile DIMMs.

Supermicro X8DTH-6, 2x X5690
Crucial 12x 8GB x4 DR 1.35V DDR3-1600 ECC RDIMMs (96GB)
3x GTX 1080Ti
Triple-Seat Virtualized With VGA Passthrough (KVM)
#15
Robbanswe
iCX Member
  • Total Posts : 338
  • Reward points : 0
  • Joined: 2011/09/18 00:19:28
  • Status: offline
  • Ribbons : 4
Re: My new Rendering mashine EVGA SR-2 with 7x GTX780 2016/09/11 12:46:24 (permalink)
Using 7xPCIe extender Cables, so no problem with ram or ramslots.  
I google X8DTH.
a very nice mobo.

My Supermicros is X8DTi, 1 pcie 16x.
 
I building this 7xGPU/SR-2  ( for my wallet to ) i dont have to buy Another mobo 
and it is fun to find parts for it, also new parts like the nice multiPSU-card on ebay.  
Homebuild welded frame/chassi and some other stuff.
I think it will peform outstanding results.
Will do a lot of tests when finisch and put them up, bios settings also.
 
 
 
 
 
 
  
 
 
   
 
 
 
 
 
 
#16
gordan79
SSC Member
  • Total Posts : 531
  • Reward points : 0
  • Joined: 2013/01/27 00:17:36
  • Status: offline
  • Ribbons : 3
Re: My new Rendering mashine EVGA SR-2 with 7x GTX780 2016/09/12 00:00:54 (permalink)
The other advantage of the X8DTH is that it is a smaller motherboard, and the top slot fits against the top slot on the case. With the SR-2, the motherboard's slot #1 actually lines up against slot #3 on the case, so you lose 2 slots on the case. Which in turn means you could use a PCIe ribbon cable and have the 5th dual slot GPU in the case. You will need something proprietary to get the last 2 GPUs in if you really want to run with 7. You will also almost certainly need to slow down PCIe to v1.x speeds if you are using PCIe ribbon extenders.

Supermicro X8DTH-6, 2x X5690
Crucial 12x 8GB x4 DR 1.35V DDR3-1600 ECC RDIMMs (96GB)
3x GTX 1080Ti
Triple-Seat Virtualized With VGA Passthrough (KVM)
#17
Robbanswe
iCX Member
  • Total Posts : 338
  • Reward points : 0
  • Joined: 2011/09/18 00:19:28
  • Status: offline
  • Ribbons : 4
Re: My new Rendering mashine EVGA SR-2 with 7x GTX780 2016/09/12 11:32:34 (permalink)
It is a homebuild Mining style chassi.
My multi-Fermi GPUs did not work with pcie 100 so probably not the gtx780.
But am not there yet.
Probably slow down PCIe to 88-92 to get it to run ok.
It is going to be a lot of Bios testing and crashes with total resets  
But hopefully it will work.
   
 
 
 
 
post edited by Robbanswe - 2016/09/12 11:36:16
#18
gordan79
SSC Member
  • Total Posts : 531
  • Reward points : 0
  • Joined: 2013/01/27 00:17:36
  • Status: offline
  • Ribbons : 3
Re: My new Rendering mashine EVGA SR-2 with 7x GTX780 2016/09/12 11:52:11 (permalink)
Note that I am not talking about PCIe base clock speed but the protocol version. To use PCIe ribbon cable extenders you have to use a motherboard that will let you reduce the PCIe protocol verision down to v1.0 or v1.1. PCIe 2.0 and later will not work.

Supermicro X8DTH-6, 2x X5690
Crucial 12x 8GB x4 DR 1.35V DDR3-1600 ECC RDIMMs (96GB)
3x GTX 1080Ti
Triple-Seat Virtualized With VGA Passthrough (KVM)
#19
Robbanswe
iCX Member
  • Total Posts : 338
  • Reward points : 0
  • Joined: 2011/09/18 00:19:28
  • Status: offline
  • Ribbons : 4
Re: My new Rendering mashine EVGA SR-2 with 7x GTX780 2016/09/13 10:54:47 (permalink)
More pics on my build.
The 3x120mm 80mm radiator is replaced with a fat 3x140 80mm radiator
So 3x140 3,15" radiator and 4x120 3,15"  in the front .
Welding the frame finish this weekend, and paint :-)
The watercooled thermelectric watercooling machine have to wait 1-2weeks, waiting for 6x12cm alublock from ebay.
This machine will have 2x850watt     
Got 3x Phobya fast Waterpumps + a lot of
extra 3x120 thin radiators, and lot of  1/4 silicone hose.
i Think that 2x1200 watt PSU will fit in the pc.  
          
 
 
post edited by Robbanswe - 2016/09/30 11:59:53

Attached Image(s)

#20
Robbanswe
iCX Member
  • Total Posts : 338
  • Reward points : 0
  • Joined: 2011/09/18 00:19:28
  • Status: offline
  • Ribbons : 4
Re: My new Rendering mashine EVGA SR-2 with 7x GTX780 2016/09/16 04:55:58 (permalink)
Build pics.
Have to rebuild the graphic-card lock.
Asus 6GB is higher.
Did a a frame around the mobo to secure it.
More pics on sunday :-)
post edited by Robbanswe - 2016/09/17 05:29:22

Attached Image(s)


2x EVGA SR-2 with X5690, 48/96GB RAM.
1x intel Platinum 48core system with 9GPUS, 192GB ram all cpus\gpus watercooled 
2x AMDThreadripper builds with 48GB ram,nvme raid.
Intel 12900k,5xNVME raid, 3080,ddr5 
 
 
 
 
 
 
 
#21
Robbanswe
iCX Member
  • Total Posts : 338
  • Reward points : 0
  • Joined: 2011/09/18 00:19:28
  • Status: offline
  • Ribbons : 4
Re: My new Rendering mashine EVGA SR-2 with 7x GTX780 2016/09/17 05:34:51 (permalink)
Pics
post edited by Robbanswe - 2016/09/30 11:59:28

Attached Image(s)


2x EVGA SR-2 with X5690, 48/96GB RAM.
1x intel Platinum 48core system with 9GPUS, 192GB ram all cpus\gpus watercooled 
2x AMDThreadripper builds with 48GB ram,nvme raid.
Intel 12900k,5xNVME raid, 3080,ddr5 
 
 
 
 
 
 
 
#22
Robbanswe
iCX Member
  • Total Posts : 338
  • Reward points : 0
  • Joined: 2011/09/18 00:19:28
  • Status: offline
  • Ribbons : 4
Re: My new Rendering mashine EVGA SR-2 with 7x GTX780 2016/09/17 09:28:16 (permalink)
More
post edited by Robbanswe - 2016/09/18 11:39:48

Attached Image(s)


2x EVGA SR-2 with X5690, 48/96GB RAM.
1x intel Platinum 48core system with 9GPUS, 192GB ram all cpus\gpus watercooled 
2x AMDThreadripper builds with 48GB ram,nvme raid.
Intel 12900k,5xNVME raid, 3080,ddr5 
 
 
 
 
 
 
 
#23
Robbanswe
iCX Member
  • Total Posts : 338
  • Reward points : 0
  • Joined: 2011/09/18 00:19:28
  • Status: offline
  • Ribbons : 4
Re: My new Rendering mashine EVGA SR-2 with 7x GTX780 2016/09/17 09:46:45 (permalink)
The 3xPsu is under the mobo.
I use 2x850W old Corsair for 5xGPU, fans and waterpump.
1250w for the mobo and 2xGPU.   
post edited by Robbanswe - 2016/09/18 12:05:43

Attached Image(s)


2x EVGA SR-2 with X5690, 48/96GB RAM.
1x intel Platinum 48core system with 9GPUS, 192GB ram all cpus\gpus watercooled 
2x AMDThreadripper builds with 48GB ram,nvme raid.
Intel 12900k,5xNVME raid, 3080,ddr5 
 
 
 
 
 
 
 
#24
Robbanswe
iCX Member
  • Total Posts : 338
  • Reward points : 0
  • Joined: 2011/09/18 00:19:28
  • Status: offline
  • Ribbons : 4
Re: My new Rendering mashine EVGA SR-2 with 7x GTX780 2016/09/30 11:54:58 (permalink)
More parts for my CPU TEC watercooling machine.
The 120mm aluminium blocks is massive/solid
I start with 350-400 Watt cooling capacity with 6x 40x40mm peltier.
Hopefully it will cool the cpu`s to 15-18c.
 
if it dont work i expand from 6x-12x =350-700watt cooling
And maby the first start of the SR-2 in a couple of weeks.
 
Still waiting for some ordered blue highflow adapters.
 
 
 
 
 
post edited by Robbanswe - 2016/09/30 13:25:57

Attached Image(s)


2x EVGA SR-2 with X5690, 48/96GB RAM.
1x intel Platinum 48core system with 9GPUS, 192GB ram all cpus\gpus watercooled 
2x AMDThreadripper builds with 48GB ram,nvme raid.
Intel 12900k,5xNVME raid, 3080,ddr5 
 
 
 
 
 
 
 
#25
Robbanswe
iCX Member
  • Total Posts : 338
  • Reward points : 0
  • Joined: 2011/09/18 00:19:28
  • Status: offline
  • Ribbons : 4
Re: My new Rendering mashine EVGA SR-2 with 7x GTX780 2016/10/01 08:43:21 (permalink)
If it work. i will build a mega GPU Pc with 2x SR-2 watercooled .
With A bunch of GTX 580 and GTX 780 and run it trough Backburner
 
post edited by Robbanswe - 2016/10/01 09:39:38

2x EVGA SR-2 with X5690, 48/96GB RAM.
1x intel Platinum 48core system with 9GPUS, 192GB ram all cpus\gpus watercooled 
2x AMDThreadripper builds with 48GB ram,nvme raid.
Intel 12900k,5xNVME raid, 3080,ddr5 
 
 
 
 
 
 
 
#26
Gadgety1
Superclocked Member
  • Total Posts : 101
  • Reward points : 0
  • Joined: 2012/11/15 05:02:22
  • Status: offline
  • Ribbons : 0
Re: My new Rendering mashine EVGA SR-2 with 7x GTX780 2016/10/14 09:19:43 (permalink)
Great stuff, Robbanswe!
#27
Robbanswe
iCX Member
  • Total Posts : 338
  • Reward points : 0
  • Joined: 2011/09/18 00:19:28
  • Status: offline
  • Ribbons : 4
Re: My new Rendering mashine EVGA SR-2 with 7x GTX780 2016/10/15 03:34:22 (permalink)
Thanks !
 
4x G1/4-3/8 Splitters and block adapters for watercooling the Supermicro backburner server.
i build it all watercooled and slim chassi style.
Like 4x 1u servers
probably build it in a couple of weeks or... :-)
 
 
post edited by Robbanswe - 2016/10/15 04:56:53

Attached Image(s)


2x EVGA SR-2 with X5690, 48/96GB RAM.
1x intel Platinum 48core system with 9GPUS, 192GB ram all cpus\gpus watercooled 
2x AMDThreadripper builds with 48GB ram,nvme raid.
Intel 12900k,5xNVME raid, 3080,ddr5 
 
 
 
 
 
 
 
#28
Robbanswe
iCX Member
  • Total Posts : 338
  • Reward points : 0
  • Joined: 2011/09/18 00:19:28
  • Status: offline
  • Ribbons : 4
Re: My new Rendering mashine EVGA SR-2 with 7x GTX780 2016/10/15 05:38:14 (permalink)
3 mobo with waterblocks.    
post edited by Robbanswe - 2016/10/15 07:52:22

Attached Image(s)


2x EVGA SR-2 with X5690, 48/96GB RAM.
1x intel Platinum 48core system with 9GPUS, 192GB ram all cpus\gpus watercooled 
2x AMDThreadripper builds with 48GB ram,nvme raid.
Intel 12900k,5xNVME raid, 3080,ddr5 
 
 
 
 
 
 
 
#29
Gadgety1
Superclocked Member
  • Total Posts : 101
  • Reward points : 0
  • Joined: 2012/11/15 05:02:22
  • Status: offline
  • Ribbons : 0
Re: My new Rendering mashine EVGA SR-2 with 7x GTX780 2016/10/15 07:01:56 (permalink)
Do you have a build log somewhere else? Such as Overclockers or some such. It's a massive system.
#30
Page: 12 > Showing page 1 of 2
Jump to:
  • Back to Mobile