EVGA

SR-2 - Underclock with lots of RAM

Author
suggestable
New Member
  • Total Posts : 10
  • Reward points : 0
  • Joined: 2012/02/06 21:04:14
  • Location: London, UK
  • Status: offline
  • Ribbons : 0
2015/04/28 04:42:21 (permalink)
Hi folks.
 
I have an SR-2 and a pair of E5645 CPUs. I also have 12x 4GB DDR3 1333 ECC Reg and 8x 8GB DDR3 1333 ECC Reg.
 
I'm interested in using the board to run FreeNAS using ZFS to handle a substantial number of disks, so need lots of RAM and not a huge amount of CPU power.
 
Can someone please advise if this is worth attempting? I am looking for low power consumption overall, so reducing the CPU clocks seems like a logical step to me.
 
Thank you!

(Retired) gaming rig:
EVGA SR-2 | 2x Xeon E5645 | 48GB (12x 4GB) DDR3 ECC Reg | 2x Radeon HD 7970 | 240GB Corsair Force Series 3 SSD | Dell PERC H200 running 4x 500GB HDD in RAID-10 | Windows 7 Ultimate x64 | Corsair TX950 PSU | Xigmatek Elysium
 
Server:
ASUS KGPE-D16 | 2x Opteron 6134 | 96GB RAM (8x8GB+8x4GB DDR3 ECC Reg) | Dell PERC H700 512MB | 12x 3TB in RAID-6 | 6x 2TB in RAID-6 | X-Case RM-424 | PC Power & Cooling Turbo Cool 860 | Windows 2012 R2 Datacenter
 
Next-gen storage server:
ASUS P9A-I with C275
#1

12 Replies Related Threads

    suggestable
    New Member
    • Total Posts : 10
    • Reward points : 0
    • Joined: 2012/02/06 21:04:14
    • Location: London, UK
    • Status: offline
    • Ribbons : 0
    Re: SR-2 - Underclock with lots of RAM 2015/04/28 04:46:03 (permalink)
    I should add:

    I'm not in front of the hardware and none of it has actually been used/powered on in the last two years, so I really don't remember the details of the RAM.
     
    I'm simply hoping that someone will say that it will be possible to use 8x 8GB and 4x 4GB together, while possibly running the CPUs at <2GHz/core. I'm also happy to disable all but two cores per CPU (in the name of power saving) if it would potentially help stability.

    (Retired) gaming rig:
    EVGA SR-2 | 2x Xeon E5645 | 48GB (12x 4GB) DDR3 ECC Reg | 2x Radeon HD 7970 | 240GB Corsair Force Series 3 SSD | Dell PERC H200 running 4x 500GB HDD in RAID-10 | Windows 7 Ultimate x64 | Corsair TX950 PSU | Xigmatek Elysium
     
    Server:
    ASUS KGPE-D16 | 2x Opteron 6134 | 96GB RAM (8x8GB+8x4GB DDR3 ECC Reg) | Dell PERC H700 512MB | 12x 3TB in RAID-6 | 6x 2TB in RAID-6 | X-Case RM-424 | PC Power & Cooling Turbo Cool 860 | Windows 2012 R2 Datacenter
     
    Next-gen storage server:
    ASUS P9A-I with C275
    #2
    gordan79
    SSC Member
    • Total Posts : 531
    • Reward points : 0
    • Joined: 2013/01/27 00:17:36
    • Status: offline
    • Ribbons : 3
    Re: SR-2 - Underclock with lots of RAM 2015/05/02 12:30:41 (permalink)
    If you have power management enabled (SpeedStep), and have everything running at stock clocks the advantages of undervolting, underclocking and disabling cores will be relatively minimal, as when the CPUs aren't under load they will clock down and undervolt anyway, that's what SpeedStep does.
     
    Regarding RAM, I think you cannot have 8GB+4GB in the same bank, but other than that, various combinations might work. Note that once you start using 8GB DIMMs you will need to make sure you have appropriate DIMMs and follow all the advice on the threads regarding running with 96GB of RAM. If your DIMMs don't fit the spec described on the other thread, it most likely won't work, and even if they are, the results are sometimes hit and miss (e.g. more people are reporting success with higher end CPUs than with lower end CPUs).
     
    Note that the SR-2 has various stability issues with SAS controllers (I have tried two LSIs of different generations, an Adaptec, and a 3ware, and all have lead to lock-ups under certain circumstances). If you are absolutely stuck with using a SAS controller (as per what is in your signature) and switching to SATA is not an option, make sure you at least disable VT-d in the BIOS, and seems to improve stability, but I haven't tested it extensively because I absolutely need VT-d (my SR-2s are multi-seat virtual workstation).
     
    One other word of warning - if your machine is going to be up 24/7 make sure you have monitoring and alerts set up using lm_sensors for the NB fan rpm. They are quite crap (standard cheap DC fan, not ball or fluid dynamic bearing) and are prone to seizing up. Make sure you use dust-filters on all intake fans on your case, and tape up various grilles and vents not occupied by intake/exhaust fans. And even then schedule extensive hoovering of the dust out of the machine at least every 6 months. Note that it is nearly impossible to get the dust out of the NB fan heatsink just by hoovering it, the fin design is such that dust will get quite thoroughly stuck in there and won't budge unless you take the top cover off. Running with dust filters helps alleviate the issue.

    Supermicro X8DTH-6, 2x X5690
    Crucial 12x 8GB x4 DR 1.35V DDR3-1600 ECC RDIMMs (96GB)
    3x GTX 1080Ti
    Triple-Seat Virtualized With VGA Passthrough (KVM)
    #3
    suggestable
    New Member
    • Total Posts : 10
    • Reward points : 0
    • Joined: 2012/02/06 21:04:14
    • Location: London, UK
    • Status: offline
    • Ribbons : 0
    Re: SR-2 - Underclock with lots of RAM 2015/05/03 11:13:38 (permalink)
    Thank you Gordan.
     
    The SR-2 I have was bought used and the original owner watercooled it with a Koolance full-cover block (and didn't provide the original HSFs), so I'm stuck with watercooling it for now.
     
    My idea of using it for FreeNAS would mean I'd be running HBAs on the board, and using the CPUs to handle the RAID-Z2 calculations. I'm actually leaning more toward simply reinstating it as my gaming rig for now, albeit with only 48GB of RAM (12x 4GB DDR3-1333 ECC Reg) and shifting server duties across to my new ASUS P9A-i C2750-based board. The P9A-i comes with 16 SAS ports onboard, which I'll use for the OS disks and for SSD caching of the main RAID-6 arrays. The KGPE-D16 can be set up for its original intended purpose: an ESXi hypervisor. I'm sure my partner will be happy with its number-crunching capabilities.
     
    What I need in a server board is stability and reliability. My SR-2 has never been that... although, now that I've read a few of the posts on here and seen that there's a new BIOS out (well, new to me anyway!) I am happy to consider it again for my gaming rig.
     
    I'm currently trying to decide which PSU I should go for when I rebuild it into a gaming monster again. I'm leaning towards a pair of GTX 980 cards, alongside my two E5645 CPUs, so I need something able to sustain >1kW when the machine's under full load. My go-to for gaming builds have always been Enermax and Corsair (mostly Corsair). I sold my TX950, as at the time I was considering getting an AX1500i. I've since learned that the AX1500i defaults back to multi-rail configuration after a reboot, which makes it an annoyance. For that reason, the AX1200i is a stronger contender.
     
    What are your views on this?
     
    I'm also considering the Corsair Obsidian 900D case, as the Elysium is too small for the water loops I have planned (two independent loops - one for CPU/mobo and one for the GPUs) and the 900D looks superb.
     
    Thank you.
     
    Sarah
    post edited by suggestable - 2015/05/03 11:17:39

    (Retired) gaming rig:
    EVGA SR-2 | 2x Xeon E5645 | 48GB (12x 4GB) DDR3 ECC Reg | 2x Radeon HD 7970 | 240GB Corsair Force Series 3 SSD | Dell PERC H200 running 4x 500GB HDD in RAID-10 | Windows 7 Ultimate x64 | Corsair TX950 PSU | Xigmatek Elysium
     
    Server:
    ASUS KGPE-D16 | 2x Opteron 6134 | 96GB RAM (8x8GB+8x4GB DDR3 ECC Reg) | Dell PERC H700 512MB | 12x 3TB in RAID-6 | 6x 2TB in RAID-6 | X-Case RM-424 | PC Power & Cooling Turbo Cool 860 | Windows 2012 R2 Datacenter
     
    Next-gen storage server:
    ASUS P9A-I with C275
    #4
    gordan79
    SSC Member
    • Total Posts : 531
    • Reward points : 0
    • Joined: 2013/01/27 00:17:36
    • Status: offline
    • Ribbons : 3
    Re: SR-2 - Underclock with lots of RAM 2015/05/06 11:10:51 (permalink)
    EVGA do PSUs, you know, and they come with 10 years' warranty. I have a 1300W on one of my SR-2s.
     
    As for the rest of it, I am going in the other direction - consolidation. I have virtualized most of my machines onto my SR-2, including my gaming systems. 12x 4GHz cores has thus far proved sufficient even under two concurrent gaming loads - it is actually quite difficult to consume that much CPU under non-synthetic load conditions. My other SR-2 is purely a mirror for backup purposes and only comes up every day or two for a few minutes to zfs receive incremental snapshots from the primary. The only reason the backup is also a similarly specced machine is to make it a quick and easy drop-in swap should the primary suffer a catastrophic failure.
    post edited by gordan79 - 2015/05/06 11:14:08

    Supermicro X8DTH-6, 2x X5690
    Crucial 12x 8GB x4 DR 1.35V DDR3-1600 ECC RDIMMs (96GB)
    3x GTX 1080Ti
    Triple-Seat Virtualized With VGA Passthrough (KVM)
    #5
    suggestable
    New Member
    • Total Posts : 10
    • Reward points : 0
    • Joined: 2012/02/06 21:04:14
    • Location: London, UK
    • Status: offline
    • Ribbons : 0
    Re: SR-2 - Underclock with lots of RAM 2015/05/06 16:28:01 (permalink)
    I actually hadn't realised that EVGA made PSUs!

    I've decided to go a slightly different route...

    I managed to score an HP DL380 G6 on eBay for just over half what I bought my SR-2 for. It comes with a whopping 4GB of RAM, but also includes a pair of X5570 (IIRC) CPUs and a 512mb P410i. I'll stick my HP SAS Expander (which hasn't been used in about three or four years) in it and run the latest SPP to upgrade all the firmware, then swap in my E5645s and load up all 18 DIMM slots.

    My SR-2 will take on the X5570s and 12x 4GB RDIMMs. I reckon I can live with 48GB of RAM in my gaming rig, after all.

    The DL380 G6 can take care of my ZFS needs (I have a Dell PERC H200 kicking around I can put IT firmware onto), the KPGE-D16 can handle my VMware needs (I'll pick up a managed switch and run LACP bonds), the P9A-i can take over my pfSense requirement (I know it's overspecced for that, but it's a lot more power efficient than what I'm currently running!) and the SR-2 can resume gaming duties, albeit with four fewer cores than before.

    How does that sound?

    I'll take a look at EVGA's PSU offerings and see what I can pick up that'll cover me for a few upgrades down the line.

    Long-term, I'll be looking to replace the SR-2 with a S2011-3 single-socket board, as I really don't think I'll need any more than 8 cores in a gaming rig. That said, I'll see what I can squeeze out of my new X5570s.

    (To note: the CPUs coming in my new DL380 G6 may not be X5570s... This is from memory. I remember that they're X-range and 55xx, and 5570 seems familiar)

    (Retired) gaming rig:
    EVGA SR-2 | 2x Xeon E5645 | 48GB (12x 4GB) DDR3 ECC Reg | 2x Radeon HD 7970 | 240GB Corsair Force Series 3 SSD | Dell PERC H200 running 4x 500GB HDD in RAID-10 | Windows 7 Ultimate x64 | Corsair TX950 PSU | Xigmatek Elysium
     
    Server:
    ASUS KGPE-D16 | 2x Opteron 6134 | 96GB RAM (8x8GB+8x4GB DDR3 ECC Reg) | Dell PERC H700 512MB | 12x 3TB in RAID-6 | 6x 2TB in RAID-6 | X-Case RM-424 | PC Power & Cooling Turbo Cool 860 | Windows 2012 R2 Datacenter
     
    Next-gen storage server:
    ASUS P9A-I with C275
    #6
    gordan79
    SSC Member
    • Total Posts : 531
    • Reward points : 0
    • Joined: 2013/01/27 00:17:36
    • Status: offline
    • Ribbons : 3
    Re: SR-2 - Underclock with lots of RAM 2015/05/07 02:18:47 (permalink)
    LOL! There I was advocating using fewer machines, so off you went and acquired an extra one. :)

    Supermicro X8DTH-6, 2x X5690
    Crucial 12x 8GB x4 DR 1.35V DDR3-1600 ECC RDIMMs (96GB)
    3x GTX 1080Ti
    Triple-Seat Virtualized With VGA Passthrough (KVM)
    #7
    suggestable
    New Member
    • Total Posts : 10
    • Reward points : 0
    • Joined: 2012/02/06 21:04:14
    • Location: London, UK
    • Status: offline
    • Ribbons : 0
    Re: SR-2 - Underclock with lots of RAM 2015/05/07 03:46:43 (permalink)
    Ha! Sorry Gordan!
     
    I've done some research into the EVGA 1300W and 1600W Titanium PSUs, and have come to the conclusion that importing one of the EVGA ones to the UK would be silly. I can get a Super Flower 1600W Titanium one for a lot less and it's exactly the same PSU (EVGA's one is made by Super Flower).
     
    Based on the specs, I think I'll go with the 1600W. It should see me through several upgrades over the years.
     
    OK... so... I double-checked the CPUs that are coming with my DL380 G6. They're X5550. What's the best OC I can expect from them? Stock is 2.66GHz and they're quad-core, so I'm hoping I should be able to exceed 3.5GHz. I'm going to run them in the SR-2 on a watercooled loop (Koolance full-cover MB block, EK CPU blocks, Laing DDC 1T-Plus, 1/2" ID tubing, compression fittings used throughout, TBD radiator - probably going with a 4x120mm in the top of an Obsidian 900d). The graphics will be handled by my pair of 7970s, on their own liquid loop (EK-FC7970 blocks, Laing DDC 1T-Plus, 1/2" ID tubing and probably a 4x120mm radiator in the LHS bottom of the 900d).
     
    Next on my shopping list:
    PSU - SuperFlower Leadex Titanium 1600W,
    Case - Corsair Obsidian 900d,
    Radiators - Make/model TBD 4x120mm,
    Fans - Got any recommendations?
    GPUs - GTX 980 SLI pair (or better) - long-term plan. The 7970s have never actually been used, so replacing them already seems unwise considering how much I spent on them (I bought them at full retail when they were brand new on the market...)

    (Retired) gaming rig:
    EVGA SR-2 | 2x Xeon E5645 | 48GB (12x 4GB) DDR3 ECC Reg | 2x Radeon HD 7970 | 240GB Corsair Force Series 3 SSD | Dell PERC H200 running 4x 500GB HDD in RAID-10 | Windows 7 Ultimate x64 | Corsair TX950 PSU | Xigmatek Elysium
     
    Server:
    ASUS KGPE-D16 | 2x Opteron 6134 | 96GB RAM (8x8GB+8x4GB DDR3 ECC Reg) | Dell PERC H700 512MB | 12x 3TB in RAID-6 | 6x 2TB in RAID-6 | X-Case RM-424 | PC Power & Cooling Turbo Cool 860 | Windows 2012 R2 Datacenter
     
    Next-gen storage server:
    ASUS P9A-I with C275
    #8
    gordan79
    SSC Member
    • Total Posts : 531
    • Reward points : 0
    • Joined: 2013/01/27 00:17:36
    • Status: offline
    • Ribbons : 3
    Re: SR-2 - Underclock with lots of RAM 2015/05/07 04:22:44 (permalink)
    Import them? Why? Scan, Ebuyer and many other UK retailers sell them.
    Be careful with the assumption that it is the same PSU just because it is made by the same manufacturer. That really doesn't follow at all. Also, do Super Flower offer a 10 year warranty on their PSUs? In my experience, PSUs are the second least reliable component on any system, right after HDDs.
     
    Cooling is seldom a limiting factor. You are going to be limited by the FSB before the temperature with a reasonable HSF. Expect to not be able to exceed 180 bclk reliably (PLLs destabilize and there's no voltage tweak that will get them stable past that, you'll see clock frequencies spiking all over the place). Personally I would not go past 177 bclk because that is how far you can go with QPI set to 4.8 without exceeding the 6.4GT/s spec of the CPU and NB. There really is not much headroom on the QPI. Also you will likely need to adjust your uncore, as that starts to destabilize at around 3.4GHz (on Westmeres the default multiplier is 20x, IIRC, not sure about other CPUs). I am running 166x24 on air with HR22 coolers and I cannot exceed 70C even when running minerd --algo=scrypt --benchmark or hours on a warn day (well, as much of a warm day as we get in UK).

    Supermicro X8DTH-6, 2x X5690
    Crucial 12x 8GB x4 DR 1.35V DDR3-1600 ECC RDIMMs (96GB)
    3x GTX 1080Ti
    Triple-Seat Virtualized With VGA Passthrough (KVM)
    #9
    suggestable
    New Member
    • Total Posts : 10
    • Reward points : 0
    • Joined: 2012/02/06 21:04:14
    • Location: London, UK
    • Status: offline
    • Ribbons : 0
    Re: SR-2 - Underclock with lots of RAM 2015/05/07 05:00:13 (permalink)
    I didn't realise you were also in the UK. Are you able to find the EVGA 1600W Titanium PSU in the UK? I haven't seen it yet, but I have seen the SuperFlower. The only difference is the outer markings on the unit and the SF only has a 5 year warranty. I've never had a high-end PSU fail.

    (Retired) gaming rig:
    EVGA SR-2 | 2x Xeon E5645 | 48GB (12x 4GB) DDR3 ECC Reg | 2x Radeon HD 7970 | 240GB Corsair Force Series 3 SSD | Dell PERC H200 running 4x 500GB HDD in RAID-10 | Windows 7 Ultimate x64 | Corsair TX950 PSU | Xigmatek Elysium
     
    Server:
    ASUS KGPE-D16 | 2x Opteron 6134 | 96GB RAM (8x8GB+8x4GB DDR3 ECC Reg) | Dell PERC H700 512MB | 12x 3TB in RAID-6 | 6x 2TB in RAID-6 | X-Case RM-424 | PC Power & Cooling Turbo Cool 860 | Windows 2012 R2 Datacenter
     
    Next-gen storage server:
    ASUS P9A-I with C275
    #10
    gordan79
    SSC Member
    • Total Posts : 531
    • Reward points : 0
    • Joined: 2013/01/27 00:17:36
    • Status: offline
    • Ribbons : 3
    Re: SR-2 - Underclock with lots of RAM 2015/05/07 05:20:26 (permalink)
    Scan seem to be listing at least 4 different 1600W EVGA PSU variants at a quick glance (not sure it really is 4, but the point is they are listed by UK retailers, Google "evga 1600w").
     
    And I wouldn't be saying that PSUs are the 2nd least reliable part if I didn't see them fail regularly.

    Supermicro X8DTH-6, 2x X5690
    Crucial 12x 8GB x4 DR 1.35V DDR3-1600 ECC RDIMMs (96GB)
    3x GTX 1080Ti
    Triple-Seat Virtualized With VGA Passthrough (KVM)
    #11
    suggestable
    New Member
    • Total Posts : 10
    • Reward points : 0
    • Joined: 2012/02/06 21:04:14
    • Location: London, UK
    • Status: offline
    • Ribbons : 0
    Re: SR-2 - Underclock with lots of RAM 2015/05/07 06:50:24 (permalink)
    Cheers. I'll have another look when I get home. The last PSU failure I encountered on one of my personal boxen was over 15 years ago...

    (Retired) gaming rig:
    EVGA SR-2 | 2x Xeon E5645 | 48GB (12x 4GB) DDR3 ECC Reg | 2x Radeon HD 7970 | 240GB Corsair Force Series 3 SSD | Dell PERC H200 running 4x 500GB HDD in RAID-10 | Windows 7 Ultimate x64 | Corsair TX950 PSU | Xigmatek Elysium
     
    Server:
    ASUS KGPE-D16 | 2x Opteron 6134 | 96GB RAM (8x8GB+8x4GB DDR3 ECC Reg) | Dell PERC H700 512MB | 12x 3TB in RAID-6 | 6x 2TB in RAID-6 | X-Case RM-424 | PC Power & Cooling Turbo Cool 860 | Windows 2012 R2 Datacenter
     
    Next-gen storage server:
    ASUS P9A-I with C275
    #12
    gordan79
    SSC Member
    • Total Posts : 531
    • Reward points : 0
    • Joined: 2013/01/27 00:17:36
    • Status: offline
    • Ribbons : 3
    Re: SR-2 - Underclock with lots of RAM 2015/05/07 06:54:54 (permalink)
    Could be an artifact in your measurement due to a small sample.

    Supermicro X8DTH-6, 2x X5690
    Crucial 12x 8GB x4 DR 1.35V DDR3-1600 ECC RDIMMs (96GB)
    3x GTX 1080Ti
    Triple-Seat Virtualized With VGA Passthrough (KVM)
    #13
    Jump to:
  • Back to Mobile