EVGA

Choosing RAM (x4 vs x8 / SR vs. DR vs. QR)

Author
gordan79
SSC Member
  • Total Posts : 531
  • Reward points : 0
  • Joined: 2013/01/27 00:17:36
  • Status: offline
  • Ribbons : 3
2014/03/08 02:36:19 (permalink)
This hasn't really been discussed here much, so some reasoned thoughts on this may be of use to someone still incluned to get an SR-2 or an SR-X.
 
x4 vs. x8
This refers to the bit-width of the chip. x4 chips are required for some of the more advanced server board features, such as chipkill. Boards relevant to readers of this thread (SR-2 and SR-X) don't have such features, and thus are unlikely to benefit from having x4 chips.
With x8 chips, half as many chips are required on the DIMM. Fewer chips means fewer components, cleaner design, less interference, cleaner signal, all of which means better reliability and OC-ability.
 
Summary: x8 DIMMs have half as many chips and thus may yield better stability, OC-ability and lower heat than x4 DIMMs
 
SR vs. DR vs. QR
Splitting memory into ranks reduces the load on the memory controller, but can also reduce performance. Each rank of memory is accessed separately, and electrically and electronically, a single DR DIMM is (or at least in theory should be) pretty indistinguishable from two SR DIMMs on the same memory channel. In practice we know this doesn't always work out the same way, e.g. I have had less luck with 6 DIMMs per CPU using SR DIMMs than with DR DIMMs on my SR-2 (although I may at some point re-visit this, my secondary SR-2 rig is using 6x8GB SR DIMM setup).
 
In theory, more ranks (ranks per DIMM times sockets per chanel) can yield higher performance because the instructions can be pipelined to overcome the latencies. In practice, outside of embedded electronics, this doesn't happen because the generic OS+application stack has no visibility of what goes on at that low a level, and while there may be some infinitesimal benefit with two ranks per channel, after that things will start to get worse rather than better, especially when going up to quad ranks per DIMM. At this point the synchronisation gets sufficiently complex that the whole memory bus has to get downclocked.
 
Each rank on a DIMM has a separate set of chips, so a DR DIMM will have twice as many chips on it as a SR DIMM of otherwise same specification.
 
Summary: SR DIMMs have half as many chips as DR DIMMs and may yield better stability, OC-ability and lower heat at least until you start pushing things out of spec (you should probably stick with the 48GB limit if you are experimenting with this). QR have twice as many chips against as DR, and typically require downclocking the bus by a notch.
 
Unfortunately, both of my SR-2s are now sorted for RAM (for the record, I am using 12x8GB DR x4 RDIMMs), so I am unlikely to be able to experiment with this further, but if anybody is looking at a fresh build from scratch, I hope the above info is useful to them.

Supermicro X8DTH-6, 2x X5690
Crucial 12x 8GB x4 DR 1.35V DDR3-1600 ECC RDIMMs (96GB)
3x GTX 1080Ti
Triple-Seat Virtualized With VGA Passthrough (KVM)
#1

4 Replies Related Threads

    tived
    iCX Member
    • Total Posts : 301
    • Reward points : 0
    • Joined: 2010/09/06 23:12:46
    • Location: Sydney : NSW : Australia
    • Status: offline
    • Ribbons : 0
    Re: Choosing RAM (x4 vs x8 / SR vs. DR vs. QR) 2014/03/08 14:28:11 (permalink)
    Thanks Gordan,
    for sharing this - I am still thinking of going back to 96gb but will probably replace my Kingston with Crucial
    Still wish for 16gb sticks :-)
     
    all the best
    Henrik

    Henrik
    - A Dane Down Under 
    Current systems: 
    EVGA Classified SR-2  Lian Li PC-V2120 Black, Antec 1200 PSU,
    2x X5650 (stock/4.2xxGhz), CPU Cooling: Noctua NH-D14 - Ram: (48gb) 6x 8Gb Kingston ECC 1333 KVR1333D3D4R9S/8GI - Disks & controllers:  Boot (Areca 1882ix-24): 8R0 128GB SAMSUNG 830 + 12R0 INTEL 520 120GB's - 1x IBM M1015 7x Seagate SV35 2TB  - GPU: Asus GTX-680 - Monitors: NEC 2690v2 & 2x Dell 2716 - Profiler X-rite: Eye-One Pro
    #2
    gordan79
    SSC Member
    • Total Posts : 531
    • Reward points : 0
    • Joined: 2013/01/27 00:17:36
    • Status: offline
    • Ribbons : 3
    Re: Choosing RAM (x4 vs x8 / SR vs. DR vs. QR) 2014/03/08 14:44:13 (permalink)
    The key points for 96GB are:
    1) DR DIMMs (I _will_ re-try with SR ones, just for cross-check in the next week or two)
    2) Manually set all the RAM timings and make sure commant rate is set to 2T.
    3) Set the memory speed to 1333 and MCH strap to 1600 (MCH strap = 1333 also works for me if running completely non-overclocked with RAM at 1333MHz). Lowering the memory clock multiplier actually makes it worse
    post edited by gordan79 - 2014/03/08 18:43:26

    Supermicro X8DTH-6, 2x X5690
    Crucial 12x 8GB x4 DR 1.35V DDR3-1600 ECC RDIMMs (96GB)
    3x GTX 1080Ti
    Triple-Seat Virtualized With VGA Passthrough (KVM)
    #3
    tived
    iCX Member
    • Total Posts : 301
    • Reward points : 0
    • Joined: 2010/09/06 23:12:46
    • Location: Sydney : NSW : Australia
    • Status: offline
    • Ribbons : 0
    Re: Choosing RAM (x4 vs x8 / SR vs. DR vs. QR) 2014/03/08 18:32:17 (permalink)
    Thanks Gordan,
     
    Much appreciated
     
    Henrik

    Henrik
    - A Dane Down Under 
    Current systems: 
    EVGA Classified SR-2  Lian Li PC-V2120 Black, Antec 1200 PSU,
    2x X5650 (stock/4.2xxGhz), CPU Cooling: Noctua NH-D14 - Ram: (48gb) 6x 8Gb Kingston ECC 1333 KVR1333D3D4R9S/8GI - Disks & controllers:  Boot (Areca 1882ix-24): 8R0 128GB SAMSUNG 830 + 12R0 INTEL 520 120GB's - 1x IBM M1015 7x Seagate SV35 2TB  - GPU: Asus GTX-680 - Monitors: NEC 2690v2 & 2x Dell 2716 - Profiler X-rite: Eye-One Pro
    #4
    gordan79
    SSC Member
    • Total Posts : 531
    • Reward points : 0
    • Joined: 2013/01/27 00:17:36
    • Status: offline
    • Ribbons : 3
    Re: Choosing RAM (x4 vs x8 / SR vs. DR vs. QR) 2014/03/08 18:42:24 (permalink)
    If you already have 6x8GB DIMMs, it's easy enough to test whether the above advice will work for you. Configure BIOS settings as I mentioned above, disable one of the CPUs, and put all 6 DIMMs on the enabled CPU. It should POST within a few attempts.

    Supermicro X8DTH-6, 2x X5690
    Crucial 12x 8GB x4 DR 1.35V DDR3-1600 ECC RDIMMs (96GB)
    3x GTX 1080Ti
    Triple-Seat Virtualized With VGA Passthrough (KVM)
    #5
    Jump to:
  • Back to Mobile