EVGA

EVGA Classified SR-2 - BIOS A58 Released

Page: < 1234 Showing page 4 of 4
Author
mathf
New Member
  • Total Posts : 17
  • Reward points : 0
  • Joined: 2015/02/23 16:12:14
  • Status: offline
  • Ribbons : 0
Re:EVGA Classified SR-2 - BIOS A58 Released 2015/04/14 04:05:11 (permalink)
The Titan X is also let's say more sensitive than the 780 (Ti or not)...
It has 12 GB of VRAM, which means that you need at least the same amount on your board for this work properly.
I am also thinking that, due to the fact that the SR-2 is a dual socket board, each CPU accesses only its "part" of the RAM... which means that each CPU can allocate max 24 GB (Ok, in your case, 48 GB :P ).
 
If the guy is using let's say 16 GB in total, it makes 8 per CPU... which is < than the 12 on the card.
#91
gordan79
SSC Member
  • Total Posts : 531
  • Reward points : 0
  • Joined: 2013/01/27 00:17:36
  • Status: offline
  • Ribbons : 3
Re:EVGA Classified SR-2 - BIOS A58 Released 2015/04/14 04:25:25 (permalink)
mathfThe Titan X is also let's say more sensitive than the 780 (Ti or not)...
It has 12 GB of VRAM, which means that you need at least the same amount on your board for this work properly.

 
That is actually a myth. There is no requirement for all of the VRAM to be shadowed in main RAM (apertures still only total 192MB of IOMEM space). Of course, that doesn't mean that some poorly programmed games/applications don't do it, I'm just saying there is no strict need for it. You can load the textures (what eats most of the memory) off the disk, shove them into VRAM, and be done with it, no need to keep them in main RAM.
 
mathfI am also thinking that, due to the fact that the SR-2 is a dual socket board, each CPU accesses only its "part" of the RAM... which means that each CPU can allocate max 24 GB (Ok, in your case, 48 GB :P ).
If the guy is using let's say 16 GB in total, it makes 8 per CPU... which is < than the 12 on the card.

 
What you are referring to WRT each CPU directly accessing half the RAM is called NUMA (Non-Uniform Memory Architecture). And there is no real connection between that and the GPU apertures and the RAM allocations. For performance reasons, you ideally want RAM to be allocated on the "near" MCH because the access latency to "local" RAM is half what it is for "remote" RAM. But in reality, process schedulers migrate processes to wherever there's space CPU time available, so on a heavily loaded system, while you can make some optimizations, all bets are generally off. One example of this, and consequences of the optimizations kernels do is what is known as "MySQL swap insanity", if you want to google for some gory details. The "fix" there is to make NUMA allocation work round-robin rather than try to allocate near RAM. You lose some performance on average RAM latency, but you avoid stuff swapping out to disk, which is worse.
 
Anyway, the point is that it's not about RAM size, it's about something quirky going on that breaks the already quirky NF200 (which breaks IOMMU DMA operations anyway, but I've got a workaround for the part of that I was falling foul of, which involves making sure guest VMs don't have any physical RAM mapped between 1GB and 4GB, which is where PCI IOMEM is mapped in host's e820 map).

Supermicro X8DTH-6, 2x X5690
Crucial 12x 8GB x4 DR 1.35V DDR3-1600 ECC RDIMMs (96GB)
3x GTX 1080Ti
Triple-Seat Virtualized With VGA Passthrough (KVM)
#92
mathf
New Member
  • Total Posts : 17
  • Reward points : 0
  • Joined: 2015/02/23 16:12:14
  • Status: offline
  • Ribbons : 0
Re:EVGA Classified SR-2 - BIOS A58 Released 2015/04/14 04:45:20 (permalink)
Correct me if I am wrong, but the 5520 is "somehow" a NUMA system, as each CPU has its own mem controller, that access the 6 ram slots.
Both CPUs are then inter-connected thru the QPI which let one provide memory chunk to the other. The operating system afterwards takes this into consideration when allocating the physical memory and when scheduling processes.
 
However, back to the main topic, I think we definitly need more details on what is happening with the Titan X, and hopefully some answers from EVGA. As you say, it might be that an incompatibility with the NF200 is causing that, but we can only make some rough guesses atm.
As you said, it would be really sad if EVGA does not bring any update to address this... given the fact that they are still offering support for the SR-2.
 
 
#93
gordan79
SSC Member
  • Total Posts : 531
  • Reward points : 0
  • Joined: 2013/01/27 00:17:36
  • Status: offline
  • Ribbons : 3
Re:EVGA Classified SR-2 - BIOS A58 Released 2015/04/14 05:53:04 (permalink)
I'm not even convinced the problem can be "fixed" with a firmware update.
But if we know the specific DMA access pattern that triggers the issue, it may potentially be possible to work around it in the driver (then we would need Nvidia to write a workaround in the driver - not something that I expect to happen any more than a BIOS update for the SR-2 to fix other much more obvious problems that have been known about for longer).

Supermicro X8DTH-6, 2x X5690
Crucial 12x 8GB x4 DR 1.35V DDR3-1600 ECC RDIMMs (96GB)
3x GTX 1080Ti
Triple-Seat Virtualized With VGA Passthrough (KVM)
#94
mathf
New Member
  • Total Posts : 17
  • Reward points : 0
  • Joined: 2015/02/23 16:12:14
  • Status: offline
  • Ribbons : 0
Re:EVGA Classified SR-2 - BIOS A58 Released 2015/04/20 08:30:26 (permalink)
gordan79
This is almost certainly the same reason why various SAS cards don't work properly on the SR-2.
I am about to order a Dell UP2715K+Titan-X combo (have to get a Kepler card because earlier ones don't have dual DP outputs required to drive that monitor), and I use my machine for virtualization with PCI passthrough for additional gaming seats, so if the Keper cards trigger the same random lock-up problems that arise when using PCI passthrough with SAS cards present in the machine, I'll have to send it all back (and make an even stronger mental note to avoid EVGA motherboards in the future).




Hi Gordan,
Did you have any chance to get your hand on a Titan X and check it on your SR-2 ?
#95
gordan79
SSC Member
  • Total Posts : 531
  • Reward points : 0
  • Joined: 2013/01/27 00:17:36
  • Status: offline
  • Ribbons : 3
Re:EVGA Classified SR-2 - BIOS A58 Released 2015/04/20 08:34:51 (permalink)
Not yet - the cards weren't available yet from my usual suppliers in UK.

Supermicro X8DTH-6, 2x X5690
Crucial 12x 8GB x4 DR 1.35V DDR3-1600 ECC RDIMMs (96GB)
3x GTX 1080Ti
Triple-Seat Virtualized With VGA Passthrough (KVM)
#96
mathf
New Member
  • Total Posts : 17
  • Reward points : 0
  • Joined: 2015/02/23 16:12:14
  • Status: offline
  • Ribbons : 0
Re:EVGA Classified SR-2 - BIOS A58 Released 2015/04/20 08:39:43 (permalink)
Let me know when you have a chance to :)
I googled a bit around, and I did not found any severe issue related to single GTX980 use, therefore, I am still not 100% convinced that the Titan X is so incompatible.
#97
gordan79
SSC Member
  • Total Posts : 531
  • Reward points : 0
  • Joined: 2013/01/27 00:17:36
  • Status: offline
  • Ribbons : 3
Re:EVGA Classified SR-2 - BIOS A58 Released 2015/04/20 08:46:46 (permalink)
I haven't looked very hard, but people have reported issues here on the EVGA forums.
My use case is very narrow (Linux-only, VT-d with PCI passthrough of GPUs to VMs), but the Titan X would be on the bare metal side of that configuration, with the VM running a 780Ti. I'm only really looking to upgrade one of my 780Ti cards because I want to upgrade to the new Dell UP2715K monitor - that requires dual DP inputs, and there are no pre-Maxwell GeForce cards with multiple DPs. Some Quadros with multiple DPs are available, but they are far too expensive.
 
If the Titan X proves to be too problematic, I'll probably have to do the unthinkable and downgrade to an AMD HD7970. Oddly, HD7970 (and rebadged versions thereof), came with dual DP outputs, but R9 cards did not.

Supermicro X8DTH-6, 2x X5690
Crucial 12x 8GB x4 DR 1.35V DDR3-1600 ECC RDIMMs (96GB)
3x GTX 1080Ti
Triple-Seat Virtualized With VGA Passthrough (KVM)
#98
mathf
New Member
  • Total Posts : 17
  • Reward points : 0
  • Joined: 2015/02/23 16:12:14
  • Status: offline
  • Ribbons : 0
Re:EVGA Classified SR-2 - BIOS A58 Released 2015/04/20 09:05:15 (permalink)
I (finally) got a hand on an SR-2 in excellent condition (from one of the forum members btw).
No watercooling modifications, not apparent damage, and no extreme overclocking done (excatly the same setup as yours).
...motherboard should arrive in the next couple of days.
-> As we have some Titan X at work, I will give it a try.
 
PS: I also looked over to the 5K Dell monitor, but I went for the LG 31MU97 instead. "Only" 4K, but Full-4K (4096x2160), and only 1 DP port is requiered.
#99
gordan79
SSC Member
  • Total Posts : 531
  • Reward points : 0
  • Joined: 2013/01/27 00:17:36
  • Status: offline
  • Ribbons : 3
Re:EVGA Classified SR-2 - BIOS A58 Released 2015/04/20 09:10:44 (permalink)
I'm currently using an IBM T221 - at 3840x2400, it is still the second highest pixel count on any monitor, and after 14 years, it has only just been bested by the 5K screens.

Supermicro X8DTH-6, 2x X5690
Crucial 12x 8GB x4 DR 1.35V DDR3-1600 ECC RDIMMs (96GB)
3x GTX 1080Ti
Triple-Seat Virtualized With VGA Passthrough (KVM)
mathf
New Member
  • Total Posts : 17
  • Reward points : 0
  • Joined: 2015/02/23 16:12:14
  • Status: offline
  • Ribbons : 0
Re:EVGA Classified SR-2 - BIOS A58 Released 2015/05/01 04:17:36 (permalink)
Short question: Is it normal that the board is not booting properly when CPU0 is disabled and CPU1 is enabled ?
It is posting, but I barely manage to pass the Windows 7 logo animation (sometimes it just stays with a black screen), and afterwards, the board is just frozen.
I am also not able to have a stable system with stock frequencies / voltages if the QPI is set to 6400 with my X5690 and this sounds more critical to me...
 
I have checked both CPUs on CPU0 socket, and both seems to work fine "alone" with A58 default settings
The only way that I managed to get Windows 7 booted with 2 CPUs, is to keep default settings and lower the QPI speed (...but in such case, it is still not booting when CPU0 is disabled), or to set the VTT to 1.35.
...and even with this high VTT, the system is unstable (freeze after 40 sec linpack).
gordan79
SSC Member
  • Total Posts : 531
  • Reward points : 0
  • Joined: 2013/01/27 00:17:36
  • Status: offline
  • Ribbons : 3
Re:EVGA Classified SR-2 - BIOS A58 Released 2015/05/01 04:37:04 (permalink)
No, that is not normal. Have you verified the problem is tied to the specific CPU socket, rather than the specific CPU or memory.
Do you use ECC RAM? I'm not sure how extensive Windows support for EDAC error reporting is, if it supports it there would be entries in the system event log to that effect. Xeons have ECC built in for various parts of them, and the NB/SB do as well, as does PCI, and all of this will be reported via EDAC, along with any RAM ECC errors, correctable or otherwise.
 
I have seen RAM before that is unstable at stock settings (e.g. Patriot), which is the main reason I have woved to never again build a workstation without ECC RAM.
If you can eliminate RAM being the cause (ideally by getting some ECC RDIMMs and testing sockets one at a time), then it's time to RMA the board.
 
It might also be worth checking all the pins in your CPU sockets, and cleaning the CPU contacts with isopropanol and/or a pencil eraser.
 
Either way, what you are describing is definitely not normal, at stock settings everything should "just work".

Supermicro X8DTH-6, 2x X5690
Crucial 12x 8GB x4 DR 1.35V DDR3-1600 ECC RDIMMs (96GB)
3x GTX 1080Ti
Triple-Seat Virtualized With VGA Passthrough (KVM)
mathf
New Member
  • Total Posts : 17
  • Reward points : 0
  • Joined: 2015/02/23 16:12:14
  • Status: offline
  • Ribbons : 0
Re:EVGA Classified SR-2 - BIOS A58 Released 2015/05/01 04:46:55 (permalink)
CPU sockets looks clean, and the CPU contacts are clean too.
I have 48GB (6*8GB) Hynix DDR3-1333 ECC (HMT31GR7BFR4C-H9) (Certified for Supermicro and ASUS server boards btw.)
I have already tried lowering down to DDR-1066, but no luck (timings are correctly detected in both cases).
 
For the first sight, the problem seems to be tied with CPU1 socket.
I am suspecting some QPI Link that is damaged somehow in the CPU1 socket.
I have tried the following:
 - test both CPUs one after the other in the CPU0 socket, leaving CPU1 disabled   -> works with default settings and linpack does not complain for 1 hour
 - tried the same in CPU1 socket -> no luck, even with 4.8 QPI and DDR-1066
 - tried both CPUs with QPI 5.8 -> works, linkpack does not complain for 1 hour
 
I was also suspecting that maybe one of the CPU's QPI link might be damaged, but this would not explain the CPU1 booting issue, when CPU0 is disabled.
...but I am really wondering if CPU1 is capable of booting "alone", since it is not the primary one.
gordan79
SSC Member
  • Total Posts : 531
  • Reward points : 0
  • Joined: 2013/01/27 00:17:36
  • Status: offline
  • Ribbons : 3
Re:EVGA Classified SR-2 - BIOS A58 Released 2015/05/01 05:06:48 (permalink)
I am reasonably sure I have tested before with each socket on my boards, but last time I had to do that was 18+ months ago, so I'm not 100% sure.
Troubleshooting issues like this is tricky. It is the main reason why I bought a complete second set of components (SR-2, ECC RAM, CPUs) just to be able to carry out a sanity cross-check on everything. If I hadn't done that, I might have given up on my first SR-2 (which I'm about to RMA for the 3rd time). Thankfully the 2nd one I bought never skipped a beat).

Supermicro X8DTH-6, 2x X5690
Crucial 12x 8GB x4 DR 1.35V DDR3-1600 ECC RDIMMs (96GB)
3x GTX 1080Ti
Triple-Seat Virtualized With VGA Passthrough (KVM)
jayjay1986
New Member
  • Total Posts : 9
  • Reward points : 0
  • Joined: 2015/02/11 06:05:14
  • Status: offline
  • Ribbons : 0
Re:EVGA Classified SR-2 - BIOS A58 Released 2015/07/13 01:14:38 (permalink)
where on the mobo is a connnector for extra power for the ram ?
--JR--
New Member
  • Total Posts : 1
  • Reward points : 0
  • Joined: 2015/09/23 20:02:38
  • Status: offline
  • Ribbons : 0
Re:EVGA Classified SR-2 - BIOS A58 Released 2015/09/23 21:22:03 (permalink)

***WARNING READ THIS BEFORE YOU UPDATE***

The firmware update instructions at the top of this thread failed to mention one REALLY important detail.
 
"First go into your BIOS and load defaults, save and exit"
 
If you have hardware RAID enabled, this will disable it.  WORSE!  If you have RAID 0 and try to boot windows 7 or newer it will write to the first disk in the array and corrupt it. The last step of resetting the BIOS and rebooting will do the same too.
 
Just lost my 6TB raid set thanks to these instructions.    This really choked me!
 
 
cuda-dude
New Member
  • Total Posts : 91
  • Reward points : 0
  • Joined: 2014/08/10 00:38:14
  • Status: offline
  • Ribbons : 1
Re:EVGA Classified SR-2 - BIOS A58 Released 2016/03/08 22:23:15 (permalink)
Anyone got a working link to the last bios, the one on the first page is no good and I have lost the file.
Thanks!

EVGA Sr-2 w58 bios
xeon x5690 x 2
evga GTX 780 ti Kingpins  x4 sli
clocked on H20 to 4.3
48 gig Corsair 1600 ram
Geekbench 34475 Windows 8.1 x64
Geekbench 36660 Linux Generic Kernel x64
3Dmark 11 Performance  26393  #1 x5690 Record
3Dmark Fire Strike Extreme  14775
3Dmark Fire Strike Ultra     10953
3dmark Fire Strike   25315
massdestructor
Superclocked Member
  • Total Posts : 209
  • Reward points : 0
  • Joined: 2010/05/24 14:51:38
  • Status: offline
  • Ribbons : 2
Re:EVGA Classified SR-2 - BIOS A58 Released 2016/03/12 03:17:34 (permalink)
You can download it from the evga support center:
 
http://cdn.evga.com/bios/SR2/W555_A58.zip

EVGA SR2 at 200 Bclk, default voltages
2xXeon E5645 at 3800MHz Turbo on, default voltages, 2xCoolerMaster V6GT
2x24Gb Kit GSkill Ripjaws 9-9-9-24 1600MHz  (12x4Gb)
4xZotac GTX480 Quad-SLI, default clocks and voltages
2x WD Caviar Black 2Tb 7200 RPM
Silverstone Strider ST1500W
LianLi V2120X

petauro
New Member
  • Total Posts : 26
  • Reward points : 0
  • Joined: 2016/02/06 09:07:56
  • Status: offline
  • Ribbons : 0
Re:EVGA Classified SR-2 - BIOS A58 Released 2016/09/08 01:32:33 (permalink)
Hello, I would like to reset the bios, I mean, re-install the bios but under windows 10 does not permit to me, when I click 'Y' and 'enter' (in dos window) nothing happens.
One of the two SR-2 has some bugs and I just would like to try to reinstall bios. Is there a way? Thank you.
petauro
New Member
  • Total Posts : 26
  • Reward points : 0
  • Joined: 2016/02/06 09:07:56
  • Status: offline
  • Ribbons : 0
Re:EVGA Classified SR-2 - BIOS A58 Released 2016/09/08 02:30:40 (permalink)
Done: I put the folder in C directory and ran it normally (I mean, If I 'run as administrator' it does not work...)
gordan79
SSC Member
  • Total Posts : 531
  • Reward points : 0
  • Joined: 2013/01/27 00:17:36
  • Status: offline
  • Ribbons : 3
Re:EVGA Classified SR-2 - BIOS A58 Released 2016/09/10 13:20:40 (permalink)
As a general rule, download a bootable FreeDOS image, burn it to a USB stick, copy the BIOS and the flash utility to the USB stick, reboot off the USB stick and run it from that. There are 3 separate BIOS image slots on the SR-2, selectable via the switch on the motherboard, flashing will only burn the image to the selected slot and will not affect the other 2 BIOS images.

Supermicro X8DTH-6, 2x X5690
Crucial 12x 8GB x4 DR 1.35V DDR3-1600 ECC RDIMMs (96GB)
3x GTX 1080Ti
Triple-Seat Virtualized With VGA Passthrough (KVM)
sl1pkn07
New Member
  • Total Posts : 34
  • Reward points : 0
  • Joined: 2014/07/14 02:12:08
  • Location: Spanishtán
  • Status: offline
  • Ribbons : 1
Re:EVGA Classified SR-2 - BIOS A58 Released 2016/09/13 08:22:23 (permalink)
I have updated my SR-2 with a Titan X (maxwell) for KVM, and Titan Black for host (i also use linux and KVM with VGA passtrougth)
 
at the moment , no issues
 
have a 48G Gskill Riphaws @1600 and dual xeon [link=mailto:x5650@2.72]x5650@2.72[/link] (for can use the memos at 1600)
 
also have a LSI 9240-i8 (5 disk at the moment. JBOD, no raid), and installed today a Dell PERC H200 for the SSD for host and SDD used by the guest (Win 10), and one normal HDD and one BR-DVD unit. both controllers only for host (zero units/controllers passtroughted)
 
greetings
post edited by sl1pkn07 - 2016/09/13 08:25:16
gordan79
SSC Member
  • Total Posts : 531
  • Reward points : 0
  • Joined: 2013/01/27 00:17:36
  • Status: offline
  • Ribbons : 3
Re:EVGA Classified SR-2 - BIOS A58 Released 2016/09/13 11:20:05 (permalink)
My experience is that with PCI passthrough enabled, the whole machine will lock up solid within minutes of a VM with a PCI device assigned starting up if you have a SAS controller attached. Either that, or it won't even get that far. With LSI controllers, I was finding disks not showing up when intel_iommu kernel option is enabled. Adaptec was, IIRC, worse. 3ware did the best of the lot in that the driver didn't panic immediately, the disks showed up, but as described above, would result in the whole machine locking up within minutes of a VM with a PCI device assigned starting up.
 
The IOMMU operation with the Nvidia NF200 PCIe bridges is very badly broken. It's a chipset bug, and affects all motherboards that use it. Some motherboards have NF200 only behind some of the slots, so only those slots are affected, but on the SR-2, all 7 slots are connected to NF200 bridges.

Supermicro X8DTH-6, 2x X5690
Crucial 12x 8GB x4 DR 1.35V DDR3-1600 ECC RDIMMs (96GB)
3x GTX 1080Ti
Triple-Seat Virtualized With VGA Passthrough (KVM)
Page: < 1234 Showing page 4 of 4
Jump to:
  • Back to Mobile