haskellcurrying
New Member
- Total Posts : 11
- Reward points : 0
- Joined: 2018/02/27 14:51:22
- Status: offline
- Ribbons : 0
Howdy all, Are there _any_ 32GB (or greater) per stick modules that work on the Dark? I do compute stuff with really large data sets and will regularly swap with 128GB of ram (thank Intel/Micron for Optane). I'll buy whatever might unofficially be known to work and wont ask for support! I'm not trying to be daft or a bummer, I've definitely read the spec and realize that officially it is a no go, but I also know these sorts of thing are way less cut and dry than that. Perhaps during testing you noticed one type of module worked while others did not? I know y'all are likely thinking I should just go elsewhere, but I'm also in a different sort of tight spot when comes to finding the right board (It's replacing the crazy awesome Asus x99-WS/IPMI that just went toast). I currently use/need five PCIe x8 slot to house my compute cards (32GB dual Polaris, Radeon Pro Duo). Not great for gaming or mining, but 160GB of vram goes a long way! The cards themselves each have PCIe routing (PLX) module on board, and don't take kindly to being daisy chained to other PLX modules (something about the timing and topological asymmetry just don't mix). So all the boards with tons of slots like the Asus x299 Sage generally don't play nice. Even boards like ASRock x299 OC, which is similarly configured to the Dark, and doesn't employ PCie routing, straight up fail to boot with more than 3 cards in place. Anyway, I am currently waiting for a used x99 Classified to show up (has a PCH PCIe 2.0 x4 slot, instead of the PCH PCIe x2 slot of like my former Asus board had), and figured that it might be time to finally upgrade my CPU to one of those fancy i9-7980XE or Xeon-W 2195. Sorry for the long post! P.S. : I could go dual CPU, but the thing that houses all these cards is pretty custom at this point and I don't want to go rebuilding it. P.P.S. : In case you're wondering why I don't use those mining usb thingy-s... I'm not really interested in running my cards at 1x, but even if I were willing to take the bandwidth hit, ROCm is a no go without native PCIe 3.0 instructions/atomics.
post edited by haskellcurrying - 2018/02/27 16:10:45
|
GB_Longshanks
Superclocked Member
- Total Posts : 101
- Reward points : 0
- Joined: 2018/02/07 06:55:16
- Status: offline
- Ribbons : 0
Re: X299 Dark Memory Support
2018/02/27 17:10:17
(permalink)
☄ Helpfulby haskellcurrying 2018/02/27 17:29:18
If you are doing large amounts of compute I would recommend going Xeon with ECC ram. I just ordered the x299 sage mainly due to the fact it has dual PLX chips for pci-e routing. The 7980XE is really nice however, with that type of setup the only motherboard available is the x299 sage. You need lots of PCI-E ports and with that much data handling I wouldn't go anything but workstation/server class components across your build. The issue with the sage, dark, etc. all of these will not take ECC ram. They are workstation/sort of server boards but they aren't meant to be xeon/server grade. You may want to also check and see if Dell or Boxx Tech has a solution for you where you can add-in your cards. Boxx especially has specialized systems that will handle that sort of work load. Also depends on how much budget you have. These types of components are extremely expensive. I would look into this with dual xeons and ECC ram https://www.asus.com/us/Motherboards/WS-C621E-SAGE/
|
haskellcurrying
New Member
- Total Posts : 11
- Reward points : 0
- Joined: 2018/02/27 14:51:22
- Status: offline
- Ribbons : 0
Re: X299 Dark Memory Support
2018/02/27 17:29:01
(permalink)
Hey! Thanks for taking the time to respond! I've touched on both suggest options in my OP: I've tried the X299 Sage, it doesn't play nice. The dual PLX modules that give it all those PCIe lane double up with the ones already on the GPUs resulting in instability and driver problems! 5x8 = 40, so I should not need to used them anyway, they are just overheard. I also really want to keep this things 1P. I liquid cool and would have switch out the AIO cooler for a two smaller AIO coolers and then replace my case with one that support the full length E-ATX, unlike the stubby E-ATX that is the Dark. I'd also have to get a second PSU, not to mention all the mods I had to do to get the 5 cards to fit would have to be recreated in the new case. it's not as simple as it just switching the boards out. As for ECC, I agree and I currently use two sweet Samsung made M393A8K40B21-CTC ECC LRDIMMs, but they did not post on the ASRock x299 OC, so I have a feeling that the same will happen here, the i9 likely won't play ball. At this point my priority is to get the cards running on whatever will support them and 128GB of ram. If I have to get that working without ECC, my plan is to implement the ostrich algo and hopefully nothing blows up in my face.
post edited by haskellcurrying - 2018/02/28 01:59:01
|
geninfo
Superclocked Member
- Total Posts : 191
- Reward points : 0
- Joined: 2017/12/18 11:22:15
- Status: offline
- Ribbons : 2
Re: X299 Dark Memory Support
2018/02/27 19:33:35
(permalink)
☄ Helpfulby haskellcurrying 2018/02/28 02:00:34
GB_Longshanks
If you are doing large amounts of compute I would recommend going Xeon with ECC ram.
Are you actively monitoring for ECC errors? If not, you don't need ECC because you aren't taking data corruption seriously enough to warrant having it and that's worked for you so far. :)
|
bcavnaugh
The Crunchinator
- Total Posts : 38977
- Reward points : 0
- Joined: 2012/09/18 17:31:18
- Location: USA Affiliate E5L3CTGE12 Associate 9E88QK5L7811G3H
- Status: offline
- Ribbons : 282
Re: X299 Dark Memory Support
2018/02/27 19:51:35
(permalink)
Or Mirroring The Memory, this requires ECC Memory.
post edited by bcavnaugh - 2018/02/27 20:01:55
|
bcavnaugh
The Crunchinator
- Total Posts : 38977
- Reward points : 0
- Joined: 2012/09/18 17:31:18
- Location: USA Affiliate E5L3CTGE12 Associate 9E88QK5L7811G3H
- Status: offline
- Ribbons : 282
Re: X299 Dark Memory Support
2018/02/27 19:55:14
(permalink)
Or setting up Redundant Memory as this requires ECC Memory as well.
post edited by bcavnaugh - 2018/02/27 20:03:53
|
GB_Longshanks
Superclocked Member
- Total Posts : 101
- Reward points : 0
- Joined: 2018/02/07 06:55:16
- Status: offline
- Ribbons : 0
Re: X299 Dark Memory Support
2018/02/27 20:36:48
(permalink)
What is your take on the asus ws x299 sage motherboard? I Just found it in stock and was able to order it however I'm torn between that and the rampage VI. I love the look of the rampage and all the etc goodies it comes with, however the sage is workstation class plus it has dual plx chips. Im worried if I went with the rampage and not a ws class mb, I could fry it in a year due to the intense cpu and gpu rendering I will be putting the system through. Thoughts? Rampage vi stable and worthy of being used for high end workstation/DCC work?
|
bcavnaugh
The Crunchinator
- Total Posts : 38977
- Reward points : 0
- Joined: 2012/09/18 17:31:18
- Location: USA Affiliate E5L3CTGE12 Associate 9E88QK5L7811G3H
- Status: offline
- Ribbons : 282
Re: X299 Dark Memory Support
2018/02/27 21:02:43
(permalink)
Who are you asking this of? This is an EVGA Forum and this Thread is about the X299 Dark Motherboard under EVGA X299 Series Area of the Forum. So as far as your question I don't really have any Take on any ASUS Products. BTW Great User Name GB_Longshanks Though not a not a very nice King. That Question might be better severed on the ASUS Forum or you could create your Own Thread about it here in the General Hardware Area of the Forum. I would think that your question is also of Topic of "X299 Dark Memory Support" Just saying.
post edited by bcavnaugh - 2018/02/27 21:35:20
|
geninfo
Superclocked Member
- Total Posts : 191
- Reward points : 0
- Joined: 2017/12/18 11:22:15
- Status: offline
- Ribbons : 2
Re: X299 Dark Memory Support
2018/02/28 06:28:34
(permalink)
haskellcurrying
Howdy all..
You have very special setup requirements. Also appears budget not major concern. Possible approach if building with consumer parts (not custom enterprise workstation with Xeon). Dark 64GB 3600 RAM 7980XE (Delid) 4 (or 5) Titan V (Watercooled) 1 TB Samsung 960 Pro Boot Drive Highpoint PCIe M.2 Carrier Card With 4x 1TB (or 2TB) Samsung 960 Pro In RAID0 Move page file to RAID0 carrier drive. Put project data on RAID0 carrier drive. Tweak algos to work well with 64GB RAM, 48GB (or 60GB) VRAM, and super fast RAID0 M.2 SSD swap and storage. Edit: The Highpoint Carrier card needs x16 slot to get full RAID0 benefit with 4 cards. So must go with either: 2 M.2. in carrier card in 8x PCIe + 4 Titan V. 4 M.2 in carrier card in 16x PCIe + 3 Titan V
post edited by geninfo - 2018/02/28 06:32:24
|
haskellcurrying
New Member
- Total Posts : 11
- Reward points : 0
- Joined: 2018/02/27 14:51:22
- Status: offline
- Ribbons : 0
Re: X299 Dark Memory Support
2018/02/28 08:11:17
(permalink)
Howdy all! Thanks for all your replies. To chip at them as best I can: bcavnaugh
Or Mirroring The Memory, this requires ECC Memory.
bcavnaugh
Or setting up Redundant Memory as this requires ECC Memory as well.
I'm just short on options for boards and it's currently the lowest priority is ECC, if I could put a Xeon-W on an X299 board and have ECC, that would really be ideal, but no one has tried that yet. Maybe I will get a dark give it a shot, but I've tried so many boards at this point Amazon really must hate me. Plus as fun as having all this tech has been, I really would like to get back to using this machine. Those cards are getting old. GB_Longshanks
What is your take on the asus ws x299 sage motherboard? I Just found it in stock and was able to order it however I'm torn between that and the rampage VI. I love the look of the rampage and all the etc goodies it comes with, however the sage is workstation class plus it has dual plx chips. Im worried if I went with the rampage and not a ws class mb, I could fry it in a year due to the intense cpu and gpu rendering I will be putting the system through. Thoughts? Rampage vi stable and worthy of being used for high end workstation/DCC work?
I'll be short to get back on topic: From my recent experience, the two companies that make the most predictable motherboards, behavior wise, are EVGA and Asus. The X299 Sage is the best Asus has to offer with PLX modules (the X99-WS/IPMI is the best without, but I'm bias). Its thoughtfully designed and comes with the kitchen sink without feeling like any of the core feature were turned into after-thoughts. It even comes with this MOS cooling kit to stop things from getting too hot up there. The Rampage VI is a rad board and has features like DIMM.2 support that sound like they would be really cool for large workloads, but it only has a single 8pin EPS. So if you overclock a 7980XE on that board, you could be push 600w throught a single 8 pin EPS with some slightly less robust VRMs... lets call that "toasty". All that being said, really if you're not worried about the 64GB ram constrains OR if someone figures out how to get 128GB onto it because of this thread, I would say get the EVGA x299 Dark! If you haven't heard of it, its a pretty amazing board. geninfo
Dark
64GB 3600 RAM
7980XE (Delid)
4 (or 5) Titan V (Watercooled)
1 TB Samsung 960 Pro Boot Drive
Highpoint PCIe M.2 Carrier Card With 4x 1TB (or 2TB) Samsung 960 Pro In RAID0
Move page file to RAID0 carrier drive.
Put project data on RAID0 carrier drive.
Tweak algos to work well with 64GB RAM, 48GB (or 60GB) VRAM, and super fast RAID0 M.2 SSD swap and storage.
Edit:
The Highpoint Carrier card needs x16 slot to get full RAID0 benefit with 4 cards.
So must go with either:
2 M.2. in carrier card in 8x PCIe + 4 Titan V.
4 M.2 in carrier card in 16x PCIe + 3 Titan V
That's a really impressive setup! And I'd love some titan Vs, but I really am looking to keep my Radeon Pro Duos. They are clearly not fast as the titan Vs but they have ~3x the VRAM per card as a titan V, and they have almost as many cores ~4600 vs ~5100. I'm already using a Optane 900p 480GB as my my main drive and its like going to stay that way. In fact the Optane is so fast that using it with VROC actually slows it down. How wild is that? Outside of sequential throughput, it blows the high-point controller setup out of the water using only 1/4 the pcie lanes. In fact, one of the driving forces behind why I would like to move from the x99 to the x299 (or C422) platform is the move from 40 to 44 (or 48) PCIe lanes. five x8 slots for the GPUs and one x4 slot so that I can move the my Optane off the PCH and connect it directly to the CPU. I imagine I am taking a pretty real performance hit having it go through the PCH. ~~~~ Anyway, I love geeking out about computer stuff with everyone here, but can we get back to things a bit? I really just want to know if I can get 128GB or more on the X299 Dark using some of the lower ranked DDR4 RDIMMs. Maybe I can try putting a Xeon-W on the Dark? Will that even post? it's an awesome board that fits most my needs. Can someone from EVGA official chime in? Please? This whole thing is tearing me apart, Lisa.
post edited by haskellcurrying - 2018/02/28 08:28:01
|
bcavnaugh
The Crunchinator
- Total Posts : 38977
- Reward points : 0
- Joined: 2012/09/18 17:31:18
- Location: USA Affiliate E5L3CTGE12 Associate 9E88QK5L7811G3H
- Status: offline
- Ribbons : 282
Re: X299 Dark Memory Support
2018/02/28 08:15:40
(permalink)
"Can someone from EVGA official chime in? Please?" Being this is not really EVGA's Official Support and is a Public Forum you should ask EVGA Directly. I would Email Customer Service and give then your requirements and see what would be the best fit for you. Contact UsX299 Dark Memory Support ATM Memory Support – 4 DIMM Quad-Channel (up to 64GB) DDR4 4000MHz+ (SKX), 2 DIMM Dual-Channel (up to 32GB) DDR4 4133MHz+ (KBL) X299 FTW K Memory Support – 8 DIMM Quad-Channel (up to 128GB) DDR4 3200MHz+ The largest Supported Single Memory Module is 16GB https://www.evga.com/support/motherboard/ CPU Support for the X299 Platform https://www.evga.com/support/motherboard/Kaby Lake-X Core™ i7 7740X 4 Cores + HT 4.30 GHz 16 1.00 Core™ i5 7640X 4 Cores 4.00 GHz 16 1.00 SkyLake-X Core™ i9 7980X 18 Cores + HT 2.60 GHz 44 1.00 Core™ i9 7960X 16 Cores + HT 2.80 GHz 44 1.00 Core™ i9 7940X 14 Cores + HT 3.10 GHz 44 1.00 Core™ i9 7920X 12 Cores + HT 2.90 GHz 44 1.00 Core™ i9 7900X 10 Cores + HT 3.30 GHz 44 1.00 Core™ i7 7820X 8 Cores + HT 3.60 GHz 28 1.00 Core™ i7 7800X 6 Cores + HT 3.50 GHz 28 1.00
post edited by bcavnaugh - 2018/02/28 08:32:19
|
haskellcurrying
New Member
- Total Posts : 11
- Reward points : 0
- Joined: 2018/02/27 14:51:22
- Status: offline
- Ribbons : 0
Re: X299 Dark Memory Support
2018/02/28 08:33:02
(permalink)
bcavnaugh
"Can someone from EVGA official chime in? Please?"
Being this is not really EVGA's Official Support and is a Public Forum you should ask EVGA Directly.
I would and give then your requirements and see what would be the best fit for you.
Contact UsX299 Dark Memory Support ATM
Memory Support – 4 DIMM Quad-Channel (up to 64GB) DDR4 4000MHz+ (SKX), 2 DIMM Dual-Channel (up to 32GB) DDR4 4133MHz+ (KBL)
X299 FTW K
Memory Support – 8 DIMM Quad-Channel (up to 128GB) DDR4 3200MHz+
The largest Supported Single Memory Module is 16GB
I might just send them an email with a link to this thread, you think they'd hate me? Also, x299 FTW K only has 4 PCIe x16/x8 slots. I know the official docs say 16GB per dimm max, but they really are taking about UDIMMs, with this caveat that X299 Dark doesn't support RDIMMs. That said, because the memory controller is built into the CPU, lots of boards that don't support RDIMMs or don't support high ranked RDIMMs actually work with them just fine. Technically speaking, the ram I was using in my X99-WS/IMPI was not officially support, but it worked and even OCed to 2800 or 3000.
post edited by haskellcurrying - 2018/02/28 08:39:41
|
bcavnaugh
The Crunchinator
- Total Posts : 38977
- Reward points : 0
- Joined: 2012/09/18 17:31:18
- Location: USA Affiliate E5L3CTGE12 Associate 9E88QK5L7811G3H
- Status: offline
- Ribbons : 282
Re: X299 Dark Memory Support
2018/02/28 08:37:13
(permalink)
haskellcurrying
bcavnaugh
"Can someone from EVGA official chime in? Please?"
Being this is not really EVGA's Official Support and is a Public Forum you should ask EVGA Directly. I would Email Customer Service and give then your requirements and see what would be the best fit for you.
Contact Us
X299 Dark Memory Support ATM
Memory Support – 4 DIMM Quad-Channel (up to 64GB) DDR4 4000MHz+ (SKX), 2 DIMM Dual-Channel (up to 32GB) DDR4 4133MHz+ (KBL)
X299 FTW K
Memory Support – 8 DIMM Quad-Channel (up to 128GB) DDR4 3200MHz+
The largest Supported Single Memory Module is 16GB https://www.evga.com/support/motherboard/
CPU Support for the X299 Platform https://www.evga.com/support/motherboard/
Kaby Lake-X
Core™ i7 7740X 4 Cores + HT 4.30 GHz 16 1.00
Core™ i5 7640X 4 Cores 4.00 GHz 16 1.00
SkyLake-X
Core™ i9 7980X 18 Cores + HT 2.60 GHz 44 1.00
Core™ i9 7960X 16 Cores + HT 2.80 GHz 44 1.00
Core™ i9 7940X 14 Cores + HT 3.10 GHz 44 1.00
Core™ i9 7920X 12 Cores + HT 2.90 GHz 44 1.00
Core™ i9 7900X 10 Cores + HT 3.30 GHz 44 1.00
Core™ i7 7820X 8 Cores + HT 3.60 GHz 28 1.00
Core™ i7 7800X 6 Cores + HT 3.50 GHz 28 1.00
I might just send them an email with a link to this thread, you think they'd hate me?
Also, x299 FTW K only has 4 PCIe x16/x8 slots.
I know the official docs say 16GB per dimm max, but they really are taking about UDIMMs, with this caveat that X299 Dark doesn't support RDIMMs. That said, because the memory controller is built into the CPU, lots of boards that don't support RDIMMs or don't support high ranked RDIMMs actually work with them just fine. Technically speaking, the ram I was using in my X99-WS/IMPI was not officially support, but it worked and even OCed to 2800 or 3000.
No EVGA is not going to hate you for asking, this is what they are here for. I own both the X299 Dark and FTW K Motherboards as well as the X99 Classified Motherboard.
post edited by bcavnaugh - 2018/02/28 08:41:19
|
haskellcurrying
New Member
- Total Posts : 11
- Reward points : 0
- Joined: 2018/02/27 14:51:22
- Status: offline
- Ribbons : 0
Re: X299 Dark Memory Support
2018/02/28 08:43:01
(permalink)
bcavnaugh
No EVGA is not going to hate you for asking, this is what they are here for.
I own both the X299 Dark and FTW K Motherboards.
Nice! Can you talk about the difference is quality? How are the chokes? How loud is the active cooling? Maybe want to go to Best Buy and grab some 128GB of DDR4 RDIMMs and test them out on my behalf? Ha! I'll give them an email, I just figured they monitored this forum.
|
bcavnaugh
The Crunchinator
- Total Posts : 38977
- Reward points : 0
- Joined: 2012/09/18 17:31:18
- Location: USA Affiliate E5L3CTGE12 Associate 9E88QK5L7811G3H
- Status: offline
- Ribbons : 282
Re: X299 Dark Memory Support
2018/02/28 08:46:10
(permalink)
haskellcurrying
bcavnaugh
No EVGA is not going to hate you for asking, this is what they are here for.
I own both the X299 Dark and FTW K Motherboards.
Nice! Can you talk about the difference is quality? How are the chokes? How loud is the active cooling? Maybe want to go to Best Buy and grab some 128GB of DDR4 RDIMMs and test them out on my behalf? Ha!
I'll give them an email, I just figured they monitored this forum.
You cannot buy 128GB Ram Modules from Best Buy, not sure what your intent is on the Forum. What you are asking is beyond the scope of a Desktop Motherboard and you should be looking at a Workstation Motherboard as posted above marked as Helpful with the ASUS Workstation Motherboard https://www.asus.com/us/Motherboards/WS-C621E-SAGE/ or for a Single CPU Socket https://www.asus.com/us/Motherboards/WS-X299-SAGE/https://www.asus.com/us/Motherboards/Workstation-Products/
post edited by bcavnaugh - 2018/02/28 08:58:19
|
haskellcurrying
New Member
- Total Posts : 11
- Reward points : 0
- Joined: 2018/02/27 14:51:22
- Status: offline
- Ribbons : 0
Re: X299 Dark Memory Support
2018/02/28 08:51:11
(permalink)
bcavnaugh
What you are asking is beyond the scope of a Desktop Motherboard and you should be looking at a Workstation Motherboard as posted above marked as Helpful with the ASUS Workstation Motherboard
Check this out: Find me a cooler for the LGA 3647 (that is the socket the Asus WS C621E, you suggested). I'm not trying to poke fun, seriously! There is just this one Noctua demoed that never went into production. I literally don't know how people do it. Put them in the fridge or something? I should be more honest, there are tons of server stuff that will work if you are in a U, but won't on a desktop, and a bunch of no name water-cooling stuff from overseas that comes with no warranty. Just the kind of stuff you would be fine putting on your 10K cpu. As for the X299 Sage, as mentioned above, I have owned it, doesn't work for the reasoned outlined previously.
post edited by haskellcurrying - 2018/02/28 09:00:04
|
GGTV-Jon
FTW Member
- Total Posts : 1813
- Reward points : 0
- Joined: 2017/11/25 14:11:43
- Location: WA, USA
- Status: offline
- Ribbons : 19
Re: X299 Dark Memory Support
2018/02/28 09:03:02
(permalink)
haskellcurrying
bcavnaugh
What you are asking is beyond the scope of a Desktop Motherboard and you should be looking at a Workstation Motherboard as posted above marked as Helpful with the ASUS Workstation Motherboard
Check this out: Find me a cooler for the LGA 3647 (that is the socket the Asus WS C621E, you suggested). I'm not trying to poke fun, seriously! There is just this one Noctua demoed that never went into production. I literally don't know how people do it. Put them in the fridge or something? I should be more honest, there are tons of server stuff that will work if you are in a U, but won't on a desktop, and a bunch of no name water-cooling stuff from overseas that comes with no warranty. Just the kind of stuff you would be fine putting on your 10K cpu.
As for the X299 Sage, as mentioned above, I have owned it, doesn't work for the reasoned outlined previously.
Water cooled? https://www.ebay.com/itm/Full-Nickel-High-Flow-LGA-3647-Rectangular-socket-P-Waterblock-Intel-SkylakeEPEX-/222704524010 Air Cooled http://store.supermicro.c...x11-snk-p0068aps4.html
|
haskellcurrying
New Member
- Total Posts : 11
- Reward points : 0
- Joined: 2018/02/27 14:51:22
- Status: offline
- Ribbons : 0
Re: X299 Dark Memory Support
2018/02/28 09:15:54
(permalink)
GGTV-Jon
Water cooled?
Air Cooled
You're quick! Reading the ad of that water block, you'll see that it specifically doesn't support the Asus board we are talking about, and that you should check his/her/there other ads, which all say the same thing! I was talking about that block, when I made the jab about not warrantied stuff. Water + unknown origin + 10K CPU = leaks and a bad time. And that air cooler, while that is the real real made my supermicro, it is for a server slice! it's meant to be used with the larger active cooling unit of the server rack/room, you can't just put it on a desktop board. It is barely the size of the socket, has no real heatsink and looks like it isn't even made of cooper. It is unlikely to cool 200 watts on its own. Like I said when I opened this thread, I've been down a lot of roads. This really is the best avenue I've seen. But thanks all, I really do appreciate everyone trying!
post edited by haskellcurrying - 2018/02/28 09:18:25
|
GGTV-Jon
FTW Member
- Total Posts : 1813
- Reward points : 0
- Joined: 2017/11/25 14:11:43
- Location: WA, USA
- Status: offline
- Ribbons : 19
Re: X299 Dark Memory Support
2018/02/28 09:29:11
(permalink)
haskellcurrying
GGTV-Jon
Water cooled?
Air Cooled
You're quick!
Reading the ad of that water block, you'll see that it specifically doesn't support the Asus board we are talking about, and that you should check his/her/there other ads, which all say the same thing! I was talking about that block, when I made the jab about not warrantied stuff. Water + unknown origin + 10K CPU = leaks and a bad time.
And that air cooler, while that is the real real made my supermicro, it is for a server slice! it's meant to be used with the larger active cooling unit of the server rack/room, you can't just put it on a desktop board. It is barely the size of the socket, has no real heatsink and looks like it isn't even made of cooper. It is unlikely to cool 200 watts on its own.
Like I said when I opened this thread, I've been down a lot of roads. This really is the best avenue I've seen. But thanks all, I really do appreciate everyone trying!
After posting above I did see that the supermicro was for a slim socket. I did not see that there were 2 LGA 3647 sockets - stupid intel There is a square water block from the same guy with an explicit listing for the sage " this is designed for SQUARE Socket P, as ASUS WS C621E SAGE and Intel S2600STQ" https://www.ebay.com/itm/...p2047675.c100752.m1982
|
haskellcurrying
New Member
- Total Posts : 11
- Reward points : 0
- Joined: 2018/02/27 14:51:22
- Status: offline
- Ribbons : 0
Re: X299 Dark Memory Support
2018/02/28 09:36:48
(permalink)
GGTV-Jon
After posting above I did see that the supermicro was for a slim socket.
I did not see that there were 2 LGA 3647 sockets - stupid intel
There is a square water block from the same guy with an explicit listing for the sage "this is designed for SQUARE Socket P, as ASUS WS C621E SAGE and Intel S2600STQ"
I almost got excited that they put the new ad up, but then... "PREORDER The NEW SQUARE Socket P High Flow Waterblock for Intel Skylake-EP, -EX LGA 3647 CPU Xeon Phi." Still doesn't minimize that this is an untested thing without a warranty I'd likely be one of the first to buy from eBay on 10K CPU, maybe even 2. Not going to wince a little bit at the thought of that? you are braver than I. Plus I'd have to wait 6 weeks for the honor of doing so.
post edited by haskellcurrying - 2018/02/28 09:40:40
|
GGTV-Jon
FTW Member
- Total Posts : 1813
- Reward points : 0
- Joined: 2017/11/25 14:11:43
- Location: WA, USA
- Status: offline
- Ribbons : 19
Re: X299 Dark Memory Support
2018/02/28 09:46:22
(permalink)
haskellcurrying
GGTV-Jon
After posting above I did see that the supermicro was for a slim socket.
I did not see that there were 2 LGA 3647 sockets - stupid intel
There is a square water block from the same guy with an explicit listing for the sage "this is designed for SQUARE Socket P, as ASUS WS C621E SAGE and Intel S2600STQ"
I almost got excited that they put the new ad up, but then...
"PREORDER The NEW SQUARE Socket P High Flow Waterblock for Intel Skylake-EP, -EX LGA 3647 CPU Xeon Phi."
Still doesn't minimize that this is an untested thing without a warranty I'd likely be one of the first to buy from eBay on 10K CPU, maybe even 2. Not going to wince a little bit at the thought of that? you are braver than I. Plus I'd have to wait 6 weeks for the honor of doing so.
Grrr - my fail is strong this morning There should be a note next to their "Buy It Now" button And I agree - some major bench testing of the block under pressure and possibly some heat (heat gun source) to see how it hold up for leaks prior to installing
|
Cool GTX
EVGA Forum Moderator
- Total Posts : 31001
- Reward points : 0
- Joined: 2010/12/12 14:22:25
- Location: Folding for the Greater Good
- Status: offline
- Ribbons : 122
Re: X299 Dark Memory Support
2018/02/28 12:07:39
(permalink)
OK couple of points If you want to have a conversation on High bandwidth PC setups ---> Make a New Thread in the "General Discussion" areaHome » All Forums » [EVGA General Forum] » General Discussion This is the EVGA X299 MB section of the Forums  Please restrict the Off Topic chatter The OP seems to be asking who has any experience with large sticks of RAM used Specifically on the X299 Dark --> the Topic of this thread
|
Cool GTX
EVGA Forum Moderator
- Total Posts : 31001
- Reward points : 0
- Joined: 2010/12/12 14:22:25
- Location: Folding for the Greater Good
- Status: offline
- Ribbons : 122
Re: X299 Dark Memory Support
2018/02/28 12:11:13
(permalink)
OP, When the MB mfg does not have "approved RAM" listed that meets your needs it is always best to go Directly to the RAM OEM - they may have already tested their product 
|
haskellcurrying
New Member
- Total Posts : 11
- Reward points : 0
- Joined: 2018/02/27 14:51:22
- Status: offline
- Ribbons : 0
Re: X299 Dark Memory Support
2018/02/28 12:42:04
(permalink)
Cool GTX
OP,
When the MB mfg does not have "approved RAM" listed that meets your needs it is always best to go Directly to the RAM OEM - they may have already tested their product
That's genius, but only kind of true! So If I wanted a fancy XMP UDIMM with 4000MT/s, you bet that company has tested it! That said, if I want to see if an ECC RDIMM will work on an X299 with a CPU that basically says no... less likely. I poked around and found very little otherwise that the whole thing is way more up to the board manufacturer. For example, gigabyte totally does allow RDIMM on the i9, but don't get me started on their boards.
post edited by haskellcurrying - 2018/02/28 12:49:46
|
Cool GTX
EVGA Forum Moderator
- Total Posts : 31001
- Reward points : 0
- Joined: 2010/12/12 14:22:25
- Location: Folding for the Greater Good
- Status: offline
- Ribbons : 122
Re: X299 Dark Memory Support
2018/02/28 12:53:20
(permalink)
haskellcurrying
Howdy all,
Are there _any_ 32GB (or greater) per stick modules that work on the Dark? I do compute stuff with really large data sets and will regularly swap with 128GB of ram (thank Intel/Micron for Optane). I'll buy whatever might unofficially be known to work and wont ask for support! I'm not trying to be daft or a bummer, I've definitely read the spec and realize that officially it is a no go, but I also know these sorts of thing are way less cut and dry than that. Perhaps during testing you noticed one type of module worked while others did not?
haskellcurrying
Cool GTX
OP,
When the MB mfg does not have "approved RAM" listed that meets your needs it is always best to go Directly to the RAM OEM - they may have already tested their product
That's genius, but only kind of true! So If I wanted a fancy XMP UDIMM with 4000MT/s, you bet that company has tested it! That said, if I want to see if an ECC RDIMM will work on an X299 with a CPU that basically says no... less likely. I poked around and found very little otherwise that the whole thing is way more up to the board manufacturer. For example, gigabyte totally does allow RDIMM on the i9, but don't get me started on their boards.
I am not aware of Any EVGA single CPU boards that support ECC Correct, OEM RAM companies will not waste their time testing every possible combination of RAM and CPUs not officially supported by the OEM MB mfg However, for officially supported CPUs --- I have gotten help from G.Skill before Xenon CPUs may work in some MB but the advanced features such as "ECC" and the like do Not - unless the MB is designed and built to do so
|
geninfo
Superclocked Member
- Total Posts : 191
- Reward points : 0
- Joined: 2017/12/18 11:22:15
- Status: offline
- Ribbons : 2
Re: X299 Dark Memory Support
2018/02/28 15:19:13
(permalink)
haskellcurrying
That's a really impressive setup! And I'd love some titan Vs, but I really am looking to keep my Radeon Pro Duos. They are clearly not fast as the titan Vs but they have ~3x the VRAM per card as a titan V, and they have almost as many cores ~4600 vs ~5100.
I'm already using a Optane 900p 480GB as my my main drive and its like going to stay that way. In fact the Optane is so fast that using it with VROC actually slows it down. How wild is that? Outside of sequential throughput, it blows the high-point controller setup out of the water using only 1/4 the pcie lanes.
In fact, one of the driving forces behind why I would like to move from the x99 to the x299 (or C422) platform is the move from 40 to 44 (or 48) PCIe lanes. five x8 slots for the GPUs and one x4 slot so that I can move the my Optane off the PCH and connect it directly to the CPU. I imagine I am taking a pretty real performance hit having it go through the PCH.
For Dark (or any X299), you can't do 5x GPUs x8 CPU and 1 x4 CPU for the Optane. Even though 44 PCIe lanes from CPU, 4 lanes usually go to M.2 or U.2 slot. Dark PE5 slot is 4 lanes to PCH. :( Understood Optane > Highpoint for 4K random read. Could you explain how algos you use benefit from high 4K random read? Genuine interest. Also, why more VRAM better than more processing power for you? If open new thread, please link.
|
bcavnaugh
The Crunchinator
- Total Posts : 38977
- Reward points : 0
- Joined: 2012/09/18 17:31:18
- Location: USA Affiliate E5L3CTGE12 Associate 9E88QK5L7811G3H
- Status: offline
- Ribbons : 282
Re: X299 Dark Memory Support
2018/02/28 15:34:43
(permalink)
Starting to sound more like the making of a Mining Rig.
|
haskellcurrying
New Member
- Total Posts : 11
- Reward points : 0
- Joined: 2018/02/27 14:51:22
- Status: offline
- Ribbons : 0
Re: X299 Dark Memory Support
2018/02/28 19:49:55
(permalink)
bcavnaugh
Starting to sound more like the making of a Mining Rig.
A bespoke built, mid tower, desktop size, 20 Core 1P, 128GB of RAM, 480 GB Optane primary, 4TB of SATA SSD RAID0, 5x dual GPU cards that have 32GB of vram per card _and_ are single rear blower cooled, electrically wired to the CPU by x8, topologically symmetric, .... mining rig? ....hahahhahahahahahahahahahahahahahahahahahahahahahahahaha. You literally don't know the first thing about _ HPC or mining _ expect maybe that both uses GPUs. It would take like 10 years for the ROI on that thing. Sure, I'm a computer scientist and a bit of a geek, so I got carried away when I built this thing, but seriously, what gives? I've been incredibly thankful and receptive to everyone who responded with any kind of input. No one could help, I get that, but there really is no need to get all sour grapes on me. Anyway, thanks again everyone for your help, I do appreciate it! 'til the next build!
|
bcavnaugh
The Crunchinator
- Total Posts : 38977
- Reward points : 0
- Joined: 2012/09/18 17:31:18
- Location: USA Affiliate E5L3CTGE12 Associate 9E88QK5L7811G3H
- Status: offline
- Ribbons : 282
Re: X299 Dark Memory Support
2018/02/28 20:31:49
(permalink)
That's OK, I will keep my 30 Years in Computer World at Bay. The comment was to the Post above me by geninfo with this; "For Dark (or any X299), you can't do 5x GPUs x8" Not at your requirements or needs.  <=  (Enthusiasts, Gamers, and now Miners) (Not Really Computer & Rocket Scientist)) Although I did support Rocket Scientists and Engineers for 17 Years. Computer or Rocket Scientist and or Engineers are all the same they are just Scientists or an Engineer. Maybe you should take a look at Cloud HPC.
post edited by bcavnaugh - 2018/02/28 20:50:45
|
haskellcurrying
New Member
- Total Posts : 11
- Reward points : 0
- Joined: 2018/02/27 14:51:22
- Status: offline
- Ribbons : 0
Re: X299 Dark Memory Support
2018/02/28 23:19:34
(permalink)
Well look at that, I'm going to have to wipe this egg off my face now, aren't I? I do apologize! bcavnaugh
That's OK, I will keep my 30 Years in Computer World at Bay.
The comment was to the Post above me by with this; "For Dark (or any X299), you can't do 5x GPUs x8"
Not at your requirements or needs.
<= (Enthusiasts, Gamers, and now Miners)
(Not Really Computer & Rocket Scientist))
Although I did support Rocket Scientists and Engineers for 17 Years.
Computer or Rocket Scientist and or Engineers are all the same they are just Scientists or an Engineer.
Maybe you should take a look at Cloud HPC.
|