Info on X299 Dark overclocking with example build.
Please help with questions at end.
Suggestions welcome.
# indicates later post with more info.
 
Refer
Kingpin Dark Guide
Intel Skylake-X Data Sheet
Intel Skylake-X Spec Update
Mesh Network Theory
Mesh Network Die Analysis
 
Goal
Stable overclock for creative/scientific/deep-learning workstation.
 
Status
4.5Ghz All 18 Cores Constant
3200 DDR4 16-18-18-36 Full Speed
Mesh Ratio 30
~82C @ Prime95 56K load
Confirmed Stable Non-AVX (AVX Testing Later)
Evaluating candidate final stable configuration with case, Titan V, and 3600 16-18-18-36 memory overclock. #75
Also AMD Radeon WX Pro 7100 in tandem with Titan V. #90
Evaluation has lasted for 18 months in regular use without issues. #92
 
Build
X299 Dark On Included Bench Stand
EVGA Supernova 1200 P2 (Eco Mode ON)
7980XE (delid, 4.3Ghz bin)
EVGA CLC 280 (USB to USBHDR1/2, Block Pump Fan Cable To CHA_FAN, Radiator Fans Direct To CPU1_FAN And CPU2_FAN)
Corsair Dominator 3200 64GB CMD64GX4M4C3200C16
Samsung 960 Pro 1TB (Slot PM1)
EVGA 1080 TI Kingpin (Slot PE1; Tentative, Titan V Later)
Gigabit Ethernet To Intel i219 NIC
Thermal Grizzly Conductonaut Between IHS and CLC Waterblock #31-35
 
BIOS
1.06 (on BIOS2)
Vcore: Override 1.175
CPU Multiplier: 45x
AVX2 Negative Offset: -4 (Untested)
AVX3 Negative Offset: -6 (Untested)
Memory: XMP Profile 1 (DDR4-3200 16-18-18-36-1.35V)
VCCIO: 1.166
 
OS
Windows 10.0.16299.192
 
Driver
NVIDIA Driver 388.71
Default Windows NVM Driver
 
Software
MemTest86 7.4 (USB Bootable)
EVGA Flow Control 2.0.4.0 (Firmware Version 2.10.0.0) (see Note)
HWiNFO64 5.7-3300
Prime95 29.4,build 5 #44
Furmark 1.19.1.0
Iometer 1.1.0 (#18)
 
Config
Nvidia Global 3D Settings Power Management Mode = Prefer maximum performance
Windows Power Plan = High Performance
 
Note
Overnight Prime95 8-4096 FFT in-place 5 minutes per test pass (two times through all tests).
 
HWiNFO64 observes 14C+ delta between heavily loaded hottest/coldest cores.
 
HWiNFO64 confirms intended frequency drop when AVX enabled in Prime 95.
--
Disable AVX in Prime95 with these entries BEFORE [Worker #1] line in local.txt configuration file:
CpuSupportsAVX=0
CpuSupportsAVX2=0
CpuSupportsAVX512F=0
---
CPU clocks down to AVX2 offset, not AVX3 (AVX-512) offset when Prime95 running without AVX disabled.
 
Running cooler radiator fans on high load drops CPU temp 12C immediately.
Coolant temperature does not immediately respond.
EVGA Flow Control shows fluid temp TO radiator, not FROM radiator.
Activating fans may drop fluid temp FROM radiator to CPU, which coolant temperature sensor does not register.
 
BIOS provides better fan control than EVGA Flow Control. #30
EVGA Flow Control fan curve maximum too limiting for Skylake-X.
Wired CLC pump to CHA_FAN for pump power.
Wired CLC radiator fans to CPU_FAN1 and CPU_FAN2.
Running stock SMART profiles based on CPU temp in BIOS for radiator fans.
 
Topic
Titan V Needs Companion Video Card - if compute matters #89
AMD WX Pro 7100 Works As Companion - handles displays while Titan V computes #90
X299 Dark LED Behavior Chart - what turns on when building #91
Choosing Good Ram - frequency/latency matters, charts provided #83
Tentative Benchmarks - results close to final CPU & GPU overclock #60-61
Liquid Metal Application - enabled 45X CPU multiplier overclock thermals. #31-35
Phantom Throttling - detected when increasing Mesh Ratio to 32 from default 30 #50
WHEA CPU Internal Parity Error -  indicated overclock instability at 45X CPU multiplier #57
BIOS Default Stock Testing - observation from Furmark crash troubleshooting #59
Dark BIOS 1.05 Issues - not supporting XMP and memory overclocks #74
Mesh Ratio Overclock Troublesome - better to focus on CPU and memory overclocks #75
Titan V And Kingpin 1080 Ti Direct Comparison On Same Board Simultaneously
Dark Case Mounting Challenge - VRM heatsink gets in way #4-8
Professional Workstation Benchmarking - using SPECwpc #76
Use Samsung NVMe Driver - Standard Windows NVMe driver terrible write speed #77
SSD Firmware Matters - slight performance differences in firmware for SSD #78
Disabling Fast Startup - optional, read to find out if you want to (link courtesy EVGA tech support)
Extend/RAID M.2 - not tested (don't boot RAID, boot M.2 slot PM1, project data on RAID PCIe M.2 card if needed)
Intel Optane PCIe SSD has best 4K random read though - from this thread #26, but thread is tedious.
Mod CLC 280 To Push/Pull - extra fans drop temps; improve sound.  Alternative to custom loop. #82
 
 
Open Question
Hypothesis on fan activated CPU temp drop without coolant temp drop accurate?
What is difference between Intel i219 and i210 NIC?
How to test AVX-512? 
Why 14C+ delta between heavily loaded cores?
Can anything fill RAM faster or test mesh ratio better than Prime95? #55
 
Closed Question
Why must EVGA Flow Control run for fans to follow curve? Shouldn't curve write to firmware on click Apply? #19
Why does HWiNFO64 hang on startup without SMBus disabled? #20
Why 23C delta between heavily loaded cores?  #2-12,21,24
 
Change
2018.02.03 - Updated 4.5Ghz overclock.  Previous 4.3Ghz overclock info moved to #42.

Over the years with all of the Intel CPUs that I've had, an 8 to 10C temperature difference on loaded cores is normal (soldered or non-soldered chips). 23C seems a bit extreme. Maybe the TIM replacement wasn't evenly applied?
 
Or perhaps your CPU cooler's cold plate is warped slightly?

geninfo can you post a picture of the setup?
 
Was wondering how your cooler was sitting in regards to the cpu / pump unit

GGTV-Jon
geninfo can you post a picture of the setup?
 

 
CPU/CLC setup and thermal paste patterns: https://imgur.com/a/6SGLr

geninfo

GGTV-Jon
geninfo can you post a picture of the setup?
 

 
CPU/CLC setup and thermal paste patterns: https://imgur.com/a/6SGLr

2 suggestions - make sure the return / feed line from the radiator to the pump is on the bottom (I do not know which one is which on the CLC) to insure no air being pumped through the pump / cooler and wouldn't it be better to have the entire IHS be covered by the TIM you are using?

GGTV-Jon
 
2 suggestions - make sure the return / feed line from the radiator to the pump is on the bottom (I do not know which one is which on the CLC) to insure no air being pumped through the pump / cooler and wouldn't it be better to have the entire IHS be covered by the TIM you are using?

Return/feed line already at top bottom based on infrared thermometer measurements at line connection point to radiator and top/bottom radiator itself.  Good tip!
 
Thermal paste came pre-applied to EVGA CLC 280 cooler in center circle as depicted.  Don't know if entire IHS coverage better because IHS covers more area than CPU - circle may already cover full CPU?  A 79xx chip delid (7980XE?):
 
https://cdn.wccftech.com/wp-content/uploads/2017/09/Intel-Core-i9-7980XE_3DMark-Firestrike-Physics-Score_2-654x740.png
 
Waiting for thermal paste cleaning solutions to try Thermal Grizzly Kryonaut.  Difficult to find proper application technique for full coverage (pea versus X, etc.).

arestavo
Over the years with all of the Intel CPUs that I've had, an 8 to 10C temperature difference on loaded cores is normal (soldered or non-soldered chips). 23C seems a bit extreme. Maybe the TIM replacement wasn't evenly applied?
 
Or perhaps your CPU cooler's cold plate is warped slightly?

Thanks.  I asked delid vendor about TIM replacement and if 23C seems abnormal.
 
How to tell if CPU cooler warped slightly?  I cannot find non-bulk Fujifilm pressure paper.

geninfo

arestavo
Over the years with all of the Intel CPUs that I've had, an 8 to 10C temperature difference on loaded cores is normal (soldered or non-soldered chips). 23C seems a bit extreme. Maybe the TIM replacement wasn't evenly applied?
 
Or perhaps your CPU cooler's cold plate is warped slightly?

Thanks.  I asked delid vendor about TIM replacement and if 23C seems abnormal.
 
How to tell if CPU cooler warped slightly?  I cannot find non-bulk Fujifilm pressure paper.

I don't think warpage will be a concern with your cooler. My personal thoughts are to just cover the whole dam IHS - the more surface contact area to the cold plate the better. I am actually surprised you are not going with LM at this point
 
From the video I saw over at Gamers Nexus where they were looking at AMD chips with HBM memory / contact footprints it looked like he had a pack with a bunch if sheets - might be the only way to get it

Return/feed line already at top based on infrared thermometer measurements at line connection point to radiator and top/bottom radiator itself.  Good tip!

 
Was / Is it at the top of your radiator with it on the side as in the picture or was that a typo and you meant bottom where you want it?
Perhaps just elevate the other end so any air bubbles get trapped in the end tank and not able to pass through the hoses
 

GGTV-Jon
 
I don't think warpage will be a concern with your cooler. My personal thoughts are to just cover the whole dam IHS - the more surface contact area to the cold plate the better. I am actually surprised you are not going with LM at this point
 
From the video I saw over at Gamers Nexus where they were looking at AMD chips with HBM memory / contact footprints it looked like he had a pack with a bunch if sheets - might be the only way to get it

Thanks.  Will try full IHS coverage.  You would go liquid metal between IHS and cooler?  Not just under IHS?  I'm willing to try with Thermal Grizzly Conductanaut once Newegg stocks.
 
I also became aware of paper at Gamers Nexus, but I can only find $500 bulk rolls online.