Clock your memory back down to 2000Mhz and verify that it will cold boot properly again.  Then, adjust (loosen) the latency timings to see if that helps with the 2400Mhz overclock.  And you may need to change the Command Rate to 2T.

luckystrikes123
Thanks.
Confirmed cold boots at stock timings 11-13-13-31 @ 2000mhz 1.65v
I had it running at 2400mhz w/ 11-13-13-33 but would not cold boot. Not sure which timings I should be adjusting first.

Is your LN2 Switch On?
What is the Model Number of your Corsair Vengeance Memory?

Did you try 2T command rate?  And I'm assuming you have the latest BIOS update R22 (3-13-2013)?
 
Lastly, try running 2400Mhz with just two sticks.

Try setting VCCSA & VCCIO to 1.3v. 

I can try pulling 2 sticks out since I never get anywhere near 32gb usage and try with the same settings and a cold boot. It's just a little baffling because I can set them to 2400, boot to windows and be fine for days. However, if I shut completely down it wont reboot.

Iluv2raceit

luckystrikes123
I can try pulling 2 sticks out since I never get anywhere near 32gb usage and try with the same settings and a cold boot. It's just a little baffling because I can set them to 2400, boot to windows and be fine for days. However, if I shut completely down it wont reboot.

What BIOS version do you have loaded?  R22 improved 2400Mhz DDR3 support ;-)

R22 all the way. I believe that's how I was able to use 3rd gen cpu as well :)

So unfortunately I have to report back some failure. 
 
The first thing I did was pull out 2 sticks, leaving only dimms 1 and 3 in. So now I'm at 16gb to rule out any 4 dimm issues.
 
I posted 2000mhz 11-13-13-31 1.65 no issue. Shut down, restarted. No issues.
I bumped to 2133mhz 11-13-13-31 1.65 beep beep beep
I adjusted to 2133mhz 11-13-13-33 1.65 boots, but wont boot from cold
I then adjusted the vccio to 1.3v as suggested, reset to 2133mhz 11-13-13-33 1.65 boots, but wont boot from cold
Note: my mobo doesn't have a vccsa setting that I could locate anywhere throughout the bios.
For the heck of it I tried 2400mhz (my goal) 11-13-13-33 1.65 boots, but wont boot from cold
XMP just plain doesn't work. I wish it did. 
 
vcore is still 1.35 and cpu multiplier is set at x44 (4.4ghz)
 
I'm wondering if it's timings. Where should I go from here? 

Here are my available and current settings:
vCore 1.35
VDimm 1.65
DIMM DQ Vref +0mv
VCCIO 1.3
PLL Vcore 1.8
VCC 1.05 PCH
PWM Frequency 800KHz

Sajin
Looks like your IMC just can't do 2400. Only things left to try would be to...
 
#1 Try relaxing timings.
#2 Try 1.7v on vdimm.
#3 Try 1.35v on the vccio.
 

Sajin's suggestion is the most logical to try.

I'd start by adjusting the tCL (cas latency) first.

I'm at 2133mhz 11-12-12-32 now. I don't think 2400 stable is going to happen. 
 
Thanks all for your help!