So, after days of troubleshooting I got this stupid **** figured out. It's a power management issue with in Nvidia's Software.
Right Click on the Desktop, Go to Nvidia Control Panel, Go to Mange 3D Settings, go to power management mode and change it to "prefer maximum performance". In Optimal, it's actively adapting the power and I guess it hiccups, it under powers the card and the card activates it's fail safe. Which is black screen, fans 100%.
2 days now, and the card is stable. This is over the course of 3 hours of SimCity, and 2 hours of BF4. Both games running @ 4k, ultra.
EDIT: Jinxed myself, loaded up MW2 and the card just did the same thing. I guess it's going back :(