Do the following to get rid of the error...
 
#1 Download & Install CCleaner & Driver Sweeper 3.2.0.
 
#2 Remove all NVIDIA software from add/remove programs & Create a restore point.
 
#3 Reboot info safe mode.
 
#4  Run driver sweeper 3.2.0, check mark NVIDIA - Display & NVIDIA - PhysX, select Analyse button, if a list of entries pop up select the Clean button, when asked to reboot select Cancel. Do the scan again to make sure all entries are removed/deleted, if all entries cannot be removed/deleted please post that the entries cannot be removed/deleted along with a screenshot showing what cannot be deleted. If the entries were removed/deleted successfully continue onto the next step...
 
#5  Run ccleaner, select the registry tab, select scan for issues button, select fix selected issues button, when asked to backup the registry select "no" (we made a restore point earlier, we don't need to worry about backing up the registry entries.), select fix all selected issues button. Do the scan again to make sure all entries are removed/deleted.
NOTE: Two entries may still appear after multiple cleanings (it should be one or two and no more), this is normal and should be ignored, all other entries should be gone. 
 
#6 Delete NVIDIA GUID's using regedit. Click the start button and type regedit and hit enter. Navigate to...
- HKEY_LOCAL_MACHINE\SYSTEM\ControlSet002\Control\Video (highlight the Video key and press the delete key.)
- HKEY_LOCAL_MACHINE\SYSTEM\CurrentControlSet\Control\Video (highlight the Video key and press the delete key.)
NOTE: When deleting the video key you will be prompted with an error saying "Error deleting key, Cannot delete Video: Error while deleting key." Just ignore the error and select OK, all keys within the Video key will be deleted except for ones that cannot be deleted.
 
#7 Reboot PC.
 
#8 Perform a clean installation of video drivers.

1. Uninstall Precision X/Afterburner, make sure to select "no" to saving profiles when asked. Reboot the machine.
2. Download & save 337.88 driver to your desktop. 
3. Double click on 337.88-desktop-win8-win7-winvista-64bit-english-whql.exe located on your desktop & run the extractor.
4. Select custom advanced install, under custom installation options uncheck all options but graphics driver & physx system software, if you are using audio over HDMI please select the HD Audio driver, if you have a 3D capable monitor and would like to use 3D at some point select the 3D Vision driver also, check mark perform clean install, then click next to install the driver, reboot when asked.
5. Re-install Precision X/Afterburner, do not install both choose one or the other.

 
Report back if your issue is fixed. 
 

jacob_r_barnes12
Question: Would it be a stupid idea to just restore my PC to an earlier point altogether? As I haven't created a restore point since I got it.

No, you could try restoring your computer to an earlier point using system restore before doing the above if you have restore points available.

Disregard that last post, figured it out.

Sajin
It's recommended to not have geforce experience installed.

+1. Although NVIDIA is trying to improve the GeForce Experience it is still not optimal in my opinion.