Welcome to the forums!
 
If those speeds are what you see at the desktop, then you likely have a web browser open that supports hardware acceleration - close it out and see if the clock speeds drop. Another possibility, if the GPU use % is high while sitting at the desktop, is that you have a virus / bitcoin miner installed on your system.
 
Another possibility is that you have a 144 Hz monitor running at 144 Hz at the desktop. It's a known bug (for a VERY long time now, and Nvidia isn't fixing it) that keeps the GPU clock speeds high when at 144 Hz. Simply set the desktop to run at 120 Hz and the GPU speeds should drop at the desktop, and when in games set the refresh rate to 144 Hz.
 
What temperature does your GPU get to when playing games?

Does taking the side of your case off lower the GPU temp a good bit?
 
And what is the GPU use % when just sitting at the desktop?

Well, if a fan (or fans) is stopped from spinning due to something getting in the way, or the decreased airflow in that top spot...
 
Check to see if the fans are indeed spinning. If they are, then the problem likely lies with the decreased amount of air available in the top slot. Put it back in that other slot and test again.

Changing the slot didnt help change the gpu clock but now the temp stays low so thats good.