So I set my new system a week ago and started noticing my gpu was running pretty hot at default settings while playing Wolcen(capping frames at 144 was getting 98% usage), and at default the temp was 82c. My case is the Lian Li Lancool2(and I know its not the greatest case for airflow), but I have it set up with 2 intakes, 1 exhaust and 2 pointed right at the gpu on the gpu shroud. So now with that set up, im getting about 76c with Heaven pushing 98% on the gpu, and slowly climbing(opening case door drops the temp by 2 maybe 3c). And at this point the fans are at 100%. I know its within limits an all, but seeing a lot of post of 60's temps makes me wonder if something my be off with mine.

Right now the fans are running at 100% at a 76-77c, so they seem to be working right. How much of a pia is it going to tear it down?
 

You can also try to open your case and see if there is any differences.
 
I know for example that asus rog strix has kind of same aircooler performance and mine worked at about 75C under 125% (330w) with closed case and coolers on auto ~60% (performance mode/ or above 85C on quiet mode).
Also I tested that with opened case and 100% fans on gpu I got 64C in furmark.
Well, that was more like open bench than an opened case :) 

 
So you should try to run your card with 100% fans and with opened case and if your temps will be higher than 70C - that will indicate some troubles with thermal interface and you should check it. If not - at least you should not remove cooler from your gpu and search something else wrong in your case setup.

Well, just put all back together(no screws left over!!!!), and its idling at 32-33c. I was idling about 40c before. Time to see how it handles a load. And yes, this is with the power slider all the way.

So.. did you disassembled your gpu? :) Or what did you "put all back together"?
UPD oh, I see now. So it was bad TIM.
 
64C on full fans with opened case seems totally legit. You can try to close case with same full fans (no curves - just full fans!) and if temp rises only to 66C-68C - well, that is kind of good too. Open case is always better than closed one.

What was so quick that I didn't even believed :)

Did you just throw some more paste on in addition to the stock paste?  Which is fine.

And I've left it running, and it keeps creeping up, 71c atm. Better than what it was I guess.

Huh, I would consider that good thick coverage, if a bit uneven.  Missing a bit on the upper left corner and it looks really thick on the right half.  
 
However, you may have had a slight, oddly shaped air pocket in the middle upper area, where you see that branching.