That is just the temperatures causing slight performance loss on the card as it heats up, it's throttling slightly to prevent overheating, which is the built in protections on the card doing it's job.
My first recommendation would be to setup a custom fan curve - the card is programmed by default to be silent, and keep the card under the "temperature target" which for Ampere I believe is 83C (pretty darn hot, imo, but also not "dangerous" since the Die can handle up to something like 92C before hard throttling or shut down). Use Afterburner or Precision X1, turn the fans up 10% at a time until they get "too loud" for the noise level you like. Once you get to that, turn them back down until it's no longer annoyingly loud, by about 5% at a time. Whatever % you end up at should be your maximum fan speed in your curve.
Then you just set it up to run at say 30% at lower temperatures, ramping up to whatever maximum speed you came up with at 55C - this will allow the card to run it's fans as fast as you'd like them to go (noise wise) and keep itself cooler, probably by a fair bit, compared to the stock fan curve, which likely tops out at something like 55%, for the sake of noise.
If you don't care about noise at all, do what I did with my 3080 FTW3 Ultra when I had it. First step in the fan curve was 50% at 30C, 80% at 55C & 100% at 70C.
This will most likely help with your vRAM temps as well, just keep in mind, the 3090 has VRAM chiplets on both sides of the PCB, it's likely the ones getting hottest are on the back. As far as the VRM temp goes, those will likely go down once you fix the fan curve to be more aggressive.
You can always do what I did, find a PCB shot of the backside of the 3090 FE, and position heatsinks over the areas of the backplate that have them behind it... or just get thermal pads, pop the backplate area off & put them on thermal pads directly on the vRAM chips:
https://forums.evga.com/3090-Kingpin-Get-that-backside-VRAM-cool-Also-Thermal-Pad-size-backplate-side-m3219773.aspx