https://www.resetera.com/threads/msi-afterburner-can-now-display-per-process-vram.291986/
Install this file for afterburner and it'll give you a better indication of what's being used. From what I'm told actual usage is nearly impossible to work out, but that's much closer than allocation.