better Double that figure & then maybe add some more
NVIDIA's latest desktop workstation has four 80GB GPUs(excerpt)
The DGX Station A100 doesn’t make its data center sibling obsolete, though. NVIDIA announced today that the standard DGX A100 will be sold with its new 80GB GPU, doubling memory capacity to 640GB per system. An upgrade option will also be available for customers who have already purchased the DGX A100 with four 40GB A100 cards (320GB). NVIDIA hasn’t disclosed any pricing for its new enterprise-grade hardware, but for context, the original DGX A100 launched
with a starting sticker price of $199,000 back in May.