Show per-GPU RAM

[almson]

Adding up GPU RAM on a host is almost never useful. The useful metric is always per-GPU RAM. Don't add per-GPU RAM as a separate column. Just replace the current one.

[kmulka-bloomberg]

@almson Personally I think it is useful to see both.

[MHillier98]

I'd like to be able to see how much VRAM each GPU has as well!

[daroczig]

We have been collecting that info (and much more after actually starting the machines and running HW inspection tools, so publishing e.g. actual BIOS and firmware version of the GPUs and CPU L1/L2/L3 cache amount) and made it available at sparecores.com/servers for free via our open-source ETL/inspection tools and web frontend. You can also grab the SQLite database for more detailed lookups or hit our APIs.

Example screenshot:

This is filtered for cloud servers across cloud providers with at least one GPU with 32 GiB memory. Direct link to this search: https://sparecores.com/servers?gpu_memory_min=32&order_by=min_price&order_dir=asc&columns=300776