[Feature]: mutiple GPU = total VRAM

Problem or motivation

Hi,

I have 2 GPUs, 5090 and 5080, and I run inferences with the total VRAM. I see who is not counted and does not limit itself to a single GPU.

Proposed solution

Calculate the total VRAM + propose the llms that are capable of being played

Alternatives considered

No response

Feature area

Hardware detection (new GPU vendor, new hardware type)

Would you be willing to contribute this?

No, just suggesting

Additional context

No response