Support running eval scripts on multiple GPUs

I'm starting to implement benchmarking scripts directly in this repository for reproducibility. We should support running them on multiple GPUs when available since they take a fair bit of time to run right now.

e.g. https://github.com/vikhyat/moondream/blob/main/moondream/eval/tallyqa.py