Google TPU support in verl with Ray

Feature request

I'm interested to see if we can add TPU support in verl. I saw an issue from last year indicating it's not supported.

Ray has made some significant strides in the past year to improve TPU support and TorchTPU is actively being developed at Google. I'd like to understand what the gaps are to bring TPU support into verl with Ray. I'm also happy to help contribute.

PR tracker:

• https://github.com/verl-project/verl-hardware-plugin/pull/18
• https://github.com/verl-project/verl/pull/7849

Motivation

Ray is improving TPU support and would be great if verl can also support TPUs when using with Ray.

Your contribution

Happy to submit or review PRs.