Smarter queue ETAs using request metadata
Author: dawoodkhan82Created Sep 28, 2026Updated Sep 28, 2026
Labelsenhancement
The queue already shows ETAs and queue position. We could make ETAs more accurate by using more metadata than the average of past run durations.
Ideas
- Condition on input size or parameters (e.g. number of steps, resolution, audio length)
- Take the hardware and the current concurrency into account
- Allow developers to supply an ETA hint from their function
Also make sure computing ETAs adds no noticeable overhead to the queue.
Source: gradio-app/gradio