Slow inference
Author: ban1989banCreated Mar 7, 2025Updated Jan 19, 2026
How can I make is fast. In a sentence of roughly 10-15 wrods, taking 3 sec approx. I need to get it done in 200-300 ms. Is it possible?
Source: Zyphra/Zonos
How can I make is fast. In a sentence of roughly 10-15 wrods, taking 3 sec approx. I need to get it done in 200-300 ms. Is it possible?
Source: Zyphra/Zonos