Inference getting slower in large scale generation of multiple files
Author: jcvasquezcCreated Nov 12, 2025Updated Aug 27, 2026
I am currently using the multilanguage model for large scale audio generation. I observed a linear time increase during continuous calls to the model.generate(...)
I think the error is related to cache accumulation in T3 and the alignmet_stream, but not be able to fix it.
Do anyone knows possible reasons for this and how to fix it?
Source: resemble-ai/chatterbox