[FEATURE_REQUEST] Service Tier Support for Openrouter, Google, OpenAI
Have you searched for similar requests?
Yes
Is your feature request related to a problem? If so, please describe.
No response
Describe the solution you'd like
Simple feature request to have a configuration option to defined the service tier passed to OpenRouter, Google, or OpenAI. I would envision it as a dropdown input in the connection profile.
https://openrouter.ai/docs/guides/features/service-tiers documents how to set it for OpenRouter and links to documentation regarding Google's and OpenAI's pages on the feature.
VertexAI https://docs.cloud.google.com/vertex-ai/generative-ai/docs/flex-paygo https://docs.cloud.google.com/vertex-ai/generative-ai/docs/priority-paygo
Gemini https://ai.google.dev/gemini-api/docs/flex-inference https://ai.google.dev/gemini-api/docs/priority-inference
OpenAI https://developers.openai.com/api/reference/resources/chat/subresources/completions/methods/create#(resource)%20chat.completions%20%3E%20(method)%20create%20%3E%20(params)%200.non_streaming%20%3E%20(param)%20service_tier%20%3E%20(schema) https://developers.openai.com/api/reference/resources/responses/methods/create#(resource)%20responses%20%3E%20(method)%20create%20%3E%20(params)%200.non_streaming%20%3E%20(param)%20service_tier%20%3E%20(schema)
Describe alternatives you've considered
No response
Additional context
Able to test for OpenRouter, not for direct APIs.
Priority
Medium (Would be very useful)
Are you willing to test this on staging/unstable branch if this is implemented?
Yes
Source: SillyTavern/SillyTavern