#853·web-llm

Exposing a compatible interface for Chrome Built-in AI (Prompt API) / Polyfill

Author: timothy-jeongCreated Sep 3, 2026Updated Sep 14, 2026

Hi team, thanks for the amazing work on Web-LLM! With Google recently introducing the Chrome Built-in AI (Prompt API, often discussed as window.ai), browser-native AI is getting a lot of attention. While Chrome utilizes its internal ML stack and Gemini Nano, I am curious if Web-LLM has any plans to provide an API adapter or polyfill that aligns with the Chrome Prompt API standard.

Why this would be useful? If Web-LLM exposes a compatible interface (e.g., matching the window.ai spec), web developers could write their logic once against the standard API. They could then seamlessly use Web-LLM as a fallback for browsers that don't natively support Built-in AI (like Safari/Firefox), or simply use it when they want to run a specific open-source model (like Llama 3) via WebGPU instead of Gemini Nano.

Are there any ongoing discussions or roadmap plans regarding API compatibility with Chrome's built-in AI standard?

Would love to hear your thoughts!