[Bug]: Missing clicks
Author: NiksaSprintingCreated May 13, 2025Updated Sep 17, 2026
LabelsBug
Version
v0.1.1
Model
UI-TARS-1.5-7B
Deployment Method
Cloud
Issue Description
OS Windows 11
I gave a seemingly simple command to open a web page and switch tenants (and later to try to log in). You can see on the screenshot below that it notices the option and is trying to click it - but it's using wrong coordinates every time.
Click coordinates from the screenshot: click(start_box: [0.07375776397515528,0.034482758620689655,0.07375776397515528,0.034482758620689655])
My screen resolution is 1920*1080 so it's nothing unusual. Also, the app opened Chrome in windowed mode by itself, and I did not resize it at all.
Error Logs
No response
Source: bytedance/UI-TARS-desktop