[Bug]: Missing clicks

Author: NiksaSprintingCreated May 13, 2025Updated Sep 17, 2026
LabelsBug

Version

v0.1.1

Model

UI-TARS-1.5-7B

Deployment Method

Cloud

Issue Description

OS Windows 11

I gave a seemingly simple command to open a web page and switch tenants (and later to try to log in). You can see on the screenshot below that it notices the option and is trying to click it - but it's using wrong coordinates every time.

Click coordinates from the screenshot: click(start_box: [0.07375776397515528,0.034482758620689655,0.07375776397515528,0.034482758620689655])

Image

My screen resolution is 1920*1080 so it's nothing unusual. Also, the app opened Chrome in windowed mode by itself, and I did not resize it at all.

Error Logs

No response

Source: bytedance/UI-TARS-desktop