How do you figure out interfaces of initially untouched sites?

When your agent hits a site it hasn't navigated before, how does it currently figure out the interface — vision model, trial and error, hardcoded assumptions? And if there were already a known, current map of that site's structure available before your agent got there, would that meaningfully change how your agent operates, or would you still want to verify it yourself in the moment?