Toolkit

Smart Button Click

Finds the best visible button-like control for a stated goal and clicks it.

What It Does

Smart Button Click helps workflows choose the right action when a page has multiple similar buttons and fragile selectors are not enough.

How It Works

  • Extracts visible button-like controls from the page, optionally including iframe content.
  • Filters candidates to buttons, button roles, and submit-like inputs.
  • Sends a compact list of candidate controls plus the user goal to the LLM.
  • Returns exactly one click step, preserving locator and iframe metadata when available.
  • Executes the selected step through the workflow bridge.

Best For

  • Pages with multiple similar buttons
  • Flows where selectors are unstable
  • Actions such as Next, Continue, Apply, Submit, Finish, or Confirm

Behavior Notes

  • It is designed to avoid destructive actions unless the goal clearly asks for them.
  • It works best when the stated goal is short and specific.
  • If no strong match exists, it can return a no-op wait step instead of forcing a bad click.