Summary
Coordinates in, desktop moves.
It is a thin layer over the operating system rather than an integration with any one application, so what it can reach is whatever a person could reach with a mouse and keyboard — and it needs the screen to itself while it does.
What it is
A desktop automation server written in Go and running over stdio. It exposes mouse, keyboard and screen control as tools: clicking at coordinates, moving the cursor with or without animation, typing with optional per-character delays, pressing key combinations, and capturing screenshots.
What you get
- Clicks at coordinates you name, with right click and double click each their own tool
- The cursor moved with smooth animation or instantly, and its current position read back
- Text typed at the cursor position, with a configurable delay between characters
- Individual keys and key combinations pressed
- A full-screen screenshot captured to a file, and the screen dimensions read
Requirements
Go, to build the binary, plus whatever your operating system requires before an application may control the mouse, keyboard and screen. It runs over stdio with no configuration beyond the binary path.