injaneity/pi-computer-use
A Pi extension that gives an AI agent eyes and hands on a desktop. It lists open windows, reads what is visible in them, finds buttons and text, then clicks, types, scrolls and waits for the screen to change instead of guessing with sleeps. It works through each operating system's accessibility layer, with a small helper app on macOS.
Idea adaptedKey files read, not run
I learnt this repo's idea and adapted it into my own workspace setup.
How we know
We read the README and key files, not every source file, and did not run it, so the most we can say is Idea adapted or Risky.
Good for
Agents that have to drive ordinary desktop apps where no API or CLI exists.
Not for
Pure web automation, or native Wayland on Linux, where the tool can only read the interface and cannot send input.
Repo
- Stars
- 2,142
- License
- MITUse it, change it, sell it, closed-source included. Keep the author's copyright notice.
- Maturity
- active
- Last push
- 2026-11-01
- Last checked
- 2026-11-14