HNHacker News
TopNewBestAskShowJobs

stif1337

6 karma · joined March 3, 2026

submissionscomments
stif1337··on Show HN: OculOS – Any desktop app as a JSON API via OS accessibility tree
Update: Since the initial post, I've shipped several features based on feedback:

- Screenshot capture: GET /windows/{pid}/screenshot → returns PNG

- Batch operations: POST /interact/batch → multiple actions per request

- Wait/poll: GET /windows/{pid}/wait?q=Submit&timeout=5000

- Python & TypeScript SDKs (local install, PyPI/npm coming soon)

- OpenAPI spec, Dockerfile, 7 example scripts

- Demo GIF in README showing Calculator automation via Claude Code

Thanks for the feedback everyone!

stif1337··on Show HN: OculOS – Any desktop app as a JSON API via OS accessibility tree
No toolkit dependency, OculOS reads the OS-level accessibility tree, which is toolkit-agnostic:

- Windows: UI Automation (works with Win32, WPF, WinForms, Qt, Electron) - Linux: AT-SPI2 (GTK, Qt, Electron) - macOS: AXUIElement (Cocoa, Qt, Electron)

The coverage varies by toolkit. Win32/WPF/GTK expose rich trees. Electron apps expose key elements but the tree is shallower. Custom-drawn UIs (games, OpenGL) have minimal or no accessibility tree. That's the main limitation.

stif1337··on Show HN: OculOS – Any desktop app as a JSON API via OS accessibility tree
Thanks! Python and TypeScript SDKs are high on the roadmap.
stif1337··on Show HN: OculOS – Any desktop app as a JSON API via OS accessibility tree
Yes, electron apps expose a reasonable accessibility tree through Chromium's UIA/AT-SPI bridge. We've tested with Spotify (Electron/CEF), VS Code, Slack, and Chrome itself.

The tree is shallower than native Win32/WPF apps, but key interactive elements (buttons, inputs, lists) are usually exposed. You can check what's available with:

  curl "localhost:7878/windows/{pid}/find?interactive=true"
stif1337··on Show HN: OculOS – Any desktop app as a JSON API via OS accessibility tree
It actually supports both you can use it as a plain REST API (no MCP needed) with any HTTP client:

  curl localhost:7878/windows
  curl -X POST localhost:7878/interact/{id}/click
MCP mode is an optional layer for AI agents (Claude, Cursor, etc.) that already speak MCP. The REST API works standalone for scripts, testing, CI/CD — no AI required.