hermes-orgo-desktop-plugin

Who this is for: you already run Hermes Agent inside an Orgo computer and want same-box GUI control without going through cloud Orgo MCP.

What it is: a Hermes plugin (orgo_desktop_* tools) + CLI (orgo-desktop) + skills (local-first policy).

What it is not: an Orgo template for spinning new VMs. That is a different repo (see table below).

---

Choose the right repo

If you need…	Use this repo
Install tools on a Hermes that is already on Orgo	This repo — hermes-orgo-desktop-plugin
Spin a new Orgo VM with Hermes + desktop stack baked in	orgo-template-hermes-desktop
Control other Orgo computers / fleet lifecycle from Hermes	orgo-mcp (cloud MCP)
Mac desktop app for Orgo	orgo-desktop (unrelated)

Name map (old → new):

Old name (redirects still work)	New name	Role
orgo-desktop-local	hermes-orgo-desktop-plugin	Install on existing Hermes
orgo-hermes-desktop-local	orgo-template-hermes-desktop	Orgo template for new VMs

---

Prefer order (same-box)

When Hermes runs on the same Orgo VM it is controlling:

1. This plugin — local Desktop API (http://127.0.0.1:8080) via orgo_desktop_* / orgo-desktop
2. Hermes browser_* for DOM work
3. Cloud Orgo MCP only for other VMs / create / restart
4. CUA / Hermes computer_use last (optional a11y)

Auth for the local Desktop API is the per-VM VNC password (VNC_PASSWORD or ORGO_DESKTOP_API_TOKEN), not ORGO_API_KEY.

---

Install (recommended)

One-shot on the Orgo VM (requires Hermes + Desktop API on :8080):

curl -fsSL https://raw.githubusercontent.com/nickvasilescu/hermes-orgo-desktop-plugin/main/install/bootstrap.sh | bash
# restart Hermes chat / gateway so model tools load
orgo-desktop doctor

Manual:

git clone https://github.com/nickvasilescu/hermes-orgo-desktop-plugin.git
cd hermes-orgo-desktop-plugin
bash install/install-on-existing-hermes.sh
bash install/validate.sh

Hermes plugin CLI only

hermes plugins install nickvasilescu/hermes-orgo-desktop-plugin --enable

That installs the plugin module. For CLI + skills + toolset enable, still run:

bash install/install-on-existing-hermes.sh

(or the bootstrap one-liner above).

---

What you get

Piece	Location / name
Hermes plugin	orgo-desktop-local → tools orgo_desktop_*, toolset orgo_desktop
CLI	~/.local/bin/orgo-desktop
Skills	~/.hermes/skills/computer-use/orgo-desktop-local, orgo-cloud-computers
Validate	bash install/validate.sh (12 checks)

Tools

Tool	Purpose
orgo_desktop_doctor	Health / prefer-local check
orgo_desktop_screenshot	Capture desktop
orgo_desktop_click / drag / click_path	Pointer
orgo_desktop_type / key	Keyboard
orgo_desktop_bash	Shell via Desktop API
orgo_desktop_scroll / open_url / wait	Navigation helpers

---

Requirements

• Hermes Agent on an Orgo Linux computer
• Orgo Desktop API healthy on loopback :8080 (standard Orgo desktop image)
• VNC_PASSWORD or ORGO_DESKTOP_API_TOKEN available to the agent (Orgo injects VNC password on the VM)

---

Validate

bash install/validate.sh
orgo-desktop doctor
# expect: ready=true, prefer=local_desktop_api

Restart Hermes after install so orgo_desktop_* tools appear in the model tool list.

---

License

MIT