OpenGUI

Core-Mate/OpenGUI is ranked 5,299 among these 8 peers; google-labs-code/stitch-sdk is ranked 5,295.

OpenGUI helps AI agents see, understand, and operate Android app interfaces on real devices. Use OpenGUI in WorkBuddy or DeepSeek Harness. Install the plugin, connect your phone, and describe your task. Features at a Glance OpenGUI uses real screenshots to understand apps and carry out phone operations and testing tasks from natural-language instructions. **Phone operations**: open apps, tap, swipe, type, navigate back, and move between screens to complete multi-step workflows. **App testing**: check features and workflows, record issues

with reproduction steps and screenshots, and summarize results. **Content and information**: read screen content, organize information, fill forms, and prepare social media drafts. **Visible execution**: use the WorkBuddy workbench to view the phone screen, task steps, and reports, or take over and stop a task. **Host integration**: use OpenGUI in WorkBuddy or DeepSeek Harness; the DSH plugin also supports managed browser operations. Common Commands After installation and authorization, enter these instructions in the corresponding host's chat. Download and run the

installer on your Mac, restart WorkBuddy once, then authorize OpenGUI. IMPORTANT] **Restart WorkBuddy once after installation. ** Finish other tasks, **fully quit with ⌘Q**, then reopen WorkBuddy before authorizing OpenGUI. Install with a Terminal command** Open macOS Terminal, paste this command, and run it: This downloads and runs the installer without saving it manually first. The script verifies the subsequent installation files, prepares the runtime, and configures OpenGUI. Node and npm dependencies default to the China npmmirror service with official fallback

, scoped to this installation. To use official sources, replace the final with . Video assets use GitHub separately; an npm mirror does not accelerate them. See download source options for a custom video mirror. Restart WorkBuddy once** After the installer finishes, complete other WorkBuddy tasks, fully quit with **⌘Q**, and reopen WorkBuddy to load the newly installed MCP configuration. Authorize the Skill and connector** In WorkBuddy, open **Experts · Skills · Connectors → Skills**, find OpenGUI, and complete authorization. Then open **Connectors**, find OpenGUI

, and authorize it as well. **Both the Skill and connector require authorization. ** If OpenGUI is not listed under Connectors, check **Custom connectors** for its MCP service. If the authorization page did not open automatically, open the path printed in Terminal; no reinstallation is needed. Verify the connection and start using OpenGUI** Enable USB debugging on your Android phone, connect it to your computer, and approve USB debugging on the phone. Enter /opengui, then enter the instructions you want the phone

to execute to control it. Try it: Post on Tiktok Try it: Vibe Testing Use OpenGUI in DeepSeek Harness The shortest path on macOS is to let Codex run the stable installer Skill from . Each run resolves the latest stable OpenGUI plugin release, while an explicit version remains available for rollback. 19+ or 24+ and installs the compatible DSH version automatically. Paste this as one prompt: The Skill downloads the public release package and checksum, verifies SHA-256, installs only

the OpenGUI plugin, starts DSH when needed, and opens DSH. It preserves unrelated DSH plugins and settings. The installer reports