Note: please consider this project a proof of concept. I don't intend to maintain it or merge pull requests. Feel free to fork and build it into something great!
Introduction
Presenting Agent.exe: the easiest way to let Claude's new computer use capabilities take over your computer!
https://github.com/user-attachments/assets/2a371241-bc43-46d4-896e-256b3adc388d
Motivation
I wanted to see how good Claude's new computer use APIs were, and the default project they provided felt too heavyweight. This is a simple Electron app that lets Claude 3.5 Sonnet control your local computer directly. I was planning on adding a "semi-auto" mode where the user has to confirm each action before it executes, but each step is so slow I found that wasn't necessary and if the model is getting confused you can easily just hit the "stop" button to end the run.
Getting started
git clone https://github.com/corbt/agent.execd agent.exenpm install- Rename
.env.example-->.envand add your Anthropic API Key npm start- Prompt the model to do something interesting on your computer!
Supported systems
- MacOS
- Theoretically Windows and Linux since all the deps are cross-platform
Known limitations
- Only works on the primary display
- Lets an AI completely take over your computer
- Oh jeez, probably lots of other stuff too
Tips
- Claude really likes Firefox. It will use other browsers if it absolutely has to, but will behave so much better if you just install Firefox and let it go to its happy place.
Roadmap
- I literally wrote this in 6 hours, probably isn't going anywhere. But I will review PRs and merge them if they seem cool.