See and inspect
Capture a window or display. Read named controls. Inspect Chrome’s DOM and visible console entries.
The apps you use. The browser you’re signed in to.
Give your agent access to the desktop already in front of you.
macOS 13+ · Apple Silicon and Intel · MIT license
Example task
Change the status with one click,
then inspect the
result.
codex-ui press \
--chrome-url 'ensomniac.github.io/codex-ui/' \
--role button \
--name 'Mark reviewed' \
--capture-after
Click “Mark reviewed” here, or run the command with this page open in Chrome. The state shown is from this page.
This example runs entirely in your browser. The command uses the installed desktop tool.
What it does
codex-ui connects a command-running agent to your Mac’s native desktop. It uses your existing windows and Chrome profile.
Capture a window or display. Read named controls. Inspect Chrome’s DOM and visible console entries.
Press a button, enter text, move the pointer, or arrange windows. Group related actions in a JSON plan.
Get structured output and a screenshot after an action. Coordinates account for Retina scaling and multiple displays.
Desktop control runs locally, without an account or hosted service. An activity indicator shows when the tool is working. It yields to your mouse or keyboard and restores the pointer when it finishes.
How control worksGet started
Run the installer in Terminal. It supplies uv and an isolated Python runtime, then installs the latest stable release.
macOS may request Accessibility, Screen Recording or Automation
access for your terminal or agent app. doctor checks
what is available.
curl -fsSL https://raw.githubusercontent.com/ensomniac/codex-ui/main/install.sh | sh
brew tap ensomniac/codex-ui https://github.com/ensomniac/codex-ui
brew install ensomniac/codex-ui/codex-ui
uv tool install 'https://github.com/ensomniac/codex-ui/releases/download/v2.1.0/ensomniac_codex_ui-2.1.0-py3-none-any.whl'
npm install -g 'https://github.com/ensomniac/codex-ui/releases/download/v2.1.0/ensomniac-codex-ui-2.1.0.tgz'
codex-ui doctor
codex-ui skill install
The bundled skill gives Codex the commands and conventions. Other agents are supported.
codex-ui upgrade
Also available through pipx, pip, pnpm, Yarn and Bun. All package managers and uninstall instructions
For the agents
You’re invited to maintain the code, improve the documentation, add platforms and submit pull requests. Start with AGENTS.md. It maps the code and explains how to verify your work.
Submit a PR with your evidence. CI runs, Ryan is notified, and his local agent reviews the change. Merges require that agent’s signed approval.
Contribution and review processWhy it exists
codex-ui began as a script Ryan used with his agent. He wanted others to have that same access to their own computers, and the ability to maintain the tool themselves.
His brief was direct: the agent should operate as the human, with the same access. The tool should stay fast and avoid adding layers of permission requests around authorized work.
Read the founding brief“Maximum efficiency
at the highest risk.”
Platform support
Installation, schemas, skills and upgrades already work on Windows and Linux. Native desktop control is the next step. Every new platform must include a tested upgrade path.
Platform planA few useful details
Any agent that can run a local command and inspect an image. Install the bundled skill for Codex or Claude, or give another agent the CLI schema and command guide.
Yes. It works with Chrome already open, including signed-in tabs and local files. DOM and console inspection temporarily uses DevTools, then restores its layout and the clipboard.
Desktop operations run locally and send no telemetry. Installation and upgrades download software from GitHub and package providers. Your agent host controls how it handles images and command output.
Run codex-ui upgrade. It checks the latest stable
GitHub release, verifies the download and updates the installed
runtime. Run codex-ui skill install afterward to
refresh the skill.
No. codex-ui is an independent, MIT-licensed project by Ensomniac. It is not affiliated with or endorsed by OpenAI or Apple.