Agent Executor (AX)vsUmaDev
Generated from the two spec rows. Green marks the better value where a spec has a clear direction. Everything else is just different.
Agent Executor (AX)
Google · Agent harness
OSSMCP
Panel
6.44 spec wins
- Reliability
- 5.7
- Usefulness
- 5.8
- Cost
- 8.0
- Longevity
- 6.0
“It is a harness for running other people's harnesses, which is either good architecture or the beginning of a very deep stack.”
UmaDev
umacloud · Agent harness
OSS
Panel
6.41 spec wins
- Reliability
- 6.5
- Usefulness
- 6.7
- Cost
- 6.8
- Longevity
- 5.5
“It assigns product, architecture, UI, frontend, backend, QA, security and DevOps seats, which is not a CLI flag, it is a reorganisation.”
Spec by spec
| Spec | Agent Executor (AX) | UmaDev |
|---|---|---|
| Architecture | ||
| Category | Agent harness | Agent harness |
| Runs | local, cloud, sandbox | local |
| Platforms | linux, macos | macos, linux, windows |
| Context window | not documented | not documented |
| Protocols | ||
| MCP client | Yes | No |
| MCP server | No | No |
| Capabilities | ||
| Runs terminal commands | Yes | Yes |
| Multi-file edits | No | YesCode is generated and written by the base CLI UmaDev drives; the coordinator role plans and gates rather than editing files. |
| Git operations | No | No |
| Browser control | No | No |
| Sandboxed execution | YesAgent actors run as stateful sandboxed environments provisioned from suspendable images. | No |
| Multi-agent orchestration | Yes | Yes |
| Headless / CI mode | Yes | No |
| Models | ||
| Backbone | any | Claude Code, Codex, OpenCode, Grok Build, Kimi Code |
| Bring your own model | Yes | Yes |
| Local models | No | NoAn optional local embedding model is used for retrieval only; the coding model always comes from the base CLI. |
| Cost | ||
| Pricing model | byok | byok |
| Starts at | $0/mo | $0/mo |
| Free tier | Yes | Yes |
| Bring your own key | Yes | Yes |
| Openness | ||
| Open source | Yes | Yes |
| License | Apache-2.0 | MIT |
| GitHub stars | 12,807 | 260 |
Which one would each critic pick
| Critic | Agent Executor (AX) | UmaDev | Pick |
|---|---|---|---|
| El Juez | — | — | not enough reviews |
| El Amigo | 6.3 | 6.8 | UmaDev — Pick it when your tasks vary from a typo to a feature; pick a plain agent when everything you do is roughly the same size. |
| El Crítico | 6.0 | 6.0 | no preference |
| El Profesor | 7.0 | 7.0 | no preference |
| La Inversora | 6.5 | 5.8 | Agent Executor (AX) — A very large company publishing harness infrastructure under a permissive licence has no revenue question and an unusually large abandonment question. |
| La Jefa | 5.8 | 5.8 | no preference |
| El Hacker | 6.8 | 7.0 | UmaDev — MIT and one Rust binary that drives the CLI I already authenticated, with an optional local embedding model for retrieval and no MCP anywhere. |
Picks are derived from each critic's own scores. Humans vote on matchups on the duels page.