Local-first mobile E2E testing

Every release, proven before it ships.

Test Runner is a native macOS app that turns a screen recording — or your own taps — into repeatable Maestro tests, runs them across a matrix of iPhones and Android devices on your own hardware, and hands you a video-documented verdict you can sign a release with.

Start 14-day free trial Watch the demo

No card required · nothing uploaded · cancel anytime

iOS + Android, real & virtual Runs entirely on your Mac AI authoring & triage
[01] — see it run

Watch a bug get reproduced on a live device.

Paste a bug report, and Test Runner's agent drives the app on a real device until it reproduces the failure — recording everything as it goes.

▸ captured from a live Test Runner session — no mockups bug intake → agent run → video-documented verdict
[02] — the workflow

One app owns the whole testing loop — author, run, verify, triage, report.

Built on Maestro, the open-source mobile testing engine. Test Runner adds everything around it that a release actually needs.

01 / AUTHORRecord it, don't write it

Tap through the app and Test Runner captures your steps as a Maestro flow — or hand the AI a screen recording and it drafts the steps for you, reusing your subflows and credential tokens. A structured editor covers 20+ Maestro commands, with raw YAML always one click away.

  • Click-through recording — author by using the app
  • AI flow generation from a screen recording
  • Structured step editor + raw YAML fallback
  • Reusable subflows & suite composition
02 / RUNEvery device that matters

One picker discovers iOS simulators, physical iPhones, Android emulators and devices. Run a single flow, a suite, or a matrix — device profiles × dark mode, font scale, locale, and orientation — executed in parallel on hardware you already own.

  • Real + virtual devices, auto-discovered
  • Parallel matrix runs across conditions
  • Auto-provisioning of simulators & emulators
  • Build library per version & environment
03 / VERIFYMore than pass/fail

Attach Figma screens and written business rules to your flows, and every run is also an audit: does the app match the design, and does it obey the rules? A multi-stage release gate combines tests, design parity, and rule compliance into one verdict.

  • Design-parity audits against Figma screens
  • Structural checks — truncation, overflow, misalignment
  • Business rules with freshness tracking
  • Release gate: must-pass vs best-effort tiers
04 / TRIAGEBugs, not noise

When a flow fails, AI classifies it: real regression, or new expectation? If it's the new expectation, update the flow and re-run. If it's a bug, you get the failing step, screenshot, video, and the network requests at the point of failure.

  • AI failure classification with confidence signals
  • Update the flow & re-run when expectations change
  • Agentic bug reproduction on a live device
  • Network capture at the point of failure
05 / REPORTProof you can forward

Every run writes a complete record: status, timings, logs, screenshots, and video of the entire session. Export a clinical, print-ready suite report for stakeholders, and junit.xml for your CI — organized per project, per build, forever.

  • Video + screenshots on every run
  • Print-ready HTML/PDF suite reports
  • summary.json + junit.xml for CI
  • Run history by build, suite & date
06 / MANAGEA real workspace

Projects keep their own flows, suites, builds, credentials, and reports — switch in a click. The credential vault holds test users, OAuth identities, cards, TOTP seeds, and API keys with field-level masking, all referenced from flows by token.

  • Multi-project, git-friendly YAML storage
  • Credential vault with token expansion
  • Per-suite credential overrides
  • Maestro Studio, embedded
[03] — spec sheet

The fine print, up front.

Application
Native macOS app (SwiftUI) — direct download, notarized DMG, auto-updates · not a cloud service
Test targets
iOS simulators · physical iPhones · Android emulators · physical Android devices
Engine
Maestro, the open-source mobile UI testing framework · guided install & environment doctor included
AI
Bring the AI CLI you already use — Claude Code or Codex. Your account, your model choice, your data agreements. Test Runner never proxies your content through our servers.
Storage
100% local. Flows, suites & rules are plain YAML/Markdown in your project folder — diff-friendly and git-ready.
Outputs
summary.json · junit.xml · full logs · MP4 video · print-ready HTML/PDF reports
CI
Headless gate evaluation CLI for pipelines · same verdicts as the app
Licensing
Subscription with license key · 2 Mac activations per seat · 14-day full-featured trial
[04] — local-first by design

Your app never leaves your Mac.

No cloud execution. No uploading builds to a device farm. No per-device fees that balloon with your team. Builds, credentials, reports, and recordings stay on hardware you control — a one-line answer for your next security review.

$0
per-device cloud fees
100%
runs on your hardware
2
platforms, one workflow
[05] — pricing

One plan. Every feature. Your hardware.

Test Runner is sold as a simple subscription — checkout, billing, and license keys are handled by Lemon Squeezy, our merchant of record.

Individual

14-day free trial

For the developer or QA engineer who owns mobile quality.

$19/ month
or $180 / year — save 21% ($15 / mo equivalent)
  • Every feature — nothing is gated
  • Unlimited projects, flows, suites & runs
  • Unlimited devices — they're yours
  • License key for 2 Macs
  • Auto-updates for the life of the subscription
  • Email support
Start 14-day free trial
No card for the trial · cancel anytime · taxes handled at checkout

Team

Coming soon

Shared seats and centralized billing for mobile teams.

Per-seat
built on multi-activation license keys
  • Everything in Individual
  • Pooled activations across the team
  • Seat management & invoicing
Get notified
Tell us your team size — early teams get launch pricing
What you're buying
A license to the Test Runner macOS app, delivered as a notarized DMG with a license key.
Billing
Recurring subscription (monthly or annual) via Lemon Squeezy, our merchant of record.
Activation
One key activates up to 2 of your Macs. Deactivate and move machines anytime.
Cancellation
Cancel in one click from your Lemon Squeezy receipt — access runs to the end of the paid period.
[06] — questions

Asked & answered.

Maestro's CLI and Studio are free. Why pay for Test Runner?+
Maestro gives you a great engine — Test Runner gives you the release workflow around it: multi-project organization, archived run history with video, physical-device orchestration, a credential vault, AI authoring and failure triage, design-parity and business-rule audits, and a release gate your CI can enforce. If you only run the occasional flow, stick with the CLI. If mobile quality is your job, Test Runner is the difference between running tests and shipping verdicts.
Do I need my own AI subscription?+
Yes — Test Runner drives the AI CLI you already have installed (Claude Code or Codex) under your own account. That's deliberate: your screenshots, logs, and flows go directly from your Mac to your AI provider under your agreements, never through our servers. Every AI feature is optional; the runner, matrix, and reporting all work without AI configured.
What exactly happens to my data?+
Everything — builds, flows, credentials, reports, videos — lives in your project folders on your Mac. The app talks to the network for exactly three things: license activation/validation (Lemon Squeezy), update checks (Sparkle), and any AI calls you trigger through your own CLI. Details are in the privacy policy.
Which devices and platforms are supported?+
iOS simulators, physical iPhones, Android emulators, and physical Android devices — discovered automatically from one picker. The app itself runs on macOS, since iOS testing requires Apple tooling.
Does it work with my CI?+
Every run writes junit.xml and summary.json, and the release gate has a headless CLI that evaluates a matrix run and exits with a pass/fail code — so your pipeline can enforce the same verdict you see in the app.
Is there a trial, and what's the refund policy?+
Every subscription starts with a 14-day full-featured trial, no card required. If you subscribe and something doesn't work for you, email [email protected] within 14 days of purchase for a full refund — details in the terms.
[07] — ship it

Stop hoping the release works.
Prove it.

14 days, every feature, your own devices, nothing uploaded. The next release on your calendar could ship with a video-documented verdict.

Start 14-day free trial Book a walkthrough