Ai Driven TestingBeginner

Editable Test Plans in Autopilot

ObserveOne's Autopilot suite page now has an editable plan, a runs tab, and generation config. You steer the plan; Autopilot writes the scripts.

ObserveOne Team
3 min read

The Autopilot suite page now centers on an editable test plan instead of a read-only file tree. Autopilot still writes every scenario and script; you edit the plan, and only the files that plan touches get regenerated.

What changed#

BeforeNow
Layoutnested sidebar over a file-tree IDEsplit view: file rail + viewer
Plangenerated once, not editablescenario cards or raw markdown, editable
Runsa flat lista dedicated Runs tab with history
Settingsfixed at creationa Configuration tab, editable after creation

The plan is editable#

Each scenario is a card you can edit, add, dismiss, or restore. Editing a card rewrites only that section of the plan and marks its generated file stale; a Regenerate from plan action rebuilds the stale and missing files, leaving the rest untouched. A raw markdown mode sits alongside the cards for editing the whole plan file directly.

A scenario card open in edit mode, with title, steps, and save/cancel controls
Editing a scenario rewrites only that section of PLAN.md.

Save an edit and the affected file drops out of sync with what's on disk: its tag flips to Out of date, and Regenerate from plan rebuilds just that file, leaving the rest of the suite untouched.

A scenario card tagged Out of date next to the Regenerate from plan button
Only the edited scenario goes stale; everything else stays generated.

Runs, with history#

The suite header shows pass rate, average duration, test count, and the last run, plus a run-history strip. The Runs tab lists each execution with its trigger source (manual, schedule, Netlify deploy, GitHub, or webhook) and a pass/fail status per test.

Configuration, after creation#

A Configuration tab makes generation settings editable post-creation instead of fixed at setup:

  • Max tests and allow form submission for the planner.
  • Planner instructions, a free-text steer (e.g. "focus on the checkout funnel, skip admin pages") read before the next plan is drafted.
  • Public report link and schedule settings, in the same tab.
The Configuration tab's Planner instructions field, with max tests and allow-form-submission settings above it
Planner instructions steer the next plan draft without touching the current one.

Environment variables live in the same tab. Values you set here are available to generated tests at run time, which is how a scenario can reach an authenticated flow instead of stopping at the login screen. Keys Autopilot detects in generated code show up automatically; regenerating with Regenerate from plan doesn't touch what's already saved.

The Environment variables panel with an add-variable row open above two saved, masked values
Values are masked once saved; generated tests read them at run time.

Limitations#

  • No version history: editing a scenario or script replaces it, nothing preserves the prior text.
  • Regenerate only rebuilds stale and missing files. To force a full rebuild, edit or dismiss the scenarios you want re-generated first.

Getting started#

Open a suite in ObserveOne's Autopilot, click into the Tests tab, and edit any scenario card. Save, then run Regenerate from plan to catch the script up. The Configuration tab holds planner instructions if you want to steer the next generation pass without touching a scenario directly.

Frequently Asked Questions

No. Editing a scenario updates the plan and marks that scenario's generated file stale. The script itself only changes once you run Regenerate from plan, so you can queue up several edits before spending a generation pass.

Yes. A raw markdown mode sits next to the scenario-card view for the same plan file, so you can restructure or bulk-edit steps directly instead of one card at a time.

It's a free-text note the AI planner reads before it drafts scenarios, such as which flows to focus on or which pages to skip. It only affects generation, not existing scripts.

Weighing your options on this stack?

Drop into the head-to-head pages, or browse the alternatives we recommend.

Alternatives shortlists

Ready for AI-Powered Testing?

ObserveOne monitors your selectors 24/7 and automatically heals them when websites change. Never deal with broken tests again.

Start Free Trial