Automated testing

End-to-end test automation, for real

Let Agents handle code checks, test design, and hands-on execution. Keep requirements, code, and test evidence on one task, so your team can focus on exceptions and quality decisions.

Explore the workflow
Original team screenshot showing desktop test results and the evidence inventory on a task

From our team's workflow · Results and evidence return to the original task

From development handoff to human sign-off

White-box checks and build verification come together at test design.

Scroll horizontally to explore the full workflow

From development handoff to human sign-offWhite-box checks and build verification come together at test design. The dashed line represents fixes based on white-box findings. Testers schedule black-box execution and approve the results before release readiness.Developer fixes bugsfrom white-box findingsDevelopmenthandoffTask statusReady for testingWhite-box AgentCommit ownership& white-box checksTest buildsucceedsBuild AgentLanded commitincluded in test tagTask statusIn testingTest design AgentData preparation& test casesWeb / DesktopTesting AgentsBlack-box executionHuman reviewFile bugs & retestwhen neededTask statusReady for releaseReports · screenshotsrecordings · open items

The testing workflow

Every handoff has something to build on

Follow a real feature: switching the AI Runtime or execution computer for a conversation while preserving the Agent's default settings.

01White-box testing Agent

Check the code. Surface the risks.

Task status → Ready for testing

The developer links a PR to the requirement. Moving the task to Ready for testing triggers white-box checks: verify commits and merge results, run relevant tests, and identify risks that need hands-on validation.

  • Ready for the next step · Test results, readiness checks, and follow-up risks around working directories, popovers, and retries.
Original Chinese screenshot of white-box findings and risks on the requirement task
02Build verification Agent

Test the build that contains the change

Build succeeds → Feishu notification

A successful test build sends a Feishu notification. The Agent verifies that the landed commit is in the test version and moves eligible tasks to In testing.

  • Ready for the next step · Build verification results, test batches, and updated task fields.
Original Feishu screenshot showing build notifications and version verification
03Test design Agent

Turn requirements into executable cases

Task status → In testing

Use requirements, task comments, and white-box risks to prepare data and cases that cover every requirement and edge case.

  • Ready for the next step · Scope, preconditions, steps, and expected results posted back to the original task.
Original Chinese screenshot of generated Runtime-switching test cases
04Web testing Agent · Desktop testing Agent

Run the steps. Keep the evidence.

A tester schedules and starts execution

Run the cases as written: each one reports its result as it completes. The run produces an HTML report, keeping screenshots and recordings as evidence.

  • Ready for the next step · Case results, an HTML report, screenshots, recordings, and environment evidence for review.
Original screenshot of a tester starting desktop black-box execution from the task

Meet the Agents

Five teammates. Clear responsibilities.

Code checks uncover risks. Test cases carry them forward. Execution leaves evidence. Choose browser or desktop testing to match the change.

White-box testing Agent

Reads requirements and code, checks commits and test readiness, runs relevant tests, and flags risks.

Build verification Agent

Checks that the landed commit is included in the test tag and maintains test batches and task status.

Test design Agent

Turns requirements and white-box risks into test scope, data setup, and executable cases.

Web testing Agent

Operates the browser to run black-box tests and delivers reports, screenshots, and recordings.

Desktop testing Agent

Tests desktop behavior, installation, and upgrades, retaining application and environment evidence.

Connect the workflow

Make the handoffs part of everyday work

Instructions define each Agent's role. Skills provide operating methods. Automations connect triggers to actions.

Configure Agents and Runtimes

Set role instructions and bind a Runtime such as Claude Code or Codex on a shared computer. Provide repository access, testing tools, and Skills so each Agent can carry out its responsibilities.

Original Chinese screenshot of test Agent instructions, runtime settings, and tools

Trigger Agents on status change

Ready for testing triggers white-box checks. In testing triggers test design. Configure the trigger, Agent, and instructions, then inspect prompts and run history in automation details.

Original Chinese screenshot of the test-design automation, its trigger, and run history

Connect Git to link tasks and code

Connect GitHub or GitLab and associate PRs with requirement tasks. The white-box Agent traces changes, while the build verification Agent checks that the landed commit is included in the test tag.

Original Chinese screenshot of PRs and code records linked to a requirement task

Connect Feishu for notifications and results

Send build notifications to a Feishu group to trigger test-version verification. Teams can also create and assign tasks from Feishu and receive Agent results in the group.

Original Feishu screenshot of test-build notifications and Agent results

Before the first run

Give every test a reliable starting point

Traceable, complete features

This team keeps frontend and backend in one repository. A feature owner aligns the complete user journey, deployment prerequisites, and acceptance criteria.

An always-on test computer

Prepare a browser, test application, Runtime, and an operable desktop so sleep settings and everyday work do not interrupt runs.

Scripted environment setup

Standardize dependency installation, database setup, startup, and test commands. Check services, migrations, the computer, and Runtime before execution.

Dedicated accounts and data

Prepare admin, member, and read-only roles with clear access rules. Make test data creation and cleanup repeatable.

Explicit acceptance criteria

Describe the main path, permissions, failures, and persisted behavior so Agents judge against requirements.

Evidence that persists

Upload reports and recordings promptly, linking task, run, and case IDs. Temporary execution directories can be reclaimed.

Start with one automation

Try it on a real requirement

Start with white-box checks at handoff, then add test design, hands-on execution, and human review.

01

Prepare a testing Agent

Connect the repository and Runtime, define the checks, and confirm the computer and dependencies are ready.

02

Automate the handoff

Trigger checks when a task becomes Ready for testing and return findings to the original task.

03

Extend the workflow

Add build verification, test design, and browser or desktop runs, with testers reviewing the evidence.

Questions & answers

Before you get started

Does this replace human testers?

+

Testers still define acceptance criteria, schedule black-box execution, resolve uncertainties, and sign off. Agents handle code checks, case generation, and hands-on steps. In this example, a tester manually started the desktop tests.

Does every change need both Web and desktop testing?

+

Choose based on impact. Browser features can go to the Web Agent; installation, upgrades, and local environments need the Desktop Agent. For cross-platform changes, validate each affected path.

Do I need all five Agents on day one?

+

Start with one automation: trigger white-box checks when a task is ready for testing. Add build verification, case design, execution, and human review as the workflow matures.

What environment do the Agents need?

+

This practice uses local Runtimes on a shared computer. White-box checks need the repository and dependencies; browser testing needs a browser and dedicated accounts; desktop testing also needs the test application and an operable desktop. Script setup and readiness checks where possible.