Skip to main content

​
Goals

Keep feedback fast and costs predictable while maintaining strong coverage.

​
Cost Controls

  • Scope smartly
    • Use testScope: "diff" for day-to-day iteration
    • Target subsets with testIds for quick loops
  • Run frequency
    • Schedule nightly full runs; run diffs on PRs
    • Use rerun to validate fixes without re-planning
  • Reports-first
    • Review reports to avoid unnecessary re-executions
  • Artifact retention
    • Retain only what you need (screenshots/videos) for CI retention windows

​
Performance Tips

  • Local readiness
    • Ensure apps start quickly and are reachable on the specified localPort
    • Pre-warm test data or seed databases for faster setup
  • Selector stability
    • Prefer role/label-based selectors to reduce retries and timeouts
  • Parallelization
    • Keep tests independent for parallel execution in CI
  • Deterministic data
    • Use stable fixtures to avoid slow flaky retries

​
Suggested Defaults

  • PRs: diff scope, targeted testIds on critical changes
  • Main branch: daily full run, artifact retention 7 days
  • Hotfixes: focused reruns on impacted suites

​
Useful Flows

  • Diff-only execution
testsprite_bootstrap_tests({ testScope: "diff", ... })
  • Subset during iteration
testsprite_generate_code_and_execute({ testIds: ["TC005", "TC010"] })
  • Rerun without re-planning
testsprite_rerun_tests({ projectPath: "/abs/path" })