Regression Suite

Know what changed since last time

A test suite tells you what's broken now. A regression suite tells you what broke since last time. Run the same test cases after every code change and see exactly which tests regressed (were passing, now fail), which resolved (were failing, now pass), and which are new. Previous results are injected automatically from your last cached run.

Sign in to use
$0.35/suite

What it checks

Six-state classification

Every test is classified as: pass, fail, regression (was passing, now fails), resolved (was failing, now passes), new_pass, or new_fail.

Automatic history

Previous results are automatically loaded from your last cached run in the ApifyForge dashboard. No manual tracking needed.

Same assertion engine

Uses the same six assertion types as Test Runner: minResults, maxResults, requiredFields, fieldTypes, maxDuration, noEmptyFields.

Regression-first reporting

Regressions are highlighted at the top of the report for immediate attention. Stable passes and known failures are secondary.

Suite versioning

Each run is auto-stamped with the current date. Track regression patterns over time — 'this actor breaks every 2 months when the target site deploys.'

CI/CD ready

Trigger via API, parse the JSON report, and block deploys when regressions > 0. Works with GitHub Actions, GitLab CI, and any automation tool.

Example output

{
  "actorName": "ryanclinton/website-contact-scraper",
  "suiteVersion": "2026-03-18",
  "totalTests": 3,
  "passed": 2,
  "failed": 1,
  "regressions": 1,
  "resolved": 0,
  "details": [
    {
      "name": "Basic scan",
      "status": "pass",
      "previousStatus": "pass",
      "currentStatus": "pass"
    },
    {
      "name": "Multiple domains",
      "status": "regression",
      "previousStatus": "pass",
      "currentStatus": "fail",
      "assertions": [
        { "assertion": "minResults >= 2", "passed": false, "actual": 1 }
      ]
    }
  ]
}

How it works

1

Connect your Apify token and enter the actor ID

2

The tool runs the actor on your account and analyzes the output

3

Get a detailed report with actionable fixes — results cached for free