Pipeline Preflight (Pipeline Builder)

Chain actors into automated pipelines

Pipeline Preflight is a pipeline validation and code generation tool that checks field mappings between Apify actor stages, detects type mismatches, and generates complete TypeScript orchestration code — all for $0.35 per build. Validates that output from stage N maps correctly to input of stage N+1 using real actor schemas, then generates Actor.call() chains with dataset forwarding.

Multi-actor pipelines break at stage boundaries when field names don't match, types are incompatible, or required fields are missing. ApifyForge Pipeline Builder catches these issues before you write any orchestration code — and generates the code for you when the pipeline validates.

Sign in to use
$0.35/build

What Pipeline Preflight does

Multi-stage field validation

Checks that output fields from stage N exist in stage N+1's input schema. Catches broken field mappings that would cause silent failures or missing data at runtime.

Type mismatch detection

Flags field mappings where output type doesn't match input type — for example, a string output mapped to an array input. Suggests transformations when possible.

TypeScript code generation

Generates complete orchestration code using the Apify SDK's Actor.call() method with dataset forwarding between stages, error handling, and structured logging.

Cost estimation

Sums PPE prices across all pipeline stages for per-run cost projections. Also projects monthly costs at 100 and 1,000 runs for budget planning.

Per-stage detail

Shows input fields, output fields, PPE price, default memory allocation, and timeout for every stage. Full visibility into what each actor expects and produces.

Schema-aware validation

Fetches input and output schemas from each actor's latest build via the Apify API. Validates against real, current schemas — not assumptions or documentation.

Pipeline building approaches compared

There are several ways to build multi-actor data pipelines on Apify. Each trades off validation depth, code generation, and setup time.

MethodField validationCode generationCost
Pipeline PreflightAutomated field + type validationComplete TypeScript with Actor.call()$0.35/build
Manual Actor.call() codingManual schema reviewManual (2-4 hours)Free (development time)
Webhook chainingNo validationManual webhook configurationFree
Trial-and-error pipeline testingRuntime errors onlyManual debuggingCompute cost per failed run

Example Pipeline Preflight output

{
  "stages": 3,
  "valid": true,
  "warnings": ["Stage 2: field 'rating' not in Stage 1 output"],
  "generatedCode": "import { Actor } from 'apify';\n\nActor.main(async () => {\n  const run1 = await Actor.call(...);\n  ...\n});",
  "costEstimate": {
    "perRun": 0.45,
    "monthly100": 45.00,
    "monthly1000": 450.00
  }
}

How Pipeline Preflight works

1

Define your pipeline stages with actor IDs and field mappings

2

Pipeline Preflight validates field mappings and type compatibility across all stages

3

Get validated pipeline with generated TypeScript code and cost estimates

Alternatives to Pipeline Preflight

Several approaches exist for building multi-actor data pipelines on Apify, from manual coding to webhook chains.

Manual Actor.call() coding

Write TypeScript orchestration code manually by reading each actor's schema, mapping fields, and implementing error handling. Full control but requires 2-4 hours per pipeline and manual schema review with no automated type checking.

Best for: experienced Apify developers building complex pipelines with custom logic.

Webhook chaining

Configure Apify webhooks to trigger the next actor when the previous one completes. Simple to set up but provides no field mapping validation, no type checking, and limited error handling. Debugging failures requires checking each stage independently.

Best for: simple two-stage pipelines with straightforward data forwarding.

Apify task sequences

Create multiple Apify tasks and trigger them sequentially via the API or webhooks. More structured than raw webhook chaining but still requires manual field mapping and has no built-in validation or code generation.

Best for: pipelines where each stage uses the same actor with different inputs.

External orchestration (Airflow, Prefect)

Use established workflow orchestration tools to manage Apify actor pipelines. Powerful but requires significant infrastructure setup, DevOps expertise, and ongoing maintenance. Overkill for most Apify-only pipelines.

Best for: enterprise teams with existing orchestration infrastructure and complex scheduling needs.

Pipeline Preflight

Automated pipeline validation with field mapping checks, type mismatch detection, and TypeScript code generation. $0.35 per build. No manual schema review or code writing required — get a validated, runnable pipeline in seconds.

Best for: developers who want validated, working pipeline code without manual schema inspection.

Limitations

  • 1.Schema-dependent validation. Pipeline Preflight requires actors to have declared input and output schemas. Actors without schemas (approximately 15% of Apify Store actors) receive limited or no field mapping validation.
  • 2.Sequential pipelines only. Pipeline Preflight validates linear stage-to-stage pipelines. It does not support branching (one stage feeding two parallel stages) or merging (two stages feeding one) — those require custom orchestration code.
  • 3.PPE-only cost estimates. Cost estimates include PPE charges per stage but not compute costs (memory, duration, proxy). Use ApifyForge Cost Calculator for complete per-actor cost projections including compute.
  • 4.TypeScript only. Generated orchestration code is TypeScript using the Apify SDK. Python users need to translate the generated code to use the apify-client Python package.
  • 5.Requires Apify account. Pipeline builds execute on your own Apify account at the $0.35 PPE rate. You need a valid Apify API token.

What Pipeline Preflight costs

Every pipeline build executes on your own Apify account at the standard pay-per-event rate of $0.35 per build. ApifyForge has no platform fee or subscription. Apify's free plan includes $5/month in credits, enough for 14 pipeline builds per month.

Frequently asked questions

What does Pipeline Preflight do?

Pipeline Preflight validates multi-actor data pipelines by checking that output fields from each stage map correctly to input fields of the next stage. It detects type mismatches, missing fields, and schema incompatibilities. Then it generates complete TypeScript orchestration code using Actor.call() chains with dataset forwarding between stages, plus cost estimates for per-run and monthly operations.

How much does a pipeline build cost?

Each Pipeline Preflight run costs $0.35, charged as a pay-per-event (PPE) fee on your own Apify account. The tool reads actor schemas from the Apify API — it does not trigger any actor runs. Apify's free tier includes $5/month in credits, enough for approximately 14 pipeline builds per month.

What programming language does the generated code use?

Pipeline Preflight generates TypeScript code using the Apify SDK's Actor.call() method. The generated code includes proper dataset forwarding between stages, error handling, and logging. You can use it directly in a new Apify actor or adapt it for use in external Node.js/TypeScript applications.

How does field mapping validation work?

Pipeline Preflight fetches the input and output schemas from each actor's latest build. It checks that output fields from stage N exist as input fields in stage N+1's schema and that their types are compatible. For example, if stage 1 outputs 'urls' as an array but stage 2 expects 'url' as a string, the builder flags both a name mismatch and a type mismatch with a suggested transformation.

Can I build pipelines with more than two stages?

Yes. Pipeline Preflight supports pipelines with any number of stages. Each stage-to-stage transition is validated independently. A 5-stage pipeline produces 4 transition validations, each checking field mappings and type compatibility. The generated TypeScript code chains all stages sequentially with proper error handling at each step.

Does the cost estimate include compute costs?

Pipeline Preflight's cost estimate sums the PPE prices across all stages for per-run projections. It also projects monthly costs at 100 and 1,000 runs. Compute costs (memory, duration) are not included in the estimate because they depend on input data size and target site behavior. Use ApifyForge Cost Calculator on each stage actor for compute cost projections.

Can I use actors I don't own in a pipeline?

Yes. Pipeline Preflight reads schemas from any public Apify Store actor. You can mix your own actors with third-party Store actors in the same pipeline. The field mapping validation works the same regardless of actor ownership — it reads the declared input and output schemas from each actor's latest build.

What if my pipeline stages don't have declared schemas?

Pipeline Preflight requires actors to have declared input_schema.json and/or dataset_schema.json to perform field mapping validation. Actors without declared schemas are flagged with a warning. You can still build the pipeline, but field mapping validation will be limited to stages where schemas are available. Approximately 15% of Apify Store actors lack output schemas.