Outway documentation

Batch scraping

Submit a bounded list of public URLs and inspect per-page collection results.

Submit your URL list

Use POST /v1/projects/{projectId}/batches:

{"urls":["https://example.com","https://example.org"]}

Provide between one and 100 unique URLs. Each requested URL reserves a collection unit. Choose cacheMode: "revalidate" when rechecking sources matters.

Track the batch

Read GET /v1/batches/{batchId} using the returned identifier. Inspect per-item results and use capture IDs to retrieve evidence. Handle partial outcomes; one successful page does not establish that every URL succeeded.

Retry carefully

Preserve submission idempotency for transport retries. For a new attempt at failed URLs, submit a deliberate new batch and account for its usage. Do not resubmit the entire list blindly.