Outway documentation
Batch scraping
Submit a bounded list of public URLs and inspect per-page collection results.
Submit your URL list
Use POST /v1/projects/{projectId}/batches:
{"urls":["https://example.com","https://example.org"]}
Provide between one and 100 unique URLs. Each requested URL reserves a collection unit. Choose cacheMode: "revalidate" when rechecking sources matters.
Track the batch
Read GET /v1/batches/{batchId} using the returned identifier. Inspect per-item results and use capture IDs to retrieve evidence. Handle partial outcomes; one successful page does not establish that every URL succeeded.
Retry carefully
Preserve submission idempotency for transport retries. For a new attempt at failed URLs, submit a deliberate new batch and account for its usage. Do not resubmit the entire list blindly.