Offline Jobs
Offline Jobs are long-running, asynchronous processes that operate over large datasets or perform heavy computation that isn’t suitable for synchronous API requests. These jobs typically take minutes or even hours to complete depending on data volume and job complexity.
Note: Offline Jobs Endpoints are only available upon request. If you are interested in using these endpoints, please contact us to request access:
Onboarding Guide
Endpoints
The offline job flow is composed of four main endpoints:
- Initialize – This endpoint sets up the job, provisions an S3 input prefix, and issues temporary STS credentials so you can securely upload input data.
- Execute – After your data has been uploaded, this endpoint triggers the execution of the offline job using the provided inputs and configuration.
- Get Status – This endpoint allows you to query the current state of the job, including whether it is queued, running, completed, or failed. Note offline jobs are only retained in our system for 90 days after initialization. After this window you will no longer be able to view the status.
- Refresh Credentials – If the temporary credentials issued during initialization have expired—either before the input upload or when retrieving output files—this endpoint can be used to obtain new short-lived STS credentials for continued access.