How to submit large batch jobs with run_job()
.run_job()
has no limit on the amount of documents you can process concurrently..run_job()
function that then returns a job_id
that can be used with a webhook notification on completion, or poll via client.job.get("<job_id>")
. If you’d rather not implement polling or webhooks, see our run()
batch processing method.