Overview
Submit and monitor batch inference jobs from the CLI. Upload and manage files for batch processing, retrieve results, and integrate batch pipelines with CI/CD workflows.
Quick install
npm install -g omniroute # or: npx omniroute
omniroute --version
Subcommands
batches
Example:
omniroute batches
batches list
Flags:
--status <s>--limit <n>
Example:
omniroute batches list
batches get <batchId>
Example:
omniroute batches get <batchId>
batches create
Flags:
--endpoint <e>--completion-window <w>--metadata <kv>
Example:
omniroute batches create
batches submit
Flags:
--endpoint <e>--wait
Example:
omniroute batches submit
batches cancel <batchId>
Flags:
--yes
Example:
omniroute batches cancel <batchId>
batches wait <batchId>
Flags:
--timeout <ms>
Example:
omniroute batches wait <batchId>
batches output <batchId>
Flags:
--out <path>
Example:
omniroute batches output <batchId>
batches errors <batchId>
Flags:
--out <path>
Example:
omniroute batches errors <batchId>
files
Example:
omniroute files
files list
Flags:
--purpose <p>--limit <n>
Example:
omniroute files list
files get <fileId>
Example:
omniroute files get <fileId>
files upload <path>
Example:
omniroute files upload <path>
files content <fileId>
Flags:
--out <path>
Example:
omniroute files content <fileId>
files delete <fileId>
Flags:
--yes
Example:
omniroute files delete <fileId>