Skip to content

Latest commit

 

History

History
44 lines (33 loc) · 1.38 KB

File metadata and controls

44 lines (33 loc) · 1.38 KB

Advanced topics

Pages here cover packaging, images, checkpoints, tokenizer tarballs, and running several operations inside one stage.

:maxdepth: 1

code-upload
docker
checkpoints
tokenizer-artifact
multiple-operations

Guides

Page What it covers
Code upload Tar layout, upload_modules, upload_paths, wrappers
Docker docker_image, registry auth, GPU images
Checkpoints Single-file model upload + mount
Tokenizer artifact Tarball upload + env vars for processor trees
Multiple operations Several run_* calls in one run()

Before you read

When these pages matter

Topic Typical trigger
Code upload Any stage with src/ in prod
Docker Import errors for torch, CUDA, or system libs on workers
Checkpoints ML inference map jobs needing a .pt / .bin
Tokenizer tarball NLP models needing tokenizer.json plus vocab dirs
Multiple operations One stage that maps then validates without splitting stages

See also