Skip to main content

Crate teeny_cli

Crate teeny_cli 

Source
Expand description

Shared --device/--options CLI configuration for ahead-of-time kernel compilation, meant to be #[command(flatten)]-ed into a downstream project’s own binary (e.g. a vision-rs demo) and driven end-to-end by cargo teeny aot in cargo-teeny.

--device selects a backend; everything after that (including --options) is opaque here and handed to that backend’s own parser — today that’s teeny_cuda::compiler::options::Options::parse for --device cuda. Adding a new backend means adding a match arm in aot_compile, not touching AotArgs.

Structs§

AotArgs
Shared AOT-compile CLI arguments. Flatten this into your own clap struct: #[command(flatten)] aot: teeny_cli::AotArgs.

Functions§

aot_compile
Trace model with a symbolic sample input of input_dtype/input_shape, then ahead-of-time compile every kernel the traced graph references for the backend/config selected by args.