swadhinbiswas feat(inference): add ML inference engine with scheduling and autoscaling · 7/9/2026
d743f45
18 lines · 507 Bytes
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
//! Real-model support: quantization configs, LoRA adapters, weight loading.
//!
//! ## Compilation strategy
//!
//! - **`quant.rs` + `lora.rs`** are always compiled and tested in the default
//!   gate (pure data structures, zero weight dependencies).
//! - **`model.rs` + `tokenizer.rs`** are gated behind `#[cfg(feature = "real")]`
//!   and pull in `candle-transformers` + `tokenizers`.

pub mod lora;
pub mod quant;

#[cfg(feature = "real")]
pub mod model;

#[cfg(feature = "real")]
pub mod tokenizer;