Lattice

Pure Rust inference engine for transformer models on Apple Silicon, with a native macOS app.

Quick start · Lattice Studio · Benchmarks · Roadmap

No ONNX. No Python. No CUDA. No external ML runtime. Lattice implements the full compute graph in Rust: weight loading, tokenization, forward pass, vector operations, quantization, and LoRA training. Hand-written Metal shaders accelerate inference on Apple Silicon. SIMD kernels (AVX2 on x86, NEON on ARM) handle the CPU path.

What is Lattice

Lattice is two things in one repo.

A Rust inference library. A workspace of focused crates covering embeddings, generation, quantization, LoRA fine-tuning, and optimal transport. The canonical member list is in Cargo.toml. Use lattice-embed as a library dependency, or run the lattice binary for interactive chat and an OpenAI-compatible HTTP server.

Lattice Studio: a native macOS app. A SwiftUI instrument panel that drives the Rust engine via CLI subprocesses. Train LoRA adapters with a live loss oscilloscope,…