astronomical
Thriving Thriving Rust RS
↑ 54 ?
astronomical aosama/astronomical

Set one RAM ceiling. Run bigger sparse language and vision models on Apple Silicon — experts stream from SSD when they don't fit, without hidden quantization. https://aosama.github.io/astronomical/ Join Discord Server https://discord.gg/dc4E6r4WD

https://aosama.github.io/astronomical/ ↗
HEALTH ? 99 / Healthy
// solo builder// hidden gem// release machine apple-siliconlocal-llmmacosmlxrustvision-language-modelmoe ?
08-2026 · today · aosama
★28 Share View on GitHub ↗

// readme

Astronomical

Run large AI models privately on your Mac, including models bigger than the memory you can spare.

Astronomical is a free app for Apple silicon Macs. You tell it how much memory it may use, pick a model, and start chatting. When a model is too big for that memory, Astronomical keeps part of it on your SSD and reads it as needed, so the rest of your Mac stays usable. Nothing you type leaves your Mac.

A 21.6 GB model running with an 11 GB memory limit. Click the picture for a 25-second demo. This is a captured run; speed varies by model, prompt length, storage and Mac.

What you need

  • A Mac with Apple silicon (any M-series chip).
  • macOS 14 (Sonoma) or later.
  • Free disk space for models. They range from under 1 GB to about 38 GB each.

Get started

  1. Install the app. Download the disk image with the button above or from the latest release, open it, and drag Astronomical into Applications. The app is signed and notarized by Apple.
  2. Open Astronomical. A chat window opens with a welcome, and an Astronomical item appears in the menu bar. The menu-bar item keeps models available while you…