ACE-Step-1.5-XL-Turbo-MLX-Serve-8bit
on a Mac: what it actually needs

For David Dalcu. Worked out from your repo, no sign-up, nothing to click.

quantized
32 layers
8 KV heads
head dim 128
1 likes
981 downloads
5.8 GB
measureddownload size, summed from the 3 safetensors files in your repo
16 GB Mac
computedthe smallest machine that holds it at 8k context, assuming MLX can wire 75% of unified memory

What it needs as context grows

4k context0.54 GB KV + 5.8 GB weights + 1.2 GB runtime = 7.6 GB, smallest Mac 16 GB
8k context1.07 GB KV + 5.8 GB weights + 1.2 GB runtime = 8.1 GB, smallest Mac 16 GB
32k context4.29 GB KV + 5.8 GB weights + 1.2 GB runtime = 11.3 GB, smallest Mac 16 GB
128k context17.18 GB KV + 5.8 GB weights + 1.2 GB runtime = 24.2 GB, smallest Mac 36 GB

KV cache = 2 tensors x 32 layers x 8 KV heads x 128 head dim x 2 bytes (fp16) x tokens. Read straight off your config.json. Runtime overhead is the 1.2 GB I see for Python, MLX, the tokenizer and activations on my own runs.

Mac by Mac

ContextNeeds81618243236486496128
4k7.6 GBnoyesyesyesyesyesyesyesyesyes
8k8.1 GBnoyesyesyesyesyesyesyesyesyes
32k11.3 GBnotightyesyesyesyesyesyesyesyes
128k24.2 GBnononononoyesyesyesyesyes

Columns are unified memory in GB. "Tight" means it fits but leaves under 2 GB for anything else, so expect swap once a browser is open.

Run it

pip install mlx-lm
mlx_lm.generate --model ddalcu/ACE-Step-1.5-XL-Turbo-MLX-Serve-8bit \
  --prompt "hello" --max-tokens 100

What is not on this page

not measuredTokens per second. That needs a real run on real silicon and I will not print a number I have not seen. If you want it, reply and I will run ACE-Step-1.5-XL-Turbo-MLX-Serve-8bit on an M5 and add the result here with the command I used.
Speed, measured: this page is about memory. For how fast models actually run on Apple Silicon, with the tasks and judging open, see the Agent-12 local agent leaderboard.

Built by Matt Macosko, who publishes 29 MLX quants and wrote claude-code-local, which runs Claude Code fully on-device on Apple Silicon. Source for this page: your model repo and its config.