• Picks
  • Discover
  • Alternatives
  • About

© 2026 Willet

  • Newsletter
  • About
  • FAQ
  • Terms
  • Privacy & Cookies
Join the Discord (opens in a new tab)
PrismML-Eng avatar

Bonsai

Setup scripts to run Bonsai 2 low-bit models locally with chat UI

  • AI models and runtimes
View on GitHub
Website

What it is

A set of shell and PowerShell scripts that download PrismML's ternary Bonsai 2 models (2B to 27B) and run them locally through a llama.cpp fork or MLX on Apple Silicon. It starts a local server with chat, image input, tool calling and MCP support, and can optionally install Open WebUI and a code interpreter. People who want to try heavily compressed open models on a laptop or desktop GPU use it to get running in a couple of commands.

Images

Facts

Stars
3,416 GitHub stars.
3,416

Forks
386
Commits
194
Contributors
52
Language
Shell
License
Apache-2.0
Last commit
Oct 20, 2026
On GitHub since
March 2026
Platforms
macOS, Windows, Linux, CLI
Self-hostable
No
Tags
  • llm-inference
  • multimodal
  • local-ai
  • model-optimization
  • chatbot

Last synced from GitHub on Oct 20, 2026

The 10 best overlooked open-source projects, every Monday.

Share and more

Comments

No comments yet. Start the conversation.

Similar projects

  • ggml avatar

    llama.cpp

    C/C++ engine for running large language models on local hardware

    132k
  • Microsoft avatar

    BitNet

    Inference engine for ternary 1.58-bit language models on CPU and GPU

    41.2k
  • Vincenzo Fornaro avatar

    colibrì

    CPU inference engine that streams MoE model experts from disk

    43k

What people are saying

Updated Oct 20, 2026
  • Hacker NewsBonsai 27B: A 27B-Class model that runs on a phoneJul 14, 2026 · 706 points · 250 comments (opens Hacker News in a new tab)
  • Hacker NewsBonsai 2 27B: Near-Lossless Compression in a 9x Smaller FootprintSep 17, 2026 · 589 points · 200 comments (opens Hacker News in a new tab)
  • Hacker News1-Bit Bonsai Image 4B Image Generation for Local DevicesMay 31, 2026 · 464 points · 201 comments (opens Hacker News in a new tab)
  • Hacker NewsShow HN: 1-Bit Bonsai, the First Commercially Viable 1-Bit LLMsMar 31, 2026 · 430 points · 153 comments (opens Hacker News in a new tab)
  • Hacker NewsTernary Bonsai: Top Intelligence at 1.58 BitsApr 18, 2026 · 225 points · 57 comments (opens Hacker News in a new tab)
  • Hacker News1-Bit Bonsai: The First Commercially Viable 1-Bit LLMsMar 31, 2026 · 9 points · 1 comment (opens Hacker News in a new tab)
  • Hacker NewsPrismML Launches Bonsai 2 27B, Its Most Capable Model YetSep 17, 2026 · 4 points · 1 comment (opens Hacker News in a new tab)
  • Hacker NewsTernary Bonsai: Top Intelligence at 1.58 BitsApr 16, 2026 · 4 points · 1 comment (opens Hacker News in a new tab)
  • Hacker News1-Bit Bonsai: The First Commercially Viable 1-Bit LLMsApr 14, 2026 · 3 points · 2 comments (opens Hacker News in a new tab)
  • Bluesky“have you checked out prismml.com”Aug 13, 2026 · 1 like · 1 reply (opens Bluesky in a new tab)
  • Hacker News1-Bit and Ternary Bonsai Image 4B: Image Generation for Local DevicesMay 27, 2026 · 2 points · 0 comments (opens Hacker News in a new tab)
  • Hacker NewsPrismML – Announcing 1-bit Bonsai: The First Commercially Viable 1-bit LLMsApr 6, 2026 · 2 points · 0 comments (opens Hacker News in a new tab)
  • Bluesky“Show HN: 1-Bit Bonsai, the First Commercially Viable 1-Bit LLMs View Article | Join the HN Conversation Summary of HN discussion 🧵👇”Apr 1, 2026 · 1 like · 1 reply (opens Bluesky in a new tab)
  • Bluesky“Show HN: 1-Bit Bonsai, the First Commercially Viable 1-Bit LLMs (”Apr 1, 2026 · 1 like · 0 replies (opens Bluesky in a new tab)
  • Bluesky“PrismML hopes its tiny LLM will change how we all use AI | TechCrunch PrismML prismml.com”Sep 21, 2026 · 0 likes · 0 replies (opens Bluesky in a new tab)
  • Bluesky“PrismML hopes its mini-LL.M. will change the way we use artificial intelligence If AI laboratory Prism ML It's not on your radar yet, and it should be — not…”Sep 18, 2026 · 0 likes · 0 replies (opens Bluesky in a new tab)
  • Bluesky“PrismML hopes its mini-LL.M. will change the way we use artificial intelligence If AI laboratory Prism ML It's not on your radar yet, and it should be — not…”Sep 18, 2026 · 0 likes · 0 replies (opens Bluesky in a new tab)
  • Bluesky“those huge datacentres? white elephants. #AI #business”Apr 8, 2026 · 0 likes · 0 replies (opens Bluesky in a new tab)
  • Bluesky“PrismML 1-bit 8B LLM!! 👀 prismml.com I tried and it’s not only fast but also generate somewhat okay looking answer to the question - ‘What is Causal…”Apr 1, 2026 · 0 likes · 0 replies (opens Bluesky in a new tab)
  • Bluesky“Show HN: 1-Bit Bonsai, the First Commercially Viable 1-Bit LLMs comments #prismml.com”Apr 1, 2026 · 0 likes · 0 replies (opens Bluesky in a new tab)