Discover

Every project in the index. Underrated first: good projects that haven’t been noticed yet.

16 projects

#model-optimization macOS Clear filters

Bonsai
Setup scripts to run Bonsai 2 low-bit models locally with chat UI
AI models and runtimes
3.4k
LiteRT
On-device runtime for running ML and generative AI models on edge hardware
AI models and runtimes
3.5k
DFlash
Block diffusion draft models for faster LLM speculative decoding
AI models and runtimes
6.2k
MLX-VLM
Run and fine-tune vision language models locally on Apple silicon
AI models and runtimes
Prince Canuma5.6k
Magnitude
Local LLM engine that auto-tunes GPU kernels for each model and chip
AI models and runtimes
7.2k
MLX-Audio
Speech synthesis, transcription and voice conversion on Apple Silicon
AI media AI models and runtimes
Prince Canuma8.1k
stable-diffusion.cpp
C/C++ inference engine for diffusion image and video models
AI models and runtimes AI media
leejet7.7k
Heretic
Automatic abliteration tool that strips refusal behavior from LLMs
AI models and runtimes
Philipp Emanuel Weidmann36k
colibrì
CPU inference engine that streams MoE model experts from disk
AI models and runtimes
Vincenzo Fornaro43k
llama.cpp
C/C++ engine for running large language models on local hardware
AI models and runtimes Self-hosted alternatives
132k
DwarfStar
Native C inference engine for running a few large open models locally
AI models and runtimes AI coding agents
Salvatore Sanfilippo24k
faster-whisper
Python library for fast Whisper speech transcription on CPU or GPU
AI media AI models and runtimes
26k
llmfit
Terminal tool that matches local LLMs to your CPU, RAM, and GPU
AI models and runtimes Developer tools
Alex Jones38.2k
AirLLM
Run very large language models on a single low-memory GPU
AI models and runtimes
Gavin Li39.7k
ONNX Runtime
Cross-platform engine for running and training ONNX machine learning models
AI models and runtimes
22.1k
BitNet
Inference engine for ternary 1.58-bit language models on CPU and GPU
AI models and runtimes
41.2k