Discover

Every project in the index. Underrated first: good projects that haven’t been noticed yet.

12 projects

#llm-inference Python CLI Clear filters

forge
Reliability layer that makes local LLM tool calls succeed more often
Agent frameworks and tools AI models and runtimes
Antoine2.3k
OpenMed
Clinical entity extraction and PII de-identification on local hardware
AI models and runtimes Health and fitness Privacy and security
Maziyar Panahi5.7k
DFlash
Block diffusion draft models for faster LLM speculative decoding
AI models and runtimes
6.2k
MLX-VLM
Run and fine-tune vision language models locally on Apple silicon
AI models and runtimes
Prince Canuma5.6k
vllm-omni
Serving engine for multimodal, diffusion, speech, and action models
AI models and runtimes AI media
7.3k
ODS
Installer that sets up a complete private local AI stack on your own machine
AI models and runtimes Self-hosted alternatives AI apps
7.6k
whichllm
Command-line tool that ranks local LLMs that will run on your hardware
AI models and runtimes Developer tools
andy6.8k
Speech To Speech
Local voice agent pipeline chaining VAD, speech recognition, LLM and TTS
AI media Agent frameworks and tools AI models and runtimes
13.5k
oMLX
Local LLM server for Apple Silicon Macs with SSD-backed KV caching
AI models and runtimes
Jun Kim23k
Unsloth
Desktop and web app for running and fine-tuning local LLMs and diffusion models
AI models and runtimes AI apps
78.3k
Hugging Face Transformers
Python library defining pretrained models for text, vision, and audio
AI models and runtimes Languages and frameworks
168k
nanochat
Minimal codebase for training a small chat LLM end to end on one GPU node
AI models and runtimes Education
Andrej58.8k