• Picks
  • Discover
  • Alternatives
  • About

© 2026 Willet

  • Newsletter
  • About
  • FAQ
  • Terms
  • Privacy & Cookies
Join the Discord (opens in a new tab)
Manjeet Singh avatar

ANE

Research code for training transformers on Apple's Neural Engine

  • AI models and runtimes
View on GitHub

What it is

A proof-of-concept that runs transformer forward and backward passes directly on the Apple Neural Engine by calling reverse-engineered private APIs and generating MIL compute graphs, bypassing CoreML. It trains small models such as Stories110M and Qwen3-0.6B, keeps weight gradients and Adam updates on the CPU, and includes benchmarks for throughput, SRAM behavior, and INT8 quantization. Researchers probing NPU hardware on Apple Silicon can read it as a reference or fork it, but it is not a maintained framework.

Images

Facts

Stars
7,274 GitHub stars.
7,274

Forks
955
Commits
42
Contributors
8
Language
Objective-C
License
MIT
Last commit
Mar 10, 2026
On GitHub since
February 2026
Platforms
macOS, CLI
Self-hostable
No
Author
Manjeet Singh
Tags
  • model-training
  • machine-learning
  • reverse-engineering
  • local-ai
  • gpu-computing

Last synced from GitHub on Oct 20, 2026

The 10 best overlooked open-source projects, every Monday.

Share and more

Comments

No comments yet. Start the conversation.

Similar projects

  • ggml avatar

    llama.cpp

    C/C++ engine for running large language models on local hardware

    132k

What people are saying

Updated Oct 21, 2026
  • Hacker NewsGitHub – Maderix/ANE: Training Neural Networks on Apple Neural EngineMar 2, 2026 · 8 points · 0 comments (opens Hacker News in a new tab)
  • Hacker NewsTraining neural networks on Apple Neural Engine via reverse'd private APIsMar 4, 2026 · 3 points · 0 comments (opens Hacker News in a new tab)
  • Hacker NewsTraining neural networks on Apple Neural EngineMar 3, 2026 · 3 points · 0 comments (opens Hacker News in a new tab)