• Picks
  • Discover
  • Alternatives
  • About

© 2026 Willet

  • Newsletter
  • About
  • FAQ
  • Terms
  • Privacy & Cookies
Join the Discord (opens in a new tab)
az avatar

RLM

Inference library letting language models recursively call themselves via a REPL

  • Agent frameworks and tools
  • AI models and runtimes
View on GitHub
Website

What it is

A Python library implementing Recursive Language Models, where an LLM handles very long inputs by loading them into a variable inside a code REPL and launching sub-model calls on pieces of it. It wraps API-based and local models behind a drop-in completion call and can run generated code locally, in IPython, Docker, or cloud sandboxes such as Modal, E2B, Daytona, and Prime. A training environment for reinforcement learning is included, and researchers and developers use it to experiment with long-context reasoning beyond a model's native window.

Images

Facts

Stars
5,703 GitHub stars.
5,703

Forks
918
Commits
143
Contributors
21
Language
Python
License
MIT
Last commit
Sep 24, 2026
On GitHub since
December 2025
First release
January 2026
Platforms
library
Self-hostable
No
Author
az
Tags
  • agent-sandbox
  • reinforcement-learning
  • llm-inference
  • context-engineering
  • ai-agents

Last synced from GitHub on Oct 20, 2026

The 10 best overlooked open-source projects, every Monday.

Share and more

Comments

No comments yet. Start the conversation.

Similar projects

  • Pydantic avatar

    Monty

    Python interpreter in Rust for safely running LLM-generated code

    8.7k
  • OpenAI avatar

    OpenAI Agents SDK

    Python SDK for building multi-agent LLM workflows with tools and handoffs

    30.2k
  • LangChain avatar

    Deep Agents

    Opinionated Python agent harness with sub-agents, files, and memory

    30.4k

What people are saying

Updated Oct 21, 2026
  • Hacker NewsRecursive Language ModelsJan 3, 2026 · 161 points · 23 comments (opens Hacker News in a new tab)
  • Bluesky“A study on Recursive Language Models (RLMs) shows they can process inputs up to 100 million tokens, vastly outperforming standard LLMs. RLMs allow models to…”Jan 29, 2026 · 27 likes · 0 replies (opens Bluesky in a new tab)
  • Bluesky“An official RLM repo, with native support for cloud-based and local REPLs.”Jan 3, 2026 · 12 likes · 0 replies (opens Bluesky in a new tab)
  • Bluesky“Sure. This is mostly true of older LLM architectures, but they're not the only thing out there. I'm seeing plenty of evidence in the field that not only can…”Mar 6, 2026 · 3 likes · 1 reply (opens Bluesky in a new tab)
  • Hacker NewsRLM: LLMs to process arbitrarily long prompts with inference-time scaling (2025)Apr 27, 2026 · 2 points · 1 comment (opens Hacker News in a new tab)
  • Bluesky“I've been implementing something similar to this paper, against 8b models locally and it's been really interesting watching their capability grow from the…”Jun 3, 2026 · 1 like · 1 reply (opens Bluesky in a new tab)
  • Hacker NewsRecursive Language Models (RLM): near-infinite context via recursive sub-queriesMay 18, 2026 · 2 points · 0 comments (opens Hacker News in a new tab)
  • Hacker NewsRLMs process inputs up to two orders of magnitude beyond model context windowsApr 24, 2026 · 2 points · 0 comments (opens Hacker News in a new tab)
  • Bluesky“What's the best way to expand the context window of a language models? With more language models! MIT just demonstrated a technique for chunking a model's…”Jan 20, 2026 · 2 likes · 0 replies (opens Bluesky in a new tab)
  • Hacker NewsGeneral plug-and-play inference lib for RLMsJan 4, 2026 · 1 point · 1 comment (opens Hacker News in a new tab)
  • Bluesky“Okay, so this makes me want to keep researching AI. It basically introduces symbolic representations and relies on the LLM to construct the program/language.”Jun 22, 2026 · 1 like · 0 replies (opens Bluesky in a new tab)
  • Bluesky“Successfully plugged #cerebras #gptoss into the framework from the Recursive Language Models paper @ Getting ready to test it out on some long context…”Feb 23, 2026 · 0 likes · 1 reply (opens Bluesky in a new tab)
  • Bluesky“With the launch of dspy's RLM() module I took some time to look at the RLM paper, and it's a banger”Jan 21, 2026 · 0 likes · 1 reply (opens Bluesky in a new tab)
  • Bluesky“context limits biting? RLM lets a model offload its context into a REPL and call itself over the pieces. just swap llm.completion for rlm.completion for…”Jun 18, 2026 · 0 likes · 0 replies (opens Bluesky in a new tab)
  • Bluesky“[2512.24601] Recursive Language Models”Apr 24, 2026 · 0 likes · 0 replies (opens Bluesky in a new tab)
  • Bluesky“Recursive Language Models (RLM): treat memory as an external environment + recursive calls. Interesting direction for long-context agents. Paper: Code:”Mar 22, 2026 · 0 likes · 0 replies (opens Bluesky in a new tab)
  • Bluesky“Looks like the AI context management problem is being solved”Jan 15, 2026 · 0 likes · 0 replies (opens Bluesky in a new tab)