Back to Michael Wahl

CC-RLM: Self-Improving Context Engine

Prototype

70–80% fewer tokens, learned per session.

Problem: Dumping a whole repo into the context window is slow, expensive, and noisy.

A proxy layer for AI coding agents that replaces naive full-repo context injection with a live structural model (import graph, symbol index, diff state) and builds a sub-8K-token context pack per request. It learns which files matter by parsing which symbols the model actually cites, biasing future context toward them.

70–80% token reduction90% recall<200ms latency

Stack

PythonFastAPIlocal LLM (Ollama)SQLiteBM25AST walkersDocker