Series
Local LLM Lab Notes
Model evidence: where local models help and where frontier models still earn the electricity.
Recommended First
Artifact Types
Validation Result, Risk Register Note
Public Posts
- Local LLMs and the Offline Factory
The question stopped being can this Mac run a model, and became can the factory decide which worker does which job, with evidence.
- Five of Six Model Names Didn't Exist
The first real overnight machine-setup run failed on model names that looked completely plausible and were completely invented. The registry had tracked their checksums as unverified for weeks. Nobody had ever checked the names.
- The Indexer Nobody Called
The symbol indexer was built in week one. It had tests, structure, and a job. Weeks later, wiring up the graph layer, I found the truth in passing: no production code had ever called it. The repo map had been silently empty on every real run.
- The 3B Model Writes the Brief
The small local model keeps failing at the actual work, so the obvious conclusion is that it's useless. The gateway found the job it's genuinely good at: writing the structured brief a frontier model executes. The intern doesn't do the surgery. The intern preps the theatre.
Draft Queue
No draft placeholders assigned to this series yet.