local-ai
4 articles
MemPalace: An AI That Remembers You — Your Whole Life, in ~120 Tokens
MemPalace: open-source AI memory that scored the first-ever perfect 500/500 on LongMemEval, 2x Mem0 on ConvoMem, and 100% on LoCoMo. Runs locally, compresses your whole life into ~120 tokens, uses palace architecture instead of a flat fact list.
llama.cpp Hits 100k Stars — Georgi Gerganov's Love Letter to Local AI
llama.cpp just crossed 100k stars. Creator Georgi Gerganov reflects on the progress of local LLMs, the agentic era, 'good enough intelligence,' and why he believes an open, portable software stack is the only path that makes sense.
Running a Trillion-Parameter Model on a MacBook? The Wild SSD Streaming Experiment
Simon Willison shared a new trend in running massive MoE models on Macs: streaming expert weights from SSD instead of cramming everything into RAM. Even a trillion-parameter Kimi K2.5 runs on a 96GB MacBook Pro.
Hermes Just Performed Brain Surgery on Itself: A Local AI Agent Hot-Swapped Its Own Model Weights
A local AI agent called Hermes downloaded and switched to a new model (qwopus) without stopping — like swapping a plane's engine mid-flight. Teknium from Nous Research saw it and said 'submit this to a hackathon.'