Topic
Token Efficiency
6 episodes
-
I ditched Ollama as my default runtime, and the replacement starts models in a fraction of the time
Laura and Harper dig into an XDA piece arguing that BaseRT is a better default local runtime than Ollama on Apple Silicon because it reaches first token much faster, especially on long prompts. They agree the claim is real but narrow: BaseRT looks strong for Mac-first, performance-sensitive workflows, while Ollama still wins on breadth, compatibility, and convenience.
-
Glm 5
Vince and Ava discuss Z dot A I's G L M five point three release, focusing on the claim that post-training alone drove the gains, with long-horizon task environments as the real lever.
-
Deep Agents v0
Deep Agents v0.7 ships a sixty-five percent token reduction by stripping the base system prompt, trimming tool descriptions, and making TodoListMiddleware opt-in — Masonry and Eyre dig into what the harness-gets-simpler pattern actually means in practice, where the Sonnet cost anomaly is a warning sign, and why configurability was the real missing piece.
-
Overview: Token Economics
We finally slow down on Token Economics: why tokens are the meter for cost, speed, memory, and product decisions in language models. We keep using the tiny-slip postage analogy until the whole thing clicks, from tokenization to context windows to real API bills.
-
SpaceXAI releases Grok 4.5, which Elon describes as an 'Opus class model' | TechCrunch
SpaceXAI unveils Grok 4.5 as an Opus-class model, touting two-times token efficiency and lower prices than Anthropic's Opus 4.7 and OpenAI's GPT 5.6 Luna. Fern sees a practical play for cost-sensitive users and asks if the agentic training on Cursor really changes anything. Lintel digs into the benchmarks and pricing math, pushing back on how much the claims actually hold up without hands-on testing.
-
Anthropic Lead: HTML Increasingly Better Than Markdown at Keeping Humans Engaged in Agentic Loops
Justy and Cody dig into Anthropic's HTML-over-Markdown argument and land on a pretty specific read: this is less a format holy war than an interface fix for long agent workflows where humans still need to steer, review, and stay mentally present.