Topic
Gpt 4
4 episodes
-
Overview: In Context Learning
We finally slow down and explain in-context learning, the thing we keep leaning on whenever prompts, agents, examples, and adaptation come up. We make the core idea concrete: the model is learning from the temporary packet you hand it, without changing itself permanently.
-
Reddit Please wait for verification
Wildflower and Talon dig into a Reddit post from a Berlin consultant who read fifteen agentic-loop papers and landed on one thesis: the verifier predicts success, not the model. Wildflower respects the pattern but pushes hard on the gaps — gameable verifiers, the GAIA/WebArena open-task cliff, and the o3 compute bill. Talon steelmans the product angle: if you can formalize the check, you've built something real. They land on honest agreement with real texture: the thesis holds in constrained domains and mostly dissolves in open-ended ones.
-
From Context to Skills: Can Language Models Learn from Context Skillfully?
Cody and Justy dig into Ctx2Skill, a self-evolving framework that turns long, dense context into reusable natural-language skills for language models. They talk through the core loop, the role of Challenger, Reasoner, Judge, and the replay trick that keeps the system from drifting into weird overfit territory, then land on what it means for product teams trying to ship context-heavy workflows.
-
Contexts are Never Long Enough: Structured Reasoning for Scalable Question Answering over Long Document Sets
A new QA framework called SLIDERS handles document sets that outgrow any context window by storing extracted facts in a relational database and reasoning over them with SQL.