Topic
Group Relative Policy Optimization Grpo
3 episodes
-
DART SD: Diamond topology Aware Retrieval and Tuning for Self Distillation of Multi Turn Tool Calling Agents
Edmund and Geffen discuss the ByteDance/USTC paper DART-SD, which tackles 'topological collapse' in agent distillation. They discuss how moving from linear trajectory imitation to a diamond-topology graph (ISTG) allows student models to learn recovery from errors without destroying their own valid reasoning paths.
-
GitHub FareedKhan Dev/train LLM From scratch: A straightforward method for training your LLM, from downloading data to generating text.
A single-GPU end-to-end LLM training guide lands on GitHub—hand-written PyTorch, pretrain to chat in one repo, plus full RLHF. Vince is giddy; Ava wants to know which corner of the GPU shelf this actually runs on. Build Next shows the exact CLI to kick it off on a T4.
-
HarnessX rewrites AI scaffolding mid task | VentureBeat
Xiaomi's HarnessX treats AI agent scaffolding as a first-class, modular object that can evolve mid-task without changing the underlying model. A trace-driven RL engine (AEGIS) automatically rewrites harness components—prompts, tool integrations, memory, control flow—while safeguarding against reward hacking and catastrophic forgetting. When paired with model fine-tuning on execution data (cross-harness GRPO), smaller models like Qwen3.5-9B see +44% gains on embodied planning, suggesting harness engineering, not just model scale, is the real bottleneck for enterprise agents.