Topic
Qwen
14 episodes
-
Improving Agents is a Data Mining Problem
Laura and Harper dig into Vivek Trivedy's claim that improving agents is fundamentally a data-mining problem, unpacking what that means for continual learning, harness engineering, and who should actually care.
-
Viability of local models for coding
Birgitta Böckeler tests local LLM viability for coding after a year away from the space. She maps a complex web of factors—RAM, model size, quantization, tool calling, context windows, reasoning modes—that determine whether small models actually work for agentic coding on consumer hardware (M3 Max / M5 Pro). Her core finding: locals are runneable and faster than a year ago, but tool calling is still shaky, reasoning can backfire, and quality is hit-or-miss. She's not claiming local models are ready to replace cloud APIs; she's charting what actually works and what doesn't on real machines.
-
Morphing into Hybrid Attention Models
Talon and Wildflower discuss FlashMorph, a new method for choosing which Transformer layers should keep full attention when converting pretrained LLMs into hybrid attention models.
-
AI agent tool routing cuts token use 99% | VentureBeat
Cooper and Miles dig into Alibaba's SkillWeaver paper via the VentureBeat write-up, landing on the real claim: tool routing breaks when decomposition vocabulary doesn't match the tool library, and the fix is a retrieval feedback loop that rewrites the plan around actual available skills. They like the systems shape, question some benchmark framing, and agree the practical takeaway is for teams with large tool catalogs, not everyone building simple agents.
-
Building a 100x Cheaper Trace Judge with Fireworks
LangChain Labs and Fireworks built a fine-tuned Qwen model to detect 'perceived error' in production agent traces—matching frontier performance at up to 100x lower cost. The model judges user-visible mistakes (corrections, rejections, repeats) from human-AI messages only, tested across two internal datasets (chat-langchain Docs Q&A and Fleet no-code agents).
-
Skip a Layer or Loop It? Learning Program of Layers in LLMs
Justy and Cody dig into PoLar, a paper arguing that a pretrained LLM does not need to run its layers in one fixed order for every input. They talk through the main idea of treating layers like reusable functions that can be skipped or repeated, how the authors used Monte Carlo Tree Search to discover better layer programs, and why a lightweight predictor makes the idea more practical. The conversation centers on what problem this solves, why dynamic depth methods have been too narrow, and whether this feels like a research curiosity or an actual path to deployment.
-
Qwen AI Releases Qwen Scope an Open Source Sparse Autoencoders Sae Suite That Turns LLM Internal Features Into Practical Development Tools
Justy and Cody unpack Qwen-Scope, Qwen AI’s open-source sparse autoencoder suite for making LLM internals more usable in debugging, steering, and benchmark analysis.
-
Recursive Multi Agent Systems
RecursiveMAS is a new multi-agent framework from researchers at UIUC, Stanford, NVIDIA, and MIT that replaces text-based agent handoffs with latent-space recursion — cutting token usage by up to 75%, speeding up inference 2.4x, and improving accuracy by 8.3% across nine benchmarks. Justy and Cody dig into why passing hidden states instead of words is such a big deal, what the RecursiveLink module actually does, and whether any of this is shippable today.
-
MIT's new fine tuning method lets LLMs learn new skills without losing old ones
MIT researchers developed self-distillation fine-tuning (SDFT), a technique that lets large language models learn new skills without forgetting old ones. By using a model's own in-context learning abilities as both teacher and student, SDFT solves the catastrophic forgetting problem that forces companies to maintain separate models for each task.
-
Outcome Accuracy is Not Enough: Aligning the Reasoning Process of Reward Models
Deep dive into fixing deceptive alignment in reward models - why getting the right answer isn't enough if the reasoning is wrong, and how a hybrid training approach combining outcome accuracy with rationale consistency achieves state-of-the-art performance while solving a critical RLHF generalization problem.
-
MAXS: Meta Adaptive Exploration with LLM Agents
MAXS introduces an innovative framework for improving the reasoning capabilities of LLM agents, addressing critical issues in multi-tool reasoning. The integration of lookahead strategies and trajectory convergence allows for more stable and efficient performance, making it highly relevant for developers and practitioners.
-
Minimax M2 Is the New King of Open Source LLMs Especially for Agentic Tool
The Minimax M2 model emerges as a powerful open-source language model, enabling advancements in AI agents and tool usage, making AI more accessible and efficient for diverse applications.
-
Paper page Stabilizing Reinforcement Learning with LLMs: Formulation and Practices
This dialogue explores the advances in reinforcement learning (RL) through the integration of large language models (LLMs), specifically focusing on a recent study that provides new strategies for stabilizing RL training. The conversation highlights practical implications, potential use cases, and the future of RL in practical applications.
-
How to Use Frontier Vision LLMs: Qwen3 VL | Towards Data Science
Large Language Models How to Use Frontier Vision LLMs: Qwen3-VL Learn how you can use vision language models to perform advanced document understanding tasks. Eivind Kjosbakken Oct 20, 2025 11 min read Share Learn how to use vision LLMs.