Topic
Qwen 3
3 episodes
-
Many Shot CoT ICL: Making In Context Learning Truly Learn
Justy and Cody dig into a paper arguing that long-context chain-of-thought prompting behaves less like stuffing a prompt with relevant examples and more like teaching the model during inference. They unpack why many-shot tricks from classification break on reasoning, why semantic retrieval stops helping, and how the paper’s Curvilinear Demonstration Selection tries to order examples like a smooth mini-curriculum.
-
New KV cache compaction technique cuts LLM memory 50x without accuracy loss
MIT researchers developed Attention Matching, a KV cache compaction technique that achieves 50x memory reduction in LLMs without accuracy loss, solving a critical bottleneck for enterprise applications handling long contexts.
-
Self Hinting Language Models Enhance Reinforcement Learning
The paper explores how self-hinting language models can enhance reinforcement learning, particularly in overcoming the challenges faced when rewards are sparse. By introducing hints generated by the model itself during training, it reshapes the distribution of outcomes, allowing for better learning signals and improved performance on difficult prompts. This approach not only addresses existing limitations but also offers a novel way to adaptively guide the training process.