Topic
Mmlu
2 episodes
-
Expert Personas Improve LLM Alignment but Damage Accuracy: Bootstrapping Intent Based Persona Routing with PRISM
Episode 248 dives into a USC research paper that solves the persona prompting puzzle: why expert personas sometimes help LLMs and sometimes hurt them. The team discovered that personas boost alignment tasks like safety and style but damage knowledge retrieval accuracy. They built PRISM, a self-bootstrapping system that routes queries to personas only when they actually help, using no external data.
-
LLM Evaluation 4 Approaches
Understanding the 4 Main Approaches to LLM Evaluation (From Scratch) Multiple-Choice Benchmarks, Verifiers, Leaderboards, and LLM Judges with Code Examples Sebastian Raschka, PhD Oct 05, 2025 319 25 30 Share How do we actually evaluate LLMs? It’s a simple question, but one that tends to open up a much bigger discussion.