Topic
Mlflow
2 episodes
-
How to Build a Production Architecture for Small Language Model Fleets
The article discusses building a production architecture for small language model fleets, focusing on avoiding model rot. It proposes a solution involving a Model Registry, Gateway Pattern, and Manifest-based Delivery System.
-
Evaluating AI Agents in Practice: Benchmarks, Frameworks, and Lessons Learned
Deep dive into practical AI agent evaluation frameworks, moving beyond traditional NLP metrics to assess real-world behavior, reliability, and production readiness. Covers hybrid evaluation approaches, operational constraints, and specific tools like MLflow, TruLens, and LangChain Evals.