Topic
Cross Entropy Loss
2 episodes
-
Overview: Loss Function
We’re finally slowing down and making loss function click: the scoreboard that tells a model how wrong it was, and the signal that lets training move in a useful direction. We also keep the usual Justy-Cody back-and-forth, because apparently even a loss function needs two friends arguing about it for forty minutes.
-
\ours: Advancing Masked Discrete Diffusion for High Resolution Image Synthesis
Discussion of \(\ours\) (NLD-Image), a masked discrete diffusion model that tackles two core problems in high-resolution text-to-image synthesis: the lack of self-correction in MDMs and the training difficulty with large codebooks. The paper introduces token editing for iterative refinement and Grouped Cross-Entropy (GCE) to alleviate codebook sparsity, achieving SOTA scores on GenEval, DPG, and HPSv3. Hosts debate its product readiness, mechanism soundness, and whether the gains justify the complexity.