Topic
Subquadratic
2 episodes
-
A Startup Claims It Broke Through a Bottleneck Thats Holding Back LLMs
Subquadratic claims its SubQ model breaks the dense attention bottleneck in LLMs, offering 12x context, near-SOTA performance, and radical efficiency. Third-party Appen benchmarks validate speed/cost claims, but full reproducibility and open access remain pending. Cody questions the 'transformer-replacement' hype; Justy sees a niche for high-throughput document and code analysis.
-
The context window has been shattered: Subquadratic debuts a 12 Million Token window
Cody is skeptical that a 12-million-token context window is broadly useful today, while Justy pushes the angle that it solves a very real pain point for teams with giant codebases, logs, and long-running workflows. They land on it as a real technical milestone with a narrow early market, plus a lot of unanswered questions about cost, latency, and whether most users need this kind of scale.