Find your next rabbit hole.

Part 3 of 3 examines the work behind clear interpretability papers, the infrastructure that speeds up subsequent investigations, and the questions newcomers can pursue.

Vector search remains useful. The question is whether it needs a separate database—and how retrieval should fit the application’s data, quality requirements, and workload.

From Cicero’s unusual moves to coding agents and multi-agent learning: what extra reasoning buys, and why objectives, experience and elapsed time still matter.

Synthetic children’s stories make coherence, elementary reasoning and model internals accessible to small experiments. Which lessons transfer to larger models remains an open question.

Good-looking arrows, digital ink, and reusable canvas interactions led to a workspace for expressing intent—and revising what a model produces.

Together connects data selection, model architecture and GPU systems to lower the cost of building and serving models. Its goal of 5,000 tokens per second reaches beyond faster chat.

The engineering behind reliable clusters, predictable training runs, and evaluations that measure useful coding capabilities.

Gradient’s context-extension work combines positional scaling, distributed training and carefully constructed data. The harder test is whether a model can use the extra information.

How Hugging Face’s M4 team connected pretrained models, built interleaved web data, debugged unstable attention and planned a smaller successor.

How training budgets, numerical precision, memory and communication shape the practical work of running large language models.

AI-assisted scattering calculations show how a well-posed question, a simplifying assumption, and expert verification can turn an unwieldy expression into a research result.

Part 2 of 6: VideoPoet turns video generation into sequence modeling; Tali Dekel explores controllable editing through neural atlases and motion features; Sander Dieleman begins a geometric introduction to diffusion.