Writeups
Source-grounded explanations from our conversations and reporting.
2024 in Agents: From Executable Actions to Useful Software Work
A practical account of coding agents: how they use tools, recover from errors, reuse workflows, and turn human feedback into completed work.
2024 in Vision: From Moving Pictures to Reading the Needle
Video generation, segmentation with memory, faster detectors, and the challenge of teaching small models to see precise details.
A data copilot needs to know what your metrics mean
Statsbot’s early Slack interface exposed two problems: understanding a question and understanding the data. Cube’s semantic layer separated them—and foundation models reopened the conversational side.
A Farewell Until GTC — Part 3 of 3
Part 3 of 3: the closing exchange of Latent Space’s conversation on NVIDIA’s AI engineering.
Abridge: From Clinical Notes to Decisions During the Visit
Ambient documentation gives Abridge a starting point for a harder problem: delivering accurate, timely assistance while clinicians can still act on it.
After DevDay: Open Models, Faster Tools, and the Work of Building — Part 4 of 4
Part 4 of 4 moves from an open-source community gathering to Julius AI’s practical priorities: faster answers, multiple tool calls, visual feedback, and building useful products alongside a competing platform.
After SWE-bench: Evaluating What Happens After the Patch
From broader task coverage to persistent codebases, coding evaluations are confronting what it means for an agent to do useful development.
Agent engineering with Pydantic: types, graphs, and observable execution
Pydantic’s approach to agents connects data contracts, explicit control flow, and visibility into running applications.
AI Engineering Starts at the Model Boundary
A June 2024 conversation about turning foundation models into products, learning from deployment, and planning for changing inference costs and capabilities.
AI for Materials Discovery: From Molecular Designs to Materials That Work
Unexpected polymer designs, active learning and quantum chemistry reveal what it takes to turn a promising prediction into a useful material.
AI Is Eating Search: What Websites Must Deliver
As assistants take over discovery and reading, businesses need content that survives search selection, answers concrete questions, and reaches the model intact.
AI Startups in 2024: Cheaper Models, Harder Product Questions
Closer model competition widened the opportunity for startups. Conviction’s NeurIPS 2024 keynote examined where that opportunity depended on better models—and where it depended on data, distribution and execution.
AI Startups: From Data Infrastructure to Products That Learn
The dbt–Fivetran merger, oversized seed rounds, and the product case for memory and continual learning.
AI Video’s New Bottlenecks: Characters, Control, and Distribution
Generating a clip is becoming easier. Sustaining a character, controlling the result, and turning attention into a business still take work.
AI’s Bottlenecks Move Beyond the GPU — Part 3 of 3
The final part follows AI infrastructure from financing and chip supply to memory budgets, specialized accelerators and CPU demand, before closing on writing habits and the value of stepping away.
AI’s Capital Flywheel—and the Businesses It Might Leave Standing
Young AI companies need enormous resources before they have mature businesses. Whether that capital sustains an application ecosystem or finances its competitors remains an open question.
Alex Zhang on What Agent Harnesses Can Teach a Language Model
From GPU kernels to recursive language models, the researcher asks how a system’s structure changes what its components can accomplish.
Amp: Build the Agent, Keep the Scaffolding Disposable
How Amp approaches a moving target: model-specific tools, fewer product commitments, deliberate context selection, and fast feedback from tests and human review.
Answer.AI’s small-team bet: reuse models, remove friction, build better tools
Continuous training, self-directed research and a simpler application stack underpin the ambition to build thousands of useful products with roughly 12 people.
Arena’s evaluation problem: earning the usage that makes a benchmark useful
Real user tasks make Arena’s evaluations valuable. Funding those requests, retaining users, and deciding what to publish make the benchmark a product and governance challenge.
Artificial Analysis: What a Model Benchmark Has to Measure
Choosing a model means comparing capability, behavior, speed and the cost of completing the work. Artificial Analysis builds evaluations around those trade-offs.
Async Agents Need More Than a Coding Model
Devin and OpenInspect show what background coding requires: shared sessions, working environments, useful tests, scoped memory and review that keeps repositories maintainable.
Autonomous Drones: From a Lost Video Link to Mass Deployment
How onboard autonomy changes drone operation—and why mission verification, manufacturing, and the economics of defense matter as much as the AI.
Axiom’s Bet: Make Reasoning Checkable, Then Scale It
Formal proofs give AI a checkable target for learning and generation. Axiom’s challenge extends from finding proofs to specifying the right problem, managing large searches, and making results reusable.
Bee: Building an Ambient Agent That Remembers and Acts
Wearable audio gives Bee context without constant explanation. Turning that context into useful help requires editable memory, selective attention, and careful choices about power and permission.
Benchmarks 101: What a Model’s Score Actually Tells You
A benchmark tests particular capabilities under particular conditions. Understanding those choices helps explain both model progress and the gap between a leaderboard score and a useful product.
Benchmarks 201: What a Leaderboard Score Actually Measures
Clémentine Fourrier on reproducible comparisons, the limits of preference rankings, and the engineering choices behind model scores, from the July 2024 conversation.
Benchmarks, Self-RAG, and Step-by-Step Verification — Part 3 of 5
Part 3 follows an agent’s failed travel plan into the science of benchmarks, then examines how Self-RAG and process supervision use intermediate judgments to select better outputs.
Better training data starts with what the model still needs to learn
Datology’s case for optimizing filtering, rewriting and training order together—and measuring their value in learning efficiency, model capability and inference cost.
Beyond AlphaFold: Boltz’s Path from Structure Prediction to Molecular Design
How evolutionary clues, generative models and inference-time search support molecular design—and why useful predictions still have to survive experiments.
Public beta. Model source and teaching reviews passed; human editorial review is pending. Original articles and recordings remain separate.