Writeups
Source-grounded explanations from our conversations and reporting.
OpenAI DevDay, Part 1 of 4: Managed State, Shared Context, and the Cost of Control
Part 1 follows developers from simpler conversation APIs and custom GPTs to tool execution, expressive speech, and the unresolved engineering questions behind vision.
OpenAI DevDay, Part 2 of 4: From Configuring Bots to Running Workflows
Part 2 of Latent Space’s DevDay recording explores conversational programming, managed retrieval’s limits, plugin migration, and Zapier’s move from chat actions to scheduled assistants.
OpenAI Functions: From Prompted JSON to Tool-Using Software
A June 2023 developer roundtable on native function calling, cheaper inference, and the decisions application code still needs to control.
OpenAI’s Agents Platform: From Tool Calls to Observable Workflows
The March 2025 launch conversation explains why Responses became a new API, how its tools compose, and how handoffs and traces could support better agents.
OpenRouter and the Marketplace for AI Models
Alex Atallah and Anjney Midha on model distribution, inference competition, fusion, and the security challenges of a growing token economy.
Outputmaxxing: Turning Compute Into Useful Work
Anj Midha’s case for a compute grid begins with idle accelerators and expands into a theory of frontier labs: pool resources, reduce coordination losses, and let the mission determine what to build.
Part 3 of 3: Finish the Research Story, Keep Senior Researchers Hands-On
Part 3 moves from writing before the experiments are settled to the environments that shape research judgment, then closes with an argument for building AI ecosystems around experienced technical contributors.
Periodic Labs’ AI Scientists Need the Physical Experiment
Liam Fedus and Ekin Doğuş Çubuk explain how uncertain measurements, simulation and lab automation fit into materials discovery.
Phind’s path from retrieved answers to coding models
Better context and stronger models turned a search product into a coding assistant. Specialized training promised more control over cost and capability; consistent correctness remained the harder problem.
Physical AI Has to Survive the Machine
Applied Intuition connects autonomy models to the engineering that makes them usable: sensor supervision, reliable operating systems, validated simulation and inference that fits the machine.
Playground’s Bet: Build the Model and the Graphics Editor Together
Better images are only part of the problem. Playground’s ambition connects model quality, precise editing, visual control, and feedback from people making things.
Post-Training’s Moving Bottlenecks: Rewards, Tokens, and Systems
Josh McGrath on the engineering behind reinforcement learning, efficient agents, and useful long context, in a conversation at NeurIPS 2025.
Post-Transformer Architectures in 2024: Cheaper Sequences, Finite Memory
Linear attention, state-space models and RWKV reduce the cost of processing sequences. Their harder challenge is preserving the information a task needs—and making that computation fast on real hardware.
Practical fine-tuning with Axolotl
From incompatible datasets to efficient training: how Axolotl turns model-building experience into reusable configuration.
Production AI Engineering Starts with Evals
Braintrust connects production logs, comparative evaluation, and interactive debugging so teams can improve AI behavior—and decide which work belongs in ordinary code.
RAG Is a Hack—and a System Worth Understanding
LlamaIndex’s early evolution shows why connecting language models to data requires more than a larger context window.
Railway, Part 2 of 3: Making Agent-Driven Infrastructure Safe to Change
Part 2 of the Railway conversation follows self-deploying workloads, durable workflows and cloneable environments to a practical question: how does faster code generation become safe production software?
Railway, Part 3 of 3: Lowering the Effort to Ship
Railway’s closing ambition is an instantaneous path from idea to shareable production deployment, pursued at every necessary layer of the stack.
Railway: Making Application Changes Cheap and Safe — Part 1 of 3
Deploying an application is only the beginning. Part 1 follows Railway’s approach to evolving it through environment versioning, owned hardware, agent interfaces and safer production experiments.
Reality: The Final Eval
Andon Labs tests whether agents can sustain a business, coordinate with people and act reliably in the physical world. Earnings matter—but so do the decisions that produce them.
Red teaming agents: from malicious inputs to consequential actions
Gray Swan connects adversarial testing, specialized guard models and system permissions to make agents safer without stripping away their usefulness.
Replicate’s path from runnable research to an API for AI builders
How a tool for sharing research became a platform for running and customizing models—and why packaging, GPU economics and hacker culture all mattered.
Replit’s code-model sprint: data pipelines, contextual completions, and the limits of benchmarks
From financial text analysis to Ghostwriter: a reading edition of the May 2023 conversation with Reza Shabani on training code models, evaluating their feel, and moving beyond autocomplete.
Retool’s AI bet: automate the workflow, keep engineers in control
Faster code generation leaves verification work behind. Retool’s bet is on AI inside business processes, with developers controlling the steps and people reviewing the results.
Retrieval After RAG: Search Built Around Storage, Concurrency, and Cost
An unaffordable recommendation feature led to Turbopuffer’s storage architecture. Agents issuing many searches at once are now changing its workload and economics.
RLHF 201: From Preference Labels to Model Behavior
How instruction tuning, reward models, and DPO turn feedback into model updates—and why the resulting behavior remains difficult to predict.
RWKV: Recurrent Language Models Meet a Website-Sized Problem
A browser-testing problem leads to cheaper token processing, multilingual models, and a crucial distinction: processing a long input is not the same as remembering it.
SAM 2: How an Interactive Demo Shaped Video Segmentation
Selecting an object is the beginning. SAM 2 connects tracking, correction and training data through an interface designed alongside the model.
SAM 3: Finding Every Instance—and Defining What Counts
Concept prompts let users name what they want to see. SAM 3’s architecture, data engine and deployment examples explain how that request becomes masks and tracks—and where human intent still matters.
Sam Schillace: Think with the Model, Plan with Code
A March 2024 conversation about combining model reasoning with software workflows—from a stubborn output format to a thousand-call textbook generator.
Public beta. Model source and teaching reviews passed; human editorial review is pending. Original articles and recordings remain separate.