Results for “context engineering”

…at all? Did you use any framework? No. You just stick it in context and then just run it in a loop until it ends call? [00:15:01] swyx: Yeah, there isn't even a loop, like Okay. Because the API is just based on sessions. It's always just…

…uh, by Workday, where you became director of machine learning engineering and now your Databricks. [00:01:06] So that's the quick bio and we can kind of go over Yeah. Step by step. But, uh, what's not on your LinkedIn that people [00:01:12]…

…for developers, it worked since they could fill in missing context in their heads. However, agents don’t have that luxury. Now in this new era of agents, everything has to be tighter. Agents need good developer experience too - Modal Blog…

…Speech Models26:58 Real-Time Encoder Advances27:45 Scaling Context for TTS28:53 What Makes Small Models30:37 Merging Modalities Tradeoffs33:05 Open Source Mission35:51 Lean and Formal Proofs38:40 Reasoning Transfer and Agents40:25 Next…

…path: Denmark → Shopify infra for nearly a decade → “angel engineering” across startups like Readwise, Replicate, and Causal → turbopuffer almost accidentally becoming a company • The Readwise origin story: building an early recommendation …

…on 70B+ high quality code and reasoning tokens Expanded context window to 16k tokens 5x faster than GPT-4 (100 tok/s vs 20 tok/s on single stream) 74.7% HumanEval vs 45% for the base model We’ve talked before about HumanEval being limited…

…[00:06:00] Yeah. [00:06:01] Challenges and Opportunities in AI Engineering [00:06:01] swyx: So like the, the general pushes is AI engineering, you know, like it's gotta, gotta wrap the shirt. And MCP is part of that, but like the, the…

…LLM Trends - Scaling Laws01:09:41 LLM Trends - Long Context vs RAG01:12:31 Long Context vs Finetuning01:14:14 If emergence is real, when does Efficiency work?01:17:41 MoEs and Upcycling01:20:47 The Efficiency Misnomer - Efficiency !=…

…once that happens, you can turn the crank. It becomes an engineering problem, which is something I like. That has to do with architecture, but it also very much has to do with data. If you don’t have data with the right information and…

…To reiterate a few points on why they matter: Longer context is not the motivation for sub-quadratic architectures: Transformers don’t inherently have hard limitations on context size, but they just get extremely expensive. When developing …

…focused on a different milestone: billion-dollar companies with engineering teams of just 20 people, enabled by AI assistance. This vision aligns with Dust's horizontal platform approach – building the infrastructure that allows small teams…

…which had a couple of I think really Keystone events in the context of what it means for the technical development of the AI field and and what you know where it leads how people's Frameworks are changing how people sort of sense that…