← AI NewsAI News

Is Harness Engineering real?

a quiet day lets us reflect on a central debate in AI engineering

A common debate in my finance days was about the value of the human vs the value of the seat: if a trader made $3m in profits, how much of it was because of her skills, and how much was because of the position/institution/brand she is in, and any generally competent human could have made the same results?

The same debate is currently raging in “Harness Engineering”, the systems subset of Agent Engineering, and the main job of Agent Labs. The central tension is between Big Model and Big Harness. [An AI framework founder you all know] once confided in me at an OpenAI event: “I’m not even sure these guys want me to exist.”

Aside: let’s define Harness — “In every engineering discipline, a harness is the same thing: the layer that connects, protects, and orchestrates components — without doing the work itself.“

And, talking with the Big Model guys, you really see it:

  • Every podcast with Boris Cherny and Cat Wu emphasizes how minimal the harness of Claude Code is, meaning their job is mostly letting the model express its full power in the way that only the model maker knows best:

    • Boris: “I would say like there’s nothing that secret in the source. And obviously it’s all JavaScript, so you can just decompile it. Compilation’s out there. It’s very interesting. Yeah. And generally our approach is, you know, all the secret sauce, it’s all in the model. And this is the thinnest possible wrapper over the model. We literally could not build anything more minimal. This is the most minimal thing.

    • Cat [01:09:21]: It is very much the simplest thing I think by design.

    • Boris [01:09:25]: So it’s got simpler. It got simpler. It doesn’t go more complex. We’ve rewritten it from scratch probably every three weeks, four weeks or something. And it just like all the, it’s like a ship of Theseus, right? Like every piece keeps getting swapped out and just cause quad is so good at writing its own code.”

  • OpenAI’s own piece on Harness Engineering (with upcoming guest Ryan Lopopolo on the Codex team) emphasizes how simple it is to start. Of course, with the “execuhire” of OpenClaw, OpenAI are now big investors of the world’s most successful open source harness.

  • Noam Brown: “before the reasoning models emerged, there was like all of this work that went into engineering agentic systems that like made a lot of calls to GPT-4o or like these non-reasoning models to get reasoning behavior. And then it turns out we just created reasoning models and they, you don’t need this complex behavior. In fact, in many ways, it makes it worse. Like you just give the reasoning model the same question without any sort of scaffolding and it just does it. And so people are building scaffolding on top of the reasoning models right now. But I think in many ways, those scaffolds will also just be replaced by the reasoning models and models in general becoming more capable. And similarly, I think things like model routers, we’ve said pretty openly that we want to move to a world where there is a single unified model. And in that world, you shouldn’t need a router on top of the model.”

  • METR saying Claude Code and Codex don’t beat a basic scaffold:

  • Scale AI’s SWE-Atlas is finds that Opus 4.6 does 2.5 points better in Claude Code than in the generic SWE-Agent, but the reverse for GPT 5.2, making the harness you choose essentially noise within the margin of error:

And yet. The Big Harness guys disagree:

  • The Harness is the Product:

    • Every production agent converges on this core loop:That is it. The entire architecture of Claude Code, Cursor’s agent, and Manus fits inside that loop.

  • Jerry Liu: “The Model Harness is Everything — the biggest barrier to getting value from AI is your own ability to context and workflow engineer the models. This is *especially* true the more horizontal the tool that you’re using.”

  • Improving 15 LLMs at Coding in One Afternoon. Only the Harness Changed shows dramatic improvements in every model when you optimize the harness (Pi)

Obviously Big Harness guys are trying to sell you their Harness, Big Model guys are trying to sell you their Model. The ML/AI industry has always had some form of milquetoast “compound AI” debate that tells you both are valuable. But perhaps the times are changing.

On Latent Space we’ve been very, very respectful of the Bitter Lesson, but increasingly as the Agent Labs thesis has played out (with Cursor now valued at $50B), we are acknowledging that “Harness Engineering” has real value. AIE Europe now has the world’s first Harness Engineering track, and if you are keen on this debate, you should join.


AI News for 3/3/2026-3/4/2026. We checked 12 subreddits, 544 Twitters and 24 Discords (264 channels, and 14242 messages) for you. Estimated reading time saved (at 200wpm): 1397 minutes. AINews’ website lets you search all past issues. As a reminder, AINews is now a section of Latent Space. You can opt in/out of email frequencies!


AI Twitter Recap

Frontier model shipping: Gemini 3.1 Flash-Lite, GPT-5.4 rumors, and “agent-first” product positioning

  • Gemini 3.1 Flash-Lite positioning (speed/$): Demis Hassabis teased Gemini 3.1 Flash-Lite as “incredibly fast and cost-efficient” for its performance—clearly framing the model line around latency and cost per capability rather than raw frontier scores (tweet). Related product chatter highlights NotebookLM as a “favorite AI tool” (tweet) and a major new NotebookLM Studio feature: Cinematic Video Overviews that generate bespoke, immersive videos from user sources for Ultra users (tweet).

  • GPT-5.4 leak narrative (The Information): Multiple tweets amplify a report that GPT-5.4 is coming with a ~1M token context window and a new “extreme reasoning mode” that can “think for hours,” targeting long-horizon agentic workflows and lower complex-task error rates (tweet, tweet, tweet). There’s also speculation that OpenAI is shifting to more frequent (monthly) model updates (tweet). Separately, one arena watcher claims “GPT-5.4 landed in the arena,” implying an imminent release window (tweet). Treat all of this as unconfirmed unless corroborated by OpenAI.

  • Claude as “agent behavior” leader, not just coding: Nat Lambert argues the discussion should shift from Anthropic “going all-in on code” to their lead on general agent behavior, implying coding capability will commoditize but agent robustness will not (tweet). MathArena evaluation adds a datapoint: Claude Opus 4.6 is strong overall but weak on visual mathematics, and costly to evaluate (claimed ~$8k) (tweet).


Alibaba Qwen “shakeup”: org design, compute access, and open-model dependency

  • Leadership exits + restructuring claims: A central thread across the dataset is that Qwen’s lead Lin Junyang stepped down amid an alleged internal restructuring that moves from a vertically integrated team toward horizontal splits (pretraining/post-training/multimodal/infra), reducing unified control and potentially conflicting with the team’s previous “tight integration” philosophy (tweet, plus follow-on context tweet). Simon Willison summarizes the situation and notes multiple apparent resignations around the release of Qwen 3.5 (tweet).

  • Emergency all-hands and “compute irony”: Reporting relayed via Poe Zhao describes Alibaba CEO Eddie Wu holding an emergency meeting; Qwen team members challenged leadership on restructuring, compute allocation, and model strategy. The most pointed detail: Alibaba Cloud’s CTO allegedly acknowledged that external customers had smoother access to compute than the internal Qwen team (tweet). This triggered reassessment among observers who assumed Qwen was “GPU-rich” (tweet).

  • How dominant Qwen is in research workflows: One claim (from a tweet summarizing HF paper usage) is that Qwen is the #1 open model in 2025–2026 HF papers, used in 41% of 7,692 papers, and ~50% in May 2025 around Qwen3’s release (tweet). Whether exact numbers hold or not, the meta-point stands: ecosystem dependence on a small core team is a real risk.

  • Open-weights existential risk framing: Nat Lambert argues open-weight frontier efforts may concentrate into only a few actors with business incentives: non-profits, NVIDIA (hardware pull-through), and Meta (commoditize complements)—a lens that makes Qwen’s corporate-strategy misalignment feel structurally likely, not anomalous (tweet).

  • Model/infra technical notes from the Qwen orbit: RASBT notes Gated DeltaNet modules can avoid KV-cache growth, making Qwen 3.5 more memory-friendly than Qwen3 under a claimed ratio (tweet). Meanwhile, users report llama.cpp doom loops with Qwen sampling params at ~20% context even at higher quants (tweet)—a reminder that “recommended decoding” can be brittle across runtimes.


Inference & systems: Speculative Speculative Decoding, vLLM scaling, and kernel-generation agents

  • Speculative Speculative Decoding (SSD): Tanishq Kumar introduces SSD, claiming up to 2× faster than leading inference engines (vLLM, SGLang), collaborating with Tri Dao and Avner May (tweet; Avner’s announcement tweet). Tri Dao frames it as “attack of the asynchronous machines,” tying the approach to lessons from GPU kernel async design (tweet). If validated, this is one of the more concrete algorithmic “speed” stories in the set.

  • Production inference pragmatics: A practical guide is shared on scaling vLLM under OOM/instability—emphasizing workload profiling + tuned configs over raw hardware (tweet).

  • Agentic RL for CUDA kernels (ByteDance): A ByteDance paper summary describes CUDA Agent: an agentic RL setup that writes CUDA kernels in a secure test environment, optimizing for speedups vs baselines; claims include up to ~100% faster components than traditional automated tools in some cases (tweet). Even allowing for “thread summary inflation,” the research direction—closed-loop code→benchmark→reward for performance engineering—is credible and strategically important.


Coding agents & dev tooling: Codex on Windows, VS Code “Agent DX,” Symphony, LangSmith Skills

  • Codex app lands on Windows + open-source sandbox: OpenAI DevRel announces Codex for Windows with a Windows-native agent sandbox, using OS controls (restricted tokens, ACLs, dedicated users) to constrain filesystem/network access unless approved; implementation is open source (tweet, tweet). AJ Ambrosino adds details: runs natively or via WSL; supports PowerShell/CMD/Git Bash/WSL terminals; “Open in …” integrations and Windows skills (tweet). Reach_vb highlights the OSS sandbox as an underrated artifact (tweet).

  • VS Code’s agent-oriented release: The @code account emphasizes “Agents, for real work,” shipping hooks, message steering/queueing, integrated agentic browser, and shared memory (tweet). A process change matters for builders: VS Code is moving from monthly to weekly shipping of main to accelerate feature delivery (tweet).

  • OpenAI Symphony (ticket-board→agents orchestration): A new OpenAI repo, Symphony, is described as an orchestration layer that polls project boards and spawns agents per ticket lifecycle stage—shifting the UX from “prompt the agent” to “move tickets and let agents execute” (tweet). This is consistent with the broader trend toward workflow-native agent automation.

  • LangSmith Skills + CLI (agents doing agent engineering): LangChain ships LangSmith Skills + CLI so coding agents can natively debug traces, build datasets, and run experiments from the terminal (tweet). In parallel, LangChain OSS Skills aim to teach agents how to use LangChain/LangGraph/DeepAgents effectively (tweet, tweet).

  • Cursor via Agent Client Protocol in JetBrains: Cursor announces availability in JetBrains IDEs through Agent Client Protocol (tweet). This is a key distribution move: IDE-native access without forcing a tool switch.


Multimodal + world models: Self-Flow, Beyond Language Modeling, persistent video, and NE-Dreamer

  • Black Forest Labs’ Self-Flow: BFL previews Self-Flow, a self-supervised flow-matching approach for multimodal generative models (image/video/audio/text) that avoids relying on external pretrained representation models (e.g., DINO). Claimed results: up to 2.8× faster convergence, improved video temporal consistency, sharper typography; positioned as foundational for multimodal visual intelligence and even action prediction (tweet; additional context tweet).

  • “Beyond Language Modeling” / vision-first multimodal pretraining: Multiple authors promote a paper exploring native multimodal models where vision is treated as first-class and models input/output all modalities “Transfusion-style,” including discussion of representations, data, world modeling, architecture, and scaling laws (tweet, tweet, tweet). The throughline: the field may be underestimating how much progress requires vision-native training, not language-first adapters.

  • Long-context video world models: Gordon Wetzstein’s thread teases “Mode Seeking meets Mean Seeking (MMM)” as a route to long-context, persistent video world models via a unified representation (tweet).

  • NE-Dreamer: embedding prediction instead of pixel reconstruction: George Bredis introduces NE-Dreamer, exploring world models trained to predict next embeddings rather than reconstruct pixels—arguing reconstruction may be the wrong objective for control (tweet).


Evaluation, memory, and “human-centered” coding: factorization barriers, agent memory diagnostics, bloated patches, and rubric drift

  • Diffusion LLM parallelism hits the “Factorization Barrier”: Ian Li explains why diffusion LLMs struggle with parallel token generation: predicting multiple tokens simultaneously can induce incoherent joint outputs (e.g., “San York”). He attributes this to a structural misspecification—fully factorized output heads can’t represent the full joint distribution without exploding output-head size—and proposes CoDD as a way to break the barrier (tweet).

  • Agent memory: retrieval dominates “writing” strategy: A diagnostic framework separates retrieval failures vs utilization failures; key claim: retrieval approach causes ~20pp variance, while memory-writing methods only shift 3–8pp. “Raw chunking” can match or beat expensive summarization/fact-extraction pipelines (tweet). Practical implication: many teams may be over-optimizing memory “ingestion” rather than search/selection.

  • SWE-bench patch bloat as a human-factor failure mode: KLieret reports LLM-generated SWE-bench patches are consistently longer/bloated than human solutions (not just comments), which can pass tests but harm human verification and maintenance (tweet). Follow-up emphasizes “test success != practical usability” and argues for human-centered coding agent research (tweet).

  • Rubric drift and evals as “living systems”: Multiple tweets stress that failures often come from an outdated eval rubric rather than a “broken prompt”; the fix is to treat evals as a feedback loop tied to production distribution shift, not static unit tests (tweet, tweet).

  • BullshitBench v2 (nonsense detection): A benchmark testing whether models reject nonsensical prompts finds only Claude and Qwen 3.5 scoring meaningfully above 60%, with an observed failure mode: “think harder” reasoning models can rationalize nonsense instead of rejecting it (tweet). If true, it’s a useful counterweight to raw “reasoning tokens” as a proxy for quality.


Top tweets (by engagement, technically relevant)

  • NotebookLM Cinematic Video Overviews rollout (Ultra users): @NotebookLM

  • OpenAI Codex app on Windows + Windows-native sandbox details: @OpenAIDevs and @ajambrosino

  • Gemini 3.1 Flash-Lite speed/cost positioning: @demishassabis

  • Speculative Speculative Decoding (SSD) claim of up to 2× faster inference: @tanishqkumar07

  • Yuan 3.0 Ultra open multimodal MoE (1010B total / 68.8B active) release announcement: @YuanAI_Lab

  • Self-Flow multimodal flow-matching research preview (2.8× faster convergence claim): @bfl_ml


AI Reddit Recap

/r/LocalLlama + /r/localLLM Recap

1. Qwen Model Performance and Benchmarks

  • Qwen3.5-35B-A3B hits 37.8% on SWE-bench Verified Hard — nearly matching Claude Opus 4.6 (40%) with the right verification strategy (Activity: 464): The post discusses the performance of the Qwen3.5-35B-A3B model, a small MoE model with 3B active parameters, on the SWE-bench Verified Hard tasks. By implementing a simple verification strategy—“verify after every edit”—the model’s performance improved from 22% to 37.8%, nearly matching Claude Opus 4.6’s 40%. This strategy involves prompting the model to verify changes after each file_edit by writing and running a test script. The model achieved 67.0% on the full 500-task benchmark, comparable to larger systems. The author notes that more complex strategies like MCTS and Best-of-N sampling were less effective. GitHub repository with code and logs is provided. One commenter suggests waiting for new tasks on SWE-bench to avoid potential data leakage in model training. Another expresses skepticism about the results, suggesting they might be “benchmaxed.” A third commenter notes the absence of looping in the strategy, which they found challenging with the 35B model.

    • ResidentPositive4122 highlights a potential issue with the SWE-bench, noting that it is outdated and may contain leaked signals in training data for newer models. They suggest waiting for an updated version with new tasks to ensure more accurate evaluations.

    • Deep_Traffic_7873 claims that Qwen3.5-35B-A3B outperforms GPT-OSS-20B in their personal benchmarks, suggesting a significant performance advantage of the former over the latter in specific tasks.

    • ethereal_intellect provides a detailed list of OpenAI’s guidelines for their Codex harness environment, which includes steps like validating the codebase, reproducing bugs, and implementing fixes. They note that some tasks, such as faking a video and driving the application, are particularly challenging but feasible with careful setup.

  • Qwen3.5-27B Q4 Quantization Comparison (Activity: 386): The post presents a detailed comparison of Q4 quantization methods for the Qwen3.5-27B model, focusing on mean KL Divergence (KLD) against a BF16 baseline. The evaluation uses a custom chat dataset and Wikitext2, with results showing that the unsloth_Qwen3.5-27B-UD-Q4_K_XL quantization achieves the lowest KLD of 0.005087, while bartowski_Qwen3.5-27B-IQ4_XS is noted for its efficiency score of 0.317506. The analysis uses llama.cpp for evaluation and highlights the importance of KLD as a measure of faithfulness to the original model’s probability distribution. The post also provides a GitHub link to a script used for the KLD sweep, though it is noted as not extensively tested. A notable comment questions the discrepancy in model size between the post and Hugging Face, suggesting potential differences in quantization methods or reporting. Another comment suggests that models close to the best fit line in a size vs. KLD plot are preferable, indicating a preference for models that balance size and accuracy.

    • Gueleric raises a technical question about the discrepancy in model size for bartowski_Qwen3.5-27B-IQ4_XS, noting a difference between the reported 14.1GB size and the 15.2GB size listed on Hugging Face. This could be due to different quantization methods or metadata included in the Hugging Face model size.

    • PaMRxR discusses a plot they created showing quantization size versus Kullback-Leibler Divergence (KLD) for the Qwen3.5-27B model. They mention removing outliers to better fit the data, suggesting that models closer to the best fit line are preferable. The plot was generated using the unsloth_Qwen3.5-27B-UD-Q4_K_XL model, indicating a focus on understanding the trade-offs between model size and performance metrics like KLD.

    • munkiemagik expresses interest in conducting qualitative comparisons across different parameters and quantization levels for models. They highlight a common issue in model testing: often only specific metrics like perplexity or throughput are reported, which may not align with the user’s needs. They also mention the challenge of understanding technical concepts like KL Divergence, indicating a need for deeper engagement with the academic principles behind large language models.

2. Qwen Model Usability and Applications

  • Qwen3.5-0.8B - Who needs GPUs? (Activity: 646): The image highlights the impressive capability of the Qwen3.5-0.8B model, which can run efficiently on outdated hardware, specifically a 2nd generation i5 processor with 4GB DDR3 RAM. This model is executed using llama.cpp, a tool for running large language models on local machines, and is shown to handle complex topics like string theory. The system information is displayed using fastfetch on an Arch Linux setup, emphasizing the model’s low resource requirements and accessibility for users without high-end GPUs. Commenters express amazement at the model’s performance on such old hardware, comparing it to the capabilities of GPT-3 and noting the open-source nature of the model. There’s also a nostalgic mention of semi-transparent terminals, reflecting on past desktop environments.

    • The Qwen3.5-0.8B model is notable for its ability to run efficiently without the need for a GPU, which is a significant advancement in making AI more accessible. This model is open-source, allowing for broader experimentation and use in various applications without the high cost of GPU resources.

    • A user suggests using the Qwen3 8B model instead, highlighting its superior performance and the fact that it also does not require a GPU. This suggests that the Qwen3 series is optimized for performance on lower-end hardware, making it a practical choice for developers without access to high-end computing resources.

    • The Qwen3.5-0.8B model includes a vision component, which allows it to analyze images and generate workflows that can produce images or videos. This feature expands its utility beyond text-based tasks, enabling it to function as a sub-agent in multimedia applications.

  • Qwen 3.5 4b is so good, that it can vibe code a fully working OS web app in one go. (Activity: 718): The post discusses the capabilities of Qwen 3.5 4b, a compact AI model, which successfully created a fully functional web-based operating system (OS) from a single prompt. The OS includes features such as two games, a text editor, an audio player, a file browser, customizable wallpaper, and a special feature chosen by the model itself. The model’s ability to generate a working OS with these specifications highlights significant advancements in AI model efficiency and information density, particularly for a model of only 4 billion parameters. The OS can be accessed here. Commenters express skepticism about the test’s validity, suggesting it may be a common benchmark scenario potentially optimized for success. Others are impressed by the model’s performance, noting the significant progress in AI capabilities beyond mere scaling.

    • tinny66666 highlights the impressive performance of the Qwen 3.5 4b model, noting that its intelligence surpasses the original GPT-3.5 despite its smaller size. This suggests a significant improvement in information density and model efficiency, raising questions about the potential limits of such advancements.

    • msixtwofive expresses skepticism about the validity of the test, suggesting that the task of creating a fully working OS web app is a common benchmark that may have been optimized for by AI influencers. This raises concerns about the authenticity of the model’s performance in real-world, unseeded scenarios.

    • simracerman points out that while the Qwen 3.5 4b model’s ability to complete the task is impressive, especially compared to larger models, there is a possibility that the code for such tasks might be included in the training data, which could influence the model’s performance.

3. Tech Industry Developments and Reactions

  • Apple unveils M5 Pro and M5 Max, citing up to 4× faster LLM prompt processing than M4 Pro and M4 Max (Activity: 998): The image illustrates the capabilities of Apple’s newly announced M5 Pro and M5 Max chips, which are claimed to process large language model (LLM) prompts up to 4 times faster than their predecessors, the M4 Pro and M4 Max. The M5 Pro supports up to 64GB of unified memory with a bandwidth of 307GB/s, while the M5 Max supports up to 128GB of unified memory with a bandwidth of 614GB/s. Additionally, these chips feature up to 2× faster SSD speeds at 14.5GB/s and include the Apple N1 wireless chip for Wi-Fi 7, enhancing download speeds if compatible with the router. Some commenters express a desire for a Mac Studio equipped with the new chips, while others note the lack of mention of AI-specific silicon improvements, such as a Neural Accelerator.

    • The M5 Pro and M5 Max chips feature significant improvements in memory capabilities, with the M5 Pro supporting up to 64GB of unified memory and 307GB/s of memory bandwidth, while the M5 Max supports up to 128GB of unified memory and 614GB/s of memory bandwidth. These enhancements are crucial for handling large-scale machine learning models and intensive computational tasks.

    • The new chips also boast up to 2× faster SSD speeds, reaching 14.5GB/s, which can significantly reduce data access times and improve overall system performance. Additionally, the inclusion of the Apple N1 wireless chip for Wi-Fi 7 support offers faster download speeds, provided the network infrastructure can support it, enhancing connectivity for data-intensive applications.

    • Despite expectations for more advanced AI-specific silicon, the M5 series still offers substantial performance gains, particularly in LLM prompt processing, which is up to 4× faster than the previous M4 series. This improvement is likely due to a combination of increased memory bandwidth and faster SSD speeds, which together enhance the chips’ ability to handle complex AI workloads efficiently.

  • ChatGPT uninstalls surged by 295% after Pentagon deal (Activity: 418): The image is a meme and does not provide any technical insights or verifiable data. It humorously suggests a significant increase in ChatGPT uninstalls following a supposed deal with the Pentagon, but lacks any credible sources or detailed information to support this claim. The comments reflect skepticism about the validity of the claim, questioning the source and the actual impact on user numbers. Commenters express skepticism about the claim, questioning the source and the actual impact on user numbers, suggesting it might be exaggerated or unsourced.

    • A user questions the validity of the claim regarding the surge in uninstalls, asking if the statistic is unsourced, which raises concerns about the reliability of the data. This highlights the importance of verifying claims with credible sources, especially when discussing significant changes in user behavior.

    • Another comment critiques the shift in OpenAI’s mission from a ‘non-profit research lab’ to potentially acting as a ‘Defense Contractor.’ This reflects a broader debate on the ethical implications of AI development and its alignment with military applications, suggesting a tension between original mission statements and current business practices.

    • A user discusses the inevitability of AI’s integration into military applications, arguing that technological advancements naturally lead to such outcomes to maintain competitive advantage. This comment underscores the strategic importance of AI in defense and the potential consequences of falling behind in technological capabilities.

Less Technical AI Subreddit Recap

/r/Singularity, /r/Oobabooga, /r/MachineLearning, /r/OpenAI, /r/ClaudeAI, /r/StableDiffusion, /r/ChatGPT, /r/ChatGPTCoding, /r/aivideo, /r/aivideo

1. AI Model and Benchmark Releases

  • Opus 4.6 solved one of Donald Knuth’s conjectures from writing “The Art of Computer Programming” and he’s quite excited about it (Activity: 1124): The image is a document titled “Claude’s Cycles” by Donald Knuth, discussing a significant breakthrough achieved by the AI model Claude Opus 4.6. This model, a hybrid reasoning system, solved a longstanding conjecture related to directed Hamiltonian cycles and the decomposition of arcs into directed cycles, which Knuth had been working on. The document highlights Knuth’s surprise and joy at the AI’s solution, marking a notable advancement in automatic deduction and creative problem solving. The full paper is available here. Commenters express admiration for Knuth’s openness to revising his views on AI, noting his intellectual integrity. They also highlight the significance of Anthropic’s achievement with Claude Opus 4.6, and celebrate Knuth’s continued active engagement in research at the age of 88.

    • In the paper, it is noted that the AI model, Claude, demonstrated its capability by solving Knuth’s conjecture for odd values of m and finding solutions for some even values, though it couldn’t generalize a solution for all even m. This highlights the model’s ability to explore numerous approaches rapidly, a task that would be time-consuming for human mathematicians.

    • Donald Knuth’s acknowledgment of the AI’s achievement marks a significant shift in his perspective on generative AI. Previously skeptical, Knuth now recognizes the rapid advancement in AI’s capabilities, particularly in automatic deduction and creative problem-solving, as demonstrated by Claude’s contribution to solving his conjecture.

    • The involvement of Anthropic’s Claude in solving a part of Knuth’s conjecture underscores the potential of AI in mathematical research. While not necessarily ‘smarter’ than human mathematicians, Claude’s ability to quickly test various hypotheses and approaches is a notable advantage, illustrating the evolving role of AI in complex problem-solving.

  • Gemini 3.1 Flash-Lite Benchmark Comparison (Activity: 236): The Gemini 3.1 Flash-Lite model, as per its model card, is benchmarked against the older 2.5 Flash model rather than the more recent 3 Flash model, raising questions about its comparative performance. The model is priced at $0.25 per input and $1.50 per output, which is significantly higher than the 2.5 Flash Lite’s $0.10 input and $0.40 output costs. This pricing strategy suggests a focus on specific use cases rather than broad applicability, as it is still cheaper than the 3 Flash model but more expensive than its predecessor. Commenters express dissatisfaction with the cost-to-performance ratio of the Gemini 3.1 Flash-Lite, noting that it is “3x as expensive” as the 2.5 Flash Lite without a proportional performance increase. Comparisons to other models like Grok 4.1 and MiniMax M2.5 highlight that these alternatives offer better value for money, suggesting that the 3.1 Flash Lite may not be competitive in terms of pricing and performance.

    • Important-Farmer-846 highlights the cost-effectiveness of 2.5 Flash Lite over 3.1 Flash Lite, noting that while 3.1 is half the price of Flash 3, it is twice as expensive as 2.5 Flash Lite. The commenter suggests that for processing large volumes of data, 2.5 Flash Lite remains the better option due to its lower cost and adequate performance.

    • ExpertPerformer provides a detailed cost comparison of various models, showing that 3.1 Flash Lite is less cost-effective compared to alternatives like MinMax M2.5 and Grok 4.1. The cost per input/output for 3.1 Flash Lite is $0.25/$1.50, whereas MinMax M2.5 offers $0.295/$1.20, and Grok 4.1 offers $0.20/$0.50, indicating better value for money with the latter models.

    • ThomasMalloc discusses the inefficiency of 3.1 Flash Lite in ‘High’ thinking mode, noting it took 14 times longer than 2.5 Flash Lite and maxed out the output tokens at 65,436 compared to 6,980 for 2.5 Lite. The commenter suggests using ‘Minimal’ or ‘Low’ thinking modes to reduce token usage and cost, as ‘High’ mode is currently impractical due to excessive token consumption and incomplete outputs.

  • Ostris is testing Lodestones ZetaChroma (Z-Image x Chroma merge) for LORA training 👀 (Activity: 254): The image is a screenshot of a chat conversation where a user named Ostris discusses testing a LoRA (Low-Rank Adaptation) model using Lodestones ZetaChroma. ZetaChroma is a new model that combines the Chroma dataset with Z-Image, focusing on pixelspace inference. This model is being tested for integration into an AI toolkit for training. The discussion highlights that ZetaChroma is not a simple model merge but a retraining of Z-Image using the Chroma dataset, aiming to create a powerful open-source model. The conversation also includes a file link to a safetensor file, indicating active testing and development. Comments clarify that ZetaChroma is not a model merge but a retraining effort, emphasizing the use of the Chroma dataset to train a pixelspace model from scratch on top of Z-Image.

    • Far_Insurance4191 clarifies that Zeta is not a model merge but a retraining of the Z-Image model using the same dataset initially used for Chroma. This indicates a focus on refining the model’s capabilities by leveraging existing data rather than combining model weights.

    • PetiteKawa00x emphasizes that Zeta involves training a pixelspace model from scratch on top of Z-Image with the Chroma dataset, highlighting that no weights from Chroma are merged with Z-Image for Zeta. This suggests a distinct approach in model development, focusing on foundational training rather than integration of existing models.

2. Anthropic and OpenAI Leadership Changes

  • OpenAI VP Max Schwarzer joins Anthropic amid recent kerfuffle (Activity: 1121): The image is a meme featuring a surprised Pikachu, humorously depicting the reaction to OpenAI VP Max Schwarzer leaving OpenAI to join Anthropic. This move is part of a broader trend where several key figures from OpenAI have transitioned to Anthropic, a company founded by former OpenAI employees. The meme suggests a sense of surprise or shock from OpenAI at this departure, reflecting ongoing tensions and shifts within the AI industry. Commenters express skepticism about the leadership at OpenAI, with some suggesting a lack of trust in the company’s direction under its current leadership. There is also a sentiment of customers switching allegiance to Anthropic, indicating a potential shift in market preference.

  • OpenAI VP for Post Training defects to Anthropic (Activity: 1839): The image is a tweet from Max Schwarzer, who was the Vice President for Post Training at OpenAI. He announced his departure to join Anthropic, a company known for its focus on AI safety and research. Max highlights his contributions at OpenAI, including leading the post-training team and working on models like GPT-5. His move to Anthropic is framed as a return to research, suggesting a shift in focus towards more foundational AI work. One comment humorously misreads his title as ‘VP of Post Training Defects,’ while another suggests his move might be due to OpenAI’s challenges, metaphorically described as ‘jumping off a sinking ship.’

  • OpenAI’s post-training lead leaves and joins Anthropic: he helped ship GPT-5, 5.1, 5.2, 5.3-Codex, o3 and o1 and will return to hands-on RL research at Anthropic (Activity: 1818): Max Schwarzer, a key figure in OpenAI’s post-training team, has announced his departure to join Anthropic. Schwarzer played a significant role in the development and deployment of several major models at OpenAI, including GPT-5, 5.1, 5.2, 5.3-Codex, and others. His move to Anthropic marks a return to hands-on research in reinforcement learning, highlighting a shift from leadership to direct research involvement. This transition underscores the competitive landscape in AI research talent, with Anthropic being noted for its strong values and talent pool. Commenters are impressed by Schwarzer’s rapid career progression and note the potential implications of his departure on OpenAI’s projects, including possible impacts on revenue and strategic direction.

    • Freed4ever raises a point about the potential need for a ‘cool down period’ for high-tech talents transitioning between companies, similar to practices in the quantitative finance industry. This is due to the sensitive nature of the work and the proprietary knowledge these researchers possess, which could impact competitive dynamics in the AI field.

    • PJpittie expresses dissatisfaction with GPT-5, suggesting it did not meet expectations. This comment reflects a broader sentiment that could be indicative of performance issues or unmet benchmarks in the latest iterations of OpenAI’s models, which might influence user trust and adoption.

    • CallMePyro highlights the implications of OpenAI’s Department of Defense (DoD) deal, suggesting that the consequences extend beyond financial losses. This could imply strategic or ethical considerations that might affect OpenAI’s operations and its talent retention strategies.

  • OpenAI VP for Research for post-training defects to Anthropic (Activity: 614): The image is a tweet from Max Schwarzer, who was the VP for Research at OpenAI, announcing his departure to join Anthropic. He highlights his contributions to OpenAI, particularly in reasoning paradigms and post-training teams, which are crucial for refining AI models post-training to ensure they function effectively. His move to Anthropic, a company known for its focus on AI safety and research, is significant given the competitive landscape in AI research and development. This shift underscores the ongoing talent migration within the AI industry, raising questions about internal dynamics at OpenAI. Commenters note the significance of losing a key figure in post-training, which is essential for model refinement, and speculate on the internal culture at OpenAI given the frequent departures of senior researchers. There is also a discussion on Anthropic’s values and potential growth, with some expressing confidence in its future prospects.

    • The departure of OpenAI’s VP for Research to Anthropic is significant due to the critical role of post-training in refining AI models. Post-training is essential for ensuring models produce coherent and reliable outputs, and losing a key figure in this area could impact OpenAI’s model development and stability.

    • The frequent departure of senior researchers from OpenAI raises questions about the company’s internal culture and stability. This trend suggests potential issues within the organization that might be prompting key talent to leave, which could affect OpenAI’s long-term innovation and competitiveness.

    • The move to Anthropic is seen as strategically timed, possibly reflecting a shift in values or strategic direction. Anthropic’s focus on ethical AI and its growing customer base, including enterprise and consumer-level clients, positions it as a strong competitor in the AI landscape, potentially attracting talent seeking alignment with these values.

3. Claude and ChatGPT User Reactions

  • Damnnnn! (Activity: 2597): The image is a meme-style screenshot from TechCrunch on X.com, highlighting a significant increase in ChatGPT uninstalls by 295% following a Department of Defense (DoD) deal. This suggests a public reaction to privacy concerns or ethical considerations regarding the use of ChatGPT in government contracts. The post has garnered substantial engagement, indicating widespread interest or concern about the implications of such a deal. However, the top comment points out that the percentage increase could be misleading without absolute numbers, suggesting that the actual impact might be minimal. Another comment highlights the potential financial implications, noting that even if a large number of users cancel their subscriptions, the DoD deal could offset these losses financially. Commenters express skepticism about the significance of the uninstall surge, with one noting that the percentage increase could be misleading without absolute numbers. Another comment discusses the financial trade-off, suggesting that the DoD deal might compensate for any loss in subscription revenue.

    • mazdarx2001 highlights the financial implications of user cancellations for a subscription service, noting that if one million users paying $20 monthly cancel, it results in a $20 million monthly revenue loss. However, they argue that a Department of Defense (DoD) contract could offset this loss, suggesting that government contracts might provide more stable revenue streams than consumer subscriptions.

    • Orangeshoeman discusses the potential impact of a Department of Defense (DoD) contract on a company’s downstream revenue, particularly in the context of privacy concerns. They imply that users seeking privacy might avoid using services associated with government contracts, which could negatively affect the company’s reputation and user base.

    • TimeTravelingChris points out that user dissatisfaction combined with the availability of better alternatives can lead to significant business challenges. They suggest that the presence of superior products in the market, along with customer discontent, could create a ‘recipe for disaster’ for the company in question.

  • 295% is wild (Activity: 3163): The image is a meme-like screenshot of a TechCrunch tweet claiming a 295% surge in ChatGPT uninstalls following a Department of Defense (DoD) deal. The post title and comments suggest skepticism about the significance of this statistic, with users pointing out that without knowing the baseline number of uninstalls, the percentage increase is not meaningful. Additionally, the comments question the reliability of the data source and the journalistic standards of TechCrunch, implying that the reported surge may not have substantial impact or relevance. Commenters express skepticism about the significance of the 295% uninstall surge, noting that without baseline numbers, the statistic lacks context. They also criticize TechCrunch’s reporting, questioning the accuracy and relevance of the data presented.

    • Diligent_Net4349 and FalkenJoshua both highlight the importance of understanding the baseline number when interpreting a 295% increase in uninstalls. Without knowing the original number of uninstalls, the percentage increase lacks context and could be misleading. For example, a 300% increase from a small base number like 1000 would only result in 3000, which might not be significant in the grand scheme.

    • FormerOSRS provides a breakdown of the uninstall statistics, suggesting that the increase equates to 12 days’ worth of uninstalls occurring over just three days. This implies that while the percentage increase seems large, the actual impact may be minimal if the baseline uninstall rate was low.

    • Umademedothis2u questions the source of the uninstall rate data, implying skepticism about the accuracy of the reported statistics. This comment suggests a need for transparency in how such data is collected and reported, especially in tech journalism.

  • OpenAI loses 1.5 million subscribers in less than 48 hours after CEO Sam Altman says yes to the deal that Anthropic rejected (Activity: 4037): OpenAI reportedly lost 1.5 million subscribers within 48 hours following CEO Sam Altman’s decision to accept a deal that Anthropic had previously rejected. The source of the 1.5 million figure is questioned, as it is unclear whether this was officially reported by OpenAI or derived from another source. This event highlights potential dissatisfaction with OpenAI’s strategic decisions and leadership under Altman. The comments reflect skepticism about the reported subscriber loss figure, questioning its origin and accuracy. Additionally, there is criticism of Sam Altman’s leadership style and public statements, suggesting a disconnect with public perception.

    • A user highlights their switch to Claude, noting its superior performance in areas like marketing, data analysis, and research. They emphasize Claude’s consistent memory and balanced feedback, comparing it to sci-fi AIs like Hal 9000 or Cortana. They also mention that Opus 4.6 extended is the best AI model they’ve used, although they still rely on GPT and Gemini for health-related queries.

    • Another user questions the source of the 1.5 million subscriber loss figure, asking if it was officially reported by OpenAI. This suggests skepticism about the accuracy or origin of the statistic, indicating a need for verification or official confirmation.

    • A user expresses a desire to obtain a personal data export from OpenAI, indicating concerns about data privacy and control. This reflects a broader trend of users becoming more conscious of their data rights and the information companies hold about them.

  • ChatGPT Uninstalls Surge 295% After OpenAI’s DoD Deal Sparks Backlash (Activity: 3053): OpenAI’s recent partnership with the U.S. Department of Defense led to a 295% increase in uninstalls of the ChatGPT mobile app, reflecting significant user backlash against the company’s military affiliations. This reaction occurred within 48 hours of the announcement and coincided with a rise in downloads for competitor Claude, illustrating the competitive dynamics in AI applications. The event highlights the reputational risks of government contracts in the AI sector, as user sentiment plays a crucial role in shaping corporate strategies. The comments reflect a strong negative sentiment towards OpenAI’s decision, with some users suggesting that the backlash was deserved and expressing skepticism about OpenAI’s intentions. There is also a mention of a conspiracy theory regarding a whistle-blower, indicating distrust among some users.

    • EnotHOME questions the significance of the 295% increase in uninstalls, suggesting that if the baseline was 1000 uninstalls, a 295% increase would mean 4000 uninstalls, which they consider insignificant in the grand scheme of things. This implies a need for more context on the baseline numbers to assess the true impact.

    • coronakillme seeks clarification on the 295% figure, interpreting it as the number of uninstalls being a little less than three times higher than before. They question what the original number of uninstalls was, highlighting the importance of understanding the baseline to evaluate the significance of the increase.


AI Discord Recap

A summary of Summaries of Summaries by gpt-5

1. Software Engineering Benchmarks & Routers

  • SWE-Atlas Stings SOTA at ~30%: Scale AI launched SWE-Atlas, extending SWE-Bench Pro, with its first benchmark Codebase QnA showing current top models at ~30% on software-engineering Q&A, per the launch post: SWE-Atlas launch (Scale AI).

    • Engineers called it a wake-up benchmark, pointing to the leaderboard for hard, repo-grounded evals: SWE-Atlas Codebase QnA leaderboard, stressing gaps in codebase grounding and long-context retrieval.

  • Max Router Routs Rivals: Arena ML researchers showcased their Max intelligent router that selects per-query winners and reportedly “beats every model on the platform,” in this breakdown: Max intelligent router (YouTube).

    • Viewers highlighted that dynamic routing plus tool selection can outperform any single static model, quoting the video’s claim that it “beats every model on the platform.”

  • Cursor Cracks First-Proof Problem: Cursor AI ran for ~4 days and discovered a novel solution to “Problem Six” from the Arc Institute’s First Proof challenge, reportedly outperforming academic baselines: Cursor solves ‘First Proof’ Problem Six (X), context at Evo-2: One year later (Arc Institute).

    • Researchers debated whether the agent coordination approach generalizes beyond code tasks into math research, with some urging replication on more problems to validate robustness.

2. Systems & GPU Optimization Breakthroughs

  • GPU Chats NVMe Without CPU Chaperone: A Linux hacker enabled AMD GPU ⇄ NVMe P2P by patching the amdgpu driver and wiring dma-buf/iommufd per Jason Gunthorpe’s RFC: dma-buf/iommufd RFC (lore.kernel.org), enabling direct GPU–SSD command paths.

    • They contrasted this with ROCm/hipFile, arguing hipFile still issues commands via the CPU, while their path keeps the CPU out of the data path: ROCm hipFile (GitHub).

  • CUDA Agent Clobbers Kernels: ByteDance introduced a CUDA Agent that writes optimized CUDA kernels and claims ~2× speedups over torch.compile on simple/medium tasks per the paper: CUDA Agent paper (arXiv).

    • Community notes say it also outperforms Claude Opus 4.5 and Gemini 3 Pro by ~40% on harder kernels, calling it a tangible step toward LLM-driven kernel autotuning.

  • MXFP8 MMA Mystifies Devs: Kernel engineers flagged that MXFP8 MMA appears to support MMA_K=64 only for sparse shapes (vs K=256 for dense) per the PTX guide: PTX matrix shapes (NVIDIA docs).

    • Threads also probed inter-CTA correctness via global memory and SASS fences (MEMBAR, LDG/STG.STRONG, CCTL.IVALL), pushing for architecture-specific guidance on barrier semantics.

3. Agent Platforms, UX, and Dev Tooling

  • Codex Camps on Windows: OpenAI shipped the Codex app on Windows with a native agent sandbox and PowerShell support, demoed here: Codex on Windows demo (video).

    • Developers welcomed Windows-native flows, calling the PowerShell integration a pragmatic boost for agentic dev environments on enterprise desktops.

  • ACP Bridges IDEs and Agents: The Agent Communication Protocol (ACP) now plugs into Zed and IntelliJ, letting agents drive multiple providers (e.g., Cursor) from one interface: AgentCommunicationProtocol.dev.

    • Engineers reported smoother multi-tool orchestration and fewer context hops, saying ACP helps keep provider sprawl in check.

  • Six Agents Ship a Marketplace: An OpenClaw squad of 6 parallel agents built a functional marketplace in a weekend, with a prompt-generator.ts that emits platform-specific templates for Cursor and v0: codebonito.com, tools at Cursor.

    • Builders praised the template compiler pattern—“write once, target many runtimes”—for speeding agent deployments across heterogeneous toolchains.

4. Inference Speed & Context-Efficiency Tricks

  • SSD Speeds Up Decoding: Researchers previewed Speculative Speculative Decoding (SSD) by Tanishq Kumar, Tri Dao, and Avner May, claiming up to 2× faster inference over leading engines: Speculative Speculative Decoding (X).

    • Practitioners flagged SSD as a practical win for throughput-constrained services, eyeing integrations with router and MoE stacks for compounding gains.

  • User-Only Context Cuts Costs: A shared study reported that passing only the user turns (not model replies) can reduce tokens by ~70% while keeping >95% of full-context quality: Adaptive context management (AlphaXiv).

    • Builders proposed harness-level sliding windows and prompt removal strategies to systematically preserve task-relevant bits without bloating context.

  • Static Constraints Guide Generation: Engineers referenced YouTube’s repo for constraint-aware decoding pipelines: static-constraint-decoding (GitHub), tying 2-stage passes to gliner2 → Neo4j graph construction.

    • The link sparked experiments in structure-first generation, where constraint decoders ensure schema safety before free-form elaboration.

Thanks for reading

Stay a little ahead of the curve.

Fresh ideas, original reporting, and deep conversations in your inbox.

Subscribe to Latent Space
Latent Space

Join Latent Space.

Sign in with Google, or get the newsletter by email.

Loading Google sign-in…

or subscribe by email

Free. Unsubscribe any time.