Token Drop

DaaX.ai

A weekly, unscripted conversation from the DaaX team on the most interesting developments in AI. Sunil Baliga and Sajjad Khazipura (DaaX Co-Founders), along with Sam Pooni (DaaX Architect) and the occasional guest, explore, discuss, and debate new AI research, news, and real-world use cases. Built for developers and business leaders who want perspectives from experienced AI practitioners. All opinions expressed on this podcast are those of the panelists and do not necessarily reflect the views of their employers.

  1. 5d ago

    10,000 Agents, 88 Hours: What OpenAI's Navier-Stokes Proof Reveals About Neuro-Symbolic AI

    OpenAI says its latest internal model found a counterexample disproving global regularity for the Navier-Stokes equations — one of math's seven Millennium Prize Problems — using 10,000 concurrent agents running for 88 hours. This episode digs past the headline number and asks the more interesting question: how did 10,000 agents actually converge on a verified answer, and what does the architecture that made it possible reveal about how neuro-symbolic AI systems should be built? Episode Summary Sunil opens with the number that caught everyone's attention: 10,000 agents, 88 hours, to disprove global regularity for a smooth solution to Navier-Stokes. His real question is procedural — with that many agents throwing out ideas in parallel, how does the system converge? How does anyone know when it's done? Sajjad and Sam reconstruct the architecture from public reporting: 10,000 instances of an agent built around OpenAI's latest model generated candidate proof strategies in parallel, informally critiquing and refining each other's intermediate results — closer to swarm intelligence than a brute-force sweep. Periodically, a consolidation layer ("Codex") cross-pollinated the most promising findings back into the groups still exploring, redirecting effort as some paths proved more promising than others (the project reportedly started on a related Euler problem before OpenAI redirected agents toward Navier-Stokes). Final adjudication ran through a completely separate pipeline: Lean, an open-source formal verification framework in the same family as Z3, Vampire, and Datalog, which mechanically checked whether a candidate proof actually held — a full 17 hours of formalization and verification on top of the 88 hours of exploration. The panel connects this directly to their own architecture. Sajjad draws the parallel to ClaimGuard: no matter how good the generating model is, DaaX's position has always been that you verify the output against grounding independently rather than trust it outright. Sam highlights what he considers the real innovation — the system doesn't just label an answer right or wrong, it produces a counterexample, and feeds that counterexample back to improve the next round of candidates. That closed loop, generate → critique → verify → redistribute → regenerate, is what let 10,000 agents converge in under four days on a problem mathematicians have worked on for decades. Full transcript at https://daax.ai/podcast/episode-24-navier-stokes-neuro-symbolic-ai Chapters ● 0:00 — This week's topic: OpenAI's Navier-Stokes result ● 1:24 — Sajjad's read: 10,000 agents, peer review, and a Lean-based verifier ● 3:59 — What is Lean? Symbolic verification, explained ● 5:01 — Sunil's chip-design analogy: what do you verify against without a "golden" reference? ● 5:40 — How DaaX's own retrieval-and-verification pipeline actually works ● 7:31 — Sunil's guess: verifying against the algorithm's own well-defined output ● 8:31 — Sam's numbers: 130 billion tokens, 2.7 million inter-agent messages ● 9:31 — Why counterexamples, not just right/wrong labels, matter for neuro-symbolic systems ● 12:11 — The HPC era: brute force, the n-body problem, and drug discovery ● 14:53 — What's different this time: intelligent candidate generation with a feedback loop ● 15:01 — Could this have been done with old-school HPC? (88 hours vs. 88 days) ● 19:32 — Not peer review — informal, adversarial swarm intelligence ● 21:08 — How the problem was actually routed: from Euler to Navier-Stokes ● 23:04 — Cross-pollination: explore, extract, redistribute, explore again ● 24:11 — The closed feedback loop, and why it maps directly to ClaimGuard ● 28:17 — Anima Anandkumar's physics-informed neural network:

  2. Sep 5

    Astra, Hallucination Rates, and the Myth of the Self-Sufficient LLM

    About This Episode OpenAI's newest model, Astra, has consumed the AI press this week — impressive benchmark scores, a steep price tag, and Greg Brockman calling it the start of the AGI era. This episode separates the genuine capability gains from the marketing, and lands on a harder question the industry is currently fighting over: what is a "harness," and can everything around an LLM eventually get absorbed into the model itself — or is there a control plane that simply can't be learned? Episode Summary Sunil opens with what caught his attention about Astra: pricing of $10 in and $50 out per million tokens, well above the prior state of the art, alongside a million-token context window and benchmark scores that reportedly leapfrog Anthropic's Fable 5.1. Sajjad and Sam walk through the numbers — a 99.5% score on ARC-AGI-2, strong results on OSWorld, and demos converting real estate listing photos into full video walkthroughs. The back half of the episode is a genuine argument about the word "harness" — a term Sunil finds confusing, since it evokes a horse and buggy rather than anything resembling AI infrastructure. Sajjad defines DaaX's harness as everything that happens before and after an LLM's inference: building context from a knowledge graph upstream, then verifying, rectifying, and regenerating output downstream. Sam introduces a sharper distinction circulating in industry writing — a "cognitive harness" (context, tools, planning) that vendors argue will eventually get absorbed into the model itself, versus a "control harness" (identity, authorization, audit, runtime) that he argues fundamentally cannot be, because a model is a passive file of weights with no way to authenticate itself or hold credentials. Sajjad pushes back hard on the anthropomorphizing language common in the industry: an LLM doesn't learn anything unless someone builds a training loop around it, and conflating that with genuine autonomous capability is scientifically loose. Full transcript is available at https://daax.ai/podcast/episode-23-astra-and-the-myth-of-the-self-sufficient-llm Chapters ● 0:00 — Introducing Astra: pricing, context window, and the AGI buzz ● 1:06 — Sajjad's take: leapfrogging Fable 5.1, ARC-AGI-2, and the Zillow demo ● 2:53 — Sam's benchmark rundown: OSWorld, speed, and pricing detail ● 4:20 — Hallucination rates: down, but not to zero ● 5:43 — Was Astra rated "critical" on OpenAI's preparedness scale? ● 6:11 — What does "harness" actually mean? ● 8:06 — DaaX's definition: controlling the LLM before and after inference ● 9:53 — The verification engine: no trust without it ● 10:03 — Cognitive harness vs. control harness ● 17:08 — Is this the first model to use something beyond just an LLM? ● 17:14 — Why an LLM is a passive .bin file, not an active agent ● 20:52 — How hallucination rates are actually measured ● 24:20 — The case against "everything gets absorbed into the model" ● 26:17 — Why explainability can't come from a black box ● 28:39 — Digital twins as the real-world alternative for process optimization ● 29:47 — Pricing vs. Gemini 2.5 Pro, and the coming need for LLM routers ● 30:49 — Astra no longer shares its reasoning traces — and why ● 32:22 — Tokenomics, price elasticity, and whether cost should drive architecture ● 33:47 — Cognitive vs. control plane: what can and can't be absorbed ● 38:41 — Wrap-up: verification is not optional

  3. Aug 28

    Why AI Agents Forget: Graph Databases and the Agent Memory Problem

    AI agents forget, and they hallucinate — and after roughly a trillion dollars of investment, the stack still has no determinism. What's the fix? In this episode of Token Drop, the DaaX teami are joined by Arun Sharma of LadybugDB — a former Linux kernel committer at Facebook and ex-Google engineer — for a technical conversation about graph databases and the agent-memory problem. Arun introduces LadybugDB, an embedded columnar graph database that grew out of the University of Waterloo's KuzuDB project (later acquired by Apple), and explains why no single storage engine can solve agent memory on its own. The discussion covers the engine's DuckDB-influenced architecture and its unusual MMAP design — prompting war stories about dynamic linkers, the ELF format, and 64-bit file support — before turning to why columnar storage beats an LSM for read-dominant graph workloads, and how modular pieces (embedded database, network protocol, load balancer) combine into a distributed system. The group digs into the graph-vector hybrid at the heart of grounded retrieval (why similarity isn't relevance, and how edges disambiguate “dog bit man” from “man bit dog”), how time can be modeled efficiently in a columnar graph without a “time tax,” and the real problem these systems solve: externalizing the knowledge locked in an LLM's weights so a smaller model can query it through deep traversals. Real-world use cases include code knowledge graphs that cut token costs (with an Uber example and Git Nexus) and parsing SEC EDGAR filings, plus how Ladybug scales from a phone to a data lake via Grass Lake and the open IceBug format. Topics covered: graph vs. relational databases; RDF vs. label property graphs; agent memory; MMAP; columnar vs. LSM storage; graph-vector hybrid search; temporal knowledge graphs; and scaling from embedded devices to distributed data lakes. Arun Sharma Linkedin https://www.linkedin.com/in/arundsharma/ LadybugDB https://ladybugdb.com/ Chapters 00:00 — The Token Drop backstory & meet Arun Sharma 02:44 — What is LadybugDB? Graph databases, NoSQL & the relational debate 04:23 — Ladybug Memory: why one storage engine can't solve agent memory 06:42 — Inside the engine: DuckDB's influence and the MMAP surprise 08:31 — MMAP war stories: dynamic linkers, ELF & 64-bit vi 13:12 — Does “embedded” mean your knowledge has to be small? 14:41 — Modular pieces: partitioned tables & a Neo4j (Bolt) wrapper 16:40 — Why columnar instead of RocksDB / LSM 18:16 — What Ladybug Memory actually is (persistent memory for coding agents) 20:39 — A trillion dollars in, still no determinism in the AI stack 21:59 — Real use cases: code knowledge graphs, Uber's token costs & Git Nexus 24:44 — Scaling past the laptop: Grass Lake, the IceBug format & querying from Hugging Face 27:18 — Does adding time blow up a knowledge graph? 29:37 — When vectors and graphs disagree: “dog bit man” vs. “man bit dog” 33:38 — If the user is an LLM, not a human: what do you throw out? 34:27 — The real problem graph databases solve: deep traversals & externalizing LLM knowledge 35:50 — From phones to data lakes: how far LadybugDB scales 37:34 — Wrap-up

  4. Aug 22

    Domain Layers, Not Better Models

    Vinod Khosla says raw ChatGPT gets medical triage wrong 20–30% of the time — and that layering a domain system on top of the same model drives the error rate to zero. Half of that is investor shorthand. The other half is the most important architectural argument in enterprise AI right now. Sunil Baliga, Sajjad Khazipura, and Sam Pooni pull the two apart. Why the failure is structural rather than a training gap: the reward function rewards producing an answer, not a correct one, and fluent English isn't backed by provenance. Why RLHF and distillation can't close it — the cognitive surface is too large to cover every domain and every phrasing variant. And why the domain layer, not the model, is the asset that compounds: every builder can rent the same frontier model, so a product that's a model plus a prompt is a margin waiting to be compressed. Also covered: the progression from loop engineering to harness engineering to grounded knowledge, whether error can ever mathematically reach zero, the intent problem (is natural language even the right way to express what a user wants?), dark data in defense and finance, and why flash trading firms have quietly been running neuro-symbolic architectures for years. Full transcript: https://daax.ai/podcast/episode-21-domain-layers-not-better-models Vinod Khosla on YouTube & X as referenced in this episode https://www.youtube.com/shorts/k32VuZjbQls?app=desktop&ra=m https://x.com/vkhosla/status/2036453452641923496 CHAPTERS 0:00 Vinod Khosla's claim: does domain AI take error to zero? 1:41 Why build on top of a frontier model at all? 2:23 A patient, not a benchmark: the diabetic ketoacidosis case 4:05 Why LLMs behave this way 6:15 The reward function rewards answering, not being right 7:17 From loop engineering to harness engineering 8:07 Grounding answers: the outboard knowledge engine 8:51 Deterministic NLP generation as an alternative 9:38 Would better training (RLHF, distillation) fix it? 11:40 The model is a commodity; the domain layer is not 12:28 Why the domain layer is slow to build — and defensible 14:09 Can the error rate ever actually reach zero? 15:49 What LLMs don't capture: experience 17:00 Human-in-the-loop use cases vs. autonomous ones 18:32 The intent problem: is natural language even the right input? 19:37 Natural language vs. domain-specific languages 21:03 Dark data: why defense and finance are different 24:39 Bloomberg's abandoned LLM and neuro-symbolic trading 27:44 Wrap-up: converting silent errors into caught errors

  5. Aug 15

    How Knowledge Graphs Handle Time: Event Graphs, Scene Graphs, and Reification Explained

    Time isn't a timestamp you attach to a node — time is change, and most knowledge graphs were never designed to track it. Ontologist and knowledge graph architect Kurt Cagle joins Sunil Baliga, Sajjad Khazipura, and Sam Pooni to walk through the architecture that results when you take time seriously: a declarative knowledge graph for what's constant, an append-only event graph capturing what changed and why, and a scene graph holding the moving "now." Also covered: RDF 1.2 and reification as a way to attach provenance and confidence to any assertion, why information should essentially never be deleted from a graph, and why most enterprise ontology initiatives fail for a reason that has nothing to do with technology — you can't get people to agree on the definition of "customer." Guest: Kurt Cagle — Ontologist, Knowledge Graph Architect, Editor-in-Chief of The Cagle Report https://www.linkedin.com/in/kurtcagle/ Full transcript: https://daax.ai/podcast/episode-20-how-knowledge-graphs-handle-time Chapters (00:00) Introducing Kurt Cagle (01:33) Why time breaks knowledge graphs (03:17) Ontology vs. JSON vs. relational (05:53) Recording every transition (07:24) The event graph (09:40) The scene graph: the moving "now" (11:01) The open world assumption (13:01) Graph vs. graph database (14:30) The six-tuple knowledge unit (16:32) RDF 1.2 and reification (19:57) Is anything ever deleted? (22:29) Newton vs. Einstein: rescoping truth (25:29) The ontology fight in boardrooms (29:12) Why ontology projects fail (31:01) Reasoning is several processes (33:35) Becoming a defensive philosopher (34:41) AI as an epistemological engine

About

A weekly, unscripted conversation from the DaaX team on the most interesting developments in AI. Sunil Baliga and Sajjad Khazipura (DaaX Co-Founders), along with Sam Pooni (DaaX Architect) and the occasional guest, explore, discuss, and debate new AI research, news, and real-world use cases. Built for developers and business leaders who want perspectives from experienced AI practitioners. All opinions expressed on this podcast are those of the panelists and do not necessarily reflect the views of their employers.