Don't Panic! It's Just Data

EM360Tech

Not only do many businesses have more data than they know what to do with, but they also often struggle to gain insights from some of the most valuable data in their possession, leading to many of their crucial data assets going unused. Whether it's issues with data quality, visualization, or management, getting lost in the sea of enterprise data at your possession can make it impossible to make smart, data-driven decisions that improve your business. The "Don't Panic! It's Just Data" podcast delves deep into the power of enterprise data. From groundbreaking vendor solutions to expert-backed best practices for making the most of your data assets, join us as we gather insights from leading tech vendors and professionals who depend on data daily.

  1. 4d ago

    How an AI-First Data Platform Enables Self-Service Analytics

    A sales development manager with no data science background built a call-analysis model in a matter of weeks using AI. According to Gina Jenks, AI Knowledge and Analytics Manager at Synthesia, a project of similar complexity would once have taken a data scientist three to five months. The example illustrates a broader shift in how organisations can use data, moving some analytical work beyond specialist teams and into the hands of employees across the business. But making that possible takes more than access to AI tools. It requires data foundations that allow people to find, understand and use information effectively. Jenks joined Christina Stathopoulos, founder of Dare to Data, on Don’t Panic! It’s Just Data to discuss how Synthesia rebuilt its data platform to support this shift with Fivetran, and what it takes to make data more accessible and useful across an organisation. Why a modern data platform matteredSynthesia makes AI video for business, so data is part of the product. The company was growing fast and producing huge volumes of it. It was also changing who it hired. As Synthesia became a scale-up, more non-technical people joined, and they needed to use data without a builder’s skills. The starting point was modest with a simple reporting tool, plus a lot of analysis scattered across spreadsheets and the CRM. Jenks says the goal was to give people “all of their reporting available in one place” as a single source of truth. A stack built for a small teamThe data team was tiny, so it had no time to tend the pipes. It chose Fivetran for ingestion, which now pulls from about 50 systems. Fivetran handles schema changes automatically, moving roughly six terabytes of data and 500,000 daily changes into the warehouse. Transformation on dbt Labs came with documentation and tests built in. As a result, the team went with a self-service approach and knew the trade-offs. Anyone could create their own metrics, which meant metric sprawl and some ungoverned definitions. But adoption was fast, and for the first time people could answer basic questions, like how many videos were generated yesterday, from one place. From gatekeepers to a platforms teamBefore AI, the data team was part analyst, part platform builder, still making dashboards and answering questions by hand. Jenks says that has changed. The business context analysts once carried in their heads can now live in a context layer that helps the AI decide what data to show whom. “No more gatekeeper,” Jenks agreed when Stathopoulos put it that way. The team now spends its time improving the platform instead of fielding one-off requests. What business users built with AIJenks says the most interesting results are the tools nobody on her team would have predicted: A book-of-business planner. A sales operations lead built a scenario tool to balance account assignments across reps. It lets her audit books at scale, and reps can check it themselves when they question their allocation.A coaching report. A sales development manager inherited a team already hitting 90 to 100 per cent of target, and his goal was to push it to 120 or 130 per cent. He built a red-amber-green report he can read in five minutes before Monday one-to-ones.A conversation analysis model. He then used call transcripts to compare last week’s conversations with those that became sales-qualified opportunities, to spot where reps stumble, such as objection handling. Jenks sees two problems solved at once. Niche requests rarely make the priority list. And there is always a translation gap between a business user and an analyst who doesn’t know their daily job. “AI has sort of collapsed that interaction,” she says, so people can build exactly what they need. Semantic layer, context and documentationGetting AI to return reliable answers took real work. Jenks’s first fix was the semantic layer, because AI, she says, reads things “very literally.” The old setup was organised around entities such as opportunities and accounts. Users joined everything together and bolted on endless fields. Even humans found it a mess. The team switched to a use-case model, with sets such as open pipeline and bookings, built around who in the business looks at what. Next came context, layered at three levels, namely: overall guidance, individual datasets and single fields. The team also needed far more documentation on its data models, a chore nobody wanted. They adopted an AI coding assistant that can read the whole codebase and work out what each table and field does, and used it to write descriptions at scale. Those descriptions flow through to the analytics layer. Testing AI accuracy with evalsEarly results weren’t always right, so the team set up evals, which are a set of prompts, such as “What is my open pipeline?”, each paired with an expected answer. An eval runner executes them, compares the output with the expectation and gives a pass or fail. Jenks says this is how you can trust the AI at scale, and it shows where the context needs adjusting. Balancing freedom and controlJenks admits it’s “quite unnerving” to stop controlling the flow of information. Several things help. Synthesia already had strong data literacy, and AI adoption pushed even sceptics to learn more. The team answers questions directly, and an AI assistant in a dedicated Slack channel can read the codebase and reply on the team’s behalf. An “AI celebrations” channel lets people show off what they’ve built and borrow ideas from each other. Dashboards haven’t gone away either. Teams still rely on them for monthly and quarterly reporting, and they give people a known source of truth to check AI answers against. Jenks says they also show which metrics people care about most. Advice for building an AI-first data platformHer advice to organisations looking to implement this type of solution is all about foundations: fresh data, version control across everything, schemas that are easy to change, and thorough documentation. Investing in data foundations, she says, is “absolutely critical” if you want to self-serve data with AI. If you would like to learn more, visit fivetran.com and synthesia.io or connect with Gina Jenks on LinkedIn. TakeawaysSynthesia's early data platform and growth challenges.Transition to a modern, scalable data architecture.Role of Fivetran, Snowflake, and dbt Labs in data ingestion and transformation.Layering business context and documentation for AI effectiveness.User-driven tool creation and AI's role in democratising data access.Balancing control and freedom in self-service AI environments. Chapters00:00 Introduction to Synthesia's Data Journey 02:37 Early Data Platform and Growth Challenges 04:47 Building a Modern Data Platform with Fivetran and dbt Labs 06:29 Self-Service Analytics and User Empowerment 08:38 The Role of AI in Scaling Data Access 10:16 Innovative Tools Built by Business Users 16:35 Behind the Scenes: Data Infrastructure and AI Integration 21:21 Layering Context and Documentation for AI Effectiveness 22:21 Evaluating AI Results with Evals 23:16 Balancing Control and User Freedom in AI Data Use 26:40 Trust, Dashboards, and Data Governance 27:25 Advice for Building AI-First Data Platforms

    How an AI-First Data Platform Enables Self-Service Analytics
  2. Nov 5

    Big Data LDN: Why MDM is Back on the C-Suite Agenda

    A massive organisation in the pharmaceutical industry deploys about six to seven master data management (MDM) platforms in addition to a few customised solutions. After facing challenges of scattered systems and their tools, the pharma company has decided to consolidate them. The problem is that every drug, clinical trial, or product is named differently across the world. On top of that, if you had to prompt an AI agent to decipher the proportion of the business that comes from every product, it would have to read through several systems, with no agreement between them, and no way of knowing which one is right. This is the challenge that LakeFusion, a master data management vendor, was tasked with solving for a major pharmaceutical firm. In this episode of the Don’t Panic, It’s Just Data Podcast, recorded live at Big Data London, Podcast Host, Producer and B2B Tech Journalist, Shubhangi Dua sits down with three guests: Sanjeev Mohan, Principal at SanjMo; Cooper Kenny, Founding Sales and Alliances Manager at LakeFusion; and Panos Athanasiou, Chief Field Technologist at Databricks. They explain why agents are unable to make up for poor master data, what it means to govern context rather than just data, and the reason why MDM has to cover the tools and data products that agents depend on. Key TakeawaysMDM is forecast to grow from $20 billion to $42 billion by 2030.Humans spot wrong records. Agents don’t.Governance now has to cover context, not just data.Context is generated at query time, so it is hard to inspect.LLMs can match structured records to audio, PDFs and social posts.Zero-copy architecture removes the need for CDC pipelines in MDM.Ontology needs semantics and connections, not only graphs.Human operators still decide what counts as a golden record.Bloated context drives token costs up and invites hallucination.Agentic data stewards can work through human-review backlogs.Start with a thin slice of value deliverable in weeks. Chapters00:00 Introduction to Big Data London and Participants05:02 Master Data Management: Evolution and Trends09:54 AI Native MDM: The Future of Data Management15:07 The Role of Context in Data Governance19:55 Challenges of Bad Data and Its Impact24:36 Cultural and Technological Shifts in Data Management25:00 The Importance of Master Data in AI Initiatives25:24 The Future of Data Management Solutions26:43 Lake Fusion's Unique Position in the Market29:30 The Role of AI in Understanding Business Dynamics32:06 The Evolution of AI Agents in Workflows35:37 Key Takeaways for C-Suite Executives @Bigdataldn @LakeFusionAI @Databricks Read the full article: https://em360tech.com/podcasts/big-data-ldn-why-mdm-back-c-suite-agendahttps://em360tech.com/podcasts/big-data-ldn-why-mdm-back-c-suite-agenda LakeFusion: https://lakefusion.ai EM360Tech: https://em360tech.com Watch more from the Don’t Panic, It’s Just Data Podcast: https://www.youtube.com/playlist?list=PLXoSlBGE35NoUm5jhXSTu4DdytBNXTgwY Follow EM360Tech on X: https://x.com/EM360Tech Follow EM360Tech on LinkedIn: https://www.linkedin.com/company/em360/posts/ #BigDataLDN #MasterDataManagement #MDM #AgenticAI #AIAgents #DataGovernance #Databricks #EnterpriseAI #DontPanicItsJustData #EM360Tech master data management, MDM, AI agents, agentic AI, golden record, data governance, context layer, Big Data LDN, Databricks, LakeFusion, enterprise AI, data management

    Big Data LDN: Why MDM is Back on the C-Suite Agenda
  3. Oct 30

    Does Vendor Lock-In Belong in an Enterprise AI Data Platform?

    An acquisition is just about to close this Friday. That means, by Monday, finance wants to know where the group is losing margins. The problem is the new enterprise functions on its own systems, and onboarding a single data source is quoted at weeks or months. Meanwhile, the foundation model your board approved last quarter sits on top of all of it, waiting for data it cannot yet read. That is the position one of Advancing Analytics' hospitality customers, a global food and beverage group built through acquisitions, was in before it changed how it brings data on board. In this episode of the Don't Panic It's Just Data podcast, recorded live on the show floor at Big Data London, host Shubhangi Dua, Podcast Host and B2B Tech Journalist, speaks with Andrew Phethean, UKI Industry Lead, Enterprise Growth at Databricks, and Terry McCann, CEO of Advancing Analytics. This podcast episode is especially relevant to CDOs, CEOs, and CEOs who are now beyond AI experimentation and are now pursuing plugging agentic systems into production. The speakers cover why the foundation of the platform’s model is the key factor when it comes to the outcome, what Databricks calls the four C's, and why the cost of doing nothing rarely makes it into the business case. "I think a lot of the time enterprises are experimenting with the big vendors of the world and putting a lot of investment in that, but not necessarily putting that into production properly,” Phethean tells Dua. Key TakeawaysBuying a foundation model without a governed data platform stalls projects.Newer models aren't needed for every business operation, says Phethean.Open source, lower-cost models and machine learning can carry production work.Databricks frames AI obstacles as four C's: context, control, cost, choice.Cost discipline now means maximising value, not tokens.Vendor lock-in isn't a strategy: choice spans vendors, clouds and LLMs.Data governance now serves AI agents as well as people.LakeForge cut data source onboarding from weeks or months to minutes.The cost of inaction can outweigh the ROI case for investing.CDOs and chief AI officers need a seat at board level.McCann's CDO advice is speed to market; Phethean's is translating IT to business. Chapters00:07 – Welcome and introductions00:48 – How has Big Data London been?02:32 – From generative AI to agents to context04:33 – The biggest challenge: getting the plumbing right05:49 – The four C's (and a fifth)07:31 – The Advancing Analytics and Databricks partnership09:52 – Customer story: LakeForge and Genie Code11:22 – The shift CEOs aren't watching15:08 – ROI versus the cost of inaction16:44 – What the tech industry gets wrong about AI18:38 – If your AI agent had a personality20:02 – One takeaway for CDOs21:30 – Closing and where to find the guests For more information, visit: advancinganalystics.co.uk Check out more data podcast episodes in the enterprise tech landscape: https://youtube.com/playlist?list=PLXoSlBGE35NoUm5jhXSTu4DdytBNXTgwY&si=iQzaMGoNb7wnRUaF ​ ⁨@AdvancingAnalytics⁩ ⁨@Bigdataldn⁩ ⁨@enterprisemanagement360⁩ #BigDataLDN #BigDataLDN2026 #AdvancingAnalytics #Databricks #AIAgents #LakeForge #GenieCode #AIROI #AIProfit #AILoss #AIMarketValue #AIValue #AIProduction #AIinProduction #AICosts #DataAnalytics #aianalytics #AIData

    Does Vendor Lock-In Belong in an Enterprise AI Data Platform?
  4. Oct 28

    Data Pipelines For Agentic AI: An Edgy, Shift-Left Live BDL Podcast

    With the boom in online shopping, the risk of parcel theft has scaled to an unprecedented level. According to security.org, the 2025 porch piracy data shows that 64 million Americans (one in four) have experienced package theft, with 9 million adults falling victim within the past three months alone. Cameras exist, but robbers wear masks and steal anyway; the risk grows every hour. That was United Parcel Service (UPS), an American parcel delivery company, in that position. The fix, however, was built with Striim and Google BigQuery. They came together and calculated the risk score for every delivery in real time, delivering enhanced security. In this episode of the Don't Panic! It's Just Data podcast, recorded live at Big Data LDN in the Y-Axis theatre in front of 200 people, host Christina Stathopoulos, Founder of Dare to Data, sat down for a fireside-style chat with Alok Pareek, Founder and EVP of Product Development at Striim. They critically examine how agentic workloads impact cost, predictability, performance, and consistency. Pareek also explains why data pipelines that simply move data can no longer keep up, and where processing should happen. Pareek, who in his early career worked on the Oracle database kernel and later served as CTO of GoldenGate, also strongly opposes zero-copy ETL. For CIOs, CDOs, and leaders in the field of data engineering who already manage mission-critical pipelines for use in operations, analytics, and business intelligence, the fact is that a new type of consumer is now situated atop these pipelines. “A simple question posed to an AI agent is quickly becoming a distributed computing problem,” states Pareek. “Especially when asking relatively complex inquiries such as ‘is this customer really someone I need to care about deeply?’” So when accessing a Large Language Model (LLM) for inference, the AI agent might be accessing its own tools, going through multiple database systems, files, websites, or simple search functions. He says the agent may be exasperated and, as a result, it ends up creating a classic GPU cost problem and a distributed computing problem. Also Watch: Can AI Agents Make Decisions Without Real-Time Enterprise Data? Key TakeawaysAgents create databases at 4x the human rate; half last under 10 seconds.Snowflake saw agent queries scanning trillions of records to return two.One agent question becomes a distributed computing problem.Agents querying several systems receive states from different moments.Pipelines built only for data movement can't explain why they break.Shift-left analytics acts on data in flight, before the warehouse.Stale data compounds agents' hallucination and people-pleasing tendencies.AI sovereignty now covers where models run, not only where data sits.Agent-guarded replicas keep agents away from production systems.Zero-copy ETL moves complexity onto the source database.UPS scores delivery addresses from 100 to 1000 in real time.The four Cs: current, consistent, consumable, contextual. Chapters03:13 Welcome and Alok Pareek's background06:17 What the agentic era demands of data pipelines14:34 Moving data versus intelligent pipelines18:40 Shift-left analytics20:49 Data and AI sovereignty25:05 Why zero-copy ETL falls short28:51 UPS Defense Delivery and real-time risk scoring31:26 The four Cs MORE RESOURCES: Striim: https://www.striim.com/ Episode article: Subscribe to the podcast: https://open.spotify.com/show/4jgUESBM1jQpq4Wx2xfou8 @striiminc @enterprisemanagement360 @Bigdataldn #AIGovernance #AgenticAI #DataPipelines #EnterpriseAI #BigDataLondon #Striim AI governance, enterprise AI, agentic AI, data pipelines, real-time data, shift-left analytics, AI sovereignty, data governance, Striim, Alok Pareek, Big Data London, tech podcast

    Data Pipelines For Agentic AI: An Edgy, Shift-Left Live BDL Podcast
  5. Oct 20

    Can AI Agents Be Trusted With Enterprise Data? | Big Data LDN Special

    Two different teams in an enterprise built two AI agents, but both asked the AI the same question: What are last quarter’s customer stats? Both agents answer promptly and quite assertively. However, the figures on the same inquiry are different. The agents’ answers don’t match. Nothing has broken because neither team is aware of the other’s AI agent. What happened here is that each agent drew the answer from different contextual data. The business holds two variations of truth delivered with equal confidence. This is the kind of oblivious failure Angelita Frozza Sanches, Head of Data at Scout24, is working to prevent at the leading German real estate platform where AI agents have already been deployed in production. In this episode of the Don't Panic It's Just Data podcast, recorded live at Big Data London 2026 in Kensington Olympia, host Mike Ferguson, Managing Director of Intelligent Business Strategies and Conference Chair of Big Data London, sits down with Sanches and Suresh Srinivas, CEO and Co-Founder of Collate and OpenMetadata. They talk about who now consumes enterprise data, how much of the context layer should be centralised, and why enterprises making progress are the ones that start small and tie every agent to a business outcome. According to Sanchez, the concerns from 20 years ago to now remain the same, and it comes back to governance. “How people consume, how they interact with data,” remains the same. What’s new is that “AI has changed the velocity and the impact of all those aspects.” “Now we can take advantage of AI to help us build governance,” Sanchez says. “How can we prepare everything not just for humans but agents–another persona in the game.” Also Watch: How to Increase Agent Accuracy & Reduce Cost with Context #AIAgents #DataGovernance #ContextLayer #AgenticAI #OpenMetadata #BigDataLondon #EM360Tech #AIAgents #DataGovernance #ContextLayer #AgenticAI #OpenMetadata #BigDataLondon #EM360Tech

    Can AI Agents Be Trusted With Enterprise Data? | Big Data LDN Special
  6. Oct 9

    How SAP BW Migration Prepares Enterprises for AI

    Companies pouring money into AI are seeing only incremental gains, and One Data Chief Executive Officer Dr Andreas Böhm says poor data is a major reason. In a recent episode of the Don't Panic. It's Just Data podcast, Böhm joined the data whisperer Scott Taylor to discuss why SAP Business Warehouse migrations can give enterprises a valuable opportunity to improve the quality and usability of their data. Böhm, who started his first data company 20 years ago, told host Taylor that the underlying task has not changed through successive waves of big data, data science and machine learning. Organisations still need to get the right data to the algorithms. The algorithms are what have improved. Why AI Projects Stall Without Trusted DataBöhm said enterprises are spending heavily on AI but are not yet seeing the return on investment (ROI). This is especially true when it comes to large jumps in efficiency, cost savings or product development. In his view, the cause is that data is not being used properly. He identified three factors that determine whether AI is adopted in practice. The first is trust. If finance controllers do not believe the data a system produces, for example because it does not match their own spreadsheets, they will not act on it. Böhm questioned how an AI agent could be expected to act on data that people themselves distrust.The second is consistency over time. Getting data right once is relatively easy, he said, but keeping quality high day to day is a continuing challenge. He compared it to asking his daughter to tidy her room: it looks fine for a day.The third is context. Data accurate enough for a forecast, where a five per cent swing may be acceptable, may not be good enough for a profit and loss statement or regulatory reporting to the US Securities and Exchange Commission. Taylor noted that AI amplifies the consequences of poor-quality data. The familiar principle of “garbage in, garbage out” becomes a much larger enterprise risk when flawed data is processed and scaled across AI systems. As Böhm put it, the result is “scaled garbage.” Why BW Migration Is an Opening for AI ReadinessBöhm said SAP BW systems hold decades of financial and operational data, along with business logic buried in ABAP code, mappings and calculation views. That logic covers how sales forecasts are calculated and how controlling processes work, and the people who built it have often left the company. Simply lifting and shifting that content to a new platform carries the old problems with it, the two agreed. Taylor said it amounts to building a faster way to repeat the same mistakes. Böhm recommended instead starting with a landscape analysis and end-to-end lineage mapping to see what is actually used. Typically, he said, about 50 per cent of legacy objects can be discarded, and reducing scope raises quality on its own. His team then uses an explainer agent to document what past logic did, so new staff and AI agents can understand it. He described a client with 32 SAP systems, a mix of BW and ERP, that wanted to free up capital by understanding how cash flowed across the group. BW was trusted at the level of individual organisations but not company-wide. One Data translated the BW logic into a modern lakehouse architecture, then built a group-wide model on top of it. The migration took months rather than years, Böhm said, and the improvement in managed cash was visible in the company's profit and loss account. Böhm cautioned that AI is not a shortcut around the work. Pasting ABAP code into a large language model does not capture logic spread across classes, reusable objects, hidden calls and customer exits. What has changed, he said, is that AI agents can now handle tasks such as migrating code, quality checks and fixing syntax errors, which would have been far harder four years ago. He dismissed the idea that LLMs remove the need to clean data. The funding angle matters too. Migration spending is already required, Böhm noted, so it can double as the investment in data management that organisations often struggle to secure. How to Keep Migrated Data Trusted After Go-LiveBöhm said governance after migration should follow a data product approach, built on several practices: Ownership: Someone must understand and be responsible for the data, or it will not stay clean.Readability: Business users need understandable column and table names, not cryptic technical labels.Business validation: Checks should go beyond technical rules such as "revenue must be a number" to business rules, such as whether negative revenue is valid because of returns.Focus: Not everything needs governing. Priorities should be core entities such as customers, revenues, purchase orders and product lifecycles. Taylor described governance as a lifestyle rather than a project. Böhm added that it remains a people business, in which data owners take pride in their work and promote it internally. His closing advice to organisations preparing SAP BW data for AI was to use the migration as a chance to clean up the data landscape and to apply the budget to making at least one or two areas AI-ready. If you would like to find out more, visit onedata.ai or follow Dr Andreas Böhm on LinkedIn. TakeawaysThe recurring hype cycles in AI and the importance of data quality.The critical role of trust, context, and governance in AI adoption.Transforming legacy SAP BW systems into modern data architectures.Strategies for cleaning up and understanding enterprise data landscapes.The significance of data ownership, understanding, and management in data governance.

    How SAP BW Migration Prepares Enterprises for AI
  7. Sep 22

    How to Increase Agent Accuracy & Reduce Cost with Context

    What happens when an enterprise data agent asks you: “What is our churn this quarter?” The AI agent has access to the warehouse, the tables, and the query engine. It carries out the necessary calculations. However, the answer it provides turns out to be inaccurate. Why? It’s not because the model is inadequate. It’s because it didn’t know which definition of the term 'churn' the business had in mind, which table was out of date, or which join resulted in customers being counted twice. When you apply this situation to all the questions your enterprise directs at AI, you begin to understand why so many agent projects come to a halt at the demo stage. In this episode of the Don't Panic, It's Just Data podcast, host Shubhangi Dua, Podcast Producer and B2B journalist at EM360Tech, sits down with Suresh Srinivas, the CEO and Co-Founder of Collate and also a Co-Founder of the open-source project OpenMetadata. They talk about the context layer and the reasons why AI agents fail when it comes to enterprise data, even though the underlying models are continually getting better. He explains why the solution must be an open context layer rather than a proprietary one. Also Read: OpenAI's self-service AI data agent, built on OpenMetadataWhat OpenAI's internal data agent shows about scaleSrinivas cites a use case to Dua to explain how the solution can be deployed at scale. He talks about OpenAI's own internal data agent, Kepler, which is used by more than 3,500 people and carries out reasoning across about 70,000 datasets and over 600 petabytes of data, as proof that the issue is not particular to Collate's customers. OpenAI developed a seven-layered context system based on OpenMetadata, and is one of its largest users as well as a major open source contributor. Srinivas maintains that even though there are seven layers, they all come down to three basic elements: the context of the data (what exists), the ontology and semantics (what it means, expressed in business terms such as "revenue" or "churn"), and memory (the corrections and feedback that the agent learns from). Srinivas states that after OpenAI had invested in the context layer, query performance on Kepler decreased from 22 minutes to 90 seconds, representing a roughly 16-fold improvement, together with improvements in token efficiency. Anthropic too has published its own research on the importance of context layers for data agents, which shows that there is convergence among the leading research labs, not merely a point made by Collate. Key TakeawaysMcKinsey: fewer than 10 per cent of enterprises have scaled AI agents to value80 per cent of enterprises cite data limitations as the scaling barrierOn the Spider 2.0 benchmark, the top models achieved only 59 per cent accuracy when tested on enterprise data.Collate's context layer raised accuracy from 59 per cent to 94 per cent on the same benchmarkThat's an 86% reduction in wrong answers from context alone, not a bigger modelToken spend fell 75 per cent once a context layer was addedDatabase queries per question dropped from 190 to 27, an 86 per cent reduction in computeOpenAI's Kepler agent spans 70,000 datasets and 600+ petabytes, built on OpenMetadataOpenAI's query performance improved from 22 minutes to 90 seconds with contextContext layer reduces to three primitives: data context, ontology/semantics, memoryOpenMetadata has 15,000+ community members and 4,000 production deploymentsCollate curates context per persona rather than serving the full context to every agentCollate's AI Governance Studio audits what agents access and the risk they pose Chapters00:00 Introduction to AI and Data Context Challenges02:16 The Root Cause of Data Problems: Missing Context04:20 Evolving Definition of Context in AI and Data06:52 Why Data Limitations Still Hinder AI Scaling07:22 The Impact of Context on AI Model Accuracy and Cost09:21 How Providing Context Improves AI Performance11:02 Verifying Data Accuracy in a Constantly Changing Enterprise12:25 AI Agents and Continuous Data Quality Management14:25 OpenAI's Use of Context Layers for Better AI Performance16:03 Avoiding Noise and Cost in Context Management18:47 The Role of Persona-Based Context Curation19:45 Open Source as a Foundation for Context Layers21:37 Accountability for Incorrect or Stale Context22:24 Collaborative Role of Data Teams and AI Agents in Context Management24:01 Guardrails and Deterministic Answers in Enterprise AI25:53 Reducing Token Consumption with Context Layers28:47 Key Takeaway: Building a Robust Context Layer for AI30:37 Upcoming Industry Discussions and Challenges at Big Data London32:28 The Future of AI Agents and the Importance of Context in Data Strategy33:12 Closing Remarks and Next Steps for AI and Data Leaders @CollateData @enterprisemanagement360 #AIagents #EnterpriseAI #DataGovernance #OpenMetadata #ContextLayer #AIaccuracy #AgenticAI #CIO #DataStrategy #EM360Tech #DontPanicItsJustData #opensourcesoftware #opensourceai AI agents, enterprise AI, CIO, CTO, IT leadership, data governance, AI governance, context layer, OpenMetadata, data strategy, agentic AI, digital transformation, tech podcast, enterprise technology

    How to Increase Agent Accuracy & Reduce Cost with Context
  8. Sep 21

    Can AI Agents Make Decisions Without Real-Time Enterprise Data?

    Envision a fraud detection model embedded in a bank's AI system, continuously monitoring transactions for unusual activity. The warehouse behind it updates itself every 15 minutes; however, that seems like a short interval. A fraudulent transaction took place 13 minutes ago, and the model still hasn't picked it up. The thing is, the model is not faulty. The data being fed to it had already overlooked the critical moment. But how? In this episode of the Don't Panic! It's Just Data podcast, host Shubhangi Dua, Podcast Producer and B2B Tech Journalist at EM360Tech, sat down with guest Sundar Nathan, VP of Product Marketing, Enablement and Academy at Striim. They discuss the gap that exists between the time an event takes place in a production system and the time an AI agent becomes aware of it. As the frontier models from companies such as OpenAI and Anthropic become more commonplace, the model ceases to be a source of competitive advantage for any enterprise. What remains then is the data beneath the model and the speed at which that data actually moves. “I'd go even a step further and state that in 18 months the model you select will be less important to you than the data which is feeding that model,” Nathan said. 'Everybody Is Renting The Same Brain'Alluding to his personal experience, Nathan tells Dua that his "superpower was memory,” particularly, the ability to remember circuit diagrams and organic chemistry structures as clearly as in a photograph when taking an exam. But with the introduction of Google search, that memory ceased to be an advantage since everyone had the same tool at their disposal. Why is that experience relevant? It’s similar to the use of AI in the enterprise today. "Your competitor next door has access to the same frontier models at the same price, roughly on the same day," he says. According to the Striim Marketing VP, what a competitor cannot rent is an enterprise’s operational data, its business insights and "the institutional knowledge accumulated over decades", in particular, how close an agent's view of production data is to the actual data. "The time gap between the agent and where your production data is measured is the new source of competition," he adds. Also Read Use Case: UPS Leverages Striim and Google BigQuery for AI-Secured Package Delivery Read Use Case: The Hyper-Responsive Payments Organisation TakeawaysThe model matters less than the data feeding it within 18 months, Viswanathan predicts.Four Cs of AI-ready data: current, consistent, consumable, contextual.Only 23% of enterprises scale AI agents past pilot stage (McKinsey).Change data capture reads transaction logs directly, in real time.Governance built for non-human users masks PII/PHI before agents see it. Chapters00:00 - Why AI advantage is moving from models to real-time data 02:06 - Sundar’s path from memory-based learning to simplifying complex tech 04:10 - Why “everyone is renting the same brain” 06:52 - Why impressive pilots fail in regulated production workflows 08:30 - The four audit questions that block deployment 10:43 - Why 15-minute refreshes are not real time for fraud 13:25 - Why enterprises need a nervous system, not a warehouse scan 15:52 - How consumable data turns raw events into agent-ready context 18:29 - What Stream’s intelligent pipe does in practice 21:12 - Governance for non-human users and mission-critical guarantees 22:26 - Stop benchmarking models and start benchmarking data staleness 25:45 - Final takeaway: it really is just data, but it must move faster

    Can AI Agents Make Decisions Without Real-Time Enterprise Data?

About

Not only do many businesses have more data than they know what to do with, but they also often struggle to gain insights from some of the most valuable data in their possession, leading to many of their crucial data assets going unused. Whether it's issues with data quality, visualization, or management, getting lost in the sea of enterprise data at your possession can make it impossible to make smart, data-driven decisions that improve your business. The "Don't Panic! It's Just Data" podcast delves deep into the power of enterprise data. From groundbreaking vendor solutions to expert-backed best practices for making the most of your data assets, join us as we gather insights from leading tech vendors and professionals who depend on data daily.

You Might Also Like