Data Driven

Data Driven

Data Driven: the podcast where we explore the emerging field of Data Science. We bring the best minds in Data, Software Engineering, Machine Learning, and Artificial Intelligence right to you every Tuesday. The field of data science mashes up the worlds of statistics, database architecture and software engineering. Data Scientist has been labelled by the Harvard Business Review, as "the sexiest job of the 21st century." A quick search of job search sites reveal that this field is in high demand. In a world where Data is the new Oil, Data Science the new Refineries, consider this Car Talk for the Data Age. Every week we bring the best minds in this emerging field straight to you. Our goal is to educate and inspire our listeners so that they can be prepared to thrive in a Data Driven world.

  1. 1d ago

    Self-Healing Pipelines and the Evolving Role of Data Engineers in the AI Era

    Welcome back to Data Driven, the podcast exploring the dynamic intersection of artificial intelligence, data science, and the foundational world of data engineering. In this episode, we dive into the realm of data pipelines, enterprise analytics, and the ever-evolving tools that power our most advanced AI models. Our guest is a seasoned data engineering and analytics professional from the College of Southern Nevada, sharing over five years of expertise spanning pharmaceutical supply chain analytics, business intelligence, and leading-edge platforms like Azure Data Factory, Databricks, and Power BI. The conversation focused on the often under-appreciated work of data engineers, the challenges of maintaining data quality, and the art of making data truly AI-ready. One concept discussed was reporting drift and its impact on business decision-making. A key theme that emerged was the transformative influence of AI integration within analytics platforms such as Power BI, as well as the arrival of AI agents and self-healing data pipelines. The discussion explored the universal lessons from industries like pharma and higher education, the advancing role of dashboards, and just how quickly science fiction is becoming reality in the data space. Get ready for a thought-provoking look at how organizations can future-proof their data infrastructure in the age of AI. LinksPratham on LinkedIn -https://www.linkedin.com/in/ypratham4/Watch on YouTube -https://youtu.be/G8JdYyV_Cas Time Stamps00:00 Intro and guest introduction 05:47 Copyright challenges in AI training 07:38 Early doubts about LLM effectiveness 13:08 Evolving impact of new technology 16:48 AI simplifying data analysis 18:41 Frustrations with Stack Overflow 22:45 AI agents in data engineering 26:48 AI conversation evolving rapidly 31:26 Talking about kids and technology 34:40 Building RAG for file classification 36:26 Exploring AI in Data Visualization

    Self-Healing Pipelines and the Evolving Role of Data Engineers in the AI Era
  2. 3d ago

    Why Mike Dymott Slows His AI Agents Down on Purpose

    Welcome to another episode of Data Driven, where we dive into the evolving landscape of artificial intelligence, data science, and the critical importance of data engineering. In this episode, the conversation focused on the journey from traditional CRM systems to AI-powered business solutions, emphasizing why solid data and well-designed processes are more crucial than ever. One concept discussed was the orchestration between humans and AI agents, highlighting the need for seamless handoffs and the risks of letting agents loose on bad data. The discussion explored lessons learned from digital transformation projects, the pitfalls of simply automating broken processes, and the real-world impact of AI on customer experiences. A key theme that emerged was the shift towards industry-specific and distributed AI models, along with the increasing importance of resilience, security, and responsible implementation. Tune in for practical insights, war stories from the field, and actionable advice on building trustworthy, effective AI-driven organizations. LinksWatch on YouTube -https://www.youtube.com/watch?v=CHqv65OGlgM Time Stamps00:00 Leading ISAM with data focus 06:44 Understanding Problems in Hackathons 10:25 Challenges in Business Transformations 11:45 Discussing digital transformation challenges 14:59 Handling Failures in Complex Systems 20:24 Testing with production-like data 24:11 Blame and responsibility in AI errors 25:13 Responsibility in AI implementation 28:07 Security and data center trends 32:24 Repurposing Cold War data centers 37:44 Discussing CEO risk and resilience 39:46 Bill Gates' ongoing influence at Microsoft 42:15 AI in Motion podcast details

    Why Mike Dymott Slows His AI Agents Down on Purpose
  3. 6d ago

    Would You Trust Your Data Scientists With Your Kubernetes Cluster?

    rank La Vigne, technical marketing manager at Klique, takes the KubeCon stage to talk about GPU control and token control for the SUSE AI Factory. You may not know the name Klique yet — it's ClearML, same DNA, same software, evolved for modern AI implementations, sitting on top of the foundation SUSE already gives you. Walking the expo floor, Frank kept hearing two themes: cost control for token spend, and how you integrate AI into Kubernetes. Klique's answer is governed self-serve access, with four pieces: an AI development studio for practitioners, an orchestration engine so admins can manage GPUs, CPUs, and cloud APIs on one screen, a governance engine with spend visibility and auditability, and an AI engine that can sit in front of every model with spend control behind it. Enable, control, publish, and measure — for every user, AI actor, or agent. SUSE AI Factory is built for managing the hardware, in a way that's comfortable for Kubernetes engineers. Klique runs on top of that and talks to the AI practitioner. The question Frank would ask IT ops: would you trust your data scientists with access to your Kubernetes cluster? The answer should be no. That's not their wheelhouse. It's the same GPUs and the same hardware, viewed through two lenses — one for the platform team in SUSE Rancher, one for the AI teams. That turns the cluster into pools, policies, and models. The end user sees a well-defined endpoint. Admins keep governance over what people can do and what they can spend, so you're talking to Dana before the surprise bill shows up at the end of the month. The LLM gateway is one governed entry point to every model. You can change keys and models to adjust cost without sending a note to every developer to update an endpoint or an environment variable. Spend controls include cost quotas, wallet budgets, and budget metering, authenticated through the gateway and metered per session. A gateway alone, Frank says, is a commodity; tying it to cost, budget, and metering is the point. In the live view, a tenant is at 62% of their allocation. Everybody's green except Dana, who's spending all the tokens. Maybe Dana has a good reason. Now you know who to ask — in a friendly way — instead of reverse-engineering it through financial alchemy when the bill arrives. This episode is the audio from Frank's talk at KubeCon. The video is linked in the comments. Frank also pointed people to his LinkedIn if they want to talk more about Klique.

    Would You Trust Your Data Scientists With Your Kubernetes Cluster?
  4. Nov 9

    Your SQL Is Correct. Why Is Your Report Wrong?

    Welcome to another episode of Data Driven, the podcast where the worlds of artificial intelligence, data science, and data engineering intersect. In this episode, the conversation focused on the crucial role of data quality, automation, and reporting in healthcare analytics. The discussion explored topics such as Electronic Visit Verification (EVV) systems, challenges and strategies in maintaining accurate and reliable data, and the balance between leveraging automation tools like Power BI, Python, and SQL with maintaining compliance and stakeholder trust. Insights were shared on practical data engineering pitfalls, troubleshooting in real-life scenarios, and advice for those starting out in the data field. A key theme that emerged was the importance of human judgment in collaboration with technology, and the necessity of continual learning and curiosity in an ever-evolving industry. Whether you're a seasoned data professional or just beginning your analytics journey, this episode offers practical wisdom and firsthand experiences from the front lines of data-driven decision making. LinksWatch on YouTube -https://www.youtube.com/watch?v=XdwFCO4EQbE Time Stamps00:00 Tracking and Analyzing Caregiver Timesheets 06:26 Collaborating and Automating with BI Tools 09:09 Choosing the right data tools 12:51 Ensuring Data Quality Standards 17:41 AI's role in tech industry 19:35 Automating Data Management and Architecture 22:56 Setting business requirements for reports 28:20 Troubleshooting Power BI time zones 31:35 Troubleshooting and career growth journey 36:15 Stay curious and keep learning 37:53 Wrapping up the show

    Your SQL Is Correct. Why Is Your Report Wrong?
  5. Nov 3

    Human Oversight in AI Agents – Addressing Trust, Authorization, and Enterprise Governance

    The conversation focused on the complex realities of deploying AI agents in enterprise environments, moving beyond the hype to examine what these agents should be allowed to do versus what they can do. One concept discussed was the critical importance of defining clear boundaries and authorizations for AI agents—emphasizing that failures often stem from insufficiently thought-out controls rather than the underlying models themselves 02:08. A key theme that emerged was the necessity of human oversight, especially for high-stakes decisions in sectors like healthcare and finance 11:45. The discussion explored evolving practices in agent governance, accountability, and the growing need for transparency as AI systems become increasingly sophisticated and embedded in daily workflows 22:12. Several points were raised, including the risks of over-reliance on AI, the need to maintain auditability, and the consequences of blurring the line between human and AI agency. Set against the backdrop of a rapidly shifting technological landscape, this episode offers practical insights for organizations seeking to harness AI responsibly, while staying alert to new ethical and operational challenges. LinksNitin on LinkedIn -https://www.linkedin.com/in/nitingupta-profile/Watch on YouTube -https://youtu.be/2g_AZqLRib8 Time Stamps00:00 Challenges in Enterprise AI Agents 04:14 Comparing AI tools: Muse vs. GrokBot 08:25 Challenges in AI Adoption and Trust 11:45 Establishing AI-human decision boundaries 13:18 Automating Agent Supervision 18:49 Determining AI vs. human tasks 19:49 Automating payments with AI 23:13 Human vs. AI Decision-Making 27:24 Using AI for presentation feedback 32:16 Boosting productivity for small businesses 35:20 Ethical questions in tech industries 36:35 Impact of AI on Society 41:26 Prioritizing tasks for automation 43:20 Learning from major tech frameworks

    Human Oversight in AI Agents – Addressing Trust, Authorization, and Enterprise Governance
  6. Oct 5

    Your Security Model Is Stuck in the ’80s. AI Isn’t.

    In this episode of Data Driven, Frank La Vigne talks with Richard Luna, CEO of Protected Harbor, about why security built around keeping attackers outside a network leaves organizations exposed once someone gets in. Richard explains his concern that AI-driven attacks will probe multiple weaknesses at once, and makes the case for layered defenses, network segmentation, and infrastructure designed around the applications it supports. The conversation moves from security architecture to the people and processes that make systems dependable. Richard shares how his team plans for failures, works across technical silos, and tests vendor claims before putting equipment into production. Frank and Richard also explore the promise of AI-assisted coding, the experience junior developers need to build, and the expensive gap between a successful demo and software that holds up under real demand. From a storage cluster that failed on its second day of testing to a deployment that collapsed under load, the episode offers practical lessons in building durable systems and teams that take responsibility for them. Key Takeaways• Design beyond the perimeter. Richard argues for barriers and tripwires inside the environment, with attention to how data moves between systems. • Build around application needs. Storage performance, traffic separation, redundancy, and failure recovery should reflect the actual workload. • Break down technical silos. Developers and infrastructure teams need each other’s knowledge to diagnose problems and implement security effectively. • Keep human judgment in AI-assisted development. Generated code and automated tests still need experienced review and realistic load testing. • Make accountability specific. Divide responsibilities clearly, give engineers a path to ask for help, and involve clients when they own a blocker. • Test before trusting. Vendor assurances and a working demo do not establish how a system will behave in production. About the GuestRichard Luna is the CEO of Protected Harbor. His career has spanned software development, managed services, hosting, DevOps, and SaaS infrastructure engineering. In this conversation, he brings that experience to the design, operation, and security of systems that businesses depend on. Links and ResourcesRichard on LinkedIn:https://www.linkedin.com/in/richardluna/Protected Harbor:https://www.protectedharbor.com/Watch on YouTube -https://youtu.be/y6ZHVmJtf9o Time Stamps00:00 Why the 1980s security model falls short 01:21 Introducing Richard Luna 02:32 What SaaS infrastructure engineering means 03:53 AI threats, perimeter defenses, and information silos 05:44 Building barriers and tripwires 07:17 Application-aware infrastructure 10:27 Phased change and lessons from Toyota 11:22 Rebuilding infrastructure around the workload 13:37 Collaboration, zero trust, and asking for help 15:35 Data flow, security, and finding the root cause 18:19 Listening to clients and earning long-term trust 20:08 AI-assisted coding and the next generation of developers 21:17 Why generated tests are not enough 25:17 DevOps experience and “works on my machine” 26:58 Learning from the loss of a customer 29:02 Dividing responsibilities without losing accountability 31:56 Oversight meetings that remove obstacles 33:34 Empowering clients and engineers 35:42 Respect, culture, and learning across teams 38:06 Building a business by solving clients’ problems 42:01 Planning for failure instead of fighting fires 43:01 Stress-testing enterprise storage 47:01 A deployment failure and the cost of skipping tests 48:32 Cloud scaling and runaway costs 49:48 Closing thoughts and connecting with Richard Subscribe to Data Driven for more conversations about data science, AI, data engineering, and the people building the systems behind them.

    Your Security Model Is Stuck in the ’80s. AI Isn’t.
4.8
out of 5
44 Ratings

About

Data Driven: the podcast where we explore the emerging field of Data Science. We bring the best minds in Data, Software Engineering, Machine Learning, and Artificial Intelligence right to you every Tuesday. The field of data science mashes up the worlds of statistics, database architecture and software engineering. Data Scientist has been labelled by the Harvard Business Review, as "the sexiest job of the 21st century." A quick search of job search sites reveal that this field is in high demand. In a world where Data is the new Oil, Data Science the new Refineries, consider this Car Talk for the Data Age. Every week we bring the best minds in this emerging field straight to you. Our goal is to educate and inspire our listeners so that they can be prepared to thrive in a Data Driven world.

You Might Also Like