Reliable Data Engineering

Reliable Data Engineering

Discover how to build, deploy, and maintain data pipelines that scale reliably in production. This podcast features practical lessons on Databricks migrations, dbt best practices, SQL optimization, cost reduction on cloud platforms, and data quality frameworks—all designed to help data engineers avoid costly mistakes.

エピソード

  1. 1月11日

    Data Engineering Is Not One Job Anymore

    Ten years ago, being a generalist worked. In 2026, companies don't hire "tool collectors." They hire specialists who solve specific problems exceptionally well. Here's which path pay and which leaves you unemployable.

    4分

  2. 1月8日

    dbt Is Not an ETL Tool — And That’s Okay

    dbt is often treated like a full ETL platform — and that expectation causes more problems than it solves. In this episode, we break down what dbt was actually designed for, where it shines, where it doesn’t, and why accepting its limits leads to cleaner pipelines and better data architecture.

    5分

  3. 1月8日

    Comparing Databricks, Snowflake, and BigQuery: Same Query, Real Costs

    A side-by-side analysis of query performance, pricing, and operational differences across three leading data platforms

    6分

  4. 1月8日

    I Replaced My Databricks Pipeline with AI Agents — Here’s What Actually Happened

    A story about how AI agents what do for us!

    4分

  5. 1月3日

    How AI Will Transform Data Engineering in 2026

    A realistic look at what’s coming and the skills that will keep you ahead of the curve

    12分

  6. 1月3日

    Welcome to Reliable Data Engineering - Here's What You'll Learn

    Welcome to Reliable Data Engineering—the podcast for data engineers who build production systems and want to stay ahead of the curve. I'm your host, a data engineer with 6+ years building enterprise-scale data infrastructure. I've migrated 500+ dbt models to Databricks, optimized SQL workloads across multiple platforms, and managed complex data governance at scale. Now I'm sharing the real lessons learned—no hype, no theory, just practical insights from someone still building these systems every day. What This Podcast Is About: Real-world data engineering challenges (migrations, cost optimization, reliability, data quality) Modern data stacks and tools (Databricks, dbt, Apache Spark, cloud platforms) Career guidance for a rapidly evolving field War stories from production incidents and lessons learned How AI is transforming data engineering and what you need to know Who This Is For:Mid-level and senior data engineers managing production systems. If you're navigating legacy-to-modern migrations, optimizing cloud costs, building data quality frameworks, or wondering how AI fits into your career—this show is for you. What You Won't Find Here:No shallow takes on AI replacing engineers. No theoretical tutorials disconnected from production reality. No influencers selling courses. Just honest analysis from someone in the trenches. New episodes every week exploring the real challenges, evolving landscape, and practical strategies that help data engineers thrive. Let's build something reliable.

    1分

予告編

番組について

Discover how to build, deploy, and maintain data pipelines that scale reliably in production. This podcast features practical lessons on Databricks migrations, dbt best practices, SQL optimization, cost reduction on cloud platforms, and data quality frameworks—all designed to help data engineers avoid costly mistakes.

情報

  • クリエイター
    Reliable Data Engineering
  • 配信期間
    26年
  • エピソード
    6
  • 制限指定
    不適切な内容を含まない
  • Copyright
    © Reliable Data Engineering
  • 番組のWebサイト
    Reliable Data Engineering