The Data Engineering Show

Mariam Ghoniem

A practical and thoughtful podcast about Data Engineering, AI, and analytics in the real world. Hosted by Mariam Ghoniem, a Data Engineer working at the intersection of data, business, and technology. Each episode breaks down complex topics like data pipelines, cloud platforms, modern data stacks, and career growth — in a clear, honest, and experience-driven way. This podcast is for engineers, analysts, and anyone curious about how data actually works behind the scenes — beyond buzzwords and hype.

Épisodes

  1. Apache Spark Architecture RDDs to AQE

    23/12/2025

    Apache Spark Architecture RDDs to AQE

    The difference between a Junior Data Engineer and a Senior Architect isn't just syntax—it's understanding the Physical Plan. In this episode, we explore the architecture of Apache Spark to answer the questions that come up in every high-level interview and every complex production issue: • "When should I use RDDs vs DataFrames?" • "How does Spark handle Skew Joins automatically?" • "What exactly is AQE doing behind the scenes?" We cover the complete timeline from the raw flexibility of RDDs to the intelligent optimization of Adaptive Query Execution (AQE). Tune in to upgrade your mental model of distributed computing. 👇 Join the conversation: What’s the hardest Spark optimization issue you've faced? Let me know!

    40 min
  • 1 épisode

À propos

A practical and thoughtful podcast about Data Engineering, AI, and analytics in the real world. Hosted by Mariam Ghoniem, a Data Engineer working at the intersection of data, business, and technology. Each episode breaks down complex topics like data pipelines, cloud platforms, modern data stacks, and career growth — in a clear, honest, and experience-driven way. This podcast is for engineers, analysts, and anyone curious about how data actually works behind the scenes — beyond buzzwords and hype.

Informations

  • Création
    Mariam Ghoniem
  • Années d’activité
    2 k
  • Épisodes
    1
  • Copyright
    © Naya Technology Institution
  • Site web de l’émission
    The Data Engineering Show