243 episodes

The Data on Kubernetes Community (DoKC) is where users go to run data on Kubernetes. We facilitate the creation and sharing of best practices to help users advance in their DoK journey. Here you can enjoy the audio from our livestreams and meetups. Learn more at https://dok.community/

Data on Kubernetes Community Data on Kubernetes Community

    • Technology

The Data on Kubernetes Community (DoKC) is where users go to run data on Kubernetes. We facilitate the creation and sharing of best practices to help users advance in their DoK journey. Here you can enjoy the audio from our livestreams and meetups. Learn more at https://dok.community/

    Implementing Data & Databases on K8s within the Dutch Government | DoKC Town Hall

    Implementing Data & Databases on K8s within the Dutch Government | DoKC Town Hall

    Implementing Data & Databases on K8s within the Dutch GovernmentPresented by Sebastiaan Mannem, Director at Mannem Solutions

    A small walkthrough of projects within the Dutch government running databases on OpenShift. This talk shares success stories, provides a proven recipe to `get it done,` and debunks some of the FUD.

    Related Links
    DoKC Website - https://dok.community/
    DoKC Meetups - https://www.meetup.com/data-on-kubernetes-community/
    Join Slack - https://join.slack.com/t/dokcommunity/shared_invite/zt-1vgv7ymz7-YtLFvZicrcLP9fS3o_r2_w

    • 44 min
    Unsticking Ourselves from Glue: Migrating PayIt’s Data Pipelines to Argo Workflows and Hera | DoKC Town Hall

    Unsticking Ourselves from Glue: Migrating PayIt’s Data Pipelines to Argo Workflows and Hera | DoKC Town Hall

    Unsticking Ourselves from Glue: Migrating PayIt’s Data Pipelines to Argo Workflows and HeraPresented by Matt Menzenski, Senior Software Engineering Manager, Payitgov

    At PayIt, we’ve been deploying applications to Kubernetes almost since the beginning of the company. Our data workloads, however, have run instead in AWS Glue. This has worked well enough for the reporting use cases that have been the main focus of this team historically. However, at the beginning of 2022, the PayIt data team began building out a new data platform, and in the process, ran into a number of challenges with Glue. In this talk, I will share the difficulties that we encountered with building, deploying, and orchestrating ETL pipelines in AWS Glue, our decision process for moving those workloads into Kubernetes, and the ELT architecture that we’ve arrived at today.

    Related Links
    DoKC Website - https://dok.community/
    DoKC Meetups - https://www.meetup.com/data-on-kubernetes-community/
    Join Slack - https://join.slack.com/t/dokcommunity/shared_invite/zt-1vgv7ymz7-YtLFvZicrcLP9fS3o_r2_w

    • 23 min
    Repel Boarders! How to find a Kubernetes operator that really protects your data | DoKC Town Hall

    Repel Boarders! How to find a Kubernetes operator that really protects your data | DoKC Town Hall

    Repel Boarders! How to find a Kubernetes operator that really protects your dataPresented by Robert Hodges, AltinityOperators are a godsend for managing data in Kubernetes. But how about protecting it? We'll explore security threats to cloud native databases and show what protection you should look for in operators. Finally we'll introduce a new Data on Kubernetes Community project to develop security standards for database operators in Kubernetes.

    Related Links
    DoKC Website - https://dok.community/
    DoKC Meetups - https://www.meetup.com/data-on-kubernetes-community/
    Join Slack - https://join.slack.com/t/dokcommunity/shared_invite/zt-1vgv7ymz7-YtLFvZicrcLP9fS3o_r2_w

    • 19 min
    DoK + Apache Spark | DoKC Town Hall

    DoK + Apache Spark | DoKC Town Hall

    DoK + Apache SparkPresented by Holden Karau, Spark Committer and Open Source Engineer at NetflixIn this brief talk, Holden will cover some of the best practices from trying to deploy both small and large scale Spark on Kube.

    Related Links
    DoKC Website - https://dok.community/
    DoKC Meetups - https://www.meetup.com/data-on-kubernetes-community/
    Join Slack - https://join.slack.com/t/dokcommunity/shared_invite/zt-1vgv7ymz7-YtLFvZicrcLP9fS3o_r2_w

    • 19 min
    DoK @ Comcast - Deliver Business Outcomes & Improved DevX with Data Services on K8s | DoKC Town Hall

    DoK @ Comcast - Deliver Business Outcomes & Improved DevX with Data Services on K8s | DoKC Town Hall

    DoK @ Comcast: Delivering Business Outcomes & Improved DevX with Data Services Running on Kubernetes
    Presented by Greg Otto, Executor Director, DevX Platforms & Charles Ju, Principal Engineer
    Transforming how to deliver measurable value using data on Kubernetes, while providing psychological safety. If you just sighed, you’re one of the many people leaders and engineers who know the challenges of making these changes. In this talk, we will share our transformation journey, the “Months to Minutes” outcomes we achieved, the architecture approach, and the human journey from one of our engineers.

    Related Links
    DoKC Website - https://dok.community/
    DoKC Meetups - https://www.meetup.com/data-on-kubernetes-community/
    Join Slack - https://join.slack.com/t/dokcommunity/shared_invite/zt-1vgv7ymz7-YtLFvZicrcLP9fS3o_r2_w

    • 16 min
    DoK Talks - What is Kafka? The rise of one of the world's most used streaming data technologies // Abbey Russell

    DoK Talks - What is Kafka? The rise of one of the world's most used streaming data technologies // Abbey Russell

    Abbey Russell, PM at Cockroach Labs, shared the backstory on how and why Kafka was created.   

    Along the way, you'll learn about  
    - Who Franz Kafka was  
    - Kafka's earliest use at Linkedin in 2010
    - Why organizations like Uber/Coursera/Mailchimp use it today
    - Future of Data Streaming  

    To find out more about how organizations are benefitting from running streaming workloads on Kubernetes, check out our 2022 research report- https://dok.community/data-on-kubernetes-2022-report/ 

    https://dokcommunity.slack.com/
    https://dok.community/ 

    About Data on Kubernetes Community (DoKC)  
    DoKC is an independent tech community where practitioners go to run data workloads on Kubernetes. It is managed by Constantia.io. We produce a range of resources for end users looking to run DoK including:  

    - DoK Landscape  An interactive landscape of products and services for running data workloads on Kubernetes. (https://dok.community/landscape/)  

    - Videos and Blogs Hundreds of videos and blogs including how tos, tutorials, use cases, case studies, and more. (https://dok.community/landscape/) (https://dok.community/blog/)  

    - DoK Reports DoKC works with an independent research firm to annually produce the industry’s only DoK-focused report. (https://dok.community/dok-reports/)  

    - Livestreams and Local Meetups  Weekly livestreams on DoK-related topics including demos, tutorials, visionary talks, panels, and more. (https://www.meetup.com/data-on-kubern...)  

    - DoK Days @ KubeCon  We host hybrid events twice a year for people to get together and learn in-person or online. Details are published on our main website. (https://dok.community/)  

    Connect With Us:  
    https://dok.community/     
    https://twitter.com/DoKcommunity
    https://www.linkedin.com/company/6667...
    https://github.com/dokc

    • 15 min

Top Podcasts In Technology

Lex Fridman Podcast
Lex Fridman
All-In with Chamath, Jason, Sacks & Friedberg
All-In Podcast, LLC
Acquired
Ben Gilbert and David Rosenthal
The Neuron: AI Explained
The Neuron
Dwarkesh Podcast
Dwarkesh Patel
TED Radio Hour
NPR

You Might Also Like

Kubernetes Bytes
Ryan Wallner & Bhavin Shah
DevOps and Docker Talk: Cloud Native Interviews and Tooling
Bret Fisher
The Changelog: Software Development, Open Source
Changelog Media
The Cloudcast
Massive Studios
Hard Fork
The New York Times