Kubernetes Bytes

Ryan Wallner & Bhavin Shah
Kubernetes Bytes

Kubernetes Bytes is a podcast bringing you the latest from the world of cloud native data management. Hosts Ryan Wallner and Bhavin Shah come to you from Boston, Massachusetts with experienced backgrounds in cloud-native tech. They'll be sharing their thoughts on recent cloud native news and talking to industry experts about their experiences and challenges managing the wealth of data in today's cloud-native ecosystem.

  1. 12/18/2024

    KubeCon NA 2024 News Recap

    Join Bhavin Shah and Ryan Wallner for a recap of announcements and news from KubeCon North America 2024.   Check out our website at https://kubernetesbytes.com/  * https://www.businesswire.com/news/home/20241119538933/en/Spectro-Cloud-Closes-75m-Series-C-Led-by-Growth-Equity-at-Goldman-Sachs-Alternatives * https://northflank.com/blog/northflank-raises-22m-to-make-kubernetes-work-for-your-developers-ship-workloads-not-infrastructure * https://snyk.io/news/snyk-acquires-developer-first-dast-provider-probely/ * https://www.nutanix.com/blog/introducing-nutanix-enterprise-ai  * https://thenewstack.io/stacklok-donates-minder-security-project-to-openssf/ * https://www.prnewswire.com/news-releases/akamai-launches-cloud-agnostic-ready-to-run-application-platform-302302446.html  * https://www.businesswire.com/news/home/20241112064093/en/Loft-Labs-Introduces-vCluster-Cloud-a-Managed-Solution-to-Simplify-and-Reduce-Costs-of-Kubernetes * https://cloud.google.com/blog/products/containers-kubernetes/gke-65k-nodes-and-counting  * https://www.veeam.com/resources/wp-whats-new-veeam-kasten-for-kubernetes.html * https://www.netapp.com/blog/trident-24-10-best-storage-kubernetes/ * https://podman-desktop.io/blog/2024/11/14/podman-desktop-cncf  * https://aws.amazon.com/blogs/aws/streamline-kubernetes-cluster-management-with-new-amazon-eks-auto-mode/ * https://aws.amazon.com/about-aws/whats-new/2024/12/amazon-eks-hybrid-nodes/ * https://thenewstack.io/kueue-can-now-schedule-kubernetes-batch-jobs-across-clusters/  * https://cloudnativenow.com/kubecon-cnc-na-2024/solo-io-donates-api-gateway-to-cncf-to-advance-kubernetes-connectivity/ * https://blocksandfiles.com/2024/11/08/tintri-unveils-kubernetes-container-storage-interface-for-streamlined-management/  * https://www.sdxcentral.com/articles/stringerai-announcements/kubiya-launches-captain-kubernetes-ai-tool-for-simplifying-kubernetes-management/ * https://cloudnativenow.com/topics/cloudnativedevelopment/application-dev/cncf-automates-kubernetes-secops-with-kyverno/ * https://www.cncf.io/announcements/2024/11/15/cloud-native-computing-foundation-expands-certification-to-platform-engineering-and-more/   * https://training.linuxfoundation.org/platform-engineering-programs  * https://cloudnativenow.com/topics/cloudnativedevelopment/cncf-kubevirt-v1-4-vms-are-now-just-another-kubernetes-resource/ * https://kubevirt.io/user-guide/release_notes/ * kubernetes.io/blog/2024/12/11/kubernetes-v1-32-release/ * https://thehackernews.com/2024/12/296000-prometheus-instances-exposed.html?utm_source=tldrdevops

    58 min
  2. Inference in Action: Scaling Al Smarter with Inferless

    10/24/2024

    Inference in Action: Scaling Al Smarter with Inferless

    In this episode, we sit down with Nilesh Agarwal, co-founder of Inferless, a platform designed to streamline serverless GPU inference. We'll cover the evolving landscape of model deployment, explore open-source tools like KServe and Knative, and discuss how Inferless solves common bottlenecks, such as cold starts and scaling issues. We also take a closer look at real-world examples like CleanLab, who saved 90% on GPU costs using Inferless. Whether you're a developer, DevOps engineer, or tech enthusiast curious about the latest in AI infrastructure, this podcast offers insights into Kubernetes-based model deployment, efficient updates, and the future of serverless ML. Tune in to hear Nilesh's journey from Amazon to founding Inferless and how his platform is transforming the way companies deploy machine learning models. Subscribe now for more episodes! Show Links: * OpenShift 4.17 is GA https://www.youtube.com/live/DvKHwz-c11c?si=6Zap6hk_GsQfdX2m * Policy SBOM from Styra: https://www.styra.com/blog/introducing-policy-sbom/ * NVIDIA GEForce NOW runs on KubeVirt https://thenewstack.io/now-nvidia-scaled-its-cloud-services-with-kubevirt/ * CBT feedback https://thenewstack.io/kubernetes-advances-cloud-native-data-protection-share-feedback * CNCF KUBEEDGE Grad https://www.devopsdigest.com/cncf-announces-kubeedge-graduation?utm_source=tldrdevops * Palumi Operator 2.0 https://www.pulumi.com/blog/pulumi-kubernetes-operator-2-0 Inferless LInks: * https://www.inferless.com/blog/cleanlab-saves-90-on-gpu-costs-with-inferless-serverless-inference * https://www.inferless.com/blog/how-spoofsense-scaled-their-ai-inference-with-inferless-dynamic-batching-autoscaling * https://www.inferless.com/  [https://www.inferless.com/] * https://docs.inferless.com/introduction/introduction  [https://docs.inferless.com/introduction/introduction] * LinkedIn - https://www.linkedin.com/in/nilesh-agarwal/  * X- https://x.com/nilesh_agarwal2  * Medium Blog https://nilesh-agarwal.medium.com/

    55 min
  3. Running Ray on Kubernetes with KubeRay

    09/05/2024

    Running Ray on Kubernetes with KubeRay

    In this episode of the Kubernetes Bytes podcast, Bhavin sits down with Kai-Hsun Chen, Software Engineer at Anyscale and maintainer of the KubeRay project. The discussion focuses on how the open source Ray project can help organizations use a single tool for data prep, model training, fine tuning and model serving workflows, both for their predictive AI and generative AI models. The discussion also dives into the KubeRay project and how it provides three different Kubernetes CRDs for Data Scientists to deploy Ray clusters on demand.    Check out our website at https://kubernetesbytes.com/   Cloud Native News: * https://azure.github.io/AKS/2024/08/23/fine-tuning-language-models-with-kaito * https://orca.security/resources/blog/kubernetes-testing-environment/ * https://www.redhat.com/en/about/press-releases/red-hat-openstack-services-openshift-now-generally-available   Show links: * Kai's LinkedIn: https://www.linkedin.com/in/kaihsun1996/ * KubeRay doc: https://docs.ray.io/en/latest/cluster/kubernetes/index.html * Ray Summit registration: https://raysummit.anyscale.com/flow/anyscale/raysummit2024/reg/createaccount (code: KaiHsunC15) * KubeRay repository: https://github.com/ray-project/kuberay * Ray repository: https://github.com/ray-project/ray * Ray Slack workspace: https://docs.google.com/forms/d/e/1FAIpQLSfAcoiLCHOguOm8e7Jnn-JJdZaCxPGjgVCvFijHB5PLaQLeig/viewform   Timestamps:  * 00:02:40 Cloud Native News  * 00:07:20 Interview with Kai  * 00:49:15 Key takeaways

    53 min
5
out of 5
13 Ratings

About

Kubernetes Bytes is a podcast bringing you the latest from the world of cloud native data management. Hosts Ryan Wallner and Bhavin Shah come to you from Boston, Massachusetts with experienced backgrounds in cloud-native tech. They'll be sharing their thoughts on recent cloud native news and talking to industry experts about their experiences and challenges managing the wealth of data in today's cloud-native ecosystem.

You Might Also Like

To listen to explicit episodes, sign in.

Stay up to date with this show

Sign in or sign up to follow shows, save episodes, and get the latest updates.

Select a country or region

Africa, Middle East, and India

Asia Pacific

Europe

Latin America and the Caribbean

The United States and Canada