Kubernetes Bytes Ryan Wallner & Bhavin Shah
-
- Tecnologia
Kubernetes Bytes is a podcast bringing you the latest from the world of cloud native data management. Hosts Ryan Wallner and Bhavin Shah come to you from Boston, Massachusetts with experienced backgrounds in cloud-native tech. They'll be sharing their thoughts on recent cloud native news and talking to industry experts about their experiences and challenges managing the wealth of data in today's cloud-native ecosystem.
-
Building the AI Hyperscaler with Kubernetes
In this episode of the Kubernetes Bytes podcast, Bhavin sits down with Brandon Jacobs, an Infrastructure architect at Coreweave. They discuss how Coreweave has adopted Kubernetes to build the AI hyperscaler. The discussion dives into details around how Coreweave handles Day 0 and Day 2 operations for AI labs that need access to GPUs. They also talk about lessons learnt and best practices for building a Kubernetes based cloud.
Check out our website at https://kubernetesbytes.com/
Episode Sponsor: Nethopper
Learn more about KAOPS: nethopper.io
For a supported-demo: info@nethopper.io
Try the free version of KAOPS now!
https://mynethopper.com/auth
Cloud Native News:
* https://siliconangle.com/2024/06/24/ollama-addresses-remote-execution-flaw-following-wiz-discovery/
* https://siliconangle.com/2024/06/18/suse-acquires-kubernetes-observability-startup-stackstate/
Show links:
* https://www.linkedin.com/in/brandonrjacobs/
* https://www.coreweave.com/
Timestamps:
* 00:01:39 Cloud Native News
* 00:05:30 Interview with Brandon
* 00:51:37 Key takeaways -
Shifting Minds: Exploring OpenShift's AI Landscape
Ryan Wallner and Bhavin Shah talk to Andy Grimes about the OpenShift AI Landscape.
Check out our website at https://kubernetesbytes.com/
Episode Sponsor: Nethopper
* - Learn more about KAOPS: @nethopper.io
* - For a supported-demo: info@nethopper.io
* - Try the free version of KAOPS now! https://mynethopper.com/auth
Links
* - https://youtube.com/watch?v=nAT9U1vJ8x0
* - https://www.theregister.com/2024/06/12/kubertenes_decade_anniversary/
* - https://www.businesswire.com/news/home/20240606882860/en/Mirantis-Collaboration-with-Pure-Storage-Simplifies-Data-Management-with-Kubernetes
* - https://falco.org/blog/falco-0-38-0/
* - https://au.finance.yahoo.com/news/rancher-government-successfully-using-harvester-121100125.html
* - https://www.youtube.com/@PlatformEngineering
* - Video: https://www.youtube.com/watch?v=tZj8j3fdXy4
* - Virtual Road Shows: https://www.redhat.com/en/north-america-red-hat-aws
* - AWS Gameday August 22nd: TBS
* - Boston Childrens Hospital RHOAI: https://www.redhat.com/en/creating-chris
* - IBM Open Source AI https://www.youtube.com/watch?v=SuGedexBudQ&t=141s -
Training Machine Learning (ML) models on Kubernetes
In this episode of the Kubernetes Bytes podcast, Bhavin sits down with Bernie Wu, VP Strategic Partnerships and AI/CXL/Kubernetes Initiatives at Memverge. They discuss about how Kubernetes is the most popular platform to run AI model training and model inferencing jobs. The discussion dives into model training, talking about different phases of a DAG, and then talk about how Memverge can help users with efficient and cost-effective model checkpoints. The discussion goes into topics like saving costs by using spot instances, hot restart of training jobs, reclaiming unused GPU resources, etc.
Check out our website at https://kubernetesbytes.com/ [https://www.youtube.com/redirect?event=video_description&redir_token=QUFFLUhqbllTN0VpRHpuZWZiem9iWWc2bDF5NF9SMGhod3xBQ3Jtc0tuMnNGTmhwN01xdC01ZEFqRjFERnZBLUlUSTFCRWVta0tYQU4wWndITWhfV3RnbHh1cFVtbUc5NGZRandUcG1ocjQ5Q2R2cG1tQmpibkhJMVNRMHIycE1SYVJNdlVWMGFCa2xwTkhIOEFZUFRqVG5sdw&q=https%3A%2F%2Fkubernetesbytes.com%2F&v=Jf059PFn6l0]
Episode Sponsor: Nethopper
* Learn more about KAOPS: @nethopper.io
* For a supported-demo: info@nethopper.io
* Try the free version of KAOPS now! https://mynethopper.com/auth [https://www.youtube.com/redirect?event=video_description&redir_token=QUFFLUhqa2c2UWw4bFZISFN2X0hIWUtuWHlpWGk3WC1RZ3xBQ3Jtc0trQ3FpMlZDeXUwcVdZZGJ1d2R5RVREc1V0SzNPeXBzZGVCeWdzYjNsRndTVzRGcTYtUVFRUnI2bXEtWE96QVpNNThCaENiWXpqM3dzSmF6cml1c1BEYUk4bnlEQ3lqc1d0cXdTVWxuVE5YZWV3elNITQ&q=https%3A%2F%2Fmynethopper.com%2Fauth&v=Jf059PFn6l0]
Cloud Native News:
* https://www.aquasec.com/blog/linguistic-lumberjack-understanding-cve-2024-4323-in-fluent-bit/
* https://kubernetes.io/blog/2024/05/20/completing-cloud-provider-migration/
* https://thenewstack.io/introducing-aks-automatic-managed-kubernetes-for-developers/
* https://www.harness.io/blog/harness-to-acquire-split
Show Links:
* https://www.linkedin.com/in/berniewu/
* https://criu.org/Main_Page
* https://memverge.com/
* https://youtu.be/tY8YOMRuqWI?si=yB3hHqLUpYPZ-KWN
* https://youtu.be/ND4seSKpJHI?si=shh0iuA9qC-dO6eb
Timestamps:
* 01:04 [https://www.youtube.com/watch?v=Jf059PFn6l0&t=64s] Cloud Native News
* 08:47 [https://www.youtube.com/watch?v=Jf059PFn6l0&t=527s] Interview with Bernie
* 51:40 [https://www.youtube.com/watch?v=Jf059PFn6l0&t=3100s] Key takeaways -
The evolution of service mesh technologies
In this episode of the Kubernetes Bytes podcast, Ryan and Bhavin talk to Christian Posta - VP and Global Field CTO at Solo.io about all things Service Mesh. They discuss how things have evolved from the early Linkerd days to sidecar less istio service mesh implementations. They also talk about how service mesh can help you connect to application components running outside Kubernetes, and how developers and platform engineers have a shared responsibility model when it comes to implementing service mesh using internal developer platforms.
Check out our website at https://kubernetesbytes.com/
Episode Sponsor: Nethopper
Learn more about KAOPS: @nethopper.io
For a supported-demo: info@nethopper.io
Try the free version of KAOPS now! https://mynethopper.com/auth
Cloud Native News:
* https://loft.sh/blog/our-24m-series-a-led-by-khosla-ventures/
* https://www.harness.io/blog/celebrating-150m-in-new-financing-to-accelerate-innovation
* https://www.akamai.com/newsroom/press-release/akamai-announces-intent-to-acquire-api-security-company-noname
* https://www.linkedin.com/posts/rouvenbesters_its-official-the-otomi-platform-has-activity-7194604616901120000-48g7?utm_source=share&utm_medium=member_desktop
* https://www.wiz.io/blog/celebrating-our-1-billion-funding-round-and-12-billion-valuation
Show Links:
* https://devsummit.infoq.com/conference/boston2024
* https://www.solo.io/topics/cakes-stack/
* https://www.solo.io/
Timestamps:
* 00:06:10 Cloud Native News
* 00:15:37 Interview with Torsten
* 01:01:58 Key takeaways -
What are Vector Databases
In this episode of the Kubernetes Bytes podcast, Ryan and Bhavin talk to Torsten Steinbach - VP, Chief Architect for Analytics & AI at EDB about all things Vector Databases, Postgres, and why Data is important for building AI platforms. The discussion dives into how vector databases are different than relational databases and why using Postgres extensions helps organizations use their existing data for AI applications.
Check out our website at https://kubernetesbytes.com/
Kubernetes Community Days (KCD) in New York City on May 22nd, use the promo code "KUBERNETESBYTES" to get a 10% discount on your registration fees!
Episode Sponsor: Nethopper
* Learn more about KAOPS: @nethopper.io
* For a supported-demo: info@nethopper.io
* Try the free version of KAOPS now!
* https://mynethopper.com/auth
Cloud Native News:
* https://www.reuters.com/markets/deals/ibm-nearing-buyout-deal-hashicorp-wsj-reports-2024-04-23/
* https://www.wiz.io/blog/wiz-acquires-gem-security-to-reinvent-threat-detection-in-the-cloud
* https://techcrunch.com/2024/04/18/wiz-is-in-talks-to-buy-lacework-for-150-200m-security-firm-was-last-valued-at-8-3b/
* https://www.prnewswire.com/news-releases/coreweave-secures-1-1-billion-in-series-c-funding-to-drive-the-next-generation-of-cloud-computing-for-the-future-of-ai-302133328.html
* https://kubernetes.io/blog/2024/04/17/kubernetes-v1-30-release
* https://dok.community/blog/become-a-data-on-kubernetes-in-2024-ambassador/
Show Links:
* https://www.enterprisedb.com/news/edb-acquires-splitgraph
* https://www.enterprisedb.com/resources/events
* https://www.enterprisedb.com/
Timestamps:
* 00:03:22 Cloud Native News
* 00:17:45 Interview with Torsten
* 00:57:00 Key takeaways -
KubeCon EU Paris News Recap
Join Bhavin Shah and Ryan Wallner for a recap of announcments and news from KubeCon Paris 2024.
Kubernetes Community Days (KCD) in New York City on May 22nd, use the promo code "KUBERNETESBYTES" to get a 10% discount on your registration fees!
Nethopper
* Learn more about KAOPS: @nethopper.io
* For a supported-demo: info@nethopper.io
* Try the free version of KAOPS now! https://mynethopper.com/auth
News
* https://about.gitlab.com/blog/2024/03/20/oxeye-joins-gitlab-to-advance-application-security-capabilities/
* https://www.redhat.com/en/blog/unveiling-red-hat-openshift-415
* https://developer.nvidia.com/blog/nvidia-nim-offers-optimized-inference-microservices-for-deploying-ai-models-at-scale/
* https://www.acorn.io/resources/blog/our-new-focus-developing-an-llm-app-platform-based-on-gpt-script-technology?fromOther=true
* https://loft.sh/blog/deliver-secure-kubernetes-multi-tenancy-with-new-vcluster-in-rancher-integration/
* https://www.observeinc.com/blog/stepping-on-the-gas/
* https://thenewstack.io/kubecost-2-2-covers-carbon-cost-monitoring-and-more/
* https://thenewstack.io/ovhcloud-unveils-roadmap-to-take-on-hyperscalers-from-europe/
* https://www.suse.com/c/meet-rancher-prime-3-0/
* https://www.suse.com/c/suse-releases-edge-3-0-highly-validated-edge-optimized-stack/
* https://www.fermyon.com/blog/introducing-spinkube-fermyon-platform-for-k8s
* https://www.cncf.io/blog/2024/03/19/announcing-the-ai-working-groups-new-cloud-native-artificial-intelligence-whitepaper/
* https://github.com/Azure/kaito
* https://azure.microsoft.com/en-us/updates/public-preview-kubernetes-ai-toolchain-operator-kaito-addon-for-aks/
* https://cloudnativenow.com/features/solo-io-delivers-on-cilium-support-promise-for-gloo-networks/
* https://docs.solo.io/gloo-network/latest/about/overview/
* https://github.com/kosmos-io/kosmos
* https://gateway.envoyproxy.io/blog/2024/03/14/announcing-envoy-gateways-1.0-release/
* https://newrelic.com/press-release/20240319
* https://siliconangle.com/2024/03/29/aviatrix-revolutionizes-networking-security-distributed-cloud-firewall-kubernetes-kubeconeu/