Kubernetes Bytes Ryan Wallner & Bhavin Shah
-
- Technology
Kubernetes Bytes is a podcast bringing you the latest from the world of cloud native data management. Hosts Ryan Wallner and Bhavin Shah come to you from Boston, Massachusetts with experienced backgrounds in cloud-native tech. They'll be sharing their thoughts on recent cloud native news and talking to industry experts about their experiences and challenges managing the wealth of data in today's cloud-native ecosystem.
-
Training Machine Learning (ML) models on Kubernetes
In this episode of the Kubernetes Bytes podcast, Bhavin sits down with Bernie Wu, VP Strategic Partnerships and AI/CXL/Kubernetes Initiatives at Memverge. They discuss about how Kubernetes is the most popular platform to run AI model training and model inferencing jobs. The discussion dives into model training, talking about different phases of a DAG, and then talk about how Memverge can help users with efficient and cost-effective model checkpoints. The discussion goes into topics like saving costs by using spot instances, hot restart of training jobs, reclaiming unused GPU resources, etc.
Check out our website at https://kubernetesbytes.com/ [https://www.youtube.com/redirect?event=video_description&redir_token=QUFFLUhqbllTN0VpRHpuZWZiem9iWWc2bDF5NF9SMGhod3xBQ3Jtc0tuMnNGTmhwN01xdC01ZEFqRjFERnZBLUlUSTFCRWVta0tYQU4wWndITWhfV3RnbHh1cFVtbUc5NGZRandUcG1ocjQ5Q2R2cG1tQmpibkhJMVNRMHIycE1SYVJNdlVWMGFCa2xwTkhIOEFZUFRqVG5sdw&q=https%3A%2F%2Fkubernetesbytes.com%2F&v=Jf059PFn6l0]
Episode Sponsor: Nethopper
* Learn more about KAOPS: @nethopper.io
* For a supported-demo: info@nethopper.io
* Try the free version of KAOPS now! https://mynethopper.com/auth [https://www.youtube.com/redirect?event=video_description&redir_token=QUFFLUhqa2c2UWw4bFZISFN2X0hIWUtuWHlpWGk3WC1RZ3xBQ3Jtc0trQ3FpMlZDeXUwcVdZZGJ1d2R5RVREc1V0SzNPeXBzZGVCeWdzYjNsRndTVzRGcTYtUVFRUnI2bXEtWE96QVpNNThCaENiWXpqM3dzSmF6cml1c1BEYUk4bnlEQ3lqc1d0cXdTVWxuVE5YZWV3elNITQ&q=https%3A%2F%2Fmynethopper.com%2Fauth&v=Jf059PFn6l0]
Cloud Native News:
* https://www.aquasec.com/blog/linguistic-lumberjack-understanding-cve-2024-4323-in-fluent-bit/
* https://kubernetes.io/blog/2024/05/20/completing-cloud-provider-migration/
* https://thenewstack.io/introducing-aks-automatic-managed-kubernetes-for-developers/
* https://www.harness.io/blog/harness-to-acquire-split
Show Links:
* https://www.linkedin.com/in/berniewu/
* https://criu.org/Main_Page
* https://memverge.com/
* https://youtu.be/tY8YOMRuqWI?si=yB3hHqLUpYPZ-KWN
* https://youtu.be/ND4seSKpJHI?si=shh0iuA9qC-dO6eb
Timestamps:
* 01:04 [https://www.youtube.com/watch?v=Jf059PFn6l0&t=64s] Cloud Native News
* 08:47 [https://www.youtube.com/watch?v=Jf059PFn6l0&t=527s] Interview with Bernie
* 51:40 [https://www.youtube.com/watch?v=Jf059PFn6l0&t=3100s] Key takeaways -
The evolution of service mesh technologies
In this episode of the Kubernetes Bytes podcast, Ryan and Bhavin talk to Christian Posta - VP and Global Field CTO at Solo.io about all things Service Mesh. They discuss how things have evolved from the early Linkerd days to sidecar less istio service mesh implementations. They also talk about how service mesh can help you connect to application components running outside Kubernetes, and how developers and platform engineers have a shared responsibility model when it comes to implementing service mesh using internal developer platforms.
Check out our website at https://kubernetesbytes.com/
Episode Sponsor: Nethopper
Learn more about KAOPS: @nethopper.io
For a supported-demo: info@nethopper.io
Try the free version of KAOPS now! https://mynethopper.com/auth
Cloud Native News:
* https://loft.sh/blog/our-24m-series-a-led-by-khosla-ventures/
* https://www.harness.io/blog/celebrating-150m-in-new-financing-to-accelerate-innovation
* https://www.akamai.com/newsroom/press-release/akamai-announces-intent-to-acquire-api-security-company-noname
* https://www.linkedin.com/posts/rouvenbesters_its-official-the-otomi-platform-has-activity-7194604616901120000-48g7?utm_source=share&utm_medium=member_desktop
* https://www.wiz.io/blog/celebrating-our-1-billion-funding-round-and-12-billion-valuation
Show Links:
* https://devsummit.infoq.com/conference/boston2024
* https://www.solo.io/topics/cakes-stack/
* https://www.solo.io/
Timestamps:
* 00:06:10 Cloud Native News
* 00:15:37 Interview with Torsten
* 01:01:58 Key takeaways -
What are Vector Databases
In this episode of the Kubernetes Bytes podcast, Ryan and Bhavin talk to Torsten Steinbach - VP, Chief Architect for Analytics & AI at EDB about all things Vector Databases, Postgres, and why Data is important for building AI platforms. The discussion dives into how vector databases are different than relational databases and why using Postgres extensions helps organizations use their existing data for AI applications.
Check out our website at https://kubernetesbytes.com/
Kubernetes Community Days (KCD) in New York City on May 22nd, use the promo code "KUBERNETESBYTES" to get a 10% discount on your registration fees!
Episode Sponsor: Nethopper
* Learn more about KAOPS: @nethopper.io
* For a supported-demo: info@nethopper.io
* Try the free version of KAOPS now!
* https://mynethopper.com/auth
Cloud Native News:
* https://www.reuters.com/markets/deals/ibm-nearing-buyout-deal-hashicorp-wsj-reports-2024-04-23/
* https://www.wiz.io/blog/wiz-acquires-gem-security-to-reinvent-threat-detection-in-the-cloud
* https://techcrunch.com/2024/04/18/wiz-is-in-talks-to-buy-lacework-for-150-200m-security-firm-was-last-valued-at-8-3b/
* https://www.prnewswire.com/news-releases/coreweave-secures-1-1-billion-in-series-c-funding-to-drive-the-next-generation-of-cloud-computing-for-the-future-of-ai-302133328.html
* https://kubernetes.io/blog/2024/04/17/kubernetes-v1-30-release
* https://dok.community/blog/become-a-data-on-kubernetes-in-2024-ambassador/
Show Links:
* https://www.enterprisedb.com/news/edb-acquires-splitgraph
* https://www.enterprisedb.com/resources/events
* https://www.enterprisedb.com/
Timestamps:
* 00:03:22 Cloud Native News
* 00:17:45 Interview with Torsten
* 00:57:00 Key takeaways -
KubeCon EU Paris News Recap
Join Bhavin Shah and Ryan Wallner for a recap of announcments and news from KubeCon Paris 2024.
Kubernetes Community Days (KCD) in New York City on May 22nd, use the promo code "KUBERNETESBYTES" to get a 10% discount on your registration fees!
Nethopper
* Learn more about KAOPS: @nethopper.io
* For a supported-demo: info@nethopper.io
* Try the free version of KAOPS now! https://mynethopper.com/auth
News
* https://about.gitlab.com/blog/2024/03/20/oxeye-joins-gitlab-to-advance-application-security-capabilities/
* https://www.redhat.com/en/blog/unveiling-red-hat-openshift-415
* https://developer.nvidia.com/blog/nvidia-nim-offers-optimized-inference-microservices-for-deploying-ai-models-at-scale/
* https://www.acorn.io/resources/blog/our-new-focus-developing-an-llm-app-platform-based-on-gpt-script-technology?fromOther=true
* https://loft.sh/blog/deliver-secure-kubernetes-multi-tenancy-with-new-vcluster-in-rancher-integration/
* https://www.observeinc.com/blog/stepping-on-the-gas/
* https://thenewstack.io/kubecost-2-2-covers-carbon-cost-monitoring-and-more/
* https://thenewstack.io/ovhcloud-unveils-roadmap-to-take-on-hyperscalers-from-europe/
* https://www.suse.com/c/meet-rancher-prime-3-0/
* https://www.suse.com/c/suse-releases-edge-3-0-highly-validated-edge-optimized-stack/
* https://www.fermyon.com/blog/introducing-spinkube-fermyon-platform-for-k8s
* https://www.cncf.io/blog/2024/03/19/announcing-the-ai-working-groups-new-cloud-native-artificial-intelligence-whitepaper/
* https://github.com/Azure/kaito
* https://azure.microsoft.com/en-us/updates/public-preview-kubernetes-ai-toolchain-operator-kaito-addon-for-aks/
* https://cloudnativenow.com/features/solo-io-delivers-on-cilium-support-promise-for-gloo-networks/
* https://docs.solo.io/gloo-network/latest/about/overview/
* https://github.com/kosmos-io/kosmos
* https://gateway.envoyproxy.io/blog/2024/03/14/announcing-envoy-gateways-1.0-release/
* https://newrelic.com/press-release/20240319
* https://siliconangle.com/2024/03/29/aviatrix-revolutionizes-networking-security-distributed-cloud-firewall-kubernetes-kubeconeu/ -
Open Policy Agent (OPA) 101
In this episode of the Kubernetes Bytes podcast, Ryan and Bhavin talk to Charlie Egan, Sr. Developer Advocate at Styra about all things Open Policy Agent or OPA. This episode is meant to be a 101 level episode, where we will learn what OPA is and how it can help improve the security posture for your applications running on Kubernetes. The discussion dives into some of the use cases for OPA and how it helps with Kubernetes admission control, auditing, etc.
Check out our website at https://kubernetesbytes.com/
Episode Sponsor: Elotl
Links:
* https://elotl.co/luna
* https://www.elotl.co/luna-free-trial
Timestamps:
* 07:46 Interview with Charlie
* 01:02:00 Key takeaways
Show Links:
* OPA Ecosystem https://www.openpolicyagent.org/ecosystem/
* OPA Envoy Integration https://github.com/open-policy-agent/opa-envoy-plugin
* Charlie's site: https://charlieegan3.com
* OPA Docs: https://www.openpolicyagent.org/docs/latest/
* OPA Playground: https://play.openpolicyagent.org
* OPA Slack: https://communityinviter.com/apps/openpolicyagent/signup -
Ops Ops Hooray! Navigating IDPs from an Ops perspective
Join hosts Ryan Wallner and Bhavin Shah of Kubernetes Bytes as they explore the complexities of Internal Developer Platforms (IDPs) with Chris Munford, CEO, and Dan Donahue, Solution Architect of Nethopper. In this episode, the team discusses the challenges of constructing IDPs, achieving the optimal balance of flexibility and prescriptive golden paths. The episode dives into the unique operations perspective required for effective implementation. Gain valuable insights and practical advice from industry leaders on navigating the evolving landscape of IDPs. Don't miss this insightful conversation on unlocking the full potential of IDPs for your organization.
Timestamps
* 00:06:24 - Discussion with Chris and Dan
* 00:51:44 - Takeaways
Episode Links
* What Happened to Platform Engineering? (ebook/pdf) [https://62972b08-d48a-483f-9bd6-61710270d1df.filesusr.com/ugd/9bf0a1_3c9b81081dbe4a26bc6aa163f82711f5.pdf]
* LinkedIn Audio Recording [https://video.wixstatic.com/video/9bf0a1_409daaef37cb42ffa5926c13af48e8fc/1080p/mp4/file.mp4] "What Happened to Platform Engineering"
* Website resources [https://www.nethopper.io/platform-engineering] on platform engineering/IDP
* LinkedIn Newsletter [https://www.linkedin.com/pulse/cloud-native-platform-engineering-idp-insights-nethopper-b4mle/?trackingId=pUpK%2Bc%2BN4Z3iwWpXOBtFbQ%3D%3D] about KAOPS/Platform Engineering/IDP