Kubernetes Bytes Ryan Wallner & Bhavin Shah

In this episode of the Kubernetes Bytes podcast, Bhavin sits down with  Bernie Wu, VP Strategic Partnerships and AI/CXL/Kubernetes Initiatives at Memverge. They discuss about how Kubernetes is the most popular platform to run AI model training and model inferencing jobs. The discussion dives into model training, talking about different phases of a DAG, and then talk about how Memverge can help users with efficient and cost-effective model checkpoints. The discussion goes into topics like saving costs by using spot instances, hot restart of training jobs, reclaiming unused GPU resources, etc.    

Check out our website at https://kubernetesbytes.com/ [https://www.youtube.com/redirect?event=video_description&redir_token=QUFFLUhqbllTN0VpRHpuZWZiem9iWWc2bDF5NF9SMGhod3xBQ3Jtc0tuMnNGTmhwN01xdC01ZEFqRjFERnZBLUlUSTFCRWVta0tYQU4wWndITWhfV3RnbHh1cFVtbUc5NGZRandUcG1ocjQ5Q2R2cG1tQmpibkhJMVNRMHIycE1SYVJNdlVWMGFCa2xwTkhIOEFZUFRqVG5sdw&q=https%3A%2F%2Fkubernetesbytes.com%2F&v=Jf059PFn6l0] 

Episode Sponsor: Nethopper 

* Learn more about KAOPS:  @nethopper.io 
* For a supported-demo:  info@nethopper.io 
* Try the free version of KAOPS now!   https://mynethopper.com/auth [https://www.youtube.com/redirect?event=video_description&redir_token=QUFFLUhqa2c2UWw4bFZISFN2X0hIWUtuWHlpWGk3WC1RZ3xBQ3Jtc0trQ3FpMlZDeXUwcVdZZGJ1d2R5RVREc1V0SzNPeXBzZGVCeWdzYjNsRndTVzRGcTYtUVFRUnI2bXEtWE96QVpNNThCaENiWXpqM3dzSmF6cml1c1BEYUk4bnlEQ3lqc1d0cXdTVWxuVE5YZWV3elNITQ&q=https%3A%2F%2Fmynethopper.com%2Fauth&v=Jf059PFn6l0]

Cloud Native News:

* https://www.aquasec.com/blog/linguistic-lumberjack-understanding-cve-2024-4323-in-fluent-bit/
* https://kubernetes.io/blog/2024/05/20/completing-cloud-provider-migration/
* https://thenewstack.io/introducing-aks-automatic-managed-kubernetes-for-developers/
* https://www.harness.io/blog/harness-to-acquire-split

Show Links:

* https://www.linkedin.com/in/berniewu/
* https://criu.org/Main_Page
* https://memverge.com/
* https://youtu.be/tY8YOMRuqWI?si=yB3hHqLUpYPZ-KWN
* https://youtu.be/ND4seSKpJHI?si=shh0iuA9qC-dO6eb

Timestamps: 

* 01:04 [https://www.youtube.com/watch?v=Jf059PFn6l0&t=64s] Cloud Native News 
* 08:47 [https://www.youtube.com/watch?v=Jf059PFn6l0&t=527s] Interview with Bernie 
* 51:40 [https://www.youtube.com/watch?v=Jf059PFn6l0&t=3100s] Key takeaways

In this episode of the Kubernetes Bytes podcast, Ryan and Bhavin talk to Christian Posta - VP and Global Field CTO at Solo.io about all things Service Mesh. They discuss how things have evolved from the early Linkerd days to sidecar less istio service mesh implementations. They also talk about how service mesh can help you connect to application components running outside Kubernetes, and how developers and platform engineers have a shared responsibility model when it comes to implementing service mesh using internal developer platforms.   

Check out our website at https://kubernetesbytes.com/  

Episode Sponsor: Nethopper
Learn more about KAOPS:  @nethopper.io
For a supported-demo:  info@nethopper.io
Try the free version of KAOPS now!   https://mynethopper.com/auth  

Cloud Native News:  

* https://loft.sh/blog/our-24m-series-a-led-by-khosla-ventures/
* https://www.harness.io/blog/celebrating-150m-in-new-financing-to-accelerate-innovation
* https://www.akamai.com/newsroom/press-release/akamai-announces-intent-to-acquire-api-security-company-noname
* https://www.linkedin.com/posts/rouvenbesters_its-official-the-otomi-platform-has-activity-7194604616901120000-48g7?utm_source=share&utm_medium=member_desktop
* https://www.wiz.io/blog/celebrating-our-1-billion-funding-round-and-12-billion-valuation 

Show Links: 

* https://devsummit.infoq.com/conference/boston2024 
* https://www.solo.io/topics/cakes-stack/
* https://www.solo.io/  

Timestamps: 

* 00:06:10 Cloud Native News 
* 00:15:37 Interview with Torsten 
* 01:01:58 Key takeaways

In this episode of the Kubernetes Bytes podcast, Ryan and Bhavin talk to Torsten Steinbach - VP, Chief Architect for Analytics & AI at EDB about all things Vector Databases, Postgres, and why Data is important for building AI platforms. The discussion dives into how vector databases are different than relational databases and why using Postgres extensions helps organizations use their existing data for AI applications.  

Check out our website at https://kubernetesbytes.com/  

Kubernetes Community Days (KCD) in New York City on May 22nd, use the promo code "KUBERNETESBYTES" to get a 10% discount on your registration fees!   

Episode Sponsor: Nethopper 

* Learn more about KAOPS:  @nethopper.io 
* For a supported-demo:  info@nethopper.io 
* Try the free version of KAOPS now!   
* https://mynethopper.com/auth 

Cloud Native News:  

* https://www.reuters.com/markets/deals/ibm-nearing-buyout-deal-hashicorp-wsj-reports-2024-04-23/
* https://www.wiz.io/blog/wiz-acquires-gem-security-to-reinvent-threat-detection-in-the-cloud
* https://techcrunch.com/2024/04/18/wiz-is-in-talks-to-buy-lacework-for-150-200m-security-firm-was-last-valued-at-8-3b/
* https://www.prnewswire.com/news-releases/coreweave-secures-1-1-billion-in-series-c-funding-to-drive-the-next-generation-of-cloud-computing-for-the-future-of-ai-302133328.html
* https://kubernetes.io/blog/2024/04/17/kubernetes-v1-30-release 
* https://dok.community/blog/become-a-data-on-kubernetes-in-2024-ambassador/   

Show Links: 

* https://www.enterprisedb.com/news/edb-acquires-splitgraph 
* https://www.enterprisedb.com/resources/events
* https://www.enterprisedb.com/  

Timestamps: 

* 00:03:22 Cloud Native News 
* 00:17:45 Interview with Torsten 
* 00:57:00 Key takeaways

Join Bhavin Shah and Ryan Wallner for a recap of announcments and news from KubeCon Paris 2024.

Kubernetes Community Days (KCD) in New York City on May 22nd, use the promo code "KUBERNETESBYTES" to get a 10% discount on your registration fees!

Nethopper

* Learn more about KAOPS:  @nethopper.io 
* For a supported-demo:  info@nethopper.io
* Try the free version of KAOPS now!   https://mynethopper.com/auth

News

* https://about.gitlab.com/blog/2024/03/20/oxeye-joins-gitlab-to-advance-application-security-capabilities/
* https://www.redhat.com/en/blog/unveiling-red-hat-openshift-415
* https://developer.nvidia.com/blog/nvidia-nim-offers-optimized-inference-microservices-for-deploying-ai-models-at-scale/
* https://www.acorn.io/resources/blog/our-new-focus-developing-an-llm-app-platform-based-on-gpt-script-technology?fromOther=true
* https://loft.sh/blog/deliver-secure-kubernetes-multi-tenancy-with-new-vcluster-in-rancher-integration/
* https://www.observeinc.com/blog/stepping-on-the-gas/
* https://thenewstack.io/kubecost-2-2-covers-carbon-cost-monitoring-and-more/
* https://thenewstack.io/ovhcloud-unveils-roadmap-to-take-on-hyperscalers-from-europe/
* https://www.suse.com/c/meet-rancher-prime-3-0/
* https://www.suse.com/c/suse-releases-edge-3-0-highly-validated-edge-optimized-stack/
* https://www.fermyon.com/blog/introducing-spinkube-fermyon-platform-for-k8s 
* https://www.cncf.io/blog/2024/03/19/announcing-the-ai-working-groups-new-cloud-native-artificial-intelligence-whitepaper/ 
* https://github.com/Azure/kaito 
* https://azure.microsoft.com/en-us/updates/public-preview-kubernetes-ai-toolchain-operator-kaito-addon-for-aks/
* https://cloudnativenow.com/features/solo-io-delivers-on-cilium-support-promise-for-gloo-networks/ 
* https://docs.solo.io/gloo-network/latest/about/overview/ 
* https://github.com/kosmos-io/kosmos 
* https://gateway.envoyproxy.io/blog/2024/03/14/announcing-envoy-gateways-1.0-release/ 
* https://newrelic.com/press-release/20240319 
* https://siliconangle.com/2024/03/29/aviatrix-revolutionizes-networking-security-distributed-cloud-firewall-kubernetes-kubeconeu/ 

In this episode of the Kubernetes Bytes podcast, Ryan and Bhavin talk to Charlie Egan, Sr. Developer Advocate at Styra about all things Open Policy Agent or OPA. This episode is meant to be a 101 level episode, where we will learn what OPA is and how it can help improve the security posture for your applications running on Kubernetes. The discussion dives into some of the use cases for OPA and how it helps with Kubernetes admission control,  auditing, etc.   

Check out our website at https://kubernetesbytes.com/  

Episode Sponsor: Elotl  

Links:  

* https://elotl.co/luna
* https://www.elotl.co/luna-free-trial 

Timestamps: 

* 07:46 Interview with Charlie 
* 01:02:00 Key takeaways  

Show Links:  

* OPA Ecosystem https://www.openpolicyagent.org/ecosystem/
* OPA Envoy Integration https://github.com/open-policy-agent/opa-envoy-plugin
* Charlie's site: https://charlieegan3.com
* OPA Docs: https://www.openpolicyagent.org/docs/latest/
* OPA Playground: https://play.openpolicyagent.org
* OPA Slack: https://communityinviter.com/apps/openpolicyagent/signup

Join hosts Ryan Wallner and Bhavin Shah of Kubernetes Bytes as they explore the complexities of Internal Developer Platforms (IDPs) with Chris Munford, CEO, and Dan Donahue, Solution Architect of Nethopper. In this episode, the team discusses the challenges of constructing IDPs, achieving the optimal balance of flexibility and prescriptive golden paths. The episode dives into the unique operations perspective required for effective implementation. Gain valuable insights and practical advice from industry leaders on navigating the evolving landscape of IDPs. Don't miss this insightful conversation on unlocking the full potential of IDPs for your organization.

Timestamps

* 00:06:24 - Discussion with Chris and Dan
* 00:51:44 - Takeaways

Episode Links

* What Happened to Platform Engineering? (ebook/pdf) [https://62972b08-d48a-483f-9bd6-61710270d1df.filesusr.com/ugd/9bf0a1_3c9b81081dbe4a26bc6aa163f82711f5.pdf]
* LinkedIn Audio Recording [https://video.wixstatic.com/video/9bf0a1_409daaef37cb42ffa5926c13af48e8fc/1080p/mp4/file.mp4]  "What Happened to Platform Engineering"
* Website resources [https://www.nethopper.io/platform-engineering] on platform engineering/IDP
* LinkedIn Newsletter [https://www.linkedin.com/pulse/cloud-native-platform-engineering-idp-insights-nethopper-b4mle/?trackingId=pUpK%2Bc%2BN4Z3iwWpXOBtFbQ%3D%3D] about KAOPS/Platform Engineering/IDP