Kubernetes Bytes Ryan Wallner & Bhavin Shah
-
- Technology
Kubernetes Bytes is a podcast bringing you the latest from the world of cloud native data management. Hosts Ryan Wallner and Bhavin Shah come to you from Boston, Massachusetts with experienced backgrounds in cloud-native tech. They'll be sharing their thoughts on recent cloud native news and talking to industry experts about their experiences and challenges managing the wealth of data in today's cloud-native ecosystem.
-
What are Vector Databases
In this episode of the Kubernetes Bytes podcast, Ryan and Bhavin talk to Torsten Steinbach - VP, Chief Architect for Analytics & AI at EDB about all things Vector Databases, Postgres, and why Data is important for building AI platforms. The discussion dives into how vector databases are different than relational databases and why using Postgres extensions helps organizations use their existing data for AI applications.
Check out our website at https://kubernetesbytes.com/
Kubernetes Community Days (KCD) in New York City on May 22nd, use the promo code "KUBERNETESBYTES" to get a 10% discount on your registration fees!
Episode Sponsor: Nethopper
* Learn more about KAOPS: @nethopper.io
* For a supported-demo: info@nethopper.io
* Try the free version of KAOPS now!
* https://mynethopper.com/auth
Cloud Native News:
* https://www.reuters.com/markets/deals/ibm-nearing-buyout-deal-hashicorp-wsj-reports-2024-04-23/
* https://www.wiz.io/blog/wiz-acquires-gem-security-to-reinvent-threat-detection-in-the-cloud
* https://techcrunch.com/2024/04/18/wiz-is-in-talks-to-buy-lacework-for-150-200m-security-firm-was-last-valued-at-8-3b/
* https://www.prnewswire.com/news-releases/coreweave-secures-1-1-billion-in-series-c-funding-to-drive-the-next-generation-of-cloud-computing-for-the-future-of-ai-302133328.html
* https://kubernetes.io/blog/2024/04/17/kubernetes-v1-30-release
* https://dok.community/blog/become-a-data-on-kubernetes-in-2024-ambassador/
Show Links:
* https://www.enterprisedb.com/news/edb-acquires-splitgraph
* https://www.enterprisedb.com/resources/events
* https://www.enterprisedb.com/
Timestamps:
* 00:03:22 Cloud Native News
* 00:17:45 Interview with Torsten
* 00:57:00 Key takeaways -
KubeCon EU Paris News Recap
Join Bhavin Shah and Ryan Wallner for a recap of announcments and news from KubeCon Paris 2024.
Kubernetes Community Days (KCD) in New York City on May 22nd, use the promo code "KUBERNETESBYTES" to get a 10% discount on your registration fees!
Nethopper
* Learn more about KAOPS: @nethopper.io
* For a supported-demo: info@nethopper.io
* Try the free version of KAOPS now! https://mynethopper.com/auth
News
* https://about.gitlab.com/blog/2024/03/20/oxeye-joins-gitlab-to-advance-application-security-capabilities/
* https://www.redhat.com/en/blog/unveiling-red-hat-openshift-415
* https://developer.nvidia.com/blog/nvidia-nim-offers-optimized-inference-microservices-for-deploying-ai-models-at-scale/
* https://www.acorn.io/resources/blog/our-new-focus-developing-an-llm-app-platform-based-on-gpt-script-technology?fromOther=true
* https://loft.sh/blog/deliver-secure-kubernetes-multi-tenancy-with-new-vcluster-in-rancher-integration/
* https://www.observeinc.com/blog/stepping-on-the-gas/
* https://thenewstack.io/kubecost-2-2-covers-carbon-cost-monitoring-and-more/
* https://thenewstack.io/ovhcloud-unveils-roadmap-to-take-on-hyperscalers-from-europe/
* https://www.suse.com/c/meet-rancher-prime-3-0/
* https://www.suse.com/c/suse-releases-edge-3-0-highly-validated-edge-optimized-stack/
* https://www.fermyon.com/blog/introducing-spinkube-fermyon-platform-for-k8s
* https://www.cncf.io/blog/2024/03/19/announcing-the-ai-working-groups-new-cloud-native-artificial-intelligence-whitepaper/
* https://github.com/Azure/kaito
* https://azure.microsoft.com/en-us/updates/public-preview-kubernetes-ai-toolchain-operator-kaito-addon-for-aks/
* https://cloudnativenow.com/features/solo-io-delivers-on-cilium-support-promise-for-gloo-networks/
* https://docs.solo.io/gloo-network/latest/about/overview/
* https://github.com/kosmos-io/kosmos
* https://gateway.envoyproxy.io/blog/2024/03/14/announcing-envoy-gateways-1.0-release/
* https://newrelic.com/press-release/20240319
* https://siliconangle.com/2024/03/29/aviatrix-revolutionizes-networking-security-distributed-cloud-firewall-kubernetes-kubeconeu/ -
Open Policy Agent (OPA) 101
In this episode of the Kubernetes Bytes podcast, Ryan and Bhavin talk to Charlie Egan, Sr. Developer Advocate at Styra about all things Open Policy Agent or OPA. This episode is meant to be a 101 level episode, where we will learn what OPA is and how it can help improve the security posture for your applications running on Kubernetes. The discussion dives into some of the use cases for OPA and how it helps with Kubernetes admission control, auditing, etc.
Check out our website at https://kubernetesbytes.com/
Episode Sponsor: Elotl
Links:
* https://elotl.co/luna
* https://www.elotl.co/luna-free-trial
Timestamps:
* 07:46 Interview with Charlie
* 01:02:00 Key takeaways
Show Links:
* OPA Ecosystem https://www.openpolicyagent.org/ecosystem/
* OPA Envoy Integration https://github.com/open-policy-agent/opa-envoy-plugin
* Charlie's site: https://charlieegan3.com
* OPA Docs: https://www.openpolicyagent.org/docs/latest/
* OPA Playground: https://play.openpolicyagent.org
* OPA Slack: https://communityinviter.com/apps/openpolicyagent/signup -
Ops Ops Hooray! Navigating IDPs from an Ops perspective
Join hosts Ryan Wallner and Bhavin Shah of Kubernetes Bytes as they explore the complexities of Internal Developer Platforms (IDPs) with Chris Munford, CEO, and Dan Donahue, Solution Architect of Nethopper. In this episode, the team discusses the challenges of constructing IDPs, achieving the optimal balance of flexibility and prescriptive golden paths. The episode dives into the unique operations perspective required for effective implementation. Gain valuable insights and practical advice from industry leaders on navigating the evolving landscape of IDPs. Don't miss this insightful conversation on unlocking the full potential of IDPs for your organization.
Timestamps
* 00:06:24 - Discussion with Chris and Dan
* 00:51:44 - Takeaways
Episode Links
* What Happened to Platform Engineering? (ebook/pdf) [https://62972b08-d48a-483f-9bd6-61710270d1df.filesusr.com/ugd/9bf0a1_3c9b81081dbe4a26bc6aa163f82711f5.pdf]
* LinkedIn Audio Recording [https://video.wixstatic.com/video/9bf0a1_409daaef37cb42ffa5926c13af48e8fc/1080p/mp4/file.mp4] "What Happened to Platform Engineering"
* Website resources [https://www.nethopper.io/platform-engineering] on platform engineering/IDP
* LinkedIn Newsletter [https://www.linkedin.com/pulse/cloud-native-platform-engineering-idp-insights-nethopper-b4mle/?trackingId=pUpK%2Bc%2BN4Z3iwWpXOBtFbQ%3D%3D] about KAOPS/Platform Engineering/IDP -
Generative AI on Kubernetes
In this episode of the Kubernetes Bytes podcast, Ryan and Bhavin sit down with Janakiram MSV - an advisor, analyst and architect to talk about how users can run Generative AI models on Kubernetes. The discussion revolves around Jani's home lab and his experimentation with different LLM models and how to get them running on NVIDIA GPUs. Jani has spent the past year becoming a subject matter expert in GenAI, and this discussion highlights all the different challenges he faced and what lessons he learnt from them.
Check out our website at https://kubernetesbytes.com/
Episode Sponsor: Elotl
* https://elotl.co/luna
* https://www.elotl.co/luna-free-trial
Timestamps:
* 02:02 Cloud Native News
* 15:31 Interview with Jani
* 01:11:00 Key takeaways
Cloud Native News:
* https://www.techerati.com/press-release/octopus-deploy-acquires-codefresh-to-boost-kubernetes-and-cloud-native-delivery/
* https://www.civo.com/blog/kubefirst-joins-civo
* https://cast.ai/kubernetes-cost-benchmark
* https://www.techradar.com/pro/vmware-customers-are-jumping-ship-as-broadcom-sales-continue-heres-where-theyre-moving-to
* https://cloudonair.withgoogle.com/events/techbyte-making-ai-ml-scalable-cost-effective-gke
* https://dok.community/dok-events/dok-day-kubecon-paris/
* https://training.linuxfoundation.org/certification/certified-argo-project-associate-capa
Show Links:
* https://www.youtube.com/janakirammsv
* https://www.linkedin.com/in/janakiramm/
* - NVIDIA Container Toolkit - https://docs.nvidia.com/datacenter/cloud-native/container-toolkit/latest/index.html
* NVIDIA Device Plugin - https://github.com/NVIDIA/k8s-device-plugin
* NVIDIA Feature Discovery - https://github.com/NVIDIA/gpu-feature-discovery
* Hugging Face Text Gen Inference - https://huggingface.co/docs/text-generation-inference/index
* Hugging Face Text Embeddings Inference - https://huggingface.co/docs/text-embeddings-inference/index
* ChromaDB - https://www.trychroma.com/ -
IDPs Unveiled: Accelerating Deployment on Kubernetes
In this episode of Kubernetes Bytes. Hosts Bhavin and Ryan dive into what makes up a Internal Development Platform (IDP). Bhavin and Ryan help to define what an IDP is, how it relates to the overarching topic of platform engineering as well as the pros and cons of implementing an IDP.
* 00:03:01 - News
* 00:12:11 - Discussion Topic on IDPs
Discount for KCD New York! https://community.cncf.io/events/details/cncf-kcd-new-york-presents-kcd-new-york-2024/
Please make sure to use the voucher code "KUBERNETESBYTES" to get a 10% discount
News:
* https://www.cncf.io/blog/2024/02/08/strimzi-joins-the-cncf-incubator/
* https://github.com/Ume0344/mongokube
* https://www.businesswire.com/news/home/20240207876324/en/ZEDEDA-Secures-72M-in-Growth-Capital-to-Meet-the-Skyrocketing-Demand-for-Edge-AI-and-Computing
* https://fintech.global/2024/02/15/ktrust-secures-5-3m-in-seed-funding-to-revolutionise-kubernetes-security
* https://thenewstack.io/kubernetes-predictions-were-wrong/
* https://cloudnativenow.com/features/crossplane-maintainers-add-python-support-to-control-plane/
* https://blog.crossplane.io/crossplane-v1-15/
Links:
* Mercado Libre IDP Talk: https://youtu.be/y-X1ZcPxRnI?si=q9UoglFrZycIcZ_l
IDP Companies and Projects
* Cortex
* OpsLevel
* Port
* Argonaut
* Upbound
* Nethopper
* Mia Platform
* Amazee
* Configure8
* Otomi-Core
* BackStage Roadie
* Qovery
* Plural
* Kubermatic
* Clutch
* Lagoon
* Garden.io
* Portainer