OpenObservability Talks Dotan Horovits

KubeCon Europe 2024 in Paris was the biggest event of the Cloud Native Computing Foundation (CNCF) to date, with over 12k participants. Have you missed it? We've got you covered! Join not one but two CNCF Ambassadors as they explore the latest and greatest highlights from the event that every tech enthusiast is talking about.  

But that's not all! We'll also zoom in on K8sgpt, a new entrant to the CNCF’s sandbox that uses generative AI to give Kubernetes superpowers to everyone. Does this open source project go beyond the GenAI hype and get us closer to diagnosing and triaging issues in plain English? Let’s ask the maintainers behind the project.

Our guest is Thomas Schuetz, a Principal Cloud Architect with a keen interest in cloud-native application delivery. Thomas teaches at an Austrian University of Applied Sciences, focusing on cloud-native technologies. Thomas is enthusiastic about open source projects, contributing as a Keptn GC Member and K8sGPT Maintainer, alongside his role as Co-Chair of the CNCF TAG App Delivery. He also brings a deep industry background from his past roles at Dynatrace and more.

The episode was live-streamed on 14 April 2024 and the video is available at https://www.youtube.com/watch?v=xr3viuhssdg

OpenObservability Talks episodes are released monthly, on the last Thursday of each month and are available for listening on your favorite podcast app and on YouTube.

We live-stream the episodes on Twitch and YouTube Live - tune in to see us live, and chime in with your comments and questions on the live chat.

https://www.youtube.com/@openobservabilitytalks  

⁠https://www.twitch.tv/openobservability⁠



Show Notes:

00:00 - Show intro

00:59 - Episode and guest intro

03:15 - Redis moves off open source

05:21 - AI white paper

07:47 - TAG App Delivery updates

12:15 - Istio beta release of ambient mode

12:57 - Fluent Bit v3 major release

13:57 - Keptn project updates

17:20 - OpenCost adds environment sustainability 

18:43 - OpenFeature adds client-side support with web SDK v1

20:08 - Perses 0.44 release

21:40 - K8sGPT founding team

24:07 - K8sGPT intro

27:36 - how K8sGPT works

31:28 - no vendor behind K8sGPT

36:10 - integration with multiple Gen AI services and local models

40:16 - K8sGPT current state and maturity

45:11 - K8sGPT traction

48:40 - K8sGPT acceptance into the sandbox and adopter companies

54:11 - how to reach out to Thomas Schuetz

56:09 - who’s behind K8sGPT

59:07 - where to follow K8sGPT  

1:00:17 - Outro



Resources:

https://github.com/k8sgpt-ai/k8sgpt

https://k8sgpt.ai/

Cloud Native Artificial Intelligence whitepaper

TAG App Delivery update at KubeCon Paris

Fluent Bit v3.0 release

OpenFeature Web SDK v1

k8sgpt slack



Socials:

Twitter:⁠ https://twitter.com/OpenObserv⁠

YouTube: ⁠https://www.youtube.com/@openobservabilitytalks⁠



Dotan Horovits
============
Twitter: https://twitter.com/horovits
LinkedIn: https://www.linkedin.com/in/horovits/
Mastodon: https://fosstodon.org/@horovits

Thomas Schuetz
===============
Twitter: https://twitter.com/thschue
LinkedIn: https://linkedin.com/in/thschue
Mastodon: https://hachyderm.io/@thschue

OpenTelemetry is expanding beyond the traditional “three pillars of observability” and introduces a groundbreaking addition to its signals - Continuous Profiling. The new Profiling Special Interest Group (SIG) that was formed to lead the topic has already made significant advancements, to be featured at KubeCon Europe. Join us in this special panel episode of OpenObservability Talks as we explore the significance of this new dimension in understanding application behavior, optimizing performance, and gaining deeper insights into your systems. Our expert guests, Felix Geisendörfer and Ryan Perry, members of the OpenTelemetry Profiling SIG, share their insights into how Profiling enhances the OpenTelemetry framework, and update on the work for open specification and implementation. 

This special episode hosts a panel of two distinguished members of OpenTelemetry’s Profile SIG, and prominent members of the observability vendor ecosystem. Felix Geisendörfer is a Senior Staff Engineer at Datadog where he works on Continuous Profiling and contributes to the Go runtime. Before that he was working at Apple, co-founded Transloadit, contributed to node.js and inspired a generation of mad scientists to program flying robots with it. Ryan Perry is Principal Product Manager at Grafana Labs. He has built a career at various startups while actively contributing to open source projects and advancing open telemetry initiatives. Most recently he built Pyroscope, an open source continuous profiling project/company, which has been acquired by Grafana Labs.

The episode was live-streamed on 7 March 2024 and the video is available at https://www.youtube.com/watch?v=iGM67RT12gQ

OpenObservability Talks episodes are released monthly, on the last Thursday of each month and are available for listening on your favorite podcast app and on YouTube.

We live-stream the episodes on Twitch and YouTube Live - tune in to see us live, and chime in with your comments and questions on the live chat.https://www.twitch.tv/openobservabilityhttps://www.youtube.com/@openobservabilitytalks  



Show Notes:

00:00 - show intro

01:03 - episode and guests intro

04:02 - trends and advancements in the Profiling space

05:42 - from cost and performance into broader observability 

11:27 - turning profile data into metrics

12:45 - runtime vs. full host profilers and eBPF use

18:44 - pprof JFR and other existing profile standards

21:19 - profile visualizations - from flame graphs to timeline view 

22:37 - entrepreneur PoV on the profiling market

26:54 - OpenTelemetry adds profiles as a new signal

32:22 - OTel choosing a pprof extended standard  

39:06 - discrete events vs. pre-aggregated data

41:09 - use cases for processing profiling data

44:19 - OTel Profiles reference implementation 

49:11 - latest milestone and roadmap

54:44 - who’s involved in OTel Profiles

56:41 - how to follow OTel Profiles and the guests

59:34 - March community events and conferences

1:00:38 - Falco and CloudEvents projects reached CNCF graduation  

1:01:59 - Prometheus and Linkerd latest releases

1:03:29 - Netflix open-sources bpftop CLI for eBPF app performance monitoring

1:05:15 - show outro



Resources:


Continuous Profiling: A New Observability Signal (previous episode): https://logz.io/blog/continuous-profiling-new-observability-signal-in-opentelemetry/?utm_source=devrel&utm_medium=devrel 


OpenTelemetry extension proposal for adding Profiles: https://github.com/open-telemetry/oteps/pull/239


OTel Profile SIG notes: https://docs.google.com/document/d/19UqPPPlGE83N37MhS93uRlxsP1_wGxQ33Qv6CDHaEp0/edit#heading=h.63a4klfdbcob


eBPF adoption in observability - github stats: https://www.linkedin.com/feed/update/urn:li:activity:7171044354667585537/ 


ProfilerPedia: https://profilerpedia.markhansen.co.nz/ 




Netflix releases bpftop CLI tool: https://netflixtechblog.com/announcing-bpftop-streamlining-ebpf-performance-optimization-6a727c1ae2e5

The .NET programming language is taking cloud native deployment and observability seriously, and most notably with the recent announcement of .NET Aspire stack unveiled at the recent .NET Conf 2023. 

In this episode, we reviewed the open source maintainers’ journey to making .NET a "by default, out of the box observable platform", as ASP.NET Core creator David Fowler put it. David was this episode’s guest, and with him we dived into .NET Aspire and how it simplifies the complexities of cloud app development with capabilities around service discovery, observability, and resilience. We discussed the local developer experience, the path to developer observability, and what we can expect from the upcoming GA release of .NET8.

David Fowler has been at Microsoft for 15 years working on developer frameworks and tools in the .NET space. He's one of the creators of several popular OSS frameworks and tools such as NuGet, SignalR and ASP.NET Core, and also architected the Azure SignalR Service. Originally from Barbados, he's an avid open-source advocate and developer currently focused on simplifying developer experiences in the microservice space. 



The episode was live-streamed on 21 February 2024 and the video is available at https://www.youtube.com/watch?v=Ll1T9Zs7jUo

OpenObservability Talks episodes are released monthly, on the last Thursday of each month and are available for listening on your favorite podcast app and on YouTube.

We live-stream the episodes on Twitch and YouTube Live - tune in to see us live, and chime in with your comments and questions on the live chat.

https://www.youtube.com/@openobservabilitytalks  

https://www.twitch.tv/openobservability⁠⁠

Show Notes:

00:10 - episode and guest intro

04:03 - what .NET used to be like for developing cloud-native

15:10 - out-of-the-box observability in .NET

21:05 - .NET aligning with OpenTelemetry

26:40 - what’s .NET Aspire

32:37 - existing .NET components are part of Aspire

37:46 - developing an observability UI as part of Aspire

43:24 - how to transition containerized apps from dev to prod 

48:48 - the relationship between Aspire to Dapr and Radius

53:31 - Aspire roadmap to GA

57:13 - where to follow Aspire and David Fowler

59:13 - K8sgpt accepted to CNCF as a sandbox project

59:56 - Strimzi reaches CNCF incubation with Kafka on Kubernetes

1:00:40 - OpenFeature becomes a CNCF incubating project

1:03:03 - Broadcom kills free ESXi and other VMware restructuring



Resources:

.NET Aspire GitHub repo: https://github.com/dotnet/aspire 

.NET Aspire Preview 3: https://learn.microsoft.com/en-us/dotnet/aspire/whats-new/preview-3 

Instrumenting C# .NET apps with OpenTelemetry: https://logz.io/blog/csharp-dotnet-opentelemetry-instrumentation/?utm_source=devrel&utm_medium=devrel

OpenTelemetry beginner’s guide: https://logz.io/learn/opentelemetry-guide/?utm_source=devrel&utm_medium=devrel

K8sgpt accepted to CNCF sandbox: https://www.linkedin.com/posts/horovits_genai-sre-kubernetes-activity-7158185284289888256-0KuZ

Strimzi reaches CNCF incubation: https://www.cncf.io/blog/2024/02/08/strimzi-joins-the-cncf-incubator/

OpenFeature reaches CNCF incubation: https://www.cncf.io/blog/2023/12/19/openfeature-becomes-a-cncf-incubating-project/

Broadcom decided to kill the free edition of ESXi and other VMware restructuring: https://horovits.medium.com/0aea7efafb47



Socials:

Twitter:⁠ https://twitter.com/OpenObserv⁠

YouTube: ⁠https://www.youtube.com/@openobservabilitytalks⁠



Dotan Horovits
============
Twitter: https://twitter.com/horovits
LinkedIn: https://www.linkedin.com/in/horovits/
Mastodon: https://fosstodon.org/@horovits

David Fowler
==========
Twitter: https://twitter.com/davidfowl
LinkedIn: https://www.linkedin.com/in/davidfowl
Mastodon: https://hachyderm.io/@davidfowl

In this episode, join us as we delve into the intricate world of Platform Engineering with Aparna Subramanian, Director of Production Engineering at Shopify. Discover how Shopify, a powerhouse in e-commerce, masters the art of scaling platform engineering. Gain invaluable insights into their strategies, innovations, and lessons learned while navigating the complexities of sustaining and evolving a robust infrastructure to support millions, even through special peak events like Black Friday and Cyber Monday. If you're keen on understanding the backbone of a thriving online platform, don’t miss out on this episode.

Aparna started her career as a Software Engineer and has spent most part of her almost two decades of technology experience specializing in Infrastructure and Data Platforms. In her current role she leads Shopify’s Cloud Native Production Platform.

Previously, she was Director of Engineering at VMware where she was a founding member of Tanzu on vSphere, a Kubernetes Platform for the hybrid cloud. She also serves as co-chair of the “CNCF End User Developer Experience” SIG and as member of the CNCF End user technical advisory board.

The episode was live-streamed on 11 January 2024 and the video is available at https://www.youtube.com/watch?v=6ShtsTTUizI

OpenObservability Talks episodes are released monthly, on the last Thursday of each month and are available for listening on your favorite podcast app and on YouTube.

We live-stream the episodes on Twitch and YouTube Live - tune in to see us live, and chime in with your comments and questions on the live chat.

https://www.youtube.com/@openobservabilitytalks  

⁠https://www.twitch.tv/openobservability



Show Notes:

00:00 - Show intro & 2023 stats

01:49 - Episode and guest intro

04:15 - Shopify’s scale

06:09 - Shopify’s journey to Platform Engineering

08:56 - Shopify’s platform structure

11:49 - division of responsibility

13:51 - golden path vs flexibility

17:58 - balancing flexibility and abstraction

19:56 - platform group structure

23:28 - handling load spikes

28:55 - FinOps in Platform Engineering

38:38 - avoiding silos and the cultural aspect

41:13 - CNCF end-user SIG and community challenges

49:24 - KubeCon Paris and guest contact 

51:03 - OpenTofu reached GA

53:33 - Isovalent acquired by Cisco

55:00 - year-end summary articles

57:07 - .NET Aspire released preview2

58:58 - Episode and show outro



Resources:

Shopify Engineering Blog https://shopify.engineering/

Performance wins at Shopify: https://www.shopify.com/news/performance%F0%9F%91%86-complexity%F0%9F%91%87-killer-updates-from-shopify-engineering

CNCF End User SIG https://github.com/cncf/enduser-public

OpenTofu has reached GA https://logz.io/blog/terraform-is-no-longer-open-source-is-opentofu-opentf-the-successor/?utm_source=devrel&utm_medium=devrel

Observability in 2024: https://thenewstack.io/observability-in-2024-more-opentelemetry-less-confusion/

OpenTelemetry in 2024: https://www.apmdigest.com/2024-application-performance-management-apm-predictions-4

.NET Aspire preview2: https://devblogs.microsoft.com/dotnet/announcing-dotnet-aspire-preview-2/ 



Socials:

Twitter:⁠ https://twitter.com/OpenObserv⁠

YouTube: ⁠https://www.youtube.com/@openobservabilitytalks⁠



Dotan Horovits

============

Twitter: @horovits

LinkedIn: in/horovits

Mastodon: @horovits@fosstodon

Aparna Subramanian

=================

Twitter: @aparnastweets

LinkedIn: https://www.linkedin.com/in/subramanianaparna/ 

In this special episode we wrapped up the year 2023 with none other than the cloud-native maestro, Kelsey Hightower! We looked into the highs and lows of the tech landscape, exploring Kelsey's insights on containerization and beyond. Tune in as we unravel the year that was and reflect on what lies ahead for Kubernetes and cloud computing.

Kelsey has been there since the birth of Kubernetes, with his contributions to the project as well as his advocacy for containers and cloud native tech and concepts. Join us to conclude 2023 with a look above the clouds.

The episode was live-streamed on 5 December 2023 and the video is available at https://www.youtube.com/watch?v=OVSIUMJxtLk

OpenObservability Talks episodes are released monthly, on the last Thursday of each month and are available for listening on your favorite podcast app and on YouTube.

We live-stream the episodes on Twitch and YouTube Live - tune in to see us live, and chime in with your comments and questions on the live chat.

https://www.twitch.tv/openobservability

https://www.youtube.com/@openobservabilitytalks  



Show Notes:

00:00 - Show intro

01:00 - Episode and guest intro

02:40 - Highlights of 2023, signs of maturity

05:17 - Standardizing on cloud bills

12:09 - Consensus vs. innovation in tech

14:46 - Evolution of OpenTelemetry and telemetry signals

19:33 - Where AI will help DevOps and Observability

25:44 - Where is Kubernetes heading in the coming decade

32:42 - Can Kubernetes serve AI/ML workloads

40:37 - CNCF landscape - transparency vs. complexity

49:05 - Evolution of observability

59:03 - Episode and show outro



Resources:

Standardizing on cloud bills with FOCUS open specification: https://horovits.medium.com/6e30069f33a0

How to fix Kubernetes monitoring: https://thenewstack.io/how-to-fix-kubernetes-monitoring/



Socials:

Twitter:⁠ https://twitter.com/OpenObserv⁠

YouTube: ⁠https://www.youtube.com/@openobservabilitytalks⁠

Have you missed KubeCon North America in Chicago? This one’s for you! In this episode, we explored the latest and greatest highlights from the event that every tech enthusiast is talking about. From cutting-edge innovations to industry insights, we've got the broad spectrum covered. 

But that's not all! We'll also zoomed in on Istio, the popular service mesh open source project that has just recently reached CNCF graduation. Join us as we map out the service mesh universe, and then dive into Istio's galaxy, unraveling its architecture, features, and the roadmap direction with Ambient. And you’ll get to hear it from the Istio authority, Lin Sun.

Lin is the Director of Open Source at Solo.io and a CNCF ambassador. She has worked on the Istio service mesh since the beginning of the project in 2017 and serves on the Istio Steering Committee and Technical Oversight Committee. Previously, she was a Senior Technical Staff Member and Master Inventor at IBM for 15+ years. She is the author of the book "Istio Ambient Explained" and co-author of “Istio Explained”, and has more than 200 patents to her name.

The episode was live-streamed on 15 November 2023 and the video is available at https://www.youtube.com/watch?v=bxnDH6LH-cA

You can read the recap post: https://logz.io/blog/kubecon-na-2023-recap/?utm_source=devrel&utm_medium=devrel

OpenObservability Talks episodes are released monthly, on the last Thursday of each month and are available for listening on your favorite podcast app and on YouTube.

We live-stream the episodes on Twitch and YouTube Live - tune in to see us live, and chime in with your comments and questions on the live chat.https://www.twitch.tv/openobservabilityhttps://www.youtube.com/@openobservabilitytalks  



Show Notes:

01:27 - Episode and guest intro

06:34 - KubeCon Highlights: Fluent Bit

09:16 - OpenTelemetry Logging, OTLP is GA

12:53 - OpenTelemetry project journey report

13:43 - WASM Day and Istio Day updates

16:18 - Keynote: the future of Kubernetes

18:51 -Crossplane latest release v1.14 

19:24 - Kyverno supports non-Kubernetes workloads

20:12 - Vitess 18 is now GA

20:43 - AI is nascent in CNCF

22:56 - CNCF’s GitOps microsurvey 

23:56 - eBPF documentary released

27:08 - Service Mesh architecture and landscape

31:36 - Envoy proxy 

33:48 - maturity of the projects

39:36 - Istio unique value proposition and adoption

43:55 - Kubernetes released native sidecar support

47:02 - The GAMMA initiative in Kubernetes Gateway API 

50:04 - Istio updates: Ambient, multi-claster, Gateway API GA impl. For N-S 

53:40 - CNCF Training & Certification Launch Istio Certification

54:56 - Istio roadmap

56:50 - how to follow Istio and Lin Sun and episode wrapup



Resources:

KubeCon Updates:

https://www.cncf.io/blog/2023/11/07/opentelemetry-at-kubecon-cloudnativecon-north-america-2023-update/

https://opentelemetry.io/blog/2023/http-conventions-declared-stable/

https://www.cncf.io/reports/opentelemetry-project-journey-report/ 

https://blog.crossplane.io/crossplane-v1-14/  

https://www.cncf.io/blog/2023/11/06/kyverno-expands-beyond-kubernetes/ 

https://planetscale.com/blog/announcing-vitess-18 

https://www.cncf.io/blog/2023/11/07/cncf-gitops-microsurvey-learning-on-the-job-as-gitops-goes-mainstream/ 



Istio Spotlight:

https://istio.io/latest/blog/2023/native-sidecars/

https://istio.io/latest/blog/2022/introducing-ambient-mesh/

https://gateway-api.sigs.k8s.io/concepts/gamma/

https://www.cncf.io/announcements/2023/07/12/cloud-native-computing-foundation-reaffirms-istio-maturity-with-project-graduation/ 

https://istio.io/latest/get-involved/

https://training.linuxfoundation.org/blog/istio-certification/ 

https://www.oreilly.com/library/view/istio-ambient-explained/9781098142698/



Socials:

Twitter:⁠ https://twitter.com/OpenObserv⁠

YouTube: ⁠https://www.youtube.com/@openobservabilitytalks⁠