OpenObservability Talks Dotan Horovits
-
- Technology
-
On OpenObservability Talks we discuss harnessing the power of open source to advance observability initiatives for DevOps practitioners around the world.
We live-stream the episodes on Twitch and YouTube Live - tune in to see us live, and chime in with your comments and questions on the live chat.
https://www.youtube.com/@openobservabilitytalks
You can find us on Twitter @openobserv
-
KubeCon Paris Highlights and AI Spotlight on K8sGPT - OpenObservability Talks S4E11
KubeCon Europe 2024 in Paris was the biggest event of the Cloud Native Computing Foundation (CNCF) to date, with over 12k participants. Have you missed it? We've got you covered! Join not one but two CNCF Ambassadors as they explore the latest and greatest highlights from the event that every tech enthusiast is talking about.
But that's not all! We'll also zoom in on K8sgpt, a new entrant to the CNCF’s sandbox that uses generative AI to give Kubernetes superpowers to everyone. Does this open source project go beyond the GenAI hype and get us closer to diagnosing and triaging issues in plain English? Let’s ask the maintainers behind the project.
Our guest is Thomas Schuetz, a Principal Cloud Architect with a keen interest in cloud-native application delivery. Thomas teaches at an Austrian University of Applied Sciences, focusing on cloud-native technologies. Thomas is enthusiastic about open source projects, contributing as a Keptn GC Member and K8sGPT Maintainer, alongside his role as Co-Chair of the CNCF TAG App Delivery. He also brings a deep industry background from his past roles at Dynatrace and more.
The episode was live-streamed on 14 April 2024 and the video is available at https://www.youtube.com/watch?v=xr3viuhssdg
OpenObservability Talks episodes are released monthly, on the last Thursday of each month and are available for listening on your favorite podcast app and on YouTube.
We live-stream the episodes on Twitch and YouTube Live - tune in to see us live, and chime in with your comments and questions on the live chat.
https://www.youtube.com/@openobservabilitytalks
https://www.twitch.tv/openobservability
Show Notes:
00:00 - Show intro
00:59 - Episode and guest intro
03:15 - Redis moves off open source
05:21 - AI white paper
07:47 - TAG App Delivery updates
12:15 - Istio beta release of ambient mode
12:57 - Fluent Bit v3 major release
13:57 - Keptn project updates
17:20 - OpenCost adds environment sustainability
18:43 - OpenFeature adds client-side support with web SDK v1
20:08 - Perses 0.44 release
21:40 - K8sGPT founding team
24:07 - K8sGPT intro
27:36 - how K8sGPT works
31:28 - no vendor behind K8sGPT
36:10 - integration with multiple Gen AI services and local models
40:16 - K8sGPT current state and maturity
45:11 - K8sGPT traction
48:40 - K8sGPT acceptance into the sandbox and adopter companies
54:11 - how to reach out to Thomas Schuetz
56:09 - who’s behind K8sGPT
59:07 - where to follow K8sGPT
1:00:17 - Outro
Resources:
https://github.com/k8sgpt-ai/k8sgpt
https://k8sgpt.ai/
Cloud Native Artificial Intelligence whitepaper
TAG App Delivery update at KubeCon Paris
Fluent Bit v3.0 release
OpenFeature Web SDK v1
k8sgpt slack
Socials:
Twitter: https://twitter.com/OpenObserv
YouTube: https://www.youtube.com/@openobservabilitytalks
Dotan Horovits
============
Twitter: https://twitter.com/horovits
LinkedIn: https://www.linkedin.com/in/horovits/
Mastodon: https://fosstodon.org/@horovits
Thomas Schuetz
===============
Twitter: https://twitter.com/thschue
LinkedIn: https://linkedin.com/in/thschue
Mastodon: https://hachyderm.io/@thschue -
Charting New Territory: OpenTelemetry Embraces Profiling - OpenObservability Talks S4E10
OpenTelemetry is expanding beyond the traditional “three pillars of observability” and introduces a groundbreaking addition to its signals - Continuous Profiling. The new Profiling Special Interest Group (SIG) that was formed to lead the topic has already made significant advancements, to be featured at KubeCon Europe. Join us in this special panel episode of OpenObservability Talks as we explore the significance of this new dimension in understanding application behavior, optimizing performance, and gaining deeper insights into your systems. Our expert guests, Felix Geisendörfer and Ryan Perry, members of the OpenTelemetry Profiling SIG, share their insights into how Profiling enhances the OpenTelemetry framework, and update on the work for open specification and implementation.
This special episode hosts a panel of two distinguished members of OpenTelemetry’s Profile SIG, and prominent members of the observability vendor ecosystem. Felix Geisendörfer is a Senior Staff Engineer at Datadog where he works on Continuous Profiling and contributes to the Go runtime. Before that he was working at Apple, co-founded Transloadit, contributed to node.js and inspired a generation of mad scientists to program flying robots with it. Ryan Perry is Principal Product Manager at Grafana Labs. He has built a career at various startups while actively contributing to open source projects and advancing open telemetry initiatives. Most recently he built Pyroscope, an open source continuous profiling project/company, which has been acquired by Grafana Labs.
The episode was live-streamed on 7 March 2024 and the video is available at https://www.youtube.com/watch?v=iGM67RT12gQ
OpenObservability Talks episodes are released monthly, on the last Thursday of each month and are available for listening on your favorite podcast app and on YouTube.
We live-stream the episodes on Twitch and YouTube Live - tune in to see us live, and chime in with your comments and questions on the live chat.https://www.twitch.tv/openobservabilityhttps://www.youtube.com/@openobservabilitytalks
Show Notes:
00:00 - show intro
01:03 - episode and guests intro
04:02 - trends and advancements in the Profiling space
05:42 - from cost and performance into broader observability
11:27 - turning profile data into metrics
12:45 - runtime vs. full host profilers and eBPF use
18:44 - pprof JFR and other existing profile standards
21:19 - profile visualizations - from flame graphs to timeline view
22:37 - entrepreneur PoV on the profiling market
26:54 - OpenTelemetry adds profiles as a new signal
32:22 - OTel choosing a pprof extended standard
39:06 - discrete events vs. pre-aggregated data
41:09 - use cases for processing profiling data
44:19 - OTel Profiles reference implementation
49:11 - latest milestone and roadmap
54:44 - who’s involved in OTel Profiles
56:41 - how to follow OTel Profiles and the guests
59:34 - March community events and conferences
1:00:38 - Falco and CloudEvents projects reached CNCF graduation
1:01:59 - Prometheus and Linkerd latest releases
1:03:29 - Netflix open-sources bpftop CLI for eBPF app performance monitoring
1:05:15 - show outro
Resources:
Continuous Profiling: A New Observability Signal (previous episode): https://logz.io/blog/continuous-profiling-new-observability-signal-in-opentelemetry/?utm_source=devrel&utm_medium=devrel
OpenTelemetry extension proposal for adding Profiles: https://github.com/open-telemetry/oteps/pull/239
OTel Profile SIG notes: https://docs.google.com/document/d/19UqPPPlGE83N37MhS93uRlxsP1_wGxQ33Qv6CDHaEp0/edit#heading=h.63a4klfdbcob
eBPF adoption in observability - github stats: https://www.linkedin.com/feed/update/urn:li:activity:7171044354667585537/
ProfilerPedia: https://profilerpedia.markhansen.co.nz/
Netflix releases bpftop CLI tool: https://netflixtechblog.com/announcing-bpftop-streamlining-ebpf-performance-optimization-6a727c1ae2e5 -
Decoding .NET8: Unveiling Cloud-Native Observability - OpenObservability Talks S4E09
The .NET programming language is taking cloud native deployment and observability seriously, and most notably with the recent announcement of .NET Aspire stack unveiled at the recent .NET Conf 2023.
In this episode, we reviewed the open source maintainers’ journey to making .NET a "by default, out of the box observable platform", as ASP.NET Core creator David Fowler put it. David was this episode’s guest, and with him we dived into .NET Aspire and how it simplifies the complexities of cloud app development with capabilities around service discovery, observability, and resilience. We discussed the local developer experience, the path to developer observability, and what we can expect from the upcoming GA release of .NET8.
David Fowler has been at Microsoft for 15 years working on developer frameworks and tools in the .NET space. He's one of the creators of several popular OSS frameworks and tools such as NuGet, SignalR and ASP.NET Core, and also architected the Azure SignalR Service. Originally from Barbados, he's an avid open-source advocate and developer currently focused on simplifying developer experiences in the microservice space.
The episode was live-streamed on 21 February 2024 and the video is available at https://www.youtube.com/watch?v=Ll1T9Zs7jUo
OpenObservability Talks episodes are released monthly, on the last Thursday of each month and are available for listening on your favorite podcast app and on YouTube.
We live-stream the episodes on Twitch and YouTube Live - tune in to see us live, and chime in with your comments and questions on the live chat.
https://www.youtube.com/@openobservabilitytalks
https://www.twitch.tv/openobservability
Show Notes:
00:10 - episode and guest intro
04:03 - what .NET used to be like for developing cloud-native
15:10 - out-of-the-box observability in .NET
21:05 - .NET aligning with OpenTelemetry
26:40 - what’s .NET Aspire
32:37 - existing .NET components are part of Aspire
37:46 - developing an observability UI as part of Aspire
43:24 - how to transition containerized apps from dev to prod
48:48 - the relationship between Aspire to Dapr and Radius
53:31 - Aspire roadmap to GA
57:13 - where to follow Aspire and David Fowler
59:13 - K8sgpt accepted to CNCF as a sandbox project
59:56 - Strimzi reaches CNCF incubation with Kafka on Kubernetes
1:00:40 - OpenFeature becomes a CNCF incubating project
1:03:03 - Broadcom kills free ESXi and other VMware restructuring
Resources:
.NET Aspire GitHub repo: https://github.com/dotnet/aspire
.NET Aspire Preview 3: https://learn.microsoft.com/en-us/dotnet/aspire/whats-new/preview-3
Instrumenting C# .NET apps with OpenTelemetry: https://logz.io/blog/csharp-dotnet-opentelemetry-instrumentation/?utm_source=devrel&utm_medium=devrel
OpenTelemetry beginner’s guide: https://logz.io/learn/opentelemetry-guide/?utm_source=devrel&utm_medium=devrel
K8sgpt accepted to CNCF sandbox: https://www.linkedin.com/posts/horovits_genai-sre-kubernetes-activity-7158185284289888256-0KuZ
Strimzi reaches CNCF incubation: https://www.cncf.io/blog/2024/02/08/strimzi-joins-the-cncf-incubator/
OpenFeature reaches CNCF incubation: https://www.cncf.io/blog/2023/12/19/openfeature-becomes-a-cncf-incubating-project/
Broadcom decided to kill the free edition of ESXi and other VMware restructuring: https://horovits.medium.com/0aea7efafb47
Socials:
Twitter: https://twitter.com/OpenObserv
YouTube: https://www.youtube.com/@openobservabilitytalks
Dotan Horovits
============
Twitter: https://twitter.com/horovits
LinkedIn: https://www.linkedin.com/in/horovits/
Mastodon: https://fosstodon.org/@horovits
David Fowler
==========
Twitter: https://twitter.com/davidfowl
LinkedIn: https://www.linkedin.com/in/davidfowl
Mastodon: https://hachyderm.io/@davidfowl -
Scaling Platform Engineering: Shopify’s Blueprint - OpenObservability Talks S4E08
In this episode, join us as we delve into the intricate world of Platform Engineering with Aparna Subramanian, Director of Production Engineering at Shopify. Discover how Shopify, a powerhouse in e-commerce, masters the art of scaling platform engineering. Gain invaluable insights into their strategies, innovations, and lessons learned while navigating the complexities of sustaining and evolving a robust infrastructure to support millions, even through special peak events like Black Friday and Cyber Monday. If you're keen on understanding the backbone of a thriving online platform, don’t miss out on this episode.
Aparna started her career as a Software Engineer and has spent most part of her almost two decades of technology experience specializing in Infrastructure and Data Platforms. In her current role she leads Shopify’s Cloud Native Production Platform.
Previously, she was Director of Engineering at VMware where she was a founding member of Tanzu on vSphere, a Kubernetes Platform for the hybrid cloud. She also serves as co-chair of the “CNCF End User Developer Experience” SIG and as member of the CNCF End user technical advisory board.
The episode was live-streamed on 11 January 2024 and the video is available at https://www.youtube.com/watch?v=6ShtsTTUizI
OpenObservability Talks episodes are released monthly, on the last Thursday of each month and are available for listening on your favorite podcast app and on YouTube.
We live-stream the episodes on Twitch and YouTube Live - tune in to see us live, and chime in with your comments and questions on the live chat.
https://www.youtube.com/@openobservabilitytalks
https://www.twitch.tv/openobservability
Show Notes:
00:00 - Show intro & 2023 stats
01:49 - Episode and guest intro
04:15 - Shopify’s scale
06:09 - Shopify’s journey to Platform Engineering
08:56 - Shopify’s platform structure
11:49 - division of responsibility
13:51 - golden path vs flexibility
17:58 - balancing flexibility and abstraction
19:56 - platform group structure
23:28 - handling load spikes
28:55 - FinOps in Platform Engineering
38:38 - avoiding silos and the cultural aspect
41:13 - CNCF end-user SIG and community challenges
49:24 - KubeCon Paris and guest contact
51:03 - OpenTofu reached GA
53:33 - Isovalent acquired by Cisco
55:00 - year-end summary articles
57:07 - .NET Aspire released preview2
58:58 - Episode and show outro
Resources:
Shopify Engineering Blog https://shopify.engineering/
Performance wins at Shopify: https://www.shopify.com/news/performance%F0%9F%91%86-complexity%F0%9F%91%87-killer-updates-from-shopify-engineering
CNCF End User SIG https://github.com/cncf/enduser-public
OpenTofu has reached GA https://logz.io/blog/terraform-is-no-longer-open-source-is-opentofu-opentf-the-successor/?utm_source=devrel&utm_medium=devrel
Observability in 2024: https://thenewstack.io/observability-in-2024-more-opentelemetry-less-confusion/
OpenTelemetry in 2024: https://www.apmdigest.com/2024-application-performance-management-apm-predictions-4
.NET Aspire preview2: https://devblogs.microsoft.com/dotnet/announcing-dotnet-aspire-preview-2/
Socials:
Twitter: https://twitter.com/OpenObserv
YouTube: https://www.youtube.com/@openobservabilitytalks
Dotan Horovits
============
Twitter: @horovits
LinkedIn: in/horovits
Mastodon: @horovits@fosstodon
Aparna Subramanian
=================
Twitter: @aparnastweets
LinkedIn: https://www.linkedin.com/in/subramanianaparna/ -
Kubernetes and Beyond: A Year-End Reflection with Kelsey Hightower - OpenObservability Talks S4E07
In this special episode we wrapped up the year 2023 with none other than the cloud-native maestro, Kelsey Hightower! We looked into the highs and lows of the tech landscape, exploring Kelsey's insights on containerization and beyond. Tune in as we unravel the year that was and reflect on what lies ahead for Kubernetes and cloud computing.
Kelsey has been there since the birth of Kubernetes, with his contributions to the project as well as his advocacy for containers and cloud native tech and concepts. Join us to conclude 2023 with a look above the clouds.
The episode was live-streamed on 5 December 2023 and the video is available at https://www.youtube.com/watch?v=OVSIUMJxtLk
OpenObservability Talks episodes are released monthly, on the last Thursday of each month and are available for listening on your favorite podcast app and on YouTube.
We live-stream the episodes on Twitch and YouTube Live - tune in to see us live, and chime in with your comments and questions on the live chat.
https://www.twitch.tv/openobservability
https://www.youtube.com/@openobservabilitytalks
Show Notes:
00:00 - Show intro
01:00 - Episode and guest intro
02:40 - Highlights of 2023, signs of maturity
05:17 - Standardizing on cloud bills
12:09 - Consensus vs. innovation in tech
14:46 - Evolution of OpenTelemetry and telemetry signals
19:33 - Where AI will help DevOps and Observability
25:44 - Where is Kubernetes heading in the coming decade
32:42 - Can Kubernetes serve AI/ML workloads
40:37 - CNCF landscape - transparency vs. complexity
49:05 - Evolution of observability
59:03 - Episode and show outro
Resources:
Standardizing on cloud bills with FOCUS open specification: https://horovits.medium.com/6e30069f33a0
How to fix Kubernetes monitoring: https://thenewstack.io/how-to-fix-kubernetes-monitoring/
Socials:
Twitter: https://twitter.com/OpenObserv
YouTube: https://www.youtube.com/@openobservabilitytalks -
KubeCon NA Highlights and Istio Spotlight with Lin Sun - OpenObservability Talks S4E06
Have you missed KubeCon North America in Chicago? This one’s for you! In this episode, we explored the latest and greatest highlights from the event that every tech enthusiast is talking about. From cutting-edge innovations to industry insights, we've got the broad spectrum covered.
But that's not all! We'll also zoomed in on Istio, the popular service mesh open source project that has just recently reached CNCF graduation. Join us as we map out the service mesh universe, and then dive into Istio's galaxy, unraveling its architecture, features, and the roadmap direction with Ambient. And you’ll get to hear it from the Istio authority, Lin Sun.
Lin is the Director of Open Source at Solo.io and a CNCF ambassador. She has worked on the Istio service mesh since the beginning of the project in 2017 and serves on the Istio Steering Committee and Technical Oversight Committee. Previously, she was a Senior Technical Staff Member and Master Inventor at IBM for 15+ years. She is the author of the book "Istio Ambient Explained" and co-author of “Istio Explained”, and has more than 200 patents to her name.
The episode was live-streamed on 15 November 2023 and the video is available at https://www.youtube.com/watch?v=bxnDH6LH-cA
You can read the recap post: https://logz.io/blog/kubecon-na-2023-recap/?utm_source=devrel&utm_medium=devrel
OpenObservability Talks episodes are released monthly, on the last Thursday of each month and are available for listening on your favorite podcast app and on YouTube.
We live-stream the episodes on Twitch and YouTube Live - tune in to see us live, and chime in with your comments and questions on the live chat.https://www.twitch.tv/openobservabilityhttps://www.youtube.com/@openobservabilitytalks
Show Notes:
01:27 - Episode and guest intro
06:34 - KubeCon Highlights: Fluent Bit
09:16 - OpenTelemetry Logging, OTLP is GA
12:53 - OpenTelemetry project journey report
13:43 - WASM Day and Istio Day updates
16:18 - Keynote: the future of Kubernetes
18:51 -Crossplane latest release v1.14
19:24 - Kyverno supports non-Kubernetes workloads
20:12 - Vitess 18 is now GA
20:43 - AI is nascent in CNCF
22:56 - CNCF’s GitOps microsurvey
23:56 - eBPF documentary released
27:08 - Service Mesh architecture and landscape
31:36 - Envoy proxy
33:48 - maturity of the projects
39:36 - Istio unique value proposition and adoption
43:55 - Kubernetes released native sidecar support
47:02 - The GAMMA initiative in Kubernetes Gateway API
50:04 - Istio updates: Ambient, multi-claster, Gateway API GA impl. For N-S
53:40 - CNCF Training & Certification Launch Istio Certification
54:56 - Istio roadmap
56:50 - how to follow Istio and Lin Sun and episode wrapup
Resources:
KubeCon Updates:
https://www.cncf.io/blog/2023/11/07/opentelemetry-at-kubecon-cloudnativecon-north-america-2023-update/
https://opentelemetry.io/blog/2023/http-conventions-declared-stable/
https://www.cncf.io/reports/opentelemetry-project-journey-report/
https://blog.crossplane.io/crossplane-v1-14/
https://www.cncf.io/blog/2023/11/06/kyverno-expands-beyond-kubernetes/
https://planetscale.com/blog/announcing-vitess-18
https://www.cncf.io/blog/2023/11/07/cncf-gitops-microsurvey-learning-on-the-job-as-gitops-goes-mainstream/
Istio Spotlight:
https://istio.io/latest/blog/2023/native-sidecars/
https://istio.io/latest/blog/2022/introducing-ambient-mesh/
https://gateway-api.sigs.k8s.io/concepts/gamma/
https://www.cncf.io/announcements/2023/07/12/cloud-native-computing-foundation-reaffirms-istio-maturity-with-project-graduation/
https://istio.io/latest/get-involved/
https://training.linuxfoundation.org/blog/istio-certification/
https://www.oreilly.com/library/view/istio-ambient-explained/9781098142698/
Socials:
Twitter: https://twitter.com/OpenObserv
YouTube: https://www.youtube.com/@openobservabilitytalks