OpenObservability Talks Dotan Horovits, Jonah Kowall, Mike Elsmore

The CNCF has a rich suite to address monitoring Kubernetes and cloud-native workloads. First of which is Prometheus, which is widely adopted, with great out-of-the-box compatibility with Kubernetes. But under the CNCF you can also find OpenMetrics that offers standardization of the metrics format, Thanos and Cortex which offer long-term storage for Prometheus, and other complimentary solutions and integrations.   

On this episode of OpenObservability Talks we’ll host “RichiH” Hartmann and discuss the different OSS projects, the synergy between them, and the future roadmap in building the community and making CNCF a leading offering.  

Richard "RichiH" Hartmann is Director of Community at Grafana Labs, Prometheus team member, OpenMetrics founder, CNCF SIG Observability chair, and other things. He also organizes various conferences, including FOSDEM, DENOG, DebConf, and Chaos Communication Congress. In the past, he made mainframe databases work, ISP backbones run, and built a datacenter from scratch.

Resources:

OpenTelemetry.io

OpenTelemetry status page

Guide to OpenTelemetry

CNCF TAG Observability

Open* Explainer by RichiH

OpenMetrics

Current observability practice is largely based on manual instrumentation, which creates a barrier to entry for many wishing to implement observability in their environment. This is especially true in Kubernetes environments and microservices architecture.

eBPF (extended Berkeley Packet Filter) is an exciting new technology for Linux kernel level instrumentation, which bears the promise of no-code instrumentation and easier observability into Kubernetes environments (alongside other benefits for networking and security).

On this episode of OpenObservability Talks we’ll host Natalie Serrino, Principal Engineer at Pixie Labs, which was recently acquired by New Relic. We’ll talk about observability in Kubernetes environments, eBPF and its use cases for observability.

We’ll also talk about Pixie, the Kubernetes-native in-cluster observability platform, and the exciting news of it being open sourced and contributed these days to CNCF under Apache 2.0 license.

Natalie is a Principal Engineer and Tech Lead at New Relic. She works on the Pixie auto-telemetry observability platform, which was acquired and open sourced by New Relic. She focuses primarily on Pixie’s data layer, including its query language, compiler, and query execution engine.

Resources:

http://www.brendangregg.com/ebpf.html

https://blog.px.dev/

https://docs.px.dev/about-pixie/roadmap/

https://www.businesswire.com/news/home/20210504005480/en/New-Relic-Joins-Cloud-Native-Computing-Foundation-Governing-Board-and-is-in-the-Process-of-Contributing-Pixie-Open-Source-for-Kubernetes-Native-Observability

https://netflixtechblog.com/how-netflix-uses-ebpf-flow-logs-at-scale-for-network-insight-e3ea997dca96

https://logz.io/blog/istio-instrumenting-microservices-distributed-tracing/

https://opensearch.org/blog/update/2021/06/opensearch-release-candidate-announcement/ 

https://thenewstack.io/tracing-why-logs-arent-enough-to-debug-your-microservices/ 

https://www.theregister.com/2021/06/29/kubernetes_spend_report/

Social:

Twitter: https://twitter.com/OpenObserv 

Twitch: https://www.twitch.tv/openobservability 

Website: https://openobservability.io/

OpenSearch project was born out of the passion for Elasticsearch and Kibana and the desire to keep them open source in the face of Elastic’s decision to close-source them. After a couple of months of hard work led by AWS, the Beta release was announced earlier this month under Apache2 license.

On this episode of OpenObservability Talks we hosted Kyle Davis, Senior Developer Advocate for OpenSearch at AWS. We talked about how OpenSearch came to be, what it took to fork Elasticsearch and Kibana, what the engineers discovered when they dug into the code, what’s planned ahead, and much more.

About Kyle Davis: While being a relative newcomer to Amazon, Kyle has a long history with software development and databases. When not working, Kyle enjoys 3D printing, and getting his hand dirty in his Edmonton, Alberta-based home garden.

Resources:

https://github.com/opensearch-project

Beta announcement

Roadmap available

Put the OPEN in Observability: Elasticsearch and Kibana relicensing and community chat - OpenObservability Talks S1E08

We are thrilled to have Juraci Kröhling a Software Engineer at Red Hat; CNCF, Maintainer for Jaeger, and OpenTelemetry. He will be live and in-person this month on the podcast in a discussion with Jonah Kowall who is the CTO at logz.io and contributor to Jaeger, OpenTelemetry, and OpenSearch.

Join Jonah Kowall and Bartek Plotka for a discussion on the latest happening topics on open source observability. Bartek works on many projects in open source and is Principal Software Engineer at Red Hat; CNCF SIG Observability Tech Lead. He is very active in the community as one of the leaders of Prometheus, Thanos, OpenMetrics, and many other projects.

The ninth of our OpenObservability Talks has Jujhar Singh, Global DevSecOps Practice Lead at The Economist.

How much observability is enough? What is the investment required to achieve it? How can we drive observability in the company in a measured and pragmatic way? 

This was first streamed at https://www.twitch.tv/openobservability on February 25th 2021 and the video is available at https://www.youtube.com/channel/UCLKOtaBdQAJVRJqhJDuOlPg

The live recording of the OpenObservability talks is the last Thursday of each month, and you can join us on Twitch or YouTube Live.

Socials:

Twitter: https://twitter.com/OpenObserv

Twitch: https://www.twitch.tv/openobservability

YouTube: https://www.youtube.com/channel/UCLKOtaBdQAJVRJqhJDuOlPg

Website: https://openobservability.io/

Links Shared in the recording:

https://www.kiwico.com/

https://sre.google/sre-book/monitoring-distributed-systems/

https://devsecops.jujhar.com/observability-strategy/

https://devsecops.jujhar.com

Elasticsearch/Kibana fork updates: https://discuss.opendistrocommunity.dev/c/forking-elasticsearch-kibana/50

OpenTelemetry v1.0 for Tracing: https://medium.com/opentelemetry/opentelemetry-specification-v1-0-0-tracing-edition-72dd08936978

Donating Docker Distribution to the CNCF: https://www.docker.com/blog/donating-docker-distribution-to-the-cncf/