33 min

Dynamic Scaling of Zeebe Brokers: “Christmas is coming, so I'm going to get new orders, so I'm going to scale‪”‬ Camunda Community Podcast

    • Technology

On this episode of the Camunda Community Podcast, we discuss the dynamic scaling of Zeebe clusters. Host and Senior Developer Advocate Niall Deehan is joined by Senior Software Engineer Backend, Deepthi Akkoorath to learn more about this new feature and how it came to be, including the technical challenges we overcame and decisions we made, as well as what’s next for scaling Zeebe. 

Zeebe, the cloud-native workflow and decision engine that powers Camunda 8, has many next-generation capabilities, including a language-agnostic approach so you can build clients in any programming language, enterprise-grade resilience, and horizontal scaling via a distributed architecture. We have further improved this last one by providing the ability to dynamically scale Zeebe brokers and are committed to further enhancing this feature in the future. 

Listen to learn more about: 
How this “daisy of destiny” came to Niall’s attentionThe structure of the Zeebe team and Deepthi’s role on the Zeebe Distributed Platform TeamWhat is the dynamic scaling Zeebe brokers? How users can dynamically add brokersWhat actually happens under the hood when dynamically scaling ZeebeHow to scale down ZeebeFailover with scaling ZeebeWhat’s next for dynamic scaling Learn more about Zeebe: https://bit.ly/3vjvslt

Get started with Camunda 8 today:
https://bit.ly/3vjM8tb

---

Additional Resources:
[docs] Camunda 8 Concepts: Clusters
[docs] Zeebe Technical Concepts: Clustering
[docs] Create your cluster
[docs] Setting up a Zeebe cluster
[docs] Cluster Scaling
[github] Zeebe
[github issue] Dynamic resize of an existing Zeebe cluster
[github issue] [EPIC] Dynamic Scaling of Zeebe Cluster - Phat 1: Number of brokers
[github issue] Dynamically start and stop partitions
[blogpost] Zeebe Performance 2023 Year in Review


---

Visit our website.
Connect with us on LinkedIn, Facebook, Mastodon, Threads, and Bluesky.
Check out our videos on YouTube.
Tweet with us.

---

Camunda enables organizations to orchestrate processes across people, systems, and devices to continuously overcome complexity and increase efficiency. With Camunda, business users and developers collaborate using BPMN to model end-to-end processes and run sophisticated automation with the speed, scale, and resilience required to stay competitive. Hundreds of enterprises such as Atlassian, ING, and Vodafone design, orchestrate, and improve business-critical processes with Camunda to accelerate digital transformation.

---

Camunda presents this podcast for informational and entertainment purposes only and does not wish or intend to provide any legal, technical, or any other advice or services to the listeners of this podcast. Please see here for the full disclaimer.

On this episode of the Camunda Community Podcast, we discuss the dynamic scaling of Zeebe clusters. Host and Senior Developer Advocate Niall Deehan is joined by Senior Software Engineer Backend, Deepthi Akkoorath to learn more about this new feature and how it came to be, including the technical challenges we overcame and decisions we made, as well as what’s next for scaling Zeebe. 

Zeebe, the cloud-native workflow and decision engine that powers Camunda 8, has many next-generation capabilities, including a language-agnostic approach so you can build clients in any programming language, enterprise-grade resilience, and horizontal scaling via a distributed architecture. We have further improved this last one by providing the ability to dynamically scale Zeebe brokers and are committed to further enhancing this feature in the future. 

Listen to learn more about: 
How this “daisy of destiny” came to Niall’s attentionThe structure of the Zeebe team and Deepthi’s role on the Zeebe Distributed Platform TeamWhat is the dynamic scaling Zeebe brokers? How users can dynamically add brokersWhat actually happens under the hood when dynamically scaling ZeebeHow to scale down ZeebeFailover with scaling ZeebeWhat’s next for dynamic scaling Learn more about Zeebe: https://bit.ly/3vjvslt

Get started with Camunda 8 today:
https://bit.ly/3vjM8tb

---

Additional Resources:
[docs] Camunda 8 Concepts: Clusters
[docs] Zeebe Technical Concepts: Clustering
[docs] Create your cluster
[docs] Setting up a Zeebe cluster
[docs] Cluster Scaling
[github] Zeebe
[github issue] Dynamic resize of an existing Zeebe cluster
[github issue] [EPIC] Dynamic Scaling of Zeebe Cluster - Phat 1: Number of brokers
[github issue] Dynamically start and stop partitions
[blogpost] Zeebe Performance 2023 Year in Review


---

Visit our website.
Connect with us on LinkedIn, Facebook, Mastodon, Threads, and Bluesky.
Check out our videos on YouTube.
Tweet with us.

---

Camunda enables organizations to orchestrate processes across people, systems, and devices to continuously overcome complexity and increase efficiency. With Camunda, business users and developers collaborate using BPMN to model end-to-end processes and run sophisticated automation with the speed, scale, and resilience required to stay competitive. Hundreds of enterprises such as Atlassian, ING, and Vodafone design, orchestrate, and improve business-critical processes with Camunda to accelerate digital transformation.

---

Camunda presents this podcast for informational and entertainment purposes only and does not wish or intend to provide any legal, technical, or any other advice or services to the listeners of this podcast. Please see here for the full disclaimer.

33 min

Top Podcasts In Technology

No Priors: Artificial Intelligence | Technology | Startups
Conviction | Pod People
All-In with Chamath, Jason, Sacks & Friedberg
All-In Podcast, LLC
Lex Fridman Podcast
Lex Fridman
Acquired
Ben Gilbert and David Rosenthal
Hard Fork
The New York Times
TED Radio Hour
NPR