Zeebe: Workflow Reinvented for Microservices and the Cloud (From Idea To Production Readiness)

Last Wednesday, July 17, we announced the first production ready release of Zeebe, Camunda’s new cloud-native workflow engine for microservices orchestration. Zeebe is a new code base, written from scratch, putting forward a completely new way of architecting workflow engines for microservices and distributed systems.

This blog post is a quick overview of why and how we did that.

Why we created Zeebe

About 6 years ago, Camunda entered the workflow space with a new approach to BPM. While our approach was very successful, it was foreseeable that something big was coming that would transform the tech landscape: microservices and distributed systems.

To meet an ever-growing need to define new business models and disrupt existing ones, companies must scale software development. If software is eating the world, then microservices and distributed systems are the forks and knives of that digital transformation.

It was clear to me that this migration to microservices architectures could only succeed if we figured out the right way of implementing workflows and business processes in this new distributed reality. However, this was such a radical change that it was not going to be sufficient to simply re-apply existing solutions to new problems. Something fundamentally new was needed and that came to be Zeebe.

(For a more in-depth overview, Read Mike’s post: Workflows Are Everywhere.)

How Zeebe is different

Zeebe puts one thing front and center, and then everything else naturally follows from there: Events!

In distributed microservices architectures, events are the new first class citizens. Events make it possible to record and publish state changes in one domain (microservice) such that other domains (microservices) can subscribe and react to them. This simple yet powerful principle decouples microservices from each other and introduces scalability and reproducibility. However, a problem that was not yet solved well is how to coordinate many (tens to hundreds) of actions implemented by different microservices to achieve a specific outcome. Or in other words: how to implement complex workflows. As the complexity grows, it becomes increasingly important to have visibility into such flows

And Zeebe provides exactly this – the ability to execute, manage, and monitor workflows that span across microservices and need to be scaled massively in the cloud.

Zeebe interprets workflow on top of event streams. Event streams flow into Zeebe (it is very easy to subscribe to external events from a workflow) and event streams flow out of Zeebe (as it processes workflows, it exports a complete event log into external systems). Given this event-driven way of interacting with the external world, it is only logical that Zeebe builds on top of stream processing internally, instead of a database. This simple fact is what makes Zeebe unique and completely different from any other workflow engine out there that we are aware of. It is at the core of Zeebe’s cloud native architecture, enabling it to scale horizontally, be fault tolerant through replication, and integrate natively into microservices architectures.

It only took me about 2 years to figure out how to do that, and then it only took some of the smartest people I know 2 more years to build it for real. And now, it is finally here! : )

If this has piqued your interest, you can read about the architecture in much more detail in Bernd’s excellent posts:

  • Camunda Platform 8.1 Released – What’s New

    We’re extremely excited to announce the release of Camunda Platform 8.1.  In this post, we will go into the highlights of this release including Web Modeler, Connectors, Zeebe, Operate, Optimize, and more. Here’s the highlights of what’s included in this release: Easier Installation and maintenance for Camunda Platform Self-managed Hot backups for Self-Managed Token-Based authentication Modeler updates Process Templates FEEL Expression Editor Inline Annotations Changes to Camunda forms Connectors updates Workflow engine updates Operate updates Optimize updates Let’s get started! Easier installation and maintenance for Camunda Platform Self-Managed Improved Guides and Support for OpenShift and Amazon EKS (AWS) With this release, we are introducing official support for deploying and running Camunda Platform 8 Self-Managed on OpenShift and Amazon EKS (AWS)....

    Read more
  • Camunda Platform 7.18 Released – What’s New

    We’re extremely excited to announce the release of Camunda Platform 7.18 Here are some of the highlights: Cockpit: Improved instance selection to avoid unintended batch operations Cockpit: Easier navigation of high batch operation volumes MDC logging features Camunda Forms in Tasklist: Populate select options via process data Exception error codes Filter and order tasks by last updated WebSphere Liberty New and retired supported environments You can download Camunda Platform or run it with Docker. For a complete list of the changes, please check out the release notes. For patched security vulnerabilities, see our security notices. If you want to dig deeper, check out the source code on GitHub. Cockpit: Improved instance selection to avoid unintended batch operations Previously, when performing...

    Read more
  • Increase your resilience with new regions in...

    We’re excited to announce new regions for Camunda Platform 8 SaaS that further strengthen the resilience, performance, and data requirements for our SaaS customers. Enterprise customers can now choose to create their clusters in a number of regions including Europe West, US Central, US East, and the most recent addition, Australia South East. This provides multiple benefits, such as increasing availability, allowing to set up fail-safes, adhering to regulatory requirements for regional data storage, and reduced latency due to closer physical proximity. Resilience and redundancy in technology are important for all modern organizations and are top of mind for many. Across industries, organizations need a solution that scales effectively and is resilient to provide a good base for process orchestration....

    Read more

Ready to get started?

Still have questions?