Blog Posts Process Management

Enterprise Integration Patterns Revisited for the Era of Big Data, Internet of Things, Cloud, and Microservices

Blog: The Tibco Blog

In 2015, I gave talks about Enterprise Integration Patterns at OOP 2015 in Munich, Germany and at JavaDay 2015 in Kiev, Ukraine. I reused a talk from 2013 and updated it with current trends to show how Enterprise Integration Patterns (EIP) are used everywhere today and what’s coming for the future.

It was great to see that Gregor Hohpe, founder and author of the EIP book and currently Head of IT at Allianz, was attending one of the sessions:

1

Introduction to Enterprise Integration Patterns

Data exchanges between companies increase frequently and the number of applications that must be integrated increases as well. The realization of these integration scenarios is a complex and time-consuming task because different applications and services do not use the same concepts, interfaces, data formats, or technologies.

Originated and published over 10 years ago by Gregor Hohpe and Bobby Woolf, Enterprise Integration Patterns became the worldwide de facto standard for describing integration problems. These patterns offer a standardized way to split huge, complex integration scenarios into smaller recurring problems. The following slide deck revisits EIPs and gives an overview about the status quo and its relevance regarding modern concepts such as big data, Internet of Things, cloud, and microservices. The following shows a simple, but powerful diagram using several different EIPs, such as a splitter or router (source: http://www.enterpriseintegrationpatterns.com/):

2

Fortunately, EIPs offer more possibilities than modeling integration problems in a standardized way. Frameworks and tools implement these patterns, so the developer does not have to implement EIPs on his own.

Trends: Hybrid Integration and the Citizen Integrator

End users’ behavior has changed, yet mission critical systems still need to be integrated on the enterprise level. However, technical people (no developer, but some technical knowledge) want to realize simple integrations with partners by themselves. “Hybrid Integration,” as Forrester calls it, can help by offering integration in the cloud via web UIs and self-service. Business users also want (and need) to be more practical without having to ask IT departments for help. This is what Gartner calls the “Citizen Developers” or “Citizen Integrators.” Business users do simple integrations by themselves. No matter how you name these new trends, they are on the way to the IT world of most enterprises.

TIBCO is following this trend! Take a look at the TIBCO NOW Tour in Paris and London in 2015: TIBCO announced different tools for different end users.

Relation between Integration Offerings and Enterprise Integration Patterns

How do EIPs map to this trend? They are used everywhere, in varying degrees of complexity. The future integration portfolio will contain offerings for business users, citizen developers, and classical enterprise integration scenarios. EIPs will be used without your awareness. Let’s take a look at different offerings and how to use EIPs within:

EIPs for Streaming Analytics, IoT and Microservices

EIPs are important for “classical integration“ using an Enterprise Service Bus like  TIBCO ActiveMatrix BusinessWorks or new cloud integration services such as TIBCO Cloud Integration or TIBCO Simplr.

EIPs are also used with frameworks and tools for stream processing (e.g. TIBCO StreamBase), API management and application services governance (e.g. TIBCO Mashery), and any other tool which uses some kind of integration logic, like Internet of Things, or building business logic via microservices. The tasks of EIPs are very similar to integration offerings: you route, filter or map data from one endpoint to another one. Sometimes, you combine the EIPs with different concepts.

While “classical integration” is usually based on concepts such as request-response or publish-subscribe communication, stream processing processes data while it is in motion using concepts such as continuous queries and sliding windows. However, in both scenarios, EIPs are needed to route, filter or map data between endpoints.

EIPs for Log Management and IT Operations Analytics (ITOA)

Log management (TIBCO LogLogic) and IT operations analytics (ITOA, TIBCO LogLogic Unity) is another hot topic in the market today, where EIPs are used for processing machine data and other events. Take a look at the typical workflow, which translates to several different EIPs:

3

Slide Deck “Enterprise Integration Patterns Revisited”

Here is the slide deck, which discusses the above content in more detail:

Enterprise Integration Patterns Revisited (again) for the Era of Big Data, Internet of Things and Microservices from Kai Wähner

Integration is Key to a Successful Future

The number of different data sources and technologies has increased more today than ever before:

Therefore: EVERYTHING HAS TO BE INTEGRATED! Enterprise Integration Patterns are a key piece in this puzzle, regardless of which problem you have to solve or which concepts you need to use.

Leave a Comment

Get the BPI Web Feed

Using the HTML code below, you can display this Business Process Incubator page content with the current filter and sorting inside your web site for FREE.

Copy/Paste this code in your website html code:

<iframe src="http://www.businessprocessincubator.com/content/enterprise-integration-patterns-revisited-for-the-era-of-big-data-internet-of-things-cloud-and-microservices/?feed=html" frameborder="0" scrolling="auto" width="100%" height="700">

Customizing your BPI Web Feed

You can click on the Get the BPI Web Feed link on any of our page to create the best possible feed for your site. Here are a few tips to customize your BPI Web Feed.

Customizing the Content Filter
On any page, you can add filter criteria using the MORE FILTERS interface:

Customizing the Content Filter

Customizing the Content Sorting
Clicking on the sorting options will also change the way your BPI Web Feed will be ordered on your site:

Get the BPI Web Feed

Some integration examples

BPMN.org

XPDL.org

×