Blog Posts Process Management

See How Products, Libraries, and Frameworks for Streaming Analytics Are Categorized and Compared

Blog: The Tibco Blog

Streaming Analytics processes data in real time while it is in motion. This concept and technology emerged several years ago in financial trading, but it is growing increasingly important these days due to digitalization and the Internet of Things (IoT). The following slide deck from a recent talk at a conference covers:

Stream Processing Frameworks and Products

The following picture shows the key differences between frameworks (no matter if open source such as Apache Storm, Apache Flink, Apache Spark or closed source such as Amazon Kinesis) and products such as TIBCO StreamBase and Live Datamart.

stream-processing-frameworks-and-products

Of course, you can implement everything by writing code and using one or more frameworks. However, besides several other benefits, the key differentiator of using a product is time to market. You can realize projects in weeks instead of months or even years. Delivering quickly is the number one priority of most enterprises these days in a world where the only constant is change!

I recommend that you choose one or two frameworks and one or two products to implement a proof of concept (POC); spend five days, for example, with each one to implement a streaming analytics use case, which includes integration of input feeds or sensors, correlation / sliding windows / patterns, simulation and testing, and a live user interface to monitor and act proactively. At the end, you can compare the results and decide which fits you best.

Fast Data and Streaming Analytics in the Era of Hadoop, R, and Apache Spark

The full power of streaming analytics comes up by combining it with other concepts. A closed loop use case includes:

analyze-model-act

For example, you can combine TIBCO StreamBase with TIBCO Enterprise Runtime for R (TERR) to execute the analytics models (which your data scientists found by using TIBCO Spotfire and R language for analyzing historical data) in real time with every transaction while data is still in motion.

Slide Deck from JavaOne 2015 in San Francisco

The following slide deck discusses the above topics in much more detail:

Streaming Analytics – Comparison of Open Source Frameworks and Products from Kai Wähner

Parts of this (extensive) slide deck were used for talks at several international conferences such as JavaOne 2015 in San Francisco. I appreciate any feedback about the content to improve it continuously…

If you want to learn more about Streaming Analytics and its relation to big data and Apache Hadoop, I recommend the following InfoQ article: Real-Time Stream Processing as Game Changer in a Big Data World with Hadoop and Data Warehouse.

Leave a Comment

Get the BPI Web Feed

Using the HTML code below, you can display this Business Process Incubator page content with the current filter and sorting inside your web site for FREE.

Copy/Paste this code in your website html code:

<iframe src="http://www.businessprocessincubator.com/content/see-how-products-libraries-and-frameworks-for-streaming-analytics-are-categorized-and-compared/?feed=html" frameborder="0" scrolling="auto" width="100%" height="700">

Customizing your BPI Web Feed

You can click on the Get the BPI Web Feed link on any of our page to create the best possible feed for your site. Here are a few tips to customize your BPI Web Feed.

Customizing the Content Filter
On any page, you can add filter criteria using the MORE FILTERS interface:

Customizing the Content Filter

Customizing the Content Sorting
Clicking on the sorting options will also change the way your BPI Web Feed will be ordered on your site:

Get the BPI Web Feed

Some integration examples

BPMN.org

XPDL.org

×