Blog Posts Process Management

Machine Learning and AI to Process Streaming Video Data in Traffic Webcams

Blog: The Tibco Blog

Reading Time: 3 minutes

Nobody loves traffic, except maybe data scientists. 

In the short video below, the TIBCO team in Australia shows how a public video feed can be combined with some clever computer vision and streaming data science to track, classify, and analyze vehicle traffic. 

This simple and replicable solution can minimize traffic jams, support traffic calming efforts, and optimize existing infrastructure—at a fraction of the cost. 

This same approach can be replicated across many other applications, from airport security to farm management to factory safety. All that’s needed is a streaming video source and TIBCO software.

Traffic Calming Using Existing Streaming Video

Tracking, analyzing, and acting on traffic data has traditionally required expensive pressure sensors placed on the road or other costly and inconvenient solutions. Using a single publicly available video feed, the video’s solution generates the same insights and automated alerts. These include:

The Methodology

Here’s the step-by-step process used by the Australian TIBCO team:

  1. Access an available public streaming video feed. In this example, it’s a webcam showing a section of raised road in front of the iconic Sydney Harbor Bridge.  
  2. Use OpenCV to grab the image and convert it from streaming video to streaming data.
  3. Put this data through a TensorFlow Neural Network, which evaluates and classifies each vehicle. Note: TIBCO trained this network by first identifying different vehicles manually. A neural network is an algorithm for machine learning meant to mirror how neurons in the human brain work.
  4. A Deep SORT algorithm was then used to track the movement of the vehicles over the designated space. 
  5. Build logic to identify a point in time to make it practical to count each vehicle and capture its image automatically. Vehicle image information includes speed, class of vehicle, and direction, which provides additional insight. This is published to Apache Kafka and then sent to TIBCO Steambase to clean, format, and store the data.

TIBCO Spotfire is used to display the analysis. Unlike other visualization tools, TIBCO Spotfire can handle and display streaming data with real-time changes.

Streaming Data Enables Countless New Opportunities

Internet-enabled devices, including sensors, cameras, purpose-built microchips, and other gadgets, continuously collect and transmit massive amounts of streaming data. Now, they can be used to create multiple new opportunities and even spur new business models. A few examples include:

Indeed, the TIBCO team in Australia even took this one step further. They used TIBCO Streaming to look for any vehicle, such as a bus, going over the speed limit. This created an event (distributed through TIBCO Messaging) that triggered the creation of an investigation case within the TIBCO Live Apps case management tool, part of TIBCO Cloud Integration. This became part of the Smart Transport Accelerator code, which you can download for free.

Ultimately, this example shows how anyone can take streaming data and create immersive real-time dashboards to visualize what’s happening—and even leverage automated case management tools to respond in real time. There are no limits to possible use cases. 

Learn how to unlock the many valuable insights inside your video feed.

The post Machine Learning and AI to Process Streaming Video Data in Traffic Webcams first appeared on The TIBCO Blog.

Leave a Comment

Get the BPI Web Feed

Using the HTML code below, you can display this Business Process Incubator page content with the current filter and sorting inside your web site for FREE.

Copy/Paste this code in your website html code:

<iframe src="" frameborder="0" scrolling="auto" width="100%" height="700">

Customizing your BPI Web Feed

You can click on the Get the BPI Web Feed link on any of our page to create the best possible feed for your site. Here are a few tips to customize your BPI Web Feed.

Customizing the Content Filter
On any page, you can add filter criteria using the MORE FILTERS interface:

Customizing the Content Filter

Customizing the Content Sorting
Clicking on the sorting options will also change the way your BPI Web Feed will be ordered on your site:

Get the BPI Web Feed

Some integration examples