IIoT for Predictive Maintenance and Big Data

9 January 2018 | 6 minutes


Checking our forecast for IIoT predictive maintenance trends a year later…

It has been a year since James Reyes-Picknell and I originally wrote this article about IIoT and predictive maintenance. Since then we have been gratified to see that the trends we forecast for the market proved to be true.  In 2018 we saw industrial companies looking to build IIoT monitoring and predictive maintenance systems using more data to detect what is going on, and taking action based on that data. Today, technology solutions that can handle large-scale IoT sensor data in real time are increasingly being used to do continuous monitoring for both detecting faults, and building up a historical record for use in making future predictions. Fortune 500 companies are also now working with IIoT data at 10 – 100 times the velocity and volume they have in the past, a perfect use case for KX technology. Stay tuned to the KX Blog for more updates on industry trends in IIoT analytics in 2019.     Przemek Tomczak, Jan. 15, 2019



By James Reyes-Picknell and Przemek Tomczak


We are often asked about the impact of the Industrial Internet of Things (IIoT) on equipment maintenance for industrial companies. When it comes to repairs, we don’t anticipate that much will change because of the IIoT, except in identifying when repairs are needed. Making systems safe after they’ve suffered failures and taking things apart and replacing components will always require human intervention. In the area of proactive maintenance however, we see a big impact and huge potential benefits.

IIoT for predictive maintenance enables more extensive monitoring of equipment and processes at a much lower cost than traditional methods and delivers actionable warnings to prevent or minimize the consequences of an impending failure. Where IIoT for predictive maintenance is deployed in a well-designed program using Reliability Centered Maintenance (RCM) it will reduce surprise outages, lost production, extensive repairs, secondary damage and increase safety.

IIoT and Big Data – it’s more than just addressable sensors

The underlying premise of the IIoT is that sensors, each with an individual IP address and the ability to communicate wirelessly with a network, allow us to see what is going on remotely when placed on industrial equipment. The stream of signals provided by these sensors provides the raw data from which valuable insight can be gleaned. Using predictive algorithms the data is analyzed and systems are programmed to send notifications to operators like alarms, warnings or work request notifications.

The combination of statistics and machine learning algorithms are effective in analyzing IIoT sensor data for predictive maintenance. For example, a model developed at the University of Toronto can predict fairly accurately the time to failure based on correlations of historic failure data and condition monitoring signals. Companies typically combine several of these types of models into a single platform that can handle various streams of condition monitoring signal data when building their own systems.

Implementing a Predictive Maintenance and Analytics Solution

We suggest some key steps when implementing a predictive maintenance and analytics solution

  • Apply a robust framework for Reliability Centered Maintenance, such as UPTIME and RCM-R®
  • Identify what type of sensor to install, and what location/position will best provide meaningful data streams. This is typically done with some sort of Reliability Centered Maintenance process.
  • Deploy sufficient numbers of sensors to collect needed data.
  • Gather and transmit streams of temporal, or time-series, data from sensors for processing and analysis at a frequency that will give sufficient information to facilitate more accurate troubleshooting.
  • Store the generated data for future analysis and historical investigations.
  • Use algorithms that can handle multiple streams of data in real or near-real time.
  • Use multiple algorithms in combination as a single service.
  • Implement the appropriate technology platform that can ingest, process, store, and analyze the velocity and volume of data, and power the predictive algorithms.
  • Develop, or acquire, expert technical support so the technology and algorithms deliver on their promise.
  • Measure and compare your results as you go so you can continually improve your RCM, using the data and experience gathered to validate and refine predictive maintenance assumptions.
  • Communicate frequently and quickly to management to trigger further field investigations and work request actions.

The need for speed in IIoT predictive analytics

One of the biggest technical hurdles companies face with IIoT predictive maintenance systems is when they run into data bottlenecks that can slow down their response times. The goal of a solution is to remove any friction or delay from when data is generated and when those insights trigger action in the field. This will become a greater challenge when more sensors and more frequent measurements are being sent wirelessly to networks. Companies that have been relying on manual methods of predictive maintenance will now begin receiving ever-growing volumes of IIoT data. New infrastructure, as well as new technologies, will be required to provide the bandwidth to accommodate the data streams.

One industry that has faced this challenge of exploding volumes of time series data is the financial services sector. Over the past two decades, it has largely replaced voice and face-to-face trading with algorithmic trading. Banks and other trading organizations take in large volumes of real-time trade and quote data from stock exchanges to make microsecond decisions about buying and selling securities. They are simultaneously drawing on many terabytes of historical trade data using computer models and machine learning programs to make decisions.

The in-memory database platform kdb+, from KX, has been part of this transition in trading technology from the beginning. Kdb+ is designed to quickly process escalating velocities and volumes of time-series data faster than traditional technologies. Widely implemented across the capital markets industry, kdb+ is also now being used in high-precision manufacturing and predictive maintenance applications. The use case for kdb+ in financial services is similar to the use case for IIoT, both industries need a technology that can efficiently ingest, process, store and analyze real-time and historical streams of data from either sensors or stock exchanges, to make microsecond decisions.

For industrial companies looking to build IIoT predictive maintenance systems, choosing the right technology is essential. A successful implementation of RCM using IIoT sensor data will support growing volumes of sensor data and continual development and improvement in predictive algorithms.

This combination of process and technology has the potential to disrupt the predictive maintenance world and for many companies, it will mean reduced downtime, fewer emergency repairs, lower repair costs, increased asset availability and increased revenues.


James Reyes-Picknell is a Principal Consultant at Conscious Asset, a specialist consulting and training firm that helps companies increase productivity, decrease costs and get the most value from their physical assets. James has over 40 years experience in contract engineering and consulting. He is based in Ontario, Canada.

Przemek Tomczak is Senior Vice-President, Internet of Things and Utilities at KX. Previously, Przemek held senior roles at the Independent Electricity System Operator in Ontario, Canada and top-tier consulting firms and systems integrators. Przemek has a CPA, CA and has a background in business, technology and risk management.


Demo kdb, the fastest time-series data analytics engine in the cloud

    For information on how we collect and use your data, please see our privacy notice. By clicking “Download Now” you understand and accept the terms of the License Agreement and the Acceptable Use Policy.