Turning big data into smart data with embedded AI
Article By : Dzianis Lukashevich, Felix Sawo
The systems and architectures for data processing are becoming more and more complex. Only with relevant, high quality, and useful data—smart data—can the associated economic potential be realized...
Industry 4.0 applications generate a huge volume of complex data—big data. The increasing number of sensors and, in general, available data sources are making the virtual view of machines, systems, and processes ever more detailed. This naturally increases the potential for generating added value along the entire value chain. At the same time, however, the question as to how exactly this value can be extracted keeps arising. After all, the systems and architectures for data processing are becoming more and more complex. Only with relevant, high quality, and useful data—smart data—can the associated economic potential be realized.
Challenges
Collecting all possible data and storing them in the cloud in the hopes that they will later be evaluated, analyzed, and structured is a widespread but not particularly effective approach to extracting value from data. The potential for generating added value from the data remains underused, and finding a solution at a later time becomes more complex. A better alternative is to make considerations early on to determine what information is relevant to the application and where in the data flow the information can be extracted. Figuratively speaking, this means refining the data—that is, making smart data out of big data for the entire processing chain. A decision regarding which AI algorithms have a high probability of success for the individual processing steps can be made at the application level. This decision depends on boundary conditions such as the available data, application type, available sensor modalities, and background information about the lower level physical processes.
(Image soure: Analog Devices, Inc.)
For the individual processing steps, correct handling and interpretation of the data are extremely important for real added value to be generated from the sensor signals. Depending on the application, it may be difficult to interpret the discrete sensor data correctly and extract the desired information. Temporal behavior often plays a role and has a direct effect on the desired information. In addition, the dependencies between multiple sensors must frequently be accounted for. For complex tasks, simple threshold values and manually determined logic or rules are no longer sufficient.
AI Algorithms
In contrast, data processing by means of AI algorithms enables the automated analysis of complex sensor data. Through this analysis, the desired information and, thus, added value are automatically arrived at from the data along the data processing chain.
For model building, which is always a part of an AI algorithm, there are basically two different approaches.
One approach is modeling by means of formulas and explicit relationships between the data and the desired information. These approaches require the availability of physical background information in the form of a mathematical description. These so-called model-based approaches combine the sensor data with this background information to yield a more precise result for the desired information. The most widely known example here is the Kalman filter.
If data, but no background information that could be described in the form of mathematical equations are available, then so-called data-driven approaches must be chosen. These algorithms extract the desired information directly from the data. They encompass the full range of machine learning methods, including linear regression, neural networks, random forest, and hidden Markov models.
Selection of an AI method often depends on the existing knowledge about the application. If extensive specialized knowledge is available, AI plays a more supporting role and the algorithms used are quite rudimentary. If no expert knowledge exists, the AI algorithms used are much more complex. In many cases, it is the application that defines the hardware and, through this, the limitations for AI algorithms.
Embedded, Edge, or Cloud Implementation
The overall data processing chain with all the algorithms needed in each individual step must be implemented in such a way that the highest possible added value can be generated. Implementation usually occurs at the overall level—from the small sensor with limited computing resources through gateways and edge computers to large cloud computers. It is clear that the algorithms should not only be implemented at one level. Rather, it is typically more advantageous to implement the algorithms as close as possible to the sensor. By doing so, the data are compressed and refined at an early stage and communication and storage costs are reduced. In addition, through early extraction of the essential information from the data, development of global algorithms at the higher levels is less complex. In most cases, algorithms from the streaming analytics area are also useful for avoiding unnecessary storage of data and, thus, high data transfer and storage costs. These algorithms use each data point only once; that is, the complete information is extracted directly, and the data do not need to be stored.
Processing AI algorithms at the edge (i.e., embedded AI) requires an integrated microcontroller with analog and digital peripherals for data acquisition, processing, control, and connectivity. The processor also needs to be able to capture and process data locally in real-time, as well as have the computing resources for executing state-of-the-art smart AI algorithms. For example, the ADuCM4050 from Analog Devices is based on the ARM Cortex-M4F architecture and provides an integrated and power-saving approach to embedded AI.
Implementing embedded AI goes far beyond just the microcontroller. To accelerate design, many silicon manufacturers have created development and evaluation platforms like the EV-COG-AD4050LZ. These platforms bring together microcontrollers with components like sensors and HF transceiver to enable engineers to explore embedded AI without having to become experts in multiple technologies. These platforms are extensible, enable developers to work with different sensors and other components. For example, the EV-GEAR-MEMS1Z shield allows engineers to quickly evaluate different MEMS technologies such as the ADXL35x series, including the ADXL355, used in this shield offers superior vibration rectification, long-term repeatability, and low noise performance in a small form factor.
The combination of platforms and shields like the EV-COG-AD4050LZ and EV-GEAR-MEMS1Z gives engineers entry into the world of structural health and machine condition monitoring based on vibration, noise, and temperature analysis. Other sensors can be connected to the platform as required so that the AI methods used can deliver a better estimate of the current situation through so-called multisensor data fusion. In this way, various operating and fault conditions can be classified with better granularity and higher probability. Through smart signal processing on the platform, big data becomes smart data locally, making it only necessary for the data relevant to the application case to be sent to the edge or the cloud.
The platform approach also simplifies communications as shields are available for different wireless communications. For example, the EV-COG-SMARTMESH1Z combines high reliability and robustness as well as extremely low power consumption with a 6LoWPAN and 802.15.4e communication protocol that addresses a large number of industrial applications. The SmartMesh IP network is composed of a highly scalable, self-forming multihop mesh of wireless nodes that collect and relay data. A network manager monitors and manages the network performance and security and exchanges data with a host application.
For wireless battery-operated condition monitoring systems in particular, embedded AI can realize the full added value. Local conversion of sensor data to smart data by the AI algorithms embedded in the ADuCM4050 results in lower data flow and consequently less power consumption than is the case with direct transmission of sensor data to the edge or the cloud.
Applications
AI algorithm development platforms, including the AI algorithms developed for them, have a very wide range of applications in the field of monitoring of machines, systems, structures, and processes that extend from simple detection of anomalies to complex fault diagnostics. The use of integrated accelerometers, microphone, and temperature sensor enables capabilities such as monitoring of vibrations and noise from diverse industrial machines and systems. Embedded AI can be used to detect process states, bearing or stator damage, failure of the control electronics, and even unknown changes in system behavior due to damage to the electronics. If a predictive model is available for certain damages, these damages can even be predicted locally. Through this, maintenance measures can be taken at an early stage and thus unnecessary damage-based failure can be avoided. If no predictive model exists, the platform can also help subject matter experts successively learn the behavior of a machine and over time derive a comprehensive model of the machine for predictive maintenance.
Ideally, through corresponding local data analysis, embedded AI algorithms should be able to decide which sensors are relevant for the respective application and which algorithm is the best one for it. This means smart scalability of the platform. At present, it is still the subject matter expert who must find the best algorithm for the respective application, even though the AI algorithms can already be scaled with minimal implementation effort for various applications of machine condition monitoring.
Embedded AI should also make a decision regarding the quality of the data and, if it is inadequate, find and make the optimal settings for the sensors and the entire signal processing. If several different sensor modalities are used for sensor fusion, an AI algorithm can compensate for the disadvantages of certain sensors and methods. Through this, data quality and system reliability are increased. If AI algorithm classifies a sensor as minimally relevant to the application, its data flow can be accordingly throttled.
The open COG platform from ADI contains a freely available software development kit and numerous example projects for hardware and software for accelerating prototype creation, facilitating development, and realizing original ideas. Through the multisensor data fusion (EV-GEAR-MEMS1Z) and embedded AI (EV-COG-AD4050LZ), a robust and reliable wireless meshed network (SMARTMESH1Z) of smart sensors can be created.
— Dzianis Lukashevich is director of platforms and solutions at Analog Devices.
— Felix Sawo, CEO & Co-Founder at Knowtion