In this section, AMBER is presented as an advanced gateway targeted to IIoT solutions, thus showing the key role that it can play in the development of innovative industrial systems leveraging on advanced Internet of Things (IoT) technologies. After an introduction related to IIoT, and the AMBER role in such a context, an industrial monitoring and control use case based on BLE and Powerlink technologies is described by detailing the whole system design and implementation. In the hardware and software implementation, a new developed Extender module is presented, thus showing how the main AMBER features can really foster an easy development of industrial solutions starting from research laboratory prototype. To prove the effectiveness of the implemented solution based on AMBER, time delay performance in monitoring and actuation are measured and reported from a laboratory testbed.
4.1 Industrial Internet of Things and AMBER role
In recent years the Internet popularity has experienced exponential growth, thus fostering in the academic and industrial communities the so-called IoT paradigm [21]. According to such a paradigm, in the near future, billion of devices will be part of the global Internet network to create smart environments in a significant number of scenarios, thus improving human lifestyle and efficiency in their working activities.
The use of IoT technologies in industrial environments is at the pillars of the fourth industrial revolution, known in the literature as Industry 4.0 [22, 23]. IIoT systems can be successfully used to create effective smart factories in which enhanced levels of efficiency can be reached. IoT devices can be pervasively used to collect data on the field with the aim of improving productivity through advanced automatic processes [24] and safety through a deeper knowledge of worker position [25] and reducing equipment faults through fast event detection capabilities [26]. Through the use of wireless and wired devices with monitoring and actuating capabilities, advanced applications avoiding the human-in-the-loop constraints can be created, thus moving towards effective cyber-physical-systems.
An advanced IIoT system with sensing and actuation capabilities is composed of three primary layers, from the bottom to the top: (i) the sensing and actuation layer, (ii) the gateway layer, and the (iii) server layer. Such architecture, depicted in Fig. 3, is a generalization of what is reported in [27] considering the whole intelligence distributed in all the components of the system, thus exploiting the so-called Fog Computing approach [28]. At the lowest layer, sensors, actuators, and other devices are considered to be smart objects, that is devices able to sense/actuate, process, and communicate, thus implementing part of the intelligence of the system according to their capabilities. At the gateway layer, instead, powerful devices are necessary to manage multiple communication technologies, both wired and wireless, as well as to perform advanced data analysis (i.e., machine learning algorithms, big data analysis) on a reduced time window, and real-time controls by leveraging on connected sensors and actuators. The greater the intelligence of the system implemented in the gateway, the faster the reaction against the occurrence of certain events. The upper layer is composed of server units able to store data collected by the two levels below, as well as to process them to extract advanced knowledge (i.e., long-term analysis). Ideally, such servers can reside in the cloud.
In the reported architecture, AMBER can be successfully used as an IoT gateway, since, how it has been reported in [29], it has all the necessary and required characteristics. Moreover, it can be easily and successfully used in an industrial scenario to develop advanced industrial control systems fully supporting the architecture depicted in Fig. 3. In fact, along with the capabilities of supporting multiple wireless technologies by developing specific Extender modules, AMBER is a suitable choice to control devices through wired field buses requiring real-time constraints. Thanks to proper Extender modules and low-level software adaptations, a wide number of industrial buses based on twisted pairs can be supported (e.g., Profibus, ModBus), as well as real-time Ethernet field buses (e.g., Powerlink, EtherCAT, Profinet).
4.2 Use case, system design, and implementation
In this article, AMBER is proposed as an IIoT gateway solution targeted to an industrial control system where the thermal control of critical equipment installed in the environment is necessary. An example is a production line in which several machines must be controlled in real-time, and afterwards, an additional thermal control making use of new generation wireless sensors is required to be installed. In this scenario, the gateway of the system must be able to manage and control all the installed actuators in real-time. Moreover, at the same time, it must receive data from wireless temperature sensors to react and take the proper action in the lowest amount of time (i.e., when the temperature of a sensor is above a certain threshold a motor in production line must be turned off to reach a safe condition). To notify of dangerous conditions in real-time to actuators compliant with new generation field buses based on Ethernet technology the Powerlink [30] standard has been selected. Moreover, battery-powered temperature sensors based on the Bluetooth Low Energy [31] technology have been considered to implement the monitoring part of the system.
Powerlink is an open-source industrial protocol designed and developed to reach reliable and deterministic real-time communications for automation. The main idea behind Powerlink is to avoid collisions over the Ethernet channel by introducing a master-slave approach. The bus master is the Managing Node (MN), while all the other nodes participating in the network are called Control Nodes (CN). The Powerlink standard acts cyclically with a bus cycle, is determined at configuration time, and divided into two phases. The former is the isochronous phase in which time critical information is sent from MN to CNs in a scheduled manner, thus avoiding collisions and meeting real-time constraints. The latter, instead, is the asynchronous phase in which all nodes can communicate to each other by using the standard Ethernet protocol. This phase is used to send non time-critical data. Bluetooth Low Energy is a wireless technology mainly developed to reach ultra low-power performance, thus being a suitable choice for a wide range of applications in which battery-powered devices require to be connected in a network. BLE applications range from healthcare, fitness, domotic to industrial applications, where new devices can be installed for retrofitting purposes. The BLE standard specifies the functionality for enabling bidirectional communications between two devices possibly acting as master or slave. Master nodes (e.g., laptop, smartphone, system gateways) usually scan for other devices, while a slave node sends data (e.g., sensor devices) whenever it is necessary. A slave is usually a battery-powered device in a sleep mode state, and it periodically wakes up to be discovered by a master.
In the considered use case, AMBER is configured as an IIoT gateway acting as MN node in the Powerlink network and master node in the wireless segment of the system. Moreover, to follow the architecture reported in Fig. 3, AMBER is wired connected to the Internet (i.e., connection towards the server layer) in order to publish possible events, or data, in remote servers. The high-level system design is depicted in Fig. 4 where at the center of the picture has been reported the AMBER with the necessary hardware modifications, some Powerlink actuators connected through Ethernet on the left, and BLE sensors on the right. From a hardware point of view, a new Extender module has been designed in order to enable an additional Gigabit Ethernet communication on AMBER. Such LAN Extender module is reported at the bottom of Fig. 5, while the top shows the IIoT AMBER mounting the extender. This additional Ethernet peripheral is used by AMBER to control Powerlink actuators, while the Texas Instruments Wilink WL183xMOD [32] module embedded in the selected Variscite SOM, the VAR-SOM-SOLO/DUAL based on a dual-core architecture, is used to interact with BLE sensors. Regarding the actuators, no real hardware solutions have been used in the laboratory implementation of the system since they are closed solutions in which no software customizations are possible to add special functions to be used for performance evaluation purposes (e.g., execution time measurements). To overcome this limitation, a laptop with a Linux OS has been used. Conversely, for the BLE segment of the system, real devices have been selected, in particular the TI Sensortag [33] device. Such a device is based on a new generation of microcontrollers, the TI CC2650 [34], implementing a double protocol stack: BLE [6] and IEEE802.15.4 [35]. Moreover, the device embeds several sensors (i.e., temperature, humidity, accelerometer, light, pressure), thus being a suitable solution to be used in a wide range of IoT applications. From a software point of view, AMBER runs a Debian Jessie distribution in which the openPowerlink [36] stack has been ported. Moreover, an application reading data from BLE sensors and sending actuation controls (AMBER is configured as a MN Powerlink node) upon the occurrence of a certain event (i.e., temperature value above a certain threshold) has been developed. The openPowerlink stack is executed even on the laptop acting as CN node in the Powerlink network. Regarding the BLE sensors, no software customizations have been developed, and the official TI code released with the devices have been used, thus focusing all development efforts on the AMBER application in charge of reading data from these sensors. Since the Powerlink stack runs as a microprocessor application, the LAN Extender is completely agnostic to the enhanced protocol mechanisms and it can be successfully used to support other real-time Ethernet field buses such as EtherCAT and Profinet.
Although in the described use case BLE sensors have been considered, thanks to the AMBER modularity and flexibility features, the envisioned IIoT system can be easily extended. In the industrial environment, a common standard used in wireless communications is the IEEE802.15.4. Such a standard is at the basis of WirelessHART [37] and 6LoWPAN-based [26] industrial monitoring solutions. To support IEEE802.15.4 based communications, while enhancing the monitoring part of the system, an additional extender can be plugged into available slots. The IEEE802.15.4 Extender reported in Fig. 6 leverages on AMBER modularity and flexibility by using an additional socket in which necessaries communication buses have been connected to support the selected transceiver.
Since additional IIoT interfaces and managing processes require additional computational resources, more powerful SOMs can be used, thus enabling scalability features in the proposed solution. For instance, the presented AMBER configuration targeted to IIoT scenarios can be upgraded by using a quad core SOM, the Variscite VAR-SOM-MX6. Moreover, thanks to the AMBER modularity, higher scalability levels can be reached by considering Extenders embedding additional microprocessors or microcontrollers, thus exploiting hardware and software Asymmetric Multi-Processor (AMP) solutions [38].
4.3 Performance evaluation
Since the whole system has been targeted to a monitoring and control IIoT use case in which a thermal criticality triggers an actuation event, a key parameter to evaluate is the actuation time delay. This key performance parameter, evaluated as the time from which the temperature data request is sent until the actuation is performed, is a global indication of the system responsiveness. To measure the actuation time delay, all the components of the system (i.e., AMBER and the laptop emulating the actuator) have been synchronized by means of an external NTP (Network Time Protocol) server. Moreover, the Powerlink network has been configured with a cycle time of 100 ms (isochronous plus asynchronous phases). More than 1000 experiments have been executed, and all results are summarized by the histogram reported in Fig. 7. The reported actuation time delay includes the time to perform the temperature request to a particular sensor, the time to compare such a value with a priori imposed threshold, and the time in which the actuation notification reaches the laptop emulating the actuator node of the Powerlink network. In a real application, an additional delay due to the actuator response time must be considered. For instance, considering electromechanical actuators characterized by response times less than 12 ms [39], such a value can be added to results in Fig. 7 to perform a worst case analysis of the system.
The actuation time delay distribution presents a Gaussian shape with a mean value close to 235 ms. A worst case analysis of the reported results shows that the highest delay is lower than 268 ms. Such a value proves the high degree of responsiveness of the system, as well as the likely choice of using AMBER as IIoT gateway solution. It must be stressed again that despite the fact that the presented system has been developed for laboratory experimentation, the developed LAN Extender module and all the software can be easily reused to enable a fast prototype of a powerful and integrated industrial solution.
