Deep Neural Network based Human Activity Recognition for the Order Picking Process

Rene Grzeszick, Jan Marius Lenk, Fernando Moya Rueda, Sascha Feldhorst, Michael ten Hompel and Gernot A. Fink
Proc. Int. Workshop on Sensor-based Activity Recognition and Interaction (iWOAR), 2017, Winner of the iWOAR Best Paper Award.

Rostock, Germany

BibTeX PDF

Abstract

Although the fourth industrial revolution is already in progress and advances have been made in automating factories, completely automated facilities are still far in the future. Human work is still an important factor in many factories and warehouses, especially in the field of logistics. Manual processes are, therefore, often subject to optimization efforts. In order to aid these optimization efforts, methods like HAR became of increasing interest in industrial settings. In this work a novel deep neural network architecture for HAR is introduced. A CNN, which employs temporal convolutions, is applied to the sequential data of multiple IMU. The network is designed to separately handle different sensor values and IMU, joining the information step-by-step within the architecture. An evaluation is performed using data from the order picking process recorded in two different warehouses. The influence of different design choices in the network architecture, as well as pre- and post-processing, will be evaluated. Crucial steps for learning a good classification network for the task of HAR in a complex industrial setting will be shown. Ultimately, it can be shown that traditional approaches based on statistical features as well as recent CNN architectures are outperformed.