FieldHAR: A Fully Integrated End-to-end RTL Framework for Human Activity Recognition with Neural Networks from Heterogeneous Sensors

by   Mengxi Liu, et al.

In this work, we propose an open-source scalable end-to-end RTL framework FieldHAR, for complex human activity recognition (HAR) from heterogeneous sensors using artificial neural networks (ANN) optimized for FPGA or ASIC integration. FieldHAR aims to address the lack of apparatus to transform complex HAR methodologies often limited to offline evaluation to efficient run-time edge applications. The framework uses parallel sensor interfaces and integer-based multi-branch convolutional neural networks (CNNs) to support flexible modality extensions with synchronous sampling at the maximum rate of each sensor. To validate the framework, we used a sensor-rich kitchen scenario HAR application which was demonstrated in a previous offline study. Through resource-aware optimizations, with FieldHAR the entire RTL solution was created from data acquisition to ANN inference taking as low as 25% logic elements and 2% memory bits of a low-end Cyclone IV FPGA and less than 1% accuracy loss from the original FP32 precision offline study. The RTL implementation also shows advantages over MCU-based solutions, including superior data acquisition performance and virtually eliminating ANN inference bottleneck.


page 1

page 3


Human Activity Recognition on Time Series Accelerometer Sensor Data using LSTM Recurrent Neural Networks

The use of sensors available through smart devices has pervaded everyday...

SparseSense: Human Activity Recognition from Highly Sparse Sensor Data-streams Using Set-based Neural Networks

Batteryless or so called passive wearables are providing new and innovat...

A Hybrid Approach combining ANN-based and Conventional Demapping in Communication for Efficient FPGA-Implementation

In communication systems, Autoencoder (AE) refers to the concept of repl...

RapidHARe: A computationally inexpensive method for real-time human activity recognition from wearable sensors

Recent human activity recognition (HAR) methods, based on on-body inerti...

DFTerNet: Towards 2-bit Dynamic Fusion Networks for Accurate Human Activity Recognition

Deep Convolutional Neural Networks (DCNNs) are currently popular in huma...

Data Fusion on Motion and Magnetic Sensors embedded on Mobile Devices for the Identification of Activities of Daily Living

Several types of sensors have been available in off-the-shelf mobile dev...

Please sign up or login with your details

Forgot password? Click here to reset