Leveraging Domain Knowledge using Machine Learning for Image Compression in Internet-of-Things

by   Prabuddha Chakraborty, et al.

The emergent ecosystems of intelligent edge devices in diverse Internet of Things (IoT) applications, from automatic surveillance to precision agriculture, increasingly rely on recording and processing variety of image data. Due to resource constraints, e.g., energy and communication bandwidth requirements, these applications require compressing the recorded images before transmission. For these applications, image compression commonly requires: (1) maintaining features for coarse-grain pattern recognition instead of the high-level details for human perception due to machine-to-machine communications; (2) high compression ratio that leads to improved energy and transmission efficiency; (3) large dynamic range of compression and an easy trade-off between compression factor and quality of reconstruction to accommodate a wide diversity of IoT applications as well as their time-varying energy/performance needs. To address these requirements, we propose, MAGIC, a novel machine learning (ML) guided image compression framework that judiciously sacrifices visual quality to achieve much higher compression when compared to traditional techniques, while maintaining accuracy for coarse-grained vision tasks. The central idea is to capture application-specific domain knowledge and efficiently utilize it in achieving high compression. We demonstrate that the MAGIC framework is configurable across a wide range of compression/quality and is capable of compressing beyond the standard quality factor limits of both JPEG 2000 and WebP. We perform experiments on representative IoT applications using two vision datasets and show up to 42.65x compression at similar accuracy with respect to the source. We highlight low variance in compression rate across images using our technique as compared to JPEG 2000 and WebP.


page 2

page 3

page 4

page 8

page 9

page 12


Energy-Efficient Model Compression and Splitting for Collaborative Inference Over Time-Varying Channels

Today's intelligent applications can achieve high performance accuracy u...

A Deep Learning Scheme for Efficient Multimedia IoT Data Compression

Given the voluminous nature of the multimedia sensed data, the Multimedi...

Optimizing IoT and Web Traffic Using Selective Edge Compression

Internet of Things (IoT) devices and applications are generating and com...

Identity Preserving Loss for Learned Image Compression

Deep learning model inference on embedded devices is challenging due to ...

Adapting JPEG XS gains and priorities to tasks and contents

Most current research in the domain of image compression focuses solely ...

Dynamic Compression Ratio Selection for Edge Inference Systems with Hard Deadlines

Implementing machine learning algorithms on Internet of things (IoT) dev...

GreedyGD: Enhanced Generalized Deduplication for Direct Analytics in IoT

Exponential growth in the amount of data generated by the Internet of Th...

Please sign up or login with your details

Forgot password? Click here to reset