Query Time Optimized Deep Learning Based Video Inference System

12/13/2022
by   Mingren Shen, et al.
0

This is a project report about how we tune Focus[1], a video inference system that provides low cost and low latency, through two phases. In this report, we will decrease the query time by saving the middle layer output of the neural network. This is a trade-off strategy that involves using more space to save time. We show how this scheme works using prototype systems, and it saves 20 of the time. The code repository URL is here, https://github.com/iphyer/CS744 FocousIngestOpt.

READ FULL TEXT

Please sign up or login with your details

Forgot password? Click here to reset