Qualitative Benchmarking of Deep Learning Hardware and Frameworks: Review and Tutorial

07/05/2019
by   Wei Dai, et al.
0

Previous survey papers offer knowledge of deep learning hardware devices and software frameworks. This paper introduces benchmarking principles, surveys machine learning devices including GPUs, FPGAs, and ASICs, and reviews deep learning software frameworks. It also reviews these technologies with respect to benchmarking from the angles of our 7-metric approach to frameworks and 12-metric approach to hardware platforms. After reading the paper, the audience will understand seven benchmarking principles, generally know that differential characteristics of mainstream AI devices, qualitatively compare deep learning hardware through our 12-metric approach for benchmarking hardware, and read benchmarking results of 16 deep learning frameworks via our 7-metric set for benchmarking frameworks.

READ FULL TEXT

page 1

page 4

research
07/05/2019

Benchmarking Deep Learning Hardware and Frameworks: Qualitative Metrics

Previous survey papers offer knowledge of deep learning hardware devices...
research
07/05/2019

Benchmarking Contemporary Deep Learning Hardware and Frameworks:A Survey of Qualitative Metrics

This paper surveys benchmarking principles, machine learning devices inc...
research
06/15/2023

MLonMCU: TinyML Benchmarking with Fast Retargeting

While there exist many ways to deploy machine learning models on microco...
research
10/23/2017

BENCHIP: Benchmarking Intelligence Processors

The increasing attention on deep learning has tremendously spurred the d...
research
07/04/2020

Building benchmarking frameworks for supporting replicability and reproducibility: spatial and textual analysis as an example

Replicability and reproducibility (R R) are critical for the long-term...
research
01/29/2019

A Modular Benchmarking Infrastructure for High-Performance and Reproducible Deep Learning

We introduce Deep500: the first customizable benchmarking infrastructure...
research
08/09/2016

LITMUS: An Open Extensible Framework for Benchmarking RDF Data Management Solutions

Developments in the context of Open, Big, and Linked Data have led to an...

Please sign up or login with your details

Forgot password? Click here to reset