research
∙
08/25/2019
Theoretical Issues in Deep Networks: Approximation, Optimization and Generalization
While deep learning is successful in a number of applications, it is not...
share
research
∙
03/12/2019
Theory III: Dynamics and Generalization in Deep Networks
We review recent observations on the dynamical systems induced by gradie...
research
∙
11/08/2018
Biologically-plausible learning algorithms can scale to large datasets
The backpropagation (BP) algorithm is often thought to be biologically i...
research
∙
07/25/2018
A Surprising Linear Relationship Predicts Test Performance in Deep Networks
Given two networks with the same training loss on a dataset, when would ...
research
∙
06/29/2018
Theory IIIb: Generalization in Deep Networks
A main puzzle of deep neural networks (DNNs) revolves around the apparen...
research
∙
06/12/2018
Approximate inference with Wasserstein gradient flows
We present a novel approximate inference method for diffusion processes,...
research
∙
02/17/2018
An analysis of training and generalization errors in shallow and deep networks
An open problem around deep networks is the apparent absence of over-fit...
research
∙
01/07/2018
Theory of Deep Learning IIb: Optimization Properties of SGD
In Theory IIb we characterize with a mix of theory and experiments the o...
research
∙
12/30/2017
Theory of Deep Learning III: explaining the non-overfitting puzzle
A main puzzle of deep networks revolves around the absence of overfittin...
research
∙
11/05/2017
Fisher-Rao Metric, Geometry, and Complexity of Neural Networks
We study the relationship between geometry and capacity measures for dee...
research
∙
07/18/2017
Pruning Convolutional Neural Networks for Image Instance Retrieval
In this work, we focus on the problem of image instance retrieval with d...
research
∙
06/26/2017
Do Deep Neural Networks Suffer from Crowding?
Crowding is a visual effect suffered by humans, in which an object that ...
research
∙
03/28/2017
Theory II: Landscape of the Empirical Risk in Deep Learning
Previous theoretical work on deep learning and neural network optimizati...
research
∙
01/18/2017
Compression of Deep Neural Networks for Image Instance Retrieval
Image instance retrieval is the problem of retrieving images from a data...
research
∙
10/19/2016
Streaming Normalization: Towards Simpler and More Biologically-plausible Normalizations for Online and Recurrent Learning
We systematically explored a spectrum of normalization algorithms relate...
research
∙
06/05/2016
View-tolerant face recognition and Hebbian learning imply mirror-symmetric neural tuning to head orientation
The primate brain contains a hierarchy of visual areas, dubbed the ventr...
research
∙
04/13/2016
Bridging the Gaps Between Residual Learning, Recurrent Neural Networks and Visual Cortex
We discuss relations between Residual Networks (ResNet), Recurrent Neura...
research
∙
03/15/2016
Nested Invariance Pooling and RBM Hashing for Image Instance Retrieval
The goal of this work is the computation of very compact binary hashes f...
research
∙
01/09/2016
Group Invariant Deep Representations for Image Instance Retrieval
Most image instance retrieval pipelines are based on comparison of vecto...
research
∙
10/16/2015
Holographic Embeddings of Knowledge Graphs
Learning embeddings of entities and relations is an efficient and versat...
research
∙
08/05/2015
Deep Convolutional Networks are Hierarchical Kernel Machines
In i-theory a typical layer of a hierarchical architecture consists of H...
research
∙
06/17/2015
Learning with a Wasserstein Loss
Learning to predict multi-label outputs is challenging, but in many prob...
research
∙
06/08/2015
Learning with Group Invariant Features: A Kernel Perspective
We analyze in this paper a random feature map based on a theory of invar...
research
∙
09/12/2014
Unsupervised learning of clutter-resistant visual representations from natural videos
Populations of neurons in inferotemporal cortex (IT) maintain an explici...
research
∙
06/15/2014
Neural tuning size is a key factor underlying holistic face processing
Faces are a class of visual stimuli with unique significance, for a vari...
research
∙
04/01/2014
A Deep Representation for Invariance And Music Classification
Representations in the auditory cortex might be based on mechanisms simi...
research
∙
11/17/2013
Unsupervised Learning of Invariant Representations in Hierarchical Architectures
The present phase of Machine Learning is characterized by supervised lea...
research
∙
11/16/2013
Can a biologically-plausible hierarchy effectively replace face detection, alignment, and recognition pipelines?
The standard approach to unconstrained face recognition in natural photo...
research
∙
03/24/2013
On Learnability, Complexity and Stability
We consider the fundamental question of learnability of a hypotheses cla...
research
∙
09/06/2012
Multiclass Learning with Simplex Coding
In this paper we discuss a novel framework for multiclass learning, defi...
research
∙
09/05/2012