Mittens: An Extension of GloVe for Learning Domain-Specialized Representations

03/27/2018
by   Nicholas Dingwall, et al.
0

We present a simple extension of the GloVe representation learning model that begins with general-purpose representations and updates them based on data from a specialized domain. We show that the resulting representations can lead to faster learning and better results on a variety of tasks.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
05/23/2023

Masked Modeling Duo for Speech: Specializing General-Purpose Audio Representation to Speech using Denoising Distillation

Self-supervised learning general-purpose audio representations have demo...
research
09/29/2022

Towards General-Purpose Representation Learning of Polygonal Geometries

Neural network representation learning for spatial data is a common need...
research
01/22/2020

Representation Learning for Medical Data

We propose a representation learning framework for medical diagnosis dom...
research
02/21/2017

Systèmes du LIA à DEFT'13

The 2013 Défi de Fouille de Textes (DEFT) campaign is interested in two ...
research
12/01/2022

A General Purpose Supervisory Signal for Embodied Agents

Training effective embodied AI agents often involves manual reward engin...
research
10/31/2022

Disentangled (Un)Controllable Features

In the context of MDPs with high-dimensional states, reinforcement learn...
research
11/19/2019

Representation Learning with Multisets

We study the problem of learning permutation invariant representations t...

Please sign up or login with your details

Forgot password? Click here to reset