research
∙
02/28/2023
BrainBERT: Self-supervised representation learning for intracranial recordings
We create a reusable Transformer, BrainBERT, for intracranial recordings...
share
research
∙
11/23/2022
Human or Machine? Turing Tests for Vision and Language
As AI algorithms increasingly participate in daily activities that used ...
research
∙
10/05/2022
Query The Agent: Improving sample efficiency through epistemic uncertainty estimation
Curricula for goal-conditioned reinforcement learning agents typically r...
research
∙
07/14/2022
Developing a Series of AI Challenges for the United States Department of the Air Force
Through a series of federal initiatives and orders, the U.S. Government ...
research
∙
12/14/2021
On the use of Cortical Magnification and Saccades as Biological Proxies for Data Augmentation
Self-supervised learning is a powerful way to learn useful representatio...
research
∙
10/19/2021
Incorporating Rich Social Interactions Into MDPs
Much of what we do as humans is engage socially with other agents, a ski...
research
∙
10/19/2021
Trajectory Prediction with Linguistic Representations
Language allows humans to build mental models that interpret what is hap...
research
∙
10/14/2021
Spoken ObjectNet: A Bias-Controlled Spoken Caption Dataset
Visually-grounded spoken language datasets can enable models to learn cr...
research
∙
03/02/2021
PHASE: PHysically-grounded Abstract Social Events for Machine Social Perception
The ability to perceive and reason about social interactions in the cont...
research
∙
08/07/2020
Learning a natural-language to LTL executable semantic parser for grounded robotics
Children acquire their native language with apparent ease by observing h...
research
∙
08/06/2020
Compositional Networks Enable Systematic Generalization for Grounded Language Understanding
Humans are remarkably flexible when understanding new sentences that inc...
research
∙
06/01/2020
Encoding formulas as deep networks: Reinforcement learning for zero-shot execution of LTL formulas
We demonstrate a reinforcement learning agent which uses a compositional...
research
∙
02/20/2020
Measuring Social Biases in Grounded Vision and Language Embeddings
We generalize the notion of social biases from language embeddings to gr...
research
∙
02/12/2020
Deep compositional robotic planners that follow natural language commands
We demonstrate how a sampling-based robotic planner can be augmented to ...
research
∙
11/16/2018
Temporal Grounding Graphs for Language Understanding with Accrued Visual-Linguistic Context
A robot's ability to understand or ground natural language instructions ...
research
∙
10/01/2018
Deep sequential models for sampling-based planning
We demonstrate how a sequence model and a sampling-based planner can inf...
research
∙
05/15/2016
Anchoring and Agreement in Syntactic Annotations
We present a study on two key characteristics of human syntactic annotat...
research
∙
03/26/2016
Do You See What I Mean? Visual Resolution of Linguistic Ambiguities
Understanding language goes hand in hand with the ability to integrate c...
research
∙
09/20/2013
Saying What You're Looking For: Linguistics Meets Video Search
We present an approach to searching large video corpora for video clips ...
research
∙
08/19/2013
Seeing What You're Told: Sentence-Guided Activity Recognition In Video
We present a system that demonstrates how the compositional structure of...
research
∙
04/16/2012
Large-Scale Automatic Labeling of Video Events with Verbs Based on Event-Participant Interaction
We present an approach to labeling short video clips with English verbs ...
research
∙
04/12/2012
Seeing Unseeability to See the Unseeable
We present a framework that allows an observer to determine occluded por...
research
∙
04/12/2012
Video In Sentences Out
We present a system that produces sentential descriptions of video: who ...
research
∙
04/12/2012