research
∙
09/18/2023
MindAgent: Emergent Gaming Interaction
Large Language Models (LLMs) have the capacity of performing complex sch...
share
research
∙
09/14/2023
MMICL: Empowering Vision-language Model with Multi-Modal In-Context Learning
Starting from the resurgence of deep learning, vision-language models (V...
research
∙
08/08/2023
3D-VisTA: Pre-trained Transformer for 3D Vision and Text Alignment
3D vision-language grounding (3D-VL) is an emerging field that aims to c...
research
∙
02/03/2023
Describe, Explain, Plan and Select: Interactive Planning with Large Language Models Enables Open-World Multi-Task Agents
In this paper, we study the problem of planning in Minecraft, a popular,...
research
∙
01/21/2023
Open-World Multi-Task Control Through Goal-Aware Representation Learning and Adaptive Horizon Prediction
We study the problem of learning goal-conditioned policies in Minecraft,...
research
∙
11/28/2022
Perceive, Ground, Reason, and Act: A Benchmark for General-purpose Visual Representation
Current computer vision models, unlike the human visual system, cannot y...
research
∙
10/14/2022
SQA3D: Situated Question Answering in 3D Scenes
We propose a new task to benchmark scene understanding of embodied agent...
research
∙
06/30/2022
Continuous-Time and Multi-Level Graph Representation Learning for Origin-Destination Demand Prediction
Traffic demand forecasting by deep neural networks has attracted widespr...
research
∙
05/27/2022
Bongard-HOI: Benchmarking Few-Shot Visual Reasoning for Human-Object Interactions
A significant gap remains between today's visual pattern recognition mod...
research
∙
04/24/2022
RelViT: Concept-guided Vision Transformer for Visual Relational Reasoning
Reasoning about visual relationships is central to how humans interpret ...
research
∙
06/10/2021
Adversarial Option-Aware Hierarchical Imitation Learning
It has been a challenge to learning skills for an agent from long-horizo...
research
∙
03/11/2020
A Mobile Robot Hand-Arm Teleoperation System by Vision and IMU
In this paper, we present a multimodal mobile teleoperation system that ...
research
∙
02/29/2020
Robust Robotic Pouring using Audition and Haptics
Robust and accurate estimation of liquid height lies as an essential par...
research
∙
11/25/2019
Theory-based Causal Transfer: Integrating Instance-level Induction and Abstract-level Structure Learning
Learning transferable knowledge across similar but different settings is...
research
∙
11/16/2019
Reinforcement Learning from Imperfect Demonstrations under Soft Expert Guidance
In this paper, we study Reinforcement Learning from Demonstrations (RLfD...
research
∙
10/10/2019
Imitation Learning from Observations by Minimizing Inverse Dynamics Disagreement
This paper studies Learning from Observations (LfO) for imitation learni...
research
∙
03/02/2019
Making Sense of Audio Vibration for Liquid Height Estimation in Robotic Pouring
In this paper, we focus on the challenging perception problem in robotic...
research
∙
09/17/2018
Vision-based Teleoperation of Shadow Dexterous Hand using End-to-End Deep Neural Network
In this paper, we present TeachNet, a novel neural network architecture ...
research
∙
09/17/2018
PointNetGPD: Detecting Grasp Configurations from Point Sets
In this paper, we propose an end-to-end grasp evaluation model to addres...
research
∙
05/18/2018
Learning and Inference Movement with Deep Generative Model
Learning and inference movement is a very challenging problem due to its...
research
∙
05/12/2018