b'Honglak Lee'

research

∙ 09/19/2023

Guide Your Agent with Adaptive Multimodal Rewards

Developing an agent capable of adapting to unseen environments remains a...

0 Changyeon Kim, et al. ∙

research

∙ 09/08/2023

Curve Your Attention: Mixed-Curvature Transformers for Graph Representation Learning

Real-world graphs naturally exhibit hierarchical or cyclical structures ...

0 Sungjun Cho, et al. ∙

research

∙ 09/08/2023

3D Denoisers are Good 2D Teachers: Molecular Pretraining via Denoising and Cross-Modal Distillation

Pretraining molecular representations from large unlabeled data is essen...

0 Sungjun Cho, et al. ∙

research

∙ 09/05/2023

NICE 2023 Zero-shot Image Captioning Challenge

In this report, we introduce NICE project[<https://nice.lgresearch.ai/>]...

0 Taehoon Kim, et al. ∙

research

∙ 08/25/2023

Go Beyond Imagination: Maximizing Episodic Reachability with World Models

Efficient exploration is a challenging topic in reinforcement learning, ...

0 Yao Fu, et al. ∙

research

∙ 08/17/2023

Exploring Demonstration Ensembling for In-context Learning

In-context learning (ICL) operates by showing language models (LMs) exam...

0 Muhammad Khalifa, et al. ∙

research

∙ 06/12/2023

Scalable 3D Captioning with Pretrained Models

We introduce Cap3D, an automatic approach for generating descriptive tex...

0 Tiange Luo, et al. ∙

research

∙ 05/31/2023

Fine-grained Text Style Transfer with Diffusion-Based Language Models

Diffusion probabilistic models have shown great success in generating hi...

3 Yiwei Lyu, et al. ∙

research

∙ 05/24/2023

Discriminator-Guided Multi-step Reasoning with Language Models

In the context of multi-step reasoning, language models (LMs) probabilit...

0 Muhammad Khalifa, et al. ∙

research

∙ 03/23/2023

Artificial-intelligence-based molecular classification of diffuse gliomas using rapid, label-free optical imaging

Molecular classification has transformed the management of brain tumors ...

3 Todd C. Hollon, et al. ∙

research

∙ 03/16/2023

A Picture is Worth a Thousand Words: Language Models Plan from Pixels

Planning is an important capability of artificial agents that perform lo...

0 Anthony Z. Liu, et al. ∙

research

∙ 03/14/2023

Lightweight feature encoder for wake-up word detection based on self-supervised speech representation

Self-supervised learning method that provides generalized speech represe...

0 Hyungjun Lim, et al. ∙

research

∙ 03/02/2023

Hierarchical discriminative learning improves visual representations of biomedical microscopy

Learning high-quality, self-supervised, visual representations is essent...

13 Cheng Jiang, et al. ∙

research

∙ 03/02/2023

Preference Transformer: Modeling Human Preferences using Transformers for RL

Preference-based reinforcement learning (RL) provides a framework to tra...

0 Changyeon Kim, et al. ∙

research

∙ 02/17/2023

Unsupervised Task Graph Generation from Instructional Video Transcripts

This work explores the problem of generating task graphs of real-world a...

0 Lajanugen Logeswaran, et al. ∙

research

∙ 02/17/2023

Multimodal Subtask Graph Generation from Instructional Videos

Real-world tasks consist of multiple inter-dependent subtasks (e.g., a d...

0 Yunseok Jang, et al. ∙

research

∙ 01/28/2023

Composing Task Knowledge with Modular Successor Feature Approximators

Recently, the Successor Features and Generalized Policy Improvement (SF ...

0 Wilka Carvalho, et al. ∙

research

∙ 01/27/2023

Learning to Unlearn: Instance-wise Unlearning for Pre-trained Classifiers

Since the recent advent of regulations for data protection (e.g., the Ge...

0 Sungmin Cha, et al. ∙

research

∙ 01/07/2023

Transferring Pre-trained Multimodal Representations with Cross-modal Similarity Matching

Despite surprising performance on zero-shot transfer, pre-training a lar...

0 Byoungjip Kim, et al. ∙

research

∙ 12/25/2022

Neural Shape Compiler: A Unified Framework for Transforming between Text, Point Cloud, and Program

3D shapes have complementary abstractions from low-level geometry to par...

7 Tiange Luo, et al. ∙

research

∙ 12/14/2022

Significantly improving zero-shot X-ray pathology classification via fine-tuning pre-trained image-text encoders

Deep neural networks have been successfully adopted to diverse domains i...

0 Jongseong Jang, et al. ∙

research

∙ 10/27/2022

Transformers meet Stochastic Block Models: Attention with Data-Adaptive Sparsity and Cost

To overcome the quadratic cost of self-attention, recent works have prop...

0 Sungjun Cho, et al. ∙

research

∙ 09/27/2022

UniCLIP: Unified Framework for Contrastive Language-Image Pre-training

Pre-training vision-language models with contrastive objectives has show...

3 Janghyeon Lee, et al. ∙

research

∙ 09/07/2022

Grouping-matrix based Graph Pooling with Adaptive Number of Clusters

Graph pooling is a crucial operation for encoding hierarchical structure...

5 Sung Moon Ko, et al. ∙

research

∙ 07/19/2022

Learning Action Translator for Meta Reinforcement Learning on Sparse-Reward Tasks

Meta reinforcement learning (meta-RL) aims to learn a policy solving a s...

7 Yijie Guo, et al. ∙

research

∙ 07/06/2022

Pure Transformers are Powerful Graph Learners

We show that standard Transformers without graph-specific modifications ...

0 Jinwoo Kim, et al. ∙

research

∙ 06/16/2022

OpenSRH: optimizing brain tumor surgery using intraoperative stimulated Raman histology

Accurate intraoperative diagnosis is essential for providing safe and ef...

36 Cheng Jiang, et al. ∙

research

∙ 06/16/2022

Is Continual Learning Truly Learning Representations Continually?

Continual learning (CL) aims to learn from sequentially arriving tasks w...

62 Sungmin Cha, et al. ∙

research

∙ 05/28/2022

Few-shot Subgoal Planning with Language Models

Pre-trained large language models have shown successful progress in many...

4 Lajanugen Logeswaran, et al. ∙

research

∙ 05/25/2022

LEPUS: Prompt-based Unsupervised Multi-hop Reranking for Open-domain QA

We study unsupervised multi-hop reranking for multi-hop QA (MQA) with op...

0 Muhammad Khalifa, et al. ∙

research

∙ 05/25/2022

Fast Inference and Transfer of Compositional Task Structures for Few-shot Task Generalization

We tackle real-world problems with complex structures beyond the pixel-b...

1 Sungryull Sohn, et al. ∙

research

∙ 05/14/2022

RiCS: A 2D Self-Occlusion Map for Harmonizing Volumetric Objects

There have been remarkable successes in computer vision with deep learni...

7 Yunseok Jang, et al. ∙

research

∙ 04/06/2022

Simple and Effective Synthesis of Indoor 3D Scenes

We study the problem of synthesizing immersive 3D indoor scenes from one...

5 Jing Yu Koh, et al. ∙

research

∙ 03/28/2022

Learning Parameterized Task Structure for Generalization to Unseen Entities

Real world tasks are hierarchical and compositional. Tasks can be compos...

6 Anthony Z. Liu, et al. ∙

research

∙ 03/18/2022

SURF: Semi-supervised Reward Learning with Data Augmentation for Feedback-efficient Preference-based Reinforcement Learning

Preference-based reinforcement learning (RL) has shown potential for tea...

8 Jongjin Park, et al. ∙

research

∙ 03/15/2022

Rich CNN-Transformer Feature Aggregation Networks for Super-Resolution

Recent vision transformers along with self-attention have achieved promi...

19 Jinsu Yoo, et al. ∙

research

∙ 02/02/2022

Lipschitz-constrained Unsupervised Skill Discovery

We study the problem of unsupervised skill discovery, whose goal is to l...

6 Seohong Park, et al. ∙

research

∙ 01/21/2022

Environment Generation for Zero-Shot Compositional Reinforcement Learning

Many real-world problems are compositional - solving them requires compl...

2 Izzeddin Gür, et al. ∙

research

∙ 11/22/2021

L-Verse: Bidirectional Generation Between Image and Text

Far beyond learning long-range interactions of natural language, transfo...

7 Taehoon Kim, et al. ∙

research

∙ 11/18/2021

Successor Feature Landmarks for Long-Horizon Goal-Conditioned Reinforcement Learning

Operating in the real-world often requires agents to learn about a compl...

8 Christopher Hoang, et al. ∙

research

∙ 11/18/2021

Improving Transferability of Representations via Augmentation-Aware Self-Supervision

Recent unsupervised representation learning methods have shown to be eff...

9 Hankook Lee, et al. ∙

research

∙ 08/08/2021

Contrastive Representation Learning for Rapid Intraoperative Diagnosis of Skull Base Tumors Imaged Using Stimulated Raman Histology

Background: Accurate diagnosis of skull base tumors is essential for pro...

11 Cheng Jiang, et al. ∙

research

∙ 07/13/2021

Shortest-Path Constrained Reinforcement Learning for Sparse Reward Tasks

We propose the k-Shortest-Path (k-SP) constraint: a novel constraint on ...

10 Sungryull Sohn, et al. ∙

research

∙ 06/02/2021

Variational Empowerment as Representation Learning for Goal-Based Reinforcement Learning

Learning to reach goal states and learning diverse skills through mutual...

9 Jongwook Choi, et al. ∙

research

∙ 05/18/2021

Pathdreamer: A World Model for Indoor Navigation

People navigating in unfamiliar buildings take advantage of myriad visua...

12 Jing Yu Koh, et al. ∙

research

∙ 04/14/2021

Revisiting Hierarchical Approach for Persistent Long-Term Video Prediction

Learning to predict the long-term future of video frames is notoriously ...

1 Wonkwang Lee, et al. ∙

research

∙ 03/02/2021

Adversarial Environment Generation for Learning to Navigate the Web

Learning to autonomously navigate the web is a difficult sequential deci...

14 Izzeddin Gür, et al. ∙

research

∙ 02/18/2021

State Entropy Maximization with Random Encoders for Efficient Exploration

Recent exploration methods have proven to be a recipe for improving samp...

13 Younggyo Seo, et al. ∙

research

∙ 01/12/2021

Cross-Modal Contrastive Learning for Text-to-Image Generation

The output of text-to-image synthesis systems should be coherent, clear,...

16 Han Zhang, et al. ∙

research

∙ 01/08/2021

Evolving Reinforcement Learning Algorithms

We propose a method for meta-learning reinforcement learning algorithms ...

28 John D. Co-Reyes, et al. ∙

Honglak Lee

Featured Co-authors