research
∙
06/12/2023
Gradient Ascent Post-training Enhances Language Model Generalization
In this work, we empirically show that updating pretrained LMs (350M, 1....
share
research
∙
05/27/2023
Continually Updating Generative Retrieval on Dynamic Corpora
Generative retrieval has recently been gaining a lot of attention from t...
research
∙
05/24/2023
Improving Probability-based Prompt Selection Through Unified Evaluation and Analysis
Large Language Models (LLMs) have demonstrated great capabilities in sol...
research
∙
05/23/2023
The CoT Collection: Improving Zero-shot and Few-shot Learning of Language Models via Chain-of-Thought Fine-Tuning
Large Language Models (LLMs) have shown enhanced capabilities of solving...
research
∙
02/07/2023
Exploring the Benefits of Training Expert Language Models over Instruction Tuning
Recently, Language Models (LMs) instruction-tuned on multiple tasks, als...
research
∙
10/06/2022
Retrieval of Soft Prompt Enhances Zero-Shot Task Generalization
During zero-shot inference with language models (LMs), using hard prompt...
research
∙
10/06/2022
Guess the Instruction! Flipped Learning Makes Language Models Stronger Zero-Shot Learners
Meta-training, which fine-tunes the language model (LM) on various downs...
research
∙
10/04/2022
Knowledge Unlearning for Mitigating Privacy Risks in Language Models
Pretrained Language Models (LMs) memorize a vast amount of knowledge dur...
research
∙
09/26/2022
Can Large Language Models Truly Understand Prompts? A Case Study with Negated Prompts
Previous work has shown that there exists a scaling law between the size...
research
∙
04/29/2022
TemporalWiki: A Lifelong Benchmark for Training and Evaluating Ever-Evolving Language Models
Language Models (LMs) become outdated as the world changes; they often f...
research
∙
01/11/2022
Music2Video: Automatic Generation of Music Video with fusion of audio and text
Creation of images using generative adversarial networks has been widely...
research
∙
10/07/2021
Towards Continual Knowledge Learning of Language Models
Large Language Models (LMs) are known to encode world knowledge in their...
research
∙
11/20/2020
