research
∙
05/24/2023
Bi-Drop: Generalizable Fine-tuning for Pre-trained Language Models via Adaptive Subnetwork Optimization
Pretrained language models have achieved remarkable success in a variety...
share
research
∙
12/31/2022
A Survey for In-context Learning
With the increasing ability of large language models (LLMs), in-context ...
research
∙
12/20/2022
Why Can GPT Learn In-Context? Language Models Secretly Perform Gradient Descent as Meta-Optimizers
Large pretrained language models have shown surprising In-Context Learni...
research
∙
04/18/2021
Knowledge Neurons in Pretrained Transformers
Large-scale pretrained language models are surprisingly good at recallin...
research
∙
09/13/2018
LiveBot: Generating Live Video Comments Based on Visual and Textual Contexts
We introduce the task of automatic live commenting. Live commenting, whi...
research
∙
08/13/2018
