A PhD Student's Perspective on Research in NLP in the Era of Very Large Language Models

05/21/2023
by   Oana Ignat, et al.
6

Recent progress in large language models has enabled the deployment of many generative NLP applications. At the same time, it has also led to a misleading public discourse that “it's all been solved.” Not surprisingly, this has in turn made many NLP researchers – especially those at the beginning of their career – wonder about what NLP research area they should focus on. This document is a compilation of NLP research directions that are rich for exploration, reflecting the views of a diverse group of PhD students in an academic research lab. While we identify many research areas, many others exist; we do not cover those areas that are currently addressed by LLMs but where LLMs lag behind in performance, or those focused on LLM development. We welcome suggestions for other research directions to include: https://bit.ly/nlp-era-llm

READ FULL TEXT

page 1

page 2

page 3

page 4

research
08/14/2023

Mind your Language (Model): Fact-Checking LLMs and their Role in NLP Research and Practice

Much of the recent discourse within the NLP research community has been ...
research
04/03/2023

A Bibliometric Review of Large Language Models Research from 2017 to 2023

Large language models (LLMs) are a class of language models that have de...
research
09/19/2023

A Family of Pretrained Transformer Language Models for Russian

Nowadays, Transformer language models (LMs) represent a fundamental comp...
research
05/29/2023

The Utility of Large Language Models and Generative AI for Education Research

The use of natural language processing (NLP) techniques in engineering e...
research
06/16/2022

Methods for Estimating and Improving Robustness of Language Models

Despite their outstanding performance, large language models (LLMs) suff...
research
05/03/2021

Teaching NLP outside Linguistics and Computer Science classrooms: Some challenges and some opportunities

NLP's sphere of influence went much beyond computer science research and...
research
06/24/2023

On the Uses of Large Language Models to Interpret Ambiguous Cyberattack Descriptions

The volume, variety, and velocity of change in vulnerabilities and explo...

Please sign up or login with your details

Forgot password? Click here to reset