A PhD Student's Perspective on Research in NLP in the Era of Very Large Language Models

by   Oana Ignat, et al.
University of Michigan

Recent progress in large language models has enabled the deployment of many generative NLP applications. At the same time, it has also led to a misleading public discourse that “it's all been solved.” Not surprisingly, this has in turn made many NLP researchers – especially those at the beginning of their career – wonder about what NLP research area they should focus on. This document is a compilation of NLP research directions that are rich for exploration, reflecting the views of a diverse group of PhD students in an academic research lab. While we identify many research areas, many others exist; we do not cover those areas that are currently addressed by LLMs but where LLMs lag behind in performance, or those focused on LLM development. We welcome suggestions for other research directions to include: https://bit.ly/nlp-era-llm


page 1

page 2

page 3

page 4


Mind your Language (Model): Fact-Checking LLMs and their Role in NLP Research and Practice

Much of the recent discourse within the NLP research community has been ...

A Bibliometric Review of Large Language Models Research from 2017 to 2023

Large language models (LLMs) are a class of language models that have de...

A Family of Pretrained Transformer Language Models for Russian

Nowadays, Transformer language models (LMs) represent a fundamental comp...

The Utility of Large Language Models and Generative AI for Education Research

The use of natural language processing (NLP) techniques in engineering e...

Methods for Estimating and Improving Robustness of Language Models

Despite their outstanding performance, large language models (LLMs) suff...

Teaching NLP outside Linguistics and Computer Science classrooms: Some challenges and some opportunities

NLP's sphere of influence went much beyond computer science research and...

On the Uses of Large Language Models to Interpret Ambiguous Cyberattack Descriptions

The volume, variety, and velocity of change in vulnerabilities and explo...

Please sign up or login with your details

Forgot password? Click here to reset