A Precis of Language Models are not Models of Language

05/16/2022
by   Csaba Veres, et al.
0

Natural Language Processing is one of the leading application areas in the current resurgence of Artificial Intelligence, spearheaded by Artificial Neural Networks. We show that despite their many successes at performing linguistic tasks, Large Neural Language Models are ill-suited as comprehensive models of natural language. The wider implication is that, in spite of the often overbearing optimism about AI, modern neural models do not represent a revolution in our understanding of cognition.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
01/16/2023

Deep Learning Models to Study Sentence Comprehension in the Human Brain

Recent artificial neural networks that process natural language achieve ...
research
12/13/2021

Language Models are not Models of Language

Natural Language Processing (NLP) has become one of the leading applicat...
research
07/26/2023

A Sentence is Worth a Thousand Pictures: Can Large Language Models Understand Human Language?

Artificial Intelligence applications show great potential for language-r...
research
03/30/2019

Linguistic generalization and compositionality in modern artificial neural networks

In the last decade, deep artificial neural networks have achieved astoun...
research
11/09/2022

What is Wrong with Language Models that Can Not Tell a Story?

This paper argues that a deeper understanding of narrative and the succe...
research
07/20/2022

Integrating Linguistic Theory and Neural Language Models

Transformer-based language models have recently achieved remarkable resu...

Please sign up or login with your details

Forgot password? Click here to reset