Human-like machine thinking: Language guided imagination

by   Feng Qi, et al.

Human thinking requires the brain to understand the meaning of language expression and to properly organize the thoughts flow using the language. However, current natural language processing models are primarily limited in the word probability estimation. Here, we proposed a Language guided imagination (LGI) network to incrementally learn the meaning and usage of numerous words and syntaxes, aiming to form a human-like machine thinking process. LGI contains three subsystems: (1) vision system that contains an encoder to disentangle the input or imagined scenarios into abstract population representations, and an imagination decoder to reconstruct imagined scenario from higher level representations; (2) Language system, that contains a binarizer to transfer symbol texts into binary vectors, an IPS (mimicking the human IntraParietal Sulcus, implemented by an LSTM) to extract the quantity information from the input texts, and a textizer to convert binary vectors into text symbols; (3) a PFC (mimicking the human PreFrontal Cortex, implemented by an LSTM) to combine inputs of both language and vision representations, and predict text symbols and manipulated images accordingly. LGI has incrementally learned eight different syntaxes (or tasks), with which a machine thinking loop has been formed and validated by the proper interaction between language and vision system. The paper provides a new architecture to let the machine learn, understand and use language in a human-like way that could ultimately enable a machine to construct fictitious 'mental' scenario and possess intelligence.


page 4

page 5

page 6


Human-like general language processing

Using language makes human beings surpass animals in wisdom. To let mach...

Semantically-Aligned Equation Generation for Solving and Reasoning Math Word Problems

Solving math word problems is a challenging task that requires accurate ...

Evaluating Input Representation for Language Identification in Hindi-English Code Mixed Text

Natural language processing (NLP) techniques have become mainstream in t...

Human Abnormality Detection Based on Bengali Text

In the field of natural language processing and human-computer interacti...

Discrete and continuous representations and processing in deep learning: Looking forward

Discrete and continuous representations of content (e.g., of language or...

Analyzing machine-learned representations: A natural language case study

As modern deep networks become more complex, and get closer to human-lik...

Language guided machine action

Here we build a hierarchical modular network called Language guided mach...

Please sign up or login with your details

Forgot password? Click here to reset