Symbol Emergence as an Interpersonal Multimodal Categorization

by   Yoshinobu Hagiwara, et al.

This study focuses on category formation for individual agents and the dynamics of symbol emergence in a multi-agent system through semiotic communication. Semiotic communication is defined, in this study, as the generation and interpretation of signs associated with the categories formed through the agent's own sensory experience or by exchange of signs with other agents. From the viewpoint of language evolution and symbol emergence, organization of a symbol system in a multi-agent system is considered as a bottom-up and dynamic process, where individual agents share the meaning of signs and categorize sensory experience. A constructive computational model can explain the mutual dependency of the two processes and has mathematical support that guarantees a symbol system's emergence and sharing within the multi-agent system. In this paper, we describe a new computational model that represents symbol emergence in a two-agent system based on a probabilistic generative model for multimodal categorization. It models semiotic communication via a probabilistic rejection based on the receiver's own belief. We have found that the dynamics by which cognitively independent agents create a symbol system through their semiotic communication can be regarded as the inference process of a hidden variable in an interpersonal multimodal categorizer, if we define the rejection probability based on the Metropolis-Hastings algorithm. The validity of the proposed model and algorithm for symbol emergence is also verified in an experiment with two agents observing daily objects in the real-world environment. The experimental results demonstrate that our model reproduces the phenomena of symbol emergence, which does not require a teacher who would know a pre-existing symbol system. Instead, the multi-agent system can form and use a symbol system without having pre-existing categories.


page 6

page 7

page 8

page 9

page 10

page 11

page 14

page 16


Multiagent Multimodal Categorization for Symbol Emergence: Emergent Communication via Interpersonal Cross-modal Inference

This paper describes a computational model of multiagent multimodal cate...

Emergent Communication through Metropolis-Hastings Naming Game with Deep Generative Models

Emergent communication, also known as symbol emergence, seeks to investi...

Recursive Metropolis-Hastings Naming Game: Symbol Emergence in a Multi-agent System based on Probabilistic Generative Models

In the studies on symbol emergence and emergent communication in a popul...

Context-dependent communication under environmental constraints

There is significant evidence that real-world communication cannot be re...

The Utility of Hedged Assertions in the Emergence of Shared Categorical Labels

We investigate the emergence of shared concepts in a community of langua...

Symbol Emergence as Inter-personal Categorization with Head-to-head Latent Word

In this study, we propose a head-to-head type (H2H-type) inter-personal ...

Symbol Emergence in Cognitive Developmental Systems: a Survey

Symbol emergence through a robot's own interactive exploration of the wo...

Please sign up or login with your details

Forgot password? Click here to reset