Domain and Function: A Dual-Space Model of Semantic Relations and Compositions

09/16/2013
by   Peter D. Turney, et al.
0

Given appropriate representations of the semantic relations between carpenter and wood and between mason and stone (for example, vectors in a vector space model), a suitable algorithm should be able to recognize that these relations are highly similar (carpenter is to wood as mason is to stone; the relations are analogous). Likewise, with representations of dog, house, and kennel, an algorithm should be able to recognize that the semantic composition of dog and house, dog house, is highly similar to kennel (dog house and kennel are synonymous). It seems that these two tasks, recognizing relations and compositions, are closely connected. However, up to now, the best models for relations are significantly different from the best models for compositions. In this paper, we introduce a dual-space model that unifies these two tasks. This model matches the performance of the best previous models for relations and compositions. The dual-space model consists of a space for measuring domain similarity and a space for measuring function similarity. Carpenter and wood share the same domain, the domain of carpentry. Mason and stone share the same domain, the domain of masonry. Carpenter and mason share the same function, the function of artisans. Wood and stone share the same function, the function of materials. In the composition dog house, kennel has some domain overlap with both dog and house (the domains of pets and buildings). The function of kennel is similar to the function of house (the function of shelters). By combining domain and function similarities in various ways, we can model relations, compositions, and other aspects of semantics.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
05/22/2023

Sentence Representations via Gaussian Embedding

Recent progress in sentence embedding, which represents the meaning of a...
research
09/10/2018

Neural Latent Relational Analysis to Capture Lexical Semantic Relations in a Vector Space

Capturing the semantic relations of words in a vector space contributes ...
research
12/07/2014

Learning Word Representations from Relational Graphs

Attributes of words and relations between two words are central to numer...
research
08/18/2018

SeVeN: Augmenting Word Embeddings with Unsupervised Relation Vectors

We present SeVeN (Semantic Vector Networks), a hybrid resource that enco...
research
05/19/2021

Do Models Learn the Directionality of Relations? A New Evaluation Task: Relation Direction Recognition

Deep neural networks such as BERT have made great progress in relation c...
research
04/04/2019

Composition of Sentence Embeddings:Lessons from Statistical Relational Learning

Various NLP problems -- such as the prediction of sentence similarity, e...
research
07/04/2018

Learning Fuzzy Set Representations of Partial Shapes on Dual Embedding Spaces

Modeling relations between components of 3D objects is essential for man...

Please sign up or login with your details

Forgot password? Click here to reset