research
∙
07/27/2023
Gzip versus bag-of-words for text classification with KNN
The effectiveness of compression distance in KNN-based text classificati...
share
research
∙
06/01/2023
AMR4NLI: Interpretable and robust NLI measures from semantic graphs
The task of natural language inference (NLI) asks whether a given premis...
research
∙
05/26/2023
With a Little Push, NLI Models can Robustly and Efficiently Predict Faithfulness
Conditional language models still generate unfaithful output that is not...
research
∙
05/15/2023
Similarity-weighted Construction of Contextualized Commonsense Knowledge Graphs for Knowledge-intense Argumentation Tasks
Arguments often do not make explicit how a conclusion follows from its p...
research
∙
05/11/2023
SMATCH++: Standardized and Extended Evaluation of Semantic Graphs
The Smatch metric is a popular method for evaluating graph distances, as...
research
∙
10/12/2022
Better Smatch = Better Parser? AMR evaluation is not so simple anymore
Recently, astonishing advances have been observed in AMR parsing, as mea...
research
∙
06/14/2022
SBERT studies Meaning Representations: Decomposing Sentence Embeddings into Explainable AMR Meaning Features
Metrics for graph-based meaning representations (e.g., Abstract Meaning ...
research
∙
05/24/2022
A Dynamic, Interpreted CheckList for Meaning-oriented NLG Metric Evaluation – through the Lens of Semantic Similarity Rating
Evaluating the quality of generated text is difficult, since traditional...
research
∙
03/24/2022
SMARAGD: Synthesized sMatch for Accurate and Rapid AMR Graph Distance
The semantic similarity of graph-based meaning representations, such as ...
research
∙
08/26/2021
Weisfeiler-Leman in the BAMBOO: Novel AMR Graph Metrics and a Benchmark for AMR Graph Similarity
Several metrics have been proposed for assessing the similarity of (abst...
research
∙
06/08/2021
Translate, then Parse! A strong baseline for Cross-Lingual AMR Parsing
In cross-lingual Abstract Meaning Representation (AMR) parsing, research...
research
∙
08/20/2020
Towards a Decomposable Metric for Explainable Evaluation of Text Generation from AMR
Systems that generate sentences from (abstract) meaning representations ...
research
∙
05/25/2020
AMR quality rating with a lightweight CNN
Structured semantic sentence representations such as Abstract Meaning Re...
research
∙
01/29/2020
AMR Similarity Metrics from Principles
Different metrics have been proposed to compare Abstract Meaning Represe...
research
∙
11/08/2019
Macro F1 and Macro F1
The 'macro F1' metric is frequently used to evaluate binary, multi-class...
research
∙
09/19/2019
Argumentative Relation Classification as Plausibility Ranking
We formulate argumentative relation classification (support vs. attack) ...
research
∙
06/07/2019
Dissecting Content and Context in Argumentative Relation Analysis
When assessing relations between argumentative units (e.g., support or a...
research
∙
04/17/2019
Automatic Accuracy Prediction for AMR Parsing
Abstract Meaning Representation (AMR) represents sentences as directed, ...
research
∙
02/04/2019
An Argument-Marker Model for Syntax-Agnostic Proto-Role Labeling
Semantic proto-role labeling (SPRL) is an alternative to semantic role l...
research
∙
06/07/2017