A Symbolic Character-Aware Model for Solving Geometry Problems

by   Maizhen Ning, et al.
University of Liverpool
Xi'an Jiaotong-Liverpool University
Duke Kunshan University

AI has made significant progress in solving math problems, but geometry problems remain challenging due to their reliance on both text and diagrams. In the text description, symbolic characters such as "ABC" often serve as a bridge to connect the corresponding diagram. However, by simply tokenizing symbolic characters into individual letters (e.g., 'A', 'B' and 'C'), existing works fail to study them explicitly and thus lose the semantic relationship with the diagram. In this paper, we develop a symbolic character-aware model to fully explore the role of these characters in both text and diagram understanding and optimize the model under a multi-modal reasoning framework. In the text encoder, we propose merging individual symbolic characters to form one semantic unit along with geometric information from the corresponding diagram. For the diagram encoder, we pre-train it under a multi-label classification framework with the symbolic characters as labels. In addition, we enhance the geometry diagram understanding ability via a self-supervised learning method under the masked image modeling auxiliary task. By integrating the proposed model into a general encoder-decoder pipeline for solving geometry problems, we demonstrate its superiority on two benchmark datasets, including GeoQA and Geometry3K, with extensive experiments. Specifically, on GeoQA, the question-solving accuracy is increased from 60.0% to 64.1%, achieving a new state-of-the-art accuracy; on Geometry3K, we reduce the question average solving steps from 6.9 down to 6.0 with marginally higher solving accuracy.


page 1

page 2

page 3

page 4


A Multi-Modal Neural Geometric Solver with Textual Clauses Parsed from Diagram

Geometry problem solving (GPS) is a high-level mathematical reasoning re...

Inter-GPS: Interpretable Geometry Problem Solving with Formal Language and Symbolic Reasoning

Geometry problem solving has attracted much attention in the NLP communi...

Neural-Symbolic Solver for Math Word Problems with Auxiliary Tasks

Previous math word problem solvers following the encoder-decoder paradig...

The DIDI dataset: Digital Ink Diagram data

We are releasing a dataset of diagram drawings with dynamic drawing info...

PGDP5K: A Diagram Parsing Dataset for Plane Geometry Problems

Diagram parsing is an important foundation for geometry problem solving,...

Plane Geometry Diagram Parsing

Geometry diagram parsing plays a key role in geometry problem solving, w...

Measuring Information Propagation in Literary Social Networks

We present the task of modeling information propagation in literature, i...

Please sign up or login with your details

Forgot password? Click here to reset