Detection of Furigana Text in Images

Furigana are pronunciation notes used in Japanese writing. Being able to detect these can help improve optical character recognition (OCR) performance or make more accurate digital copies of Japanese written media by correctly displaying furigana. This project focuses on detecting furigana in Japanese books and comics. While there has been research into the detection of Japanese text in general, there are currently no proposed methods for detecting furigana. We construct a new dataset containing Japanese written media and annotations of furigana. We propose an evaluation metric for such data which is similar to the evaluation protocols used in object detection except that it allows groups of objects to be labeled by one annotation. We propose a method for detection of furigana that is based on mathematical morphology and connected component analysis. We evaluate the detections of the dataset and compare different methods for text extraction. We also evaluate different types of images such as books and comics individually and discuss the challenges of each type of image. The proposed method reaches an F1-score of 76% on the dataset. The method performs well on regular books, but less so on comics, and books of irregular format. Finally, we show that the proposed method can improve the performance of OCR by 5% on the manga109 dataset. Source code is available via


page 2

page 3

page 5

page 7

page 10


An Image Dataset of Text Patches in Everyday Scenes

This paper describes a dataset containing small images of text from ever...

Rooms with Text: A Dataset for Overlaying Text Detection

In this paper, we introduce a new dataset of room interior pictures with...

Objectron: A Large Scale Dataset of Object-Centric Videos in the Wild with Pose Annotations

3D object detection has recently become popular due to many applications...

EMDS-7: Environmental Microorganism Image Dataset Seventh Version for Multiple Object Detection Evaluation

The Environmental Microorganism Image Dataset Seventh Version (EMDS-7) i...

Detecting Curve Text in the Wild: New Dataset and New Solution

Scene text detection has been made great progress in recent years. The d...

Unsupervised Text Extraction from G-Maps

This paper represents an text extraction method from Google maps, GIS ma...

Unconstrained Text Detection in Manga: a New Dataset and Baseline

The detection and recognition of unconstrained text is an open problem i...

Please sign up or login with your details

Forgot password? Click here to reset