DRG-Net: Interactive Joint Learning of Multi-lesion Segmentation and Classification for Diabetic Retinopathy Grading

by   Hasan Md Tusfiqur, et al.

Diabetic Retinopathy (DR) is a leading cause of vision loss in the world, and early DR detection is necessary to prevent vision loss and support an appropriate treatment. In this work, we leverage interactive machine learning and introduce a joint learning framework, termed DRG-Net, to effectively learn both disease grading and multi-lesion segmentation. Our DRG-Net consists of two modules: (i) DRG-AI-System to classify DR Grading, localize lesion areas, and provide visual explanations; (ii) DRG-Expert-Interaction to receive feedback from user-expert and improve the DRG-AI-System. To deal with sparse data, we utilize transfer learning mechanisms to extract invariant feature representations by using Wasserstein distance and adversarial learning-based entropy minimization. Besides, we propose a novel attention strategy at both low- and high-level features to automatically select the most significant lesion information and provide explainable properties. In terms of human interaction, we further develop DRG-Net as a tool that enables expert users to correct the system's predictions, which may then be used to update the system as a whole. Moreover, thanks to the attention mechanism and loss functions constraint between lesion features and classification features, our approach can be robust given a certain level of noise in the feedback of users. We have benchmarked DRG-Net on the two largest DR datasets, i.e., IDRID and FGADR, and compared it to various state-of-the-art deep learning networks. In addition to outperforming other SOTA approaches, DRG-Net is effectively updated using user feedback, even in a weakly-supervised manner.


page 1

page 2

page 5

page 9

page 11

page 18

page 20

page 22


Improving Lesion Segmentation for Diabetic Retinopathy using Adversarial Learning

Diabetic Retinopathy (DR) is a leading cause of blindness in working age...

Learn to Segment Retinal Lesions and Beyond

Towards automated retinal screening, this paper makes an endeavor to sim...

Automated Detection and Diagnosis of Diabetic Retinopathy: A Comprehensive Survey

Diabetic Retinopathy (DR) is a leading cause of vision loss in the world...

Cost-effective Interactive Attention Learning with Neural Attention Processes

We propose a novel interactive learning framework which we refer to as I...

Joint Liver Lesion Segmentation and Classification via Transfer Learning

Transfer learning and joint learning approaches are extensively used to ...

DR-HAI: Argumentation-based Dialectical Reconciliation in Human-AI Interactions

We present DR-HAI – a novel argumentation-based framework designed to ex...

Dr. Watson type Artificial Intellect (AI) Systems

The article proposes a new type of AI system that does not give solution...

Please sign up or login with your details

Forgot password? Click here to reset