Automated Scoring System of HER2 in Pathological Images under the Microscope

10/21/2021
by   Zichen Zhang, et al.
0

Breast cancer is the most common cancer among women worldwide. The human epidermal growth factor receptor 2(HER2) with immunohistochemical(IHC) is widely used for pathological evaluation to provide the appropriate therapy for patients with breast cancer. However, the deficiency of pathologists is extremely significant in the current society, and visual diagnosis of the HER2 overexpression is subjective and susceptible to inter-observer variation. Recently, with the rapid development of artificial intelligence(AI) in disease diagnosis, several automated HER2 scoring methods using traditional computer vision or machine learning methods indicate the improvement of the HER2 diagnostic accuracy, but the unreasonable interpretation in pathology, as well as the expensive and ethical issues for annotation, make these methods still have a long way to deploy in hospitals to ease pathologists' burden in real. In this paper, we propose a HER2 automated scoring system that strictly follows the HER2 scoring guidelines simulating the real workflow of HER2 scores diagnosis by pathologists. Unlike the previous work, our method takes the positive control of HER2 into account to make sure the assay performance for each slide, eliminating work for repeated comparison and checking for the current field of view(FOV) and positive control FOV, especially for the borderline cases. Besides, for each selected FOV under the microscope, our system provides real-time HER2 scores analysis and visualizations of the membrane staining intensity and completeness corresponding with the cell classification. Our rigorous workflow along with the flexible interactive adjustion in demand substantially assists pathologists to finish the HER2 diagnosis faster and improves the robustness and accuracy. The proposed system will be embedded in our Thorough Eye platform for deployment in hospitals.

READ FULL TEXT

page 4

page 6

page 7

research
09/15/2020

Microscope Based HER2 Scoring System

The overexpression of human epidermal growth factor receptor 2 (HER2) ha...
research
05/23/2017

Her2 Challenge Contest: A Detailed Assessment of Automated Her2 Scoring Algorithms in Whole Slide Images of Breast Cancer Tissues

Evaluating expression of the Human epidermal growth factor receptor 2 (H...
research
11/21/2018

Microscope 2.0: An Augmented Reality Microscope with Real-time Artificial Intelligence Integration

The brightfield microscope is instrumental in the visual examination of ...
research
03/15/2021

Exploring Genetic-histologic Relationships in Breast Cancer

The advent of digital pathology presents opportunities for computer visi...
research
06/21/2016

Crowdsourcing scoring of immunohistochemistry images: Evaluating Performance of the Crowd and an Automated Computational Method

The assessment of protein expression in immunohistochemistry (IHC) image...
research
03/26/2019

Learning Where to See: A Novel Attention Model for Automated Immunohistochemical Scoring

Estimating over-amplification of human epidermal growth factor receptor ...

Please sign up or login with your details

Forgot password? Click here to reset