TY - JOUR
T1 - Weakly supervised learning for classification of lung cytological images using attention-based multiple instance learning
AU - Teramoto, Atsushi
AU - Kiriyama, Yuka
AU - Tsukamoto, Tetsuya
AU - Sakurai, Eiko
AU - Michiba, Ayano
AU - Imaizumi, Kazuyoshi
AU - Saito, Kuniaki
AU - Fujita, Hiroshi
N1 - Publisher Copyright:
© 2021, The Author(s).
PY - 2021/12
Y1 - 2021/12
N2 - In cytological examination, suspicious cells are evaluated regarding malignancy and cancer type. To assist this, we previously proposed an automated method based on supervised learning that classifies cells in lung cytological images as benign or malignant. However, it is often difficult to label all cells. In this study, we developed a weakly supervised method for the classification of benign and malignant lung cells in cytological images using attention-based deep multiple instance learning (AD MIL). Images of lung cytological specimens were divided into small patch images and stored in bags. Each bag was then labeled as benign or malignant, and classification was conducted using AD MIL. The distribution of attention weights was also calculated as a color map to confirm the presence of malignant cells in the image. AD MIL using the AlexNet-like convolutional neural network model showed the best classification performance, with an accuracy of 0.916, which was better than that of supervised learning. In addition, an attention map of the entire image based on the attention weight allowed AD MIL to focus on most malignant cells. Our weakly supervised method automatically classifies cytological images with acceptable accuracy based on supervised learning without complex annotations.
AB - In cytological examination, suspicious cells are evaluated regarding malignancy and cancer type. To assist this, we previously proposed an automated method based on supervised learning that classifies cells in lung cytological images as benign or malignant. However, it is often difficult to label all cells. In this study, we developed a weakly supervised method for the classification of benign and malignant lung cells in cytological images using attention-based deep multiple instance learning (AD MIL). Images of lung cytological specimens were divided into small patch images and stored in bags. Each bag was then labeled as benign or malignant, and classification was conducted using AD MIL. The distribution of attention weights was also calculated as a color map to confirm the presence of malignant cells in the image. AD MIL using the AlexNet-like convolutional neural network model showed the best classification performance, with an accuracy of 0.916, which was better than that of supervised learning. In addition, an attention map of the entire image based on the attention weight allowed AD MIL to focus on most malignant cells. Our weakly supervised method automatically classifies cytological images with acceptable accuracy based on supervised learning without complex annotations.
UR - http://www.scopus.com/inward/record.url?scp=85117363284&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=85117363284&partnerID=8YFLogxK
U2 - 10.1038/s41598-021-99246-4
DO - 10.1038/s41598-021-99246-4
M3 - Article
C2 - 34645863
AN - SCOPUS:85117363284
SN - 2045-2322
VL - 11
JO - Scientific reports
JF - Scientific reports
IS - 1
M1 - 20317
ER -