TY - JOUR
T1 - A Heuristic Neural Network Structure Relying on Fuzzy Logic for Images Scoring
AU - PANDEY, HARI MOHAN
AU - Kang, Cheng
AU - Yu, Xiang
AU - Wang, Shui-Hua
AU - Guttery, David S.
AU - Tian, Yingli
AU - Zhang, Yu-Dong
N1 - Funding Information:
Manuscript received September 5, 2019; revised December 11, 2019; accepted December 31, 2019. Date of publication January 13, 2020; date of current version December 30, 2020. The work was supported in part by the Royal Society International Exchanges Cost Share Award (RP202G0230), in part by Medical Research Council Confidence in Concept (MRC CIC) Award, and in part by Hope Foundation for Cancer Research (RM60G0680), U.K. (Corresponding author: Shui-Hua Wang; David S. Guttery; Hari Mohan Pandey; Yingli Tian; Yu-Dong Zhang.) C. Kang and X. Yu are with the School of Informatics, University of Leicester, LE1 7RH Leicester, U.K. (e-mail: [email protected]; [email protected]).
Funding Information:
He was sponsored by CSC and by the University of Leicester as a graduate teaching assistant (GTA).
Publisher Copyright:
© 1993-2012 IEEE.
Copyright:
Copyright 2020 Elsevier B.V., All rights reserved.
PY - 2021/1
Y1 - 2021/1
N2 - Traditional deep learning methods are suboptimal in classifying ambiguity features, which often arise in noisy and hard to predict categories, especially, to distinguish semantic scoring. Semantic scoring, depending on semantic logic to implement evaluation, inevitably contains fuzzy description and misses some concepts, for example, the ambiguous relationship between normal and probably normal always presents unclear boundaries (normal - more likely normal - probably normal). Thus, human error is common when annotating images. Differing from existing methods that focus on modifying kernel structure of neural networks, this article proposes a dominant fuzzy fully connected layer (FFCL) for breast imaging reporting and data system (BI-RADS) scoring and validates the universality of this proposed structure. This proposed model aims to develop complementary properties of scoring for semantic paradigms, while constructing fuzzy rules based on analyzing human thought patterns, and to particularly reduce the influence of semantic conglutination. Specifically, this semantic-sensitive defuzzifier layer projects features occupied by relative categories into semantic space, and a fuzzy decoder modifies probabilities of the last output layer referring to the global trend. Moreover, the ambiguous semantic space between two relative categories shrinks during the learning phases, as the positive and negative growth trends of one category appearing among its relatives were considered. We first used the Euclidean distance to zoom in the distance between the real scores and the predicted scores, and then employed two sample t test method to evidence the advantage of the FFCL architecture. Extensive experimental results performed on the curated breast imaging subset of digital database of screening mammography dataset show that our FFCL structure can achieve superior performances for both triple and multiclass classification in BI-RADS scoring, outperforming the state-of-the-art methods.
AB - Traditional deep learning methods are suboptimal in classifying ambiguity features, which often arise in noisy and hard to predict categories, especially, to distinguish semantic scoring. Semantic scoring, depending on semantic logic to implement evaluation, inevitably contains fuzzy description and misses some concepts, for example, the ambiguous relationship between normal and probably normal always presents unclear boundaries (normal - more likely normal - probably normal). Thus, human error is common when annotating images. Differing from existing methods that focus on modifying kernel structure of neural networks, this article proposes a dominant fuzzy fully connected layer (FFCL) for breast imaging reporting and data system (BI-RADS) scoring and validates the universality of this proposed structure. This proposed model aims to develop complementary properties of scoring for semantic paradigms, while constructing fuzzy rules based on analyzing human thought patterns, and to particularly reduce the influence of semantic conglutination. Specifically, this semantic-sensitive defuzzifier layer projects features occupied by relative categories into semantic space, and a fuzzy decoder modifies probabilities of the last output layer referring to the global trend. Moreover, the ambiguous semantic space between two relative categories shrinks during the learning phases, as the positive and negative growth trends of one category appearing among its relatives were considered. We first used the Euclidean distance to zoom in the distance between the real scores and the predicted scores, and then employed two sample t test method to evidence the advantage of the FFCL architecture. Extensive experimental results performed on the curated breast imaging subset of digital database of screening mammography dataset show that our FFCL structure can achieve superior performances for both triple and multiclass classification in BI-RADS scoring, outperforming the state-of-the-art methods.
KW - Fuzzy deep neural networks
KW - transfer learning
KW - fuzzy fully connected layer
KW - medical image scoring
KW - fuzzy fully connected layer (FFCL)
U2 - 10.1109/TFUZZ.2020.2966163
DO - 10.1109/TFUZZ.2020.2966163
M3 - Article (journal)
C2 - 33408453
SN - 1063-6706
VL - 29
SP - 34
EP - 45
JO - IEEE Transactions on Fuzzy Systems
JF - IEEE Transactions on Fuzzy Systems
IS - 1
M1 - 8957449
ER -