{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,2,21]],"date-time":"2025-02-21T23:56:34Z","timestamp":1740182194111,"version":"3.37.3"},"reference-count":50,"publisher":"Oxford University Press (OUP)","issue":"4","license":[{"start":{"date-parts":[[2022,8,1]],"date-time":"2022-08-01T00:00:00Z","timestamp":1659312000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100012166","name":"National Key Research and Development Program of China","doi-asserted-by":"publisher","award":["2019YFB1311300"],"id":[{"id":"10.13039\/501100012166","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2022,8,31]]},"abstract":"Abstract<\/jats:title>\n A deep learning screening model of esophageal endoscopic images can reduce the burden on endoscopists. However, most deep learning methods require many labeled data with balanced categories, and their ability to deal with new diseases not appearing in the training set is limited. This study elaborated a semi-supervised anomaly detection model for the initial screening of esophageal endoscopic images, requiring a single class of samples as a training set. The reconstruction-based method was used for anomaly detection. The model\u2019s framework was a variational auto-encoder, with two memory modules added in latent space to restrain its generalization ability. In the memory module, a clustering operation was introduced to provide a better distribution of memory vectors, promoting their compactness with encoded features and separation from each other. A detailed description and theoretical substantiation of the proposed model were presented. A dataset containing 7989 esophageal endoscopic images labeled by experienced endoscopists was used for numerical experiments. The proposed model results were compared with those of other auto-encoder-based anomaly detection methods, outperforming them and achieving an area under the curve of 0.8212. The ablation study was also conducted to validate the effectiveness of each model\u2019s part, and new data were successfully incorporated to assess the model feasibility and applicability range.<\/jats:p>","DOI":"10.1093\/jcde\/qwac073","type":"journal-article","created":{"date-parts":[[2022,8,1]],"date-time":"2022-08-01T15:30:35Z","timestamp":1659367835000},"page":"1525-1537","source":"Crossref","is-referenced-by-count":1,"title":["Clustering memory-guided anomaly detection model for large-scale screening of esophageal endoscopic images"],"prefix":"10.1093","volume":"9","author":[{"given":"Yanbing","family":"Wu","sequence":"first","affiliation":[{"name":"School of Control Science and Engineering, Shandong University , Jinan 250061, China"}]},{"given":"Zijian","family":"Zhao","sequence":"additional","affiliation":[{"name":"School of Control Science and Engineering, Shandong University , Jinan 250061, China"}]},{"given":"Xuejiao","family":"Pang","sequence":"additional","affiliation":[{"name":"School of Control Science and Engineering, Shandong University , Jinan 250061, China"}]},{"given":"Jin","family":"Liu","sequence":"additional","affiliation":[{"name":"Department of Gastroenterology, Shandong Provincial Hospital Affiliated to the Shandong First Medical University , Jinan 250021, China"}]}],"member":"286","published-online":{"date-parts":[[2022,8,1]]},"reference":[{"key":"2022083109580793200_bib1","first-page":"622","article-title":"Ganomaly: Semi-supervised anomaly detection via adversarial training","volume-title":"Proceedings of the Asian Conference on Computer Vision","author":"Akcay","year":"2018"},{"issue":"1","key":"2022083109580793200_bib2","first-page":"1","article-title":"Variational autoencoder based anomaly detection using reconstruction probability","volume":"2","author":"An","year":"2015","journal-title":"Special Lecture on IE"},{"key":"2022083109580793200_bib3","first-page":"161","article-title":"Deep autoencoding models for unsupervised anomaly segmentation in brain MR images","volume-title":"International MICCAI Brain Lesion Workshop","author":"Baur","year":"2018"},{"key":"2022083109580793200_bib4","first-page":"4182","article-title":"Uninformed students: Student\u2013teacher anomaly detection with discriminative latent embeddings","volume-title":"Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition (CVPR)","author":"Bergmann","year":"2020"},{"article-title":"Deep learning for anomaly detection: A survey","year":"2019","author":"Chalapathy","key":"2022083109580793200_bib6"},{"issue":"3","key":"2022083109580793200_bib5","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1145\/1541880.1541882","article-title":"Anomaly detection: A survey","volume":"41","author":"Chandola","year":"2009","journal-title":"ACM Computing Surveys"},{"article-title":"Unsupervised detection of lesions in brain MRI using constrained adversarial auto-encoders","year":"2018","author":"Chen","key":"2022083109580793200_bib7"},{"key":"2022083109580793200_bib8","first-page":"9737","article-title":"Anomaly detection via reverse distillation from one-class embedding","volume-title":"Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition","author":"Deng","year":"2022"},{"issue":"2","key":"2022083109580793200_bib9","doi-asserted-by":"crossref","first-page":"421","DOI":"10.1053\/j.gastro.2017.07.041","article-title":"Endoscopic management of early adenocarcinoma and squamous cell carcinoma of the esophagus: Screening, diagnosis, and therapy","volume":"154","author":"Di\u00a0Pietro","year":"2018","journal-title":"Gastroenterology"},{"key":"2022083109580793200_bib10","first-page":"1705","article-title":"Memorizing normality to detect anomaly: Memory-augmented deep autoencoder for unsupervised anomaly detection","volume-title":"Proceedings of the IEEE\/CVF International Conference on Computer Vision","author":"Gong","year":"2019"},{"key":"2022083109580793200_bib11","first-page":"2672","article-title":"Generative adversarial nets","volume-title":"Proceedings of the 27th International Conference on Neural Information Processing Systems","author":"Goodfellow","year":"2014"},{"issue":"4","key":"2022083109580793200_bib12","doi-asserted-by":"crossref","first-page":"538","DOI":"10.1177\/2050640619837443","article-title":"The Argos project: The development of a computer-aided detection system to improve detection of Barrett\u2019s neoplasia on white light endoscopy","volume":"7","author":"Groof","year":"2019","journal-title":"United European Gastroenterology Journal"},{"key":"2022083109580793200_bib13","article-title":"Beta-VAE: Learning basic visual concepts with a constrained variational framework","volume-title":"Proceedings of the International Conference on Learning Representations (ICLR)","author":"Higgins","year":"2016"},{"issue":"5786","key":"2022083109580793200_bib14","doi-asserted-by":"crossref","first-page":"504","DOI":"10.1126\/science.1127647","article-title":"Reducing the dimensionality of data with neural networks","volume":"313","author":"Hinton","year":"2006","journal-title":"Science"},{"key":"2022083109580793200_bib15","first-page":"2892","article-title":"Convolutional neural network classifier for distinguishing Barrett\u2019s esophagus and neoplasia endomicroscopy images","volume-title":"Proceedings of the 39th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC)","author":"Hong","year":"2017"},{"issue":"1","key":"2022083109580793200_bib16","doi-asserted-by":"crossref","first-page":"25","DOI":"10.1016\/j.gie.2018.07.037","article-title":"Diagnostic outcomes of esophageal cancer by artificial intelligence using convolutional neural networks","volume":"89","author":"Horie","year":"2019","journal-title":"Gastrointestinal Endoscopy"},{"key":"2022083109580793200_bib17","first-page":"7132","article-title":"Squeeze-and-excitation networks","volume-title":"Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition","author":"Hu","year":"2018"},{"issue":"3","key":"2022083109580793200_bib18","doi-asserted-by":"crossref","first-page":"210","DOI":"10.1016\/j.asjsur.2016.10.005","article-title":"Esophageal cancer: Risk factors, genetic association, and treatment","volume":"41","author":"Huang","year":"2018","journal-title":"Asian Journal of Surgery"},{"issue":"6","key":"2022083109580793200_bib19","doi-asserted-by":"crossref","first-page":"480","DOI":"10.1111\/j.1442-2050.2009.01039.x","article-title":"Prospective evaluation of narrow-band imaging endoscopy for screening of esophageal squamous mucosal high-grade neoplasia in experienced and less experienced endoscopists","volume":"23","author":"Ishihara","year":"2010","journal-title":"Diseases of the Esophagus"},{"article-title":"Auto-encoding variational Bayes","year":"2014","author":"Kingma","key":"2022083109580793200_bib20"},{"key":"2022083109580793200_bib21","first-page":"300","article-title":"Anomaly detection with prototype-guided discriminative latent embeddings","volume-title":"Proceedings of the IEEE International Conference on Data Mining (ICDM)","author":"Lai","year":"2021"},{"key":"2022083109580793200_bib22","first-page":"9664","article-title":"Cut paste: Self-supervised learning for anomaly detection and localization","volume-title":"Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition","author":"Li","year":"2021"},{"key":"2022083109580793200_bib23","first-page":"413","article-title":"Isolation forest","volume-title":"Proceedings of the 8th IEEE International Conference on Data Mining","author":"Liu","year":"2008"},{"article-title":"Anomaly detection for skin disease images using variational autoencoder","year":"2018","author":"Lu","key":"2022083109580793200_bib24"},{"key":"2022083109580793200_bib25","doi-asserted-by":"crossref","first-page":"103062","DOI":"10.1016\/j.cviu.2020.103062","article-title":"PS-DeVCEM: Pathology-sensitive deep learning model for video capsule endoscopy based on weakly labeled data","volume":"201","author":"Mohammed","year":"2020","journal-title":"Computer Vision and Image Understanding"},{"article-title":"Stack of discriminative autoencoders for multiclass anomaly detection in endoscopy images","year":"2021","author":"Mohebbian","key":"2022083109580793200_bib26"},{"key":"2022083109580793200_bib27","doi-asserted-by":"crossref","first-page":"70","DOI":"10.1016\/j.neucom.2014.02.064","article-title":"Abnormal image detection in endoscopy videos using a filter bank and local binary patterns","volume":"144","author":"Nawarathna","year":"2014","journal-title":"Neurocomputing"},{"key":"2022083109580793200_bib28","first-page":"14372","article-title":"Learning memory-guided normality for anomaly detection","volume-title":"Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition","author":"Park","year":"2020"},{"key":"2022083109580793200_bib29","first-page":"2898","article-title":"OCGAN: One-class novelty detection using gans with constrained latent representations","volume-title":"Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition","author":"Perera","year":"2019"},{"key":"2022083109580793200_bib30","first-page":"1651","article-title":"Anomaly detection with conditional variational autoencoders","volume-title":"Proceedings of the 18th IEEE International Conference on Machine Learning and Applications (ICMLA)","author":"Pol","year":"2019"},{"key":"2022083109580793200_bib31","first-page":"13576","article-title":"Self-supervised predictive convolutional attentive block for anomaly detection","volume-title":"Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition","author":"Ristea","year":"2022"},{"key":"2022083109580793200_bib32","article-title":"Deep semi-supervised anomaly detection","volume-title":"Proceedings of the International Conference on Learning Representations (LCLR)","author":"Ruff","year":"2020"},{"key":"2022083109580793200_bib33","first-page":"14902","article-title":"Multiresolution knowledge distillation for anomaly detection","volume-title":"Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition","author":"Salehi","year":"2021"},{"key":"2022083109580793200_bib34","doi-asserted-by":"crossref","first-page":"105751P","DOI":"10.1117\/12.2292276","article-title":"A primitive study on unsupervised anomaly detection with an autoencoder in emergency head CT volumes","volume-title":"Proceedings of the SPIE Medical Imaging 2018: Computer-Aided Diagnosis","author":"Sato","year":"2018"},{"key":"2022083109580793200_bib35","doi-asserted-by":"crossref","first-page":"146","DOI":"10.1007\/978-3-319-59050-9_12","article-title":"Unsupervised anomaly detection with generative adversarial networks to guide marker discovery","volume-title":"Proceedings of the International Conference on Information Processing in Medical Imaging","author":"Schlegl","year":"2017"},{"key":"2022083109580793200_bib36","doi-asserted-by":"crossref","first-page":"30","DOI":"10.1016\/j.media.2019.01.010","article-title":"f-AnoGAN: Fast unsupervised anomaly detection with generative adversarial networks","volume":"54","author":"Schlegl","year":"2019","journal-title":"Medical Image Analysis"},{"key":"2022083109580793200_bib37","first-page":"582","article-title":"Support vector method for novelty detection","volume-title":"Proceedings of the 12th International Conference on Neural Information Processing Systems","author":"Sch\u00f6lkopf","year":"1999"},{"key":"2022083109580793200_bib38","doi-asserted-by":"crossref","first-page":"113","DOI":"10.1145\/3429309.3429326","article-title":"Variational autoencoder anomaly-detection of avalanche deposits in satellite SAR imagery","volume-title":"Proceedings of the 10th International Conference on Climate Informatics","author":"Sinha","year":"2020"},{"issue":"1","key":"2022083109580793200_bib39","doi-asserted-by":"crossref","first-page":"45","DOI":"10.1023\/B:MACH.0000008084.60811.49","article-title":"Support vector data description","volume":"54","author":"Tax","year":"2004","journal-title":"Machine Learning"},{"key":"2022083109580793200_bib40","doi-asserted-by":"crossref","first-page":"101272","DOI":"10.1016\/j.aei.2021.101272","article-title":"Autoencoder-based anomaly detection for surface defect inspection","volume":"48","author":"Tsai","year":"2021","journal-title":"Advanced Engineering Informatics"},{"issue":"3","key":"2022083109580793200_bib41","doi-asserted-by":"crossref","first-page":"409","DOI":"10.1007\/s12530-018-9236-x","article-title":"Weakly supervised multilabel classification for semantic interpretation of endoscopy video frames","volume":"11","author":"Vasilakakis","year":"2020","journal-title":"Evolving Systems"},{"article-title":"Student\u2013teacher feature pyramid matching for unsupervised anomaly detection","year":"2021","author":"Wang","key":"2022083109580793200_bib42"},{"key":"2022083109580793200_bib43","first-page":"187","article-title":"Unsupervised anomaly detection via variational auto-encoder for seasonal KPIs in web applications","volume-title":"Proceedings of the World Wide Web Conference (WWW '18)","author":"Xu","year":"2018"},{"key":"2022083109580793200_bib44","first-page":"3110","article-title":"Learning semantic context from normal samples for unsupervised anomaly detection","volume-title":"Proceedings of the AAAI Conference on Artificial Intelligence","author":"Yan","year":"2021"},{"key":"2022083109580793200_bib45","doi-asserted-by":"crossref","first-page":"107706","DOI":"10.1016\/j.patcog.2020.107706","article-title":"Reconstruction by inpainting for visual anomaly detection","volume":"112","author":"Zavrtanik","year":"2021","journal-title":"Pattern Recognition"},{"key":"2022083109580793200_bib47","first-page":"727","article-title":"Adversarially learned anomaly detection","volume-title":"Proceedings of the IEEE International Conference on Data Mining (ICDM)","author":"Zenati","year":"2018"},{"issue":"3","key":"2022083109580793200_bib48","doi-asserted-by":"crossref","first-page":"879","DOI":"10.1109\/TMI.2020.3040950","article-title":"Viral pneumonia screening on chest X-rays using confidence-aware anomaly detection","volume":"40","author":"Zhang","year":"2021","journal-title":"IEEE Transactions on Medical Imaging"},{"key":"2022083109580793200_bib49","doi-asserted-by":"crossref","first-page":"108525","DOI":"10.1016\/j.ress.2022.108525","article-title":"Towards trustworthy machine fault diagnosis: A probabilistic Bayesian deep learning framework","volume":"224","author":"Zhou","year":"2022","journal-title":"Reliability Engineering & System Safety"},{"key":"2022083109580793200_bib50","first-page":"289","article-title":"Unsupervised anomaly localization using variational auto-encoders","volume-title":"Proceedings of the International Conference on Medical Image Computing and Computer-Assisted Intervention","author":"Zimmerer","year":"2019"},{"key":"2022083109580793200_bib51","article-title":"Deep autoencoding Gaussian mixture model for unsupervised anomaly detection","volume-title":"Proceedings of the International Conference on Learning Representations (ICLR)","author":"Zong","year":"2018"}],"container-title":["Journal of Computational Design and Engineering"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/academic.oup.com\/jcde\/advance-article-pdf\/doi\/10.1093\/jcde\/qwac073\/45209416\/qwac073.pdf","content-type":"application\/pdf","content-version":"am","intended-application":"syndication"},{"URL":"https:\/\/academic.oup.com\/jcde\/article-pdf\/9\/4\/1525\/45630325\/qwac073.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/academic.oup.com\/jcde\/article-pdf\/9\/4\/1525\/45630325\/qwac073.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2022,8,31]],"date-time":"2022-08-31T09:59:03Z","timestamp":1661939943000},"score":1,"resource":{"primary":{"URL":"https:\/\/academic.oup.com\/jcde\/article\/9\/4\/1525\/6652901"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,8,1]]},"references-count":50,"journal-issue":{"issue":"4","published-print":{"date-parts":[[2022,8,31]]}},"URL":"https:\/\/doi.org\/10.1093\/jcde\/qwac073","relation":{},"ISSN":["2288-5048"],"issn-type":[{"type":"electronic","value":"2288-5048"}],"subject":[],"published-other":{"date-parts":[[2022,8]]},"published":{"date-parts":[[2022,8,1]]}}}