Abstract




 
   

IJE TRANSACTIONS C: Aspects Vol. 31, No. 6 (June 2018) 1257-1265   

downloaded Downloaded: 0   viewed Viewed: 99

  A RADON-BASED CONVOLUTIONAL NEURAL NETWORK FOR MEDICAL IMAGE RETRIEVAL
 
A. Khatami, M. Babaie, Hamid R. Tizhoosh, A. Khosravi and S. Nahavandi
 
( Received: August 22, 2017 – Accepted: March 09, 2018 )
 
 

Abstract    Image classification and retrieval systems have gained more attention because of easier access to high-tech medical imaging. However, the lack of availability of large-scaled balanced labelled data in medicine is still a challenge. Simplicity, practicality, efficiency, and effectiveness are the main targets in medical domain. To achieve these goals, Radon transformation, which is a well-known technology in medical field, is utilized along with a deep network to propose a retrieval system for a highly imbalanced medical benchmark. The main contribution of this study is to propose a deep model which is trained on the Radon-based transformed input data. The experimental results show that applying this transformation as input to feed into a convolutional neural network, significantly increases the performance, compared with other retrieval systems. The proposed scheme clearly increases the retrieval performance, compared with almost all models which use Radon transformation to retrieve medical images.

 

Keywords    deep CNN, medical image retrieval, Radon transformation,IRMA

 

چکیده    اخیرا سیستم های دسته بندی و بازیابی تصاویر پزشکی به دلیل دسترسسی به موارد مشابه ذخیره شده و پیگیری خط سیر درمان این موارد مشابه، بیشتر از هر زمانی مورد توجه قرار گرفته اند. با این حال، به علت عدم وجود داده های متوازن و یرچسبگذاری شده در ابعاد وسیع (به خصوص در تصاویر پزشکی) دسترسی به این سیستم ها را دشوار ساخته است. در این مطالعه به منظور ایجاد یک سیستم بازیابی در یک دیتابیس غیرمتوازن، از تبدیل Radon تصاویر به همراه یک شبکه عصبی عمیق استفاده گردیده است. در بخش نتایج نشان داده خواهد شد که اعمال این تبدیل به لایه ورودی یک شبکه عمیق، دقت بازیابی اطلاعات را به طور چشمگیری افزایش می دهد.

References    [1] H. Müller, N. Michoux, D. Bandon, A. Geissbuhler, A review of content-based image retrieval systems in medical applications—clinical benefits and future directions, International journal of medical informatics 73(1) (2004) 1-23. [2] H. Müller, T. Deselaers, T. Deserno, P. Clough, E. Kim, W. Hersh, Overview of the ImageCLEFmed 2006 medical retrieval and medical annotation tasks, Workshop of the Cross-Language Evaluation Forum for European Languages, Springer, 2006, pp. 595-608. [3] M. Rantala, S. Vanska, S. Jarvenpaa, M. Kalke, M. Lassas, J. Moberg, S. Siltanen, Wavelet-based reconstruction for limited-angle X-ray tomography, IEEE transactions on medical imaging 25(2) (2006) 210-217. [4] M. Babaie, S. Kalra, A. Sriram, C. Mitcheltree, S. Zhu, A. Khatami, S. Rahnamayan, H.R. Tizhoosh, Classification and Retrieval of Digital Pathology Scans: A New Dataset, arXiv preprint arXiv:1705.07522  (2017). [5] A. Khatami, M. Babaie, A. Khosravi, H. Tizhoosh, S.M. Salaken, S. Nahavandi, A deep-structural medical image classification for a Radon-based image retrieval, Electrical and Computer Engineering (CCECE), 2017 IEEE 30th Canadian Conference on, IEEE, 2017, pp. 1-4. [6] A. Khatami, A. Khosravi, C.P. Lim, S. Nahavandi, A Wavelet Deep Belief Network-Based Classifier for Medical Images, International Conference on Neural Information Processing, Springer, 2016, pp. 467-474. [7] A. Khatami, A. Khosravi, T. Nguyen, C.P. Lim, S. Nahavandi, Medical Image Analysis using Wavelet Transform and Deep Belief Networks, Expert Systems with Applications  (2017). [8] S.A. Khatami, A. Khosravi, S. Nahavandi, A New Approach Based on Support Vector Machine for Solving Stochastic Optimization, Systems, Man, and Cybernetics (SMC), 2013 IEEE International Conference on, IEEE, 2013, pp. 2498-2503. [9] T. Ojala, M. Pietikainen, T. Maenpaa, Multiresolution gray-scale and rotation invariant texture classification with local binary patterns, IEEE Transactions on pattern analysis and machine intelligence 24(7) (2002) 971-987. [10] T. Ahonen, A. Hadid, M. Pietikainen, Face description with local binary patterns: Application to face recognition, IEEE transactions on pattern analysis and machine intelligence 28(12) (2006) 2037-2041. [11] N. Dalal, B. Triggs, Histograms of oriented gradients for human detection, Computer Vision and Pattern Recognition, 2005. CVPR 2005. IEEE Computer Society Conference on, IEEE, 2005, pp. 886-893. [12] A. Khatami, S. Mirghasemi, A. Khosravi, C.P. Lim, S. Nahavandi, A new PSO-based approach to fire flame detection using K-Medoids clustering, Expert Systems With Applications 68 (2017) 69-80. [13] A. Khatami, S. Mirghasemi, A. Khosravi, S. Nahavandi, A new color space based on k-medoids clustering for fire detection, Systems, Man, and Cybernetics (SMC), 2015 IEEE International Conference on, IEEE, 2015, pp. 2755-2760. [14] A. Khatami, S. Mirghasemi, A. Khosravi, S. Nahavandi, An efficient hybrid algorithm for fire flame detection, Neural Networks (IJCNN), 2015 International Joint Conference on, IEEE, 2015, pp. 1-6. [15] M. Keyvanpour, R. Tavoli, S. Mozafari, Document image retrieval based on keyword spotting using relevance feedback, International Journal of Engineering-Transactions A: Basics 27(1) (2013) 7-14. [16] M. Ezoji, S. Iravani, A GENERAL FRAMEWORK FOR 1-D HISTOGRAM-BAESD IMAGE CONTRAST ENHANCEMENT, International Journal of Engineering-Transactions A: Basics 29(10) (2016) 1384. [17] M. Kashif, T.M. Deserno, D. Haak, S. Jonas, Feature description with SIFT, SURF, BRIEF, BRISK, or FREAK? A general question answered for bone age assessment, Computers in biology and medicine 68 (2016) 67-75. [18] D. Sargent, C.-I. Chen, C.-M. Tsai, Y.-F. Wang, D. Koppel, Feature detector and descriptor for medical images, SPIE Medical Imaging, International Society for Optics and Photonics, 2009, pp. 72592Z-72592Z-8. [19] T.M. Lehmann, M. Gold, C. Thies, B. Fischer, K. Spitzer, D. Keysers, H. Ney, M. Kohnen, H. Schubert, B.B. Wein, Content-based image retrieval in medical applications, Methods of information in medicine 43(4) (2004) 354-361. [20] T.M. Lehmann, M.O. Güld, T. Deselaers, D. Keysers, H. Schubert, K. Spitzer, H. Ney, B.B. Wein, Automatic categorization of medical images for content-based retrieval and data mining, Computerized Medical Imaging and Graphics 29(2) (2005) 143-155. [21] L. Weisi, D. Tao, J. Kacprzyk, Z. Li, E. Izquierdo, H. Wang, Multimedia analysis, processing and communications, Springer Science & Business Media2011. [22] C.E. Metz, X. Pan, A unified analysis of exact methods of inverting the 2-D exponential Radon transform, with implications for noise control in SPECT, IEEE transactions on medical imaging 14(4) (1995) 643-658. [23] M. Defrise, R. Clack, A cone-beam reconstruction algorithm using shift-variant filtering and cone-beam backprojection, IEEE Transactions on Medical Imaging 13(1) (1994) 186-195. [24] P. Kuchment, The Radon transform and medical imaging, SIAM2013. [25] M. Babaie, H. Tizhoosh, S. Zhu, M. Shiri, Retrieving Similar X-Ray Images from Big Image Data Using Radon Barcodes with Single Projections, arXiv preprint arXiv:1701.00449  (2017). [26] H.R. Tizhoosh, Barcode annotations for medical image retrieval: A preliminary investigation, Image Processing (ICIP), 2015 IEEE International Conference on, IEEE, 2015, pp. 818-822. [27] H.R. Tizhoosh, S. Rahnamayan, Evolutionary projection selection for Radon barcodes, Evolutionary Computation (CEC), 2016 IEEE Congress on, IEEE, 2016, pp. 1-8. [28] X. Liu, H.R. Tizhoosh, J. Kofman, Generating binary tags for fast medical image retrieval based on convolutional nets and Radon Transform, Neural Networks (IJCNN), 2016 International Joint Conference on, IEEE, 2016, pp. 2872-2878. [29] A. Sze-To, H.R. Tizhoosh, A.K. Wong, Binary codes for tagging x-ray images via deep de-noising autoencoders, Neural Networks (IJCNN), 2016 International Joint Conference on, IEEE, 2016, pp. 2864-2871. [30] H.R. Tizhoosh, C. Mitcheltree, S. Zhu, S. Dutta, Barcodes for Medical Image Retrieval Using Autoencoded Radon Transform, arXiv preprint arXiv:1609.05112  (2016). [31] T.M. Lehmann, M.O. Güld, C. Thies, B. Plodowski, D. Keysers, B. Ott, H. Schubert, IRMA-Content-based image retrieval in medical applications, Medinfo  (2004) 842-8. [32] T.M. Lehmann, H. Schubert, D. Keysers, M. Kohnen, B.B. Wein, The IRMA code for unique classification of medical images, Medical Imaging 2003, International Society for Optics and Photonics, 2003, pp. 440-451. [33] A. Krizhevsky, I. Sutskever, G.E. Hinton, Imagenet classification with deep convolutional neural networks, Advances in neural information processing systems, 2012, pp. 1097-1105. [34] S. Zhu, H.R. Tizhoosh, Radon features and barcodes for medical image retrieval via SVM, Neural Networks (IJCNN), 2016 International Joint Conference on, IEEE, 2016, pp. 5065-5071.





International Journal of Engineering
E-mail: office@ije.ir
Web Site: http://www.ije.ir