Advanced
Automatic Intelligent Asymmetry Detection Using Digital Infrared Imaging with K-Means Clustering
Automatic Intelligent Asymmetry Detection Using Digital Infrared Imaging with K-Means Clustering
International Journal of Fuzzy Logic and Intelligent Systems. 2015. Sep, 15(3): 180-185
Copyright © 2015, Korean Institute of Intelligent Systems
This is an Open Access article distributed under the terms of the Creative Commons Attribution Non-Commercial License (http://creativecommons.org/licenses/by-nc/3.0/) which permits unrestricted noncommercial use, distribution, and reproduction in any medium, provided the original work is properly cited.
  • Received : August 22, 2015
  • Accepted : September 24, 2015
  • Published : September 25, 2015
Download
PDF
e-PUB
PubReader
PPT
Export by style
Share
Article
Author
Metrics
Cited by
TagCloud
About the Authors
Kwang Baek Kim
Department of Computer Engineering, Silla University, Busan, Korea
Doo Hoen Song
Department of Computer Games, Songdam College, Yongin, Korea

Abstract
Digital infrared thermal imaging is a non-invasive adjunctive diagnostic technique that allows an examiner to visualize and quantify changes in skin surface temperature. The asymmetry of temperature differences between the diseased and the contralateral healthy body parts can be automatically analyzed and has been studied in many areas of medical science. In this paper, we propose a method for intelligent automatic asymmetry detection based on a K-means analysis and a YCbCr color model. The implemented software successfully visualizes an asymmetric distribution of colors with respect to the patients’ health status.
Keywords
1. Introduction
Digital infrared thermal imaging (DITI) is a fast, passive, non-contact, and non-invasive alternative to conventional clinical thermometers for monitoring body temperature [1] . DITI has been used in many areas of medical science as well as in the field of non-destructive testing (NDT). In the field of NDT, it is mainly used for surface defect detection and online monitoring of processes [2 - 4] .
The usefulness of thermograms for the diagnosis of physical illnesses was reported as early as 1963 [5] . Over several decades, with rapidly developing computer technology and artificial intelligence, DITI has been extensively studied in many fields of medical science, such as diabetic neuropathy [6] , vascular disorders [7] , fever screening [8] , dry eye syndrome diagnosis [9] , and breast cancer detection [10 - 13] , and even as a pre-screening tool for the detection of canine bone cancer [14] . For example, it has been reported that when state-of-the-art infrared technology was combined with advanced computer hardware and software technology, the sensitivity for breast cancer detection was 97% in 92 patients undergoing breast biopsy [15] . Further, a system with an artificial neural network for breast cancer detection with DITI showed particularly low sensitivity and was useful for women under the age of 50 years [11] .
For a DITI analysis in medical science, the power of such pre-screening or detection of extraordinary conditions comes from an asymmetry analysis in which temperature differences between the diseased and the contralateral healthy body parts are analyzed [1] . Since cancer cells with their higher metabolic rate are hotter than normal cells, which makes cancerous tumors appear as hotspots in DIT images, this technique is particularly useful in female breast imaging [13] . While higher-order statistics such as variance, skewness, kurtosis, and joint entropy are effective measures of asymmetry [13] , there are other technical methodologies to develop an automatic asymmetry analysis system, such as independent component analysis [12] , Hough transform-aided image segmentation and pattern classification [16] , and fuzzy logic [17] .
In this study, we focus on asymmetry detection using DITI with different color models and propose a method based on the well-known K-means clustering algorithm [18] . The YCbCr color model that we have used in this study is a way of encoding RGB information and successfully applying it to a human skin model for face detection [19] . As illustrated in Figure 1 , we first extract the blue and red regions from the YCbCr space-transferred DITI and then apply K-means to form the object clusters. Then, we search the center of gravity among the extracted objects and form a circle to define the magnitude of the red/blue objects. Thereafter, the degree of asymmetry can be easily analyzed.
PPT Slide
Lager Image
Overall process of asymmetry analysis.
2. Automatic Asymmetry Detection
- 2.1 Object Extraction by K-Means Clustering
As one can see from Figure 2 , the spectrum of colors indicates an increase or decrease in the amount of infrared radiation being emitted from the body surface in a DIT image; here, red denotes a relatively high temperature and blue, a relatively low temperature. In order to effectively separate the red and blue regions, we transfer the usual RGB color model to the YCrCb color model. The idea of such color model transfer is based on the fact that humans are more sensitive to brightness than to a color itself; thus, brightness contrast is a more reliable measure. In the YCrCb color model, Y denotes the luminance, and Cb and Cr represent the blue-difference and the red-difference chroma components. Thus, the red region and the blue region are extracted on the basis of such Cb and Cr values, as shown in Figure 3 .
PPT Slide
Lager Image
Example digital infrared thermal image.
PPT Slide
Lager Image
Color region extraction based on Cb and Cr: (a) blue region and (b) red region.
The next step is to make clusters by K-means [18] and extract regions using region labeling. K-means is a well-known unsupervised learning algorithm to form K clusters from data with iterative updates of k centers so that the within-cluster sum of squares is minimized.
After clustering, we apply a region labeling method [20] to connect the related pixels in order to form an object of concern. We adopt repetitive region labeling. The effect of K-means clustering and region labeling are shown in Figure 4 .
PPT Slide
Lager Image
Effects of object extraction process. (a) After K-means clustering and (b) after region labeling.
In order to analyze the extracted red and blue regions, we set the center of gravity points Center ( x , y ) according to equation (1).
PPT Slide
Lager Image
where k denotes the number of pixels and xi , yi represent the coordinates of pixel P ( xi , yi ) in the target object.
Using these center points, we draw circles that contain all the target regions, as shown in Figure 5 .
PPT Slide
Lager Image
Maximal regions of target objects.
- 2.2 DITI Diagnosis
Using DITI, medical experts judge whether a subject has an unhealthy status on the basis of the degree of asymmetry in the body temperature distribution. Figure 6 shows some typical DIT images that represent healthy and unhealthy subjects.
PPT Slide
Lager Image
Comparison of (a) healthy and (b) unhealthy subjects by digital infrared thermal imaging.
As one can see from Figure 6(a) , a healthy subject has a balanced distribution of body temperature and shows a high degree of left–right symmetry. Furthermore, there exist highly contrasted regions of high temperature (popliteal, cubital fossa, flesh, and breast) and of low temperature (elbow, heel, and knee). However, an unhealthy subject does not show such characteristic features in DITI, as shown in Figure 6(b) .
Thus, we can easily provide some quantitative measures of such asymmetry in the form of blue/red distribution statistics and left–right imbalance. If there is a highly skewed distribution of the red region, it is a sign of unhealthiness due to high body temperature. In contrast, if the blue region is overwhelming in the lower body or hands/feet, the subject may be suffering from hypothermia or circulatory disturbances.
Figure 7 illustrates how to measure the left–right symmetry in the proposed method. As explained in the previous section, we draw circles from the center points decided by K-means clustering and compare the left part and the right part. Typical asymmetries are found when a subject has a herniated cervical (lumbar) disc, chronic shoulder pain (upper body) or spinal disk disorder, rheumatoid arthritis, or knee arthralgia (lower body).
PPT Slide
Lager Image
Asymmetry analysis. (a) Original image, (b) range of left object, (c) range of right object, and (b) symmetry check.
3. Experiment
The proposed method was implemented with a Microsoft Visual Studio 2010 tool, and experiments were performed on an IBM-compatible PC with Intel Core i7-2600 CPU @ 3.40 GHz and 4-GB RAM. A typical snapshot of the software is shown in Figure 8 .
PPT Slide
Lager Image
Example snapshot.
Our software was tested by medical experts from the medical school of Pusan National University, Korea, and the typical outputs of the healthy and unhealthy subjects are shown in Figure 9 . It was tested more than 20 times, and multiple medical experts verified the efficacy of the software.
PPT Slide
Lager Image
Application of real data. (a) Healthy object and (b) unhealthy object.
4. Conclusions
In this paper, we propose a method to analyze DIT images automatically by using K-means unsupervised clustering and region labeling on the YCrCb color model. Since human vision is more sensitive to the brightness contrast than to a color itself, the YCrCb color model helps to extract more salient red/blue regions with respect to the body temperature, and the distribution statistics and the asymmetry degree are crucial for the diagnosis of a subject as healthy or unhealthy. In the experiment, the implemented software reacts appropriately to real data. In the future, we intend to study certain related research themes such as a clinical evaluation of the statistical parameters and specific-disease-related color–body part pattern detection.
Conflict of InterestNo potential conflict of interest relevant to this article was reported.
BIO
Kwang Baek Kim received his M.S. and Ph.D. degrees from the Department of Computer Science, Pusan National University, Busan, Korea, in 1993 and 1999, respectively. From 1997 to the present, he is a professor at the Department of Computer Engineering, Silla University, Korea. He is currently an associate editor for Journal of Intelligence and Information Systems and The Open Artificial Intelligence Journal (USA). His research interests include fuzzy neural network and applications, bioinformatics, and image processing.
E-mail: gbkim@silla.ac.kr
Doo Heon Song Professor of Songdam College
Research Area: ITS, Machine learning, Artificial intelligence, Game intelligence, etc.
E-mail: dsong@ysc.ac.kr
References
Lahiri B. B. , Bagavathiappan S. , Jayakumar T. , Philip J. 2012 “Medical applications of infrared thermography: a review,” Infrared Physics & Technology 55 (4) 221 - 235    DOI : 10.1016/j.infrared.2012.03.007
Maldague X. 2001 “Theory and Practice of Infrared Technology for Nondestructive Testing,” first ed. John Wiley and Sons New York
Lahiri B. B. , Bagavathiappan S. , Reshmi P. R. , Philip J. , Jayakumar T. , Raj B. 2012 “Quantification of defects in composites and rubber materials using active thermography,” Infrared Physics & Technology 55 191 - 199    DOI : 10.1016/j.infrared.2012.01.001
Chou Y. C. , Yao L. 2009 “Automatic diagnostic system of electrical equipment using infrared thermography,” Soft Computing and Pattern Recognition 2009. IEEE 155 - 160
Barnes R. B. 1963 Thermography of the Human body Science 140 870 - 877    DOI : 10.1126/science.140.3569.870
Bagavathiappan S. , Philip J. , Jayakumar T. , Raj B. , Rao P. N. S. , Varalakshmi M. , Mohan V. 2010 “Correlation between plantar foot temperature and diabetic neuropathy: a case study by using an infrared thermal imaging technique,” Journal of diabetes science and technology 4 (6) 1386 - 1392    DOI : 10.1177/193229681000400613
Bagavathiappan S. , Saravanan T. , Philip J. , Jayakumar T. , Raj B. , Karunanithi R. , Panicker T. , Korath M.P. , Jagadeesan K. 2009 “Infrared thermal imaging for detection of peripheral vascular disorders,” Journal of Medical Physics 34 43 - 47    DOI : 10.4103/0971-6203.48720
Bitar D. , Goubar A. , Desenclos J. C. 2009 “International travels and fever screening during epidemics: a literature review on the effectiveness and potential use of non-contact infrared thermometers,” Eurosurveillance 14 1 - 5
Zelichowska B. , Rozycki R. , Tlustochowicz M. , Kujawa A. , Kalicki B. , Murawski P. 2005 “The usefulness of the thermography in the dry eye syndrome,” Klinika Oczna 107 483 - 487
Amalu W. C. , Hobbins W. B. , Head J. F. , Elliot R. L. 2006 The Biomedical Engineering Handbook 3rd ed. Medical Devices and Systems. CRC Press Baton Rouge “Infrared imaging of the breast ? an overview,”
Wishart G. C. , Campisi M. , Boswell M. , Chapman D. , Shackleton V. , Iddles S. , Hallett A. , Britton P. D. 2010 “The accuracy of digital infrared imaging for breast cancer detection in women undergoing breast biopsy.” European Journal of Surgical Oncology 36 (6) 535 - 540    DOI : 10.1016/j.ejso.2010.04.003
oquete L. B , Ortega S. , Miguel-Jim?nez J. M. , Rodr?guez-Ascariz J. M. , Blanco R. 2012 “Automated detection of breast cancer in thermal infrared images, based on independent component analysis,” Journal of medical systems 36 (1) 103 - 111    DOI : 10.1007/s10916-010-9450-y
Kuruganti P. T. , Qi H. 2002 “Asymmetry analysis in breast cancer detection using thermal infrared images,” Engineering in Medicine and Biology, 2002. 24th Annual Conference and the Annual Fall Meeting of the Biomedical Engineering Society EMBS/BMES Conference, 2002. Proceedings of the Second Joint. IEEE 2 1155 - 1156
Subedi S. , Umbaugh S. E. , Fu J. , Marino D. J. , Loughin C. A. , Sackman J. 2014 “Thermographic image analysis as a pre-screening tool for the detection of canine bone cancer.” SPIE Optical Engineering Applications. International Society for Optics and Photonics 92171D - 92171D
Arora N. , Martins D. , Ruggerio D. , Tousimis E. , Swistel A. J. , Osborne M. P. , Simmons R. M. 2008 “Effectiveness of a noninvasive digital infrared thermal imaging system in the detection of breast cancer,” The American Journal of Surgery 196 (4) 523 - 526    DOI : 10.1016/j.amjsurg.2008.06.015
Qi H. , Head J. 2001 “Asymmetry analysis using automatic segmentation and classification for breast cancer detection in thermograms,” Proc. 23rd Annual Int’ Conference of the IEEE EMBS, Turkey 2866 - 2869
Tan T. Z. , Quek C. , Ng G. S. , Ng E. Y. K. 2007 “A novel cognitive interpretation of breast cancer thermography with complementary learning fuzzy neural memory structure,” Expert Systems with Applications 33 652 - 666    DOI : 10.1016/j.eswa.2006.06.012
Duda R. O. , Hart P. E. 1973 Pattern Classification and Scene Analysis John Wiley and Sons New York
Phung S. L. , Bouzerdoum A. , Chai D. 2002 “A novel skin color model in YCbCr color space and its application to human face detection,” Image Processing. 2002. Proceedings. 2002 International Conference on. IEEE 1 I-289 - I-292
Fisher B. , Perkins S. , Walker A. , Wolfart E. 1996 Hypermedia Image Processing Reference John Wiley & Sons Ltd.