Home   >   CSC-OpenAccess Library   >    Manuscript Information
Fusion of Wavelet Coefficients from Visual and Thermal Face Images for Human Face Recognition – A Comparative Study
Mrinal Kanti Bhowmik, Debotosh Bhattacharjee, Mita Nasipuri, Dipak Kumar Basu , Mahantapas Kundu
Pages - 12 - 23     |    Revised - 25-02-2010     |    Published - 26-03-2010
Volume - 4   Issue - 1    |    Publication Date - March 2010  Table of Contents
Thermal image, Daubechies Wavelet Transform, Haar Wavelet Transform, Fusion, Principal Component Analysis (PCA), Multi-layer Perceptron and Face Recognition
In this paper we present a comparative study on fusion of visual and thermal images using different wavelet transformations. Here, coefficients of discrete wavelet transforms from both visual and thermal images are computed separately and combined. Next, inverse discrete wavelet transformation is taken in order to obtain fused face image. Both Haar and Daubechies (db2) wavelet transforms have been used to compare recognition results. For experiments IRIS Thermal/Visual Face Database was used. Experimental results using Haar and Daubechies wavelets show that the performance of the approach presented here achieves maximum success rate of 100% in many cases.
CITED BY (8)  
1 Singh, K., & Sinha, A. K. (2013). Face Recognition using Extended Kalman Filter based Machine Learning. International Journal of Computer Applications, 66(16).
2 DURÓ, V. E. (2013). Face recognition by means of advanced contributions in machine learning (Doctoral dissertation, Universitat Politècnica de Catalunya).
3 Wang, N., Li, Q., El-Latif, A. A. A., Peng, J., Niu, X., Rawat, P., ... & Kumar, V. V. (2013). Multibiometric Complex Fusion for Visible and Thermal Face Images. International Journal of Signal Processing, Image Processing and Pattern Recognition, 6(3), 1-16.
4 Bhowmik, M. K., Bhattacharjee, D., Basu, D. K., & Nasipuri, M. (2012). Eye region-based fusion technique of thermal and dark visual images for human face recognition. Optical Engineering, 51(7), 077205-1.
5 Saha, P., Bhowmik, M. K., De, B. K., Bhattacharjee, D., & Nasipuri, M. Performance Evaluation through KICA and Feature level Fusion for Human Face Recognition. In Artificial Intelligence and Soft Computing (p. 34).
6 Bhowmik, M. K., Bhattacharjee, D., Basu, D. K., & Nasipuri, M. (2011, December). Facial expression invariant person recognition using feature level fusion of visual and thermal images. In Information and Communication Technologies (WICT), 2011 World Congress on (pp. 1090-1097). IEEE.
7 Bhowmik, m. k., bhattacharjee, d., basu, d. k., & nasipuri, M. Human Face Recognition using Wavelet Fusion and SVM.
8 Singh, K., & Sinha, A. K. (2010, December). An improved algorithm for face recognition using wavelet and facial parameters. In Proceedings of the First International Conference on Intelligent Interactive Technologies and Multimedia (pp. 51-58). ACM.
1 Google Scholar 
2 ScientificCommons 
3 Academic Index 
4 CiteSeerX 
5 iSEEK 
6 Socol@r  
7 ResearchGATE 
8 Bielefeld Academic Search Engine (BASE) 
9 OpenJ-Gate 
10 Scribd 
11 WorldCat 
12 SlideShare 
14 PdfSR 
A. Gyaourova, G. Bebis and I. Pavlidis. “Fusion of infrared and visible images for face recognition”. Lecture Notes in Computer Science. 2004.Springer. Berlin
A. Haar. “Zur Theorie der orthogonalen Funktionensysteme (German)”
A. Pentland and T. Choudhury. “Face Recognition for Smart Environments”. IEEE Computer. 33(2):50-55, 2000
A. Rahim & J. V. Charangatt. “Face Hallucination using Eigen Transformation in Transform Domain”. International Journal of Image Processing (IJIP) Vol. 3. Issue 6, pp. 265-282.
A. Ross and A. Jain. “Information fusion in biometrics”. Pattern Recognition Letters. Vol. 24, No. 13. pp.2115-2125. 2003
A. Selinger, D. Socolinsky. “Appearance-based facial recognition using visible and thermal imagery: a comparative study”. Technical Report 02-01. Equinox Corporation. 2002
A. Singh, G. B. Gyaourva and I. Pavlidis. “Infrared and Visible Image Fusion for Face Recognition”. Proc. SPIE. vol.5404. pp.585-596. Aug.2004
B. Moghaddam and A. Pentland. “Probabilistic Visual Recognition for Object Recognition”. Trans. IEEE Pattern Analysis and Machine Intelligence. 19(7):696-710. 1997
C. Sanderson and K. K. Paliwal. “Information fusion and person verification using speech and face information”. IDIAP Research Report 02-33. Martigny. Switzerland. 2002
D. Bhattacharjee, M. K. Bhowmik, M. Nasipuri, D. K. Basu & M. Kundu. “A Parallel Framework for Multilayer Perceptron for Human Face Recognition”. International Journal of Computer Science and Security (IJCSS), Vol. 3. Issue 6, pp. 491-507.
D. Bhattacharjee, M. K. Bhowmik, M. Nasipuri, D. K. Basu and M. Kundu. “Classification of Fused Face Images using Multilayer Perceptron Neural Network”. Proceedings of International Conference on Rough sets. Fuzzy sets and Soft Computing. November 5–7, 2009. organized by Deptt. of Mathematics. Tripura University. pp. 289 – 300
G. Bebis, A. Gyaourova, S. Singh and I. Pavlidis. “Face Recognition by Fusing Thermal Infrared and Visible Imagery”. Image and Vision Computing. Vol. 24, Issue 7. July 2006. pp. 727-742
H. K. Ekenel and B. Sankur. “Multiresolution face recognition”. Image and Vision Computing. 2005. Vol. 23. pp. 469 – 477
I. Daubechies. Ten lectures on wavelets, CBMS-NSF conference series in applied mathematics. SIAM Ed. 1992
I. Pavlidis and P. Symosek. “The Imaging Issue in an Automatic Face/Disguise Detecting System”. Proceedings of the IEEE Workshop on Computer Vision Beyond the Visible Spectrum: Methods and Applications (CVBVS 2000)
I. Pavlidis, P. Symosek, B. Fritz. “A Near Infrared Fusion Scheme for Automatic Detection of Humans”. U.S. Patent Pending. H16-25929 US. filed in September 3, 1999
J. Heo, S. G. Kong, B. R. Abidi and M. A. Abidi. “Fusion of Visual and Thermal Signatures with Eyeglass Removal for Robust Face Recognition”. Conference on Computer Vision and Pattern Recognition Workshop (CVPRW'04) Vol. 8. pp. 122-122. USA. 2004
J. Shen and G. Strang. “Applied and Computational Harmonic Analysis”. 5(3). “Asymptotics of Daubechies Filters, Scaling Functions and Wavelets”
L. Wiskott et al., “Face Recognition by Elastic Bunch Graph Matching”. Trans. IEEE Pattern Analysis and Machine Intelligence. 19(7):775-779. 1997
M. Hanif and U. Ali. “Optimized Visual and Thermal Image Fusion for Efficient Face Recognition”. IEEE Conference on Information Fusion. 2006
M. K. Bhowmik, D. Bhattacharjee and M. Nasipuri. “Topological Change in Artificial Neural Network for Human Face Recognition”. Proceedings of National Seminar on Recent Development in Mathematics and its Application. Tripura University. Nov. 14 – 15, 2008. pp: 43 – 49
M. K. Bhowmik, D. Bhattacharjee, M. Nasipuri, D. K. Basu and M. Kundu. “Classification of fused images using Radial basis function Neural Network for Human Face Recognition”. Proceedings of The World congress on Nature and Biologically Inspired Computing (NaBIC- 09). Coimbatore, India. published by IEEE Computer Society. Dec. 9-11, 2009. pp. 19-24
M. K. Bhowmik, D. Bhattacharjee, M. Nasipuri, D. K. Basu and M. Kundu. “Human Face Recognition using Line Features”. proceedings of National Seminar on Recent Advances on Information Technology (RAIT-2009) Feb. 6-7,2009. Indian School of Mines University. Dhanbad. pp: 385
M. K. Bhowmik, D. Bhattacharjee, M. Nasipuri, D.K. Basu and M. Kundu. “Classification of Log Polar Visual Eigenfaces using Multilayer Perceptron”. Proceedings of The 2nd International Conference on Soft computing (ICSC-2008). IET. Alwar. Rajasthan. India. Nov. 8–10. 2008. pp:107-123
M. K. Bhowmik, D. Bhattacharjee, M. Nasipuri, D.K. Basu and M. Kundu. “Classification of Polar-Thermal Eigenfaces using Multilayer Perceptron for Human Face Recognition”. in Proceedings of the 3rd IEEE Conference on Industrial and Information Systems (ICIIS-2008). IIT Kharagpur. India. Dec. 8-10. 2008. Page no: 118
M. K. Bhowmik, D. Bhattacharjee, M. Nasipuri, D.K. Basu and M. Kundu. ”Image Pixel Fusion for Human Face Recognition”. appeared in International Journal of Recent Trends in Engineering [ISSN 1797-9617]. published by Academy Publishers. Finland. Vol. 2. No. 1, pp. 258–262. Nov. 2009
M. K. Bhowmik. ”Artificial Neural Network as a Soft Computing Tool – A case study”. In Proceedings of National Seminar on Fuzzy Math. & its application. Tripura University. Nov. 25 – 26, 2006. pp: 31 – 46
P. Penev and J. Atick. “Local Feature Analysis: A General Statistical Theory for Object Representation”. Network: Computation in Neural Systems. Mar. 1996, pp. 477-500
P. Phillips et al., The Feret Database and Evaluation Procedure for Face Recognition Algorithms. Image and Vision Computing. May 1998. pp. 295-306
S. G. Mallat. “A theory for multiresolution signal decomposition: The wavelet representation”. IEEE Trans. Pattern Anal. Machine Intell., vol.11. pp. 674-693. July 1989
Sathesh & Samuel Manoharan. “A Dual Tree Complex Wavelet Transform Construction and its Application to Image Denoising”. International Journal of Image Processing (IJIP) Vol. 3. Issue 6, pp. 293-300.
T. K. Ho, J. J. Hull, and S. N. Srihari. “Decision combination in multiple classifier systems”. IEEE Trans. on Pattern Analysis and Machine Intelligence. Vol. 16. No. 1. pp.66-75. 1994
T. Paul. “Affine coherent statesand the radial Schrodinger equation. Radial harmonic oscillator and hydrogen atom”. Preprint
V. S. Petrovic and C. S. Xydeas. “Gradient-Based Multiresolution Image Fusion”. IEEE Trans. On image Processing. Vol. 13. No. 2. Feb. 2004.
W. G. Gilbert, S. Xiaoping. “Wavelets and Other Orthogonal Systems”. 2001
Y. Adini, Y. Moses, and S. Ullman. “Face recognition: The problem of compensating for changes in illumination direction”. IEEE Trans. On Pattern Analysis and Machine Intelligence. Vol. 19, No. 7. pp.721-732, 1997
Y. Meyer. Wavelets and operators. Cambridge Univ. Press. 1993
Mr. Mrinal Kanti Bhowmik
Tripura University(A Central University) - India
Dr. Debotosh Bhattacharjee
Jadavpur University - India
Professor Mita Nasipuri
Jadavpur University - India
Professor Dipak Kumar Basu
Jadavpur University - India
Professor Mahantapas Kundu
Jadavpur University - India