Home   >   CSC-OpenAccess Library   >    Manuscript Information
Image Fusion and Image Quality Assessment of Fused Images
MANJUSHA, UDHAV
Pages - 484 - 508     |    Revised - 30-11-2010     |    Published - 20-12-2010
Volume - 4   Issue - 5    |    Publication Date - December 2010  Table of Contents
MORE INFORMATION
KEYWORDS
Hotelling Transform, , Image Registration, , Radon Transform, Wavelet Transform, Image Fusion
ABSTRACT
Accurate diagnosis of tumor extent is important in radiotherapy. This paper presents the use of image fusion of PET and MRI image. Multi-sensor image fusion is the process of combining information from two or more images into a single image. The resulting image contains more information as compared to individual images. PET delivers high-resolution molecular imaging with a resolution down to 2.5 mm full width at half maximum (FWHM), which allows us to observe the brain\'s molecular changes using the specific reporter genes and probes. On the other hand, the 7.0 T-MRI, with sub-millimeter resolution images of the cortical areas down to 250 m, allows us to visualize the fine details of the brainstem areas as well as the many cortical and sub-cortical areas. The PET-MRI fusion imaging system provides complete information on neurological diseases as well as cognitive neurosciences. The paper presents PCA based image fusion and also focuses on image fusion algorithm based on wavelet transform to improve resolution of the images in which two images to be fused are firstly decomposed into sub-images with different frequency and then the information fusion is performed and finally these sub-images are reconstructed into result image with plentiful information. . We also propose image fusion in Radon space. This paper presents assessment of image fusion by measuring the quantity of enhanced information in fused images. We use entropy, mean, standard deviation and Fusion Mutual Information, cross correlation , Mutual Information Root Mean Square Error, Universal Image Quality Index and Relative shift in mean to compare fused image quality. Comparative evaluation of fused images is a critical step to evaluate the relative performance of different image fusion algorithms. In this paper, we also propose image quality metric based on the human vision system (HVS).
CITED BY (46)  
1 Brahmbhatt, K. N., & Makwana, R. M. (2016). Implementation and Comparative Study of Image Fusion Methods in Frequency Domain. In Proceedings of 3rd International Conference on Advanced Computing, Networking and Informatics (pp. 271-278). Springer India.
2 Yin, H., Liu, Z., Fang, B., & Li, Y. (2015). A novel image fusion approach based on compressive sensing. Optics Communications, 354, 299-313.
3 Pohl, C., Nazirun, N. N. N., & Tamin, S. S. (2015). Multimodal Medical Image Fusion in Cardiovascular Applications. In Medical Imaging Technology (pp. 91-109). Springer Singapore.
4 Chen, Y., & Hu, W. (2015, August). Low light level color night vision technology study on triple-band. In International Conference on Optical Instruments and Technology 2015 (pp. 96180S-96180S). International Society for Optics and Photonics.
5 Prakash, O., & Khare, A. (2015). CT and MR Images Fusion Based on Stationary Wavelet Transform by Modulus Maxima. In Computational Vision and Robotics (pp. 199-204). Springer India.
6 Suru, D., & Karamchandani, S. (2015, February). Image Fusion in Variable Raster Media for Enhancement of Graphic Device Interface. In Computing Communication Control and Automation (ICCUBEA), 2015 International Conference on (pp. 733-736). IEEE.
7 Zhang, C., Luo, X., Zhang, Z., Gao, R., & Wu, X. (2015). Multi-focus Image Fusion Method Using Higher Order Singular Value Decomposition and Fuzzy Reasoning. Journal of Algorithms & Computational Technology, 9(3), 303-322.
8 Kathiresan, N., & Manoharan, J. S. (2015). A Comparative Analysis of Fusion Techniques Based on Multi Resolution Transforms. National Academy Science Letters, 38(1), 61-65.
9 Siddiqui, U. Z., & Thorat, P. R. A New Approach to Efficient Medical Image Fusion.Chen Chao, Huwen Gang, WU Dong-sheng, He Yongqiang, Dongxiao Zhang, & Li Xiaoming. (2015). Three-band color shimmer night vision Research Methods Applied Optics, (3), 430-434.
10 Aiordachioaie, D. (2015, June). On the spatial and multi-frequency airborne ultrasonic image fusion. In Electronics, Computers and Artificial Intelligence (ECAI), 2015 7th International Conference on (pp. E-33). IEEE.
11 An, Z., & Shi, Z. (2014). Hyperspectral image fusion by multiplication of spectral constraint and NMF. Optik-International Journal for Light and Electron Optics, 125(13), 3150-3158.
12 Tarolli, J., Tian, H., & Winograd, N. (2014). Application of pan-sharpening to SIMS imaging. Surface and Interface Analysis, 46(S1), 217-220.
13 Xu, Z. (2014). Medical image fusion using multi-level local extrema. Information Fusion, 19, 38-48.
14 Liu, Z., Yin, H., Chai, Y., & Yang, S. X. (2014). A novel approach for multimodal medical image fusion. Expert Systems with Applications, 41(16), 7425-7435.
15 Budhewar, S. T. (2014). Wavelet and Curvelet Transform based Image Fusion Algorithm. structure, 7, 3.
16 Amini, N., Fatemizadeh, E., & Behnam, H. (2014). MRI-PET image fusion based on NSCT transform using local energy and local variance fusion rules. Journal of medical engineering & technology, 38(4), 211-219.
17 Devi, A. G., Madhu, T., & Kishore, K. L. (2014). An improved super resolution image reconstruction using SVD based fusion and blind deconvolution techniques. International Journal of Signal Processing, Image Processing and Pattern Recognition, 7(1), 283-298.
18 Tarolli, J. G., Jackson, L. M., & Winograd, N. (2014). Improving Secondary Ion Mass Spectrometry Image Quality with Image Fusion. Journal of The American Society for Mass Spectrometry, 25(12), 2154-2162.
19 Kothalkar, S. S., & Deshmukh, M. (2014). Comparative Study of Image Registration Methods. International Journal of Image Processing (IJIP), 8(3), 125.
20 Mirji, B., & Manjesh, R. Image Fusion based on Face and Iris Feature vectors.
21 Sontakke, N. K., Gaikwad, V. T., & Datir, H. N. Review On: An Approach For Protection Of Secret Image Using Curvelet Transform.
22 Tseng, D. C., Liu, Y. S., & Chou, C. M. (2014). Image Fusion with Contrast Improving and Feature Preserving. Mathematical Problems in Engineering.
23 Budhewar, S., & Paikrao, P. L. Review of Image Fusion Techniques.
24 Yu, Z., Yan, L., & Han, N. (2014). A Region-Based Image Fusion Algorithm for Detecting Trees in Forests. Open Cybernetics & Systemics Journal, 8, 540-545.
25 Panigrahi, B. K., Santhosh, J., & Anand, S. (2014, November). Application of SiDWT with extended PCA for multi-focus images. In Medical Imaging, m-Health and Emerging Communication Systems (MedCom), 2014 International Conference on (pp. 55-59). IEEE.
26 Amini, N., Fatemizadeh, E., & Behnam, H. (2014). MRI and PET Image Fusion by Using Curvelet Transform. Journal of Advances in Computer Research, 5(4), 23-30.
27 An, Z., & Shi, Z. (2014). An improved-SFIM fusion method based on the calibration process. Optik-International Journal for Light and Electron Optics, 125(14), 3764-3769.
28 Sudharani, B., Hemalatha, M., & Deepa, B. Wavelet Transform for a Fuzzy Based Image Fusion.
29 Yang, J. I. A. O., & De-sheng, F. U. (2013). Infrared and Visible Cloud Image Fusion Based on the Second Generation Curvelet Transforms. Journal of Convergence Information Technology, 8(4).
30 Bharathi, K. S., & Nivedha, R. A Study on the Fusion of Registered Infrared and Visual Images.
31 Sale, D., Joshi, D. M., Patil, V., Sonare, P., & Jadhav, C. Image Fusion For Medical Image Retrieval. International Journal of Computational Engineering Research, 3, 01-05.
32 Mantale, U. B., & Gaikwad, V. B. (2013). Image Fusion of Brain Images using Redundant Discrete Wavelet Transform. International Journal of Computer Applications, 74(4).
33 Vahidi, M. J., Jafarzadeh, A. A., Fakherifard, A., Sadeghi, S. H. R., Rezaei-Moghaddam, M. H., Sofia, G., & Tarolli, P. (2013). DIGITAL CHANGE DETECTION USING REMOTELY SENSED DATA FOR MONITORING LAND USE/LAND COVER IN HERVI WATERSHED, IRAN. International Journal of Agriculture, 3(2), 423.
34 Yusuf, Y., Sri Sumantyo, J. T., & Kuze, H. (2013). Spectral information analysis of image fusion data for remote sensing applications. Geocarto International, 28(4), 291-310.
35 Zhang, Z., & Shi, Z. (2013). Nonnegative matrix factorization-based hyperspectral and panchromatic image fusion. Neural Computing and Applications, 23(3-4), 895-905.
36 Nair, S. A. H., Aruna, P., & Vadivukarassi, M. PCA BASED Image Fusion of Face And Iris Biometric Features.
37 Jameel, A., Ghafoor, A., & Riaz, M. M. (2013, November). Entropy dependent compressive sensing based image fusion. In 2013 International Symposium on Intelligent Signal Processing and Communication Systems.
38 VIDHYA, K., & SARITHA, E. A COMPARATIVE STUDY ON MEDICAL IMAGE FUSION TECHNIQUES.
39 Galande, A., & Patil, R. (2013, August). The art of medical image fusion: a survey. In Advances in Computing, Communications and Informatics (ICACCI), 2013 International Conference on (pp. 400-405). IEEE.
40 Zhang, Z., Shi, Z., & An, Z. (2013). Hyperspectral and panchromatic image fusion using unmixing-based constrained nonnegative matrix factorization. Optik-International Journal for Light and Electron Optics, 124(13), 1601-1608.
41 Prakash, O., Srivastava, R., & Khare, A. (2013, April). Biorthogonal wavelet transform based image fusion using absolute maximum fusion rule. In Information & Communication Technologies (ICT), 2013 IEEE Conference on (pp. 577-582). IEEE.
42 Kaur, S., & Kaur, K. (2012). Study and Implementation of Image Fusion Methods. International Journal Of Electronics And Computer Science Engineering (Ijecse, ISSN: 2277-1956), 1(03), 1369-1373.
43 Xiaoxin Yong. (2012) A joint bilateral filtering and PCA of new non-flash and flash-based image fusion technology.
44 Bandyopadhyay, P., Samir, K., Datta, B., & Roy, S. (2012). Identifications of concealed weapon in a Human Body. arXiv preprint arXiv:1210.5653.
45 Haghighat, M. B. A., Aghagolzadeh, A., & Seyedarabi, H. (2011). A non-reference image fusion metric based on mutual information of image features. Computers & Electrical Engineering, 37(5), 744-756.
46 Wan, T., & Qin, Z. (2011). An application of compressive sensing for image fusion. International Journal of Computer Mathematics, 88(18), 3915-3930.
1 Google Scholar 
2 CiteSeerX 
3 refSeek 
4 iSEEK 
5 Socol@r  
6 Scribd 
7 SlideShare 
8 PDFCAST 
9 PdfSR 
Andrew P. Bradley,” Shift6invariance in the Discrete Wavelet Transform” Proc. VIIth Digital Image Computing: Techniques and Applications, Sun C., Talbot H., Ourselin S. and Adriaansen T. (Eds.), 10112 Dec. 2003, Sydney.
Ramac, L. C., Uner, M. K., Varshney, P. K., “Morphological filters and wavelet based image fusion for concealed weapon detection,” Proceedings of SPIE, 3376, 1998.
Alexander Toet, van Ruyven, J.J. & Valeton, J.M.,” Merging Thermal and Visual Images by a Contrast Pyramid”, Optical Engineering, 28(7), pp. 7891792.
Alexander Toet’ Multiscale contrast enhancement with applications to image fusion”, Optical Engineering 31(5), 102611031 (May 1992).
Barbara Zitova, Jan Flusser, “Image Registration Methods: A survey”, Image and Vision Computing 21(2003)97711000.
Brown Gottesfeld L., “Survey of Image Registration techniques”, ACM Computing Surveys, 24, 4, and 1992, 3251376.
Chavez, P.S., Sides, S. C. Anderson, J.A., “Comparison of Three Different Methods to Merge Multiresolution and Multispectral Data: Landsat TM and SPOT Panchromatic”, Photogrametric Engineering and Remote Sensing, 57,2951303.
David A Y “ Image Merging and Data Fusion by Means of the Discrete Two Dimensional Wavelet Transform” J.Opt.Soc.An.Am.A, 1995 , 12 (9) : 183411841.
Du1Ming Tsai, Ron1Hwa Yang “An eigenvalue6based similarity measure and its application in defect detection”Image and Vision Computing , 23(12): 109411101, Nov 2005,
Garzelli, A” Possibilities and Limitations of the Use of Wavelets in Image Fusion.” In: Pro. IEEE International Geoscience and Remote Sensing Symposium, 2002.
H. Li, B. S, Manjunath and S. K. Mitra “ Multisensor Image Fusion Using the Wavelet Transform”, Graphical Models and Image Processing. 57 (3): 2351245,1995.
Haim Schweitzer, "Optimal Eigenfeature Selection by Optimal Image Registration," cvpr,pp.1219, 1999 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'99) 1 Volume 1, 1999.
J.B. Antoine Maintz and Max A. Vierger , “A Survey of Medical Image Registration, Medical Image Analysis”,(1/98) volume 2. number1, pp 1137
JIA Yong1hong, Li de1ren, SUN Jia1bing “Multidimentional Remote Sensing Imagery Data Fusion” Remote Sensing Technology and Application 2005,15 (1) : 41144.
Jiangsheng You,Weiguo Lu, Jian Li et. al. “Image Matching for Translation Rotation and Uniform Scaling by Radon Transform” 0181861882111/98, 1998 IEEE.
Lau Wai Leung, Bruce King and Vijay Vohora,” Comparison of Image Fusion Techniques using Entropy and INI”, In: Pro. 22 nd Asian Conference on Remote Sensing, 519 Nov 2001.
Lau Wai Leung, Bruce King and Vijay Vohora,” Comparison of Image Fusion Techniques using Entropy and INI”, In: Pro. 22 nd Asian Conference on Remote Sensing,519 Nov 2001.
Ma Debao Li Wugao Le Zhongxin Wang Jiefeng “The new matrix characteristic methods of image fine registrationfor synthetic aperture radar interferometry”Geoscience and Remote Sensing Symposium, 2000. Proceedings. IGARSS 2000. IEEE 2000 International, 2000, 2: 7581760
Milad Ghantous, Soumik Ghosh and Magdy Bayoumi ,” A Gradient6based Hybrid Image Fusion Scheme using Object Extraction”,2008 IEEE,97811142441176413/08.
Nunez, J., “Multiresolution6based image fusion with additive wavelet decomposition,” IEEE Transactions onGeoscience and Remote Sensing, 37(3), 1999.
P. Burt, E. Adelson, “Laplacian pyramid as a compact image code,” IEEE Transactions on Communications, 31(4), 1983.
P.A. Van den Elsen, Evert1Jan D. Pol et al:” Medical Image Matching6 a Review with Classification.”IEEE Engineering Medicine and Biology, March , pp 26138,1993.
Rafael C. Gonzalez, R. E. Woods, StevanL.Eddins, Digital Image Processing (Pearson Education, 2003).
Rockinger, O., “Image Sequence Fusion Using a Shift Invariant Wavelet Transform, “Proceedings of the International conference on Image Processing, 1997.
S. Mallat, “ A Wavelet Tour of Signal Processing” Academic Press, Second Edition, 1998.
Svensson, J. R..,M. O.Ulfarsson & J. A. Benediktsson, “Cluster Based Feature Extraction and Data Fusion in the Wavelet Domain” In:Pro. IEEE International Geoscience and Remote Sensing Symposium, pp. 8671869.
Toet, J. Van Ruvan, and J. Valeton, “Merging thermal and visual images by a contrast pyramid,” Optical Engineering, 28, 1989.
Vivek Maik , Jeongho Shin and Joonki Paik ,” Pattern Selective Image Fusion for Focus Image Reconstruction”, Caip 2005, LNCS 3691,pp 6771684,2005.
Wen Cao; Bicheng Li; Yong Zhang,” A remote sensing image fusion method based on PCA t ransform and wavelet packet transform”, Neural Networks and Signal Processing, 2003. Proceedings of the 2003 International Conference on 2:14117 Dec. 2003 ,2: 976 1 981
Wen Doua, Yunhao Chen,” An Improved Image Fusion Method with High Spectral Fidelity”, The International Archives of the Photogrammetry
Xydeas, C., and Petrovic, V., “Objective Pixel6level Image Fusion Performance Meas
Zhao Zong1gui “ An Introduction to Data Fusion Method.” First press. 28 th Institute of Electricity Ministry,1998.
Mr. MANJUSHA
- India
manju0810@yahoo.com
Mr. UDHAV
- India


CREATE AUTHOR ACCOUNT
 
LAUNCH YOUR SPECIAL ISSUE
View all special issues >>
 
PUBLICATION VIDEOS