Home   >   CSC-OpenAccess Library   >    Manuscript Information
Image-Based Multi-Sensor Data Representation and Fusion Via 2D Non-Linear Convolution
Aaron Rababaah
Pages - 138 - 156     |    Revised - 15-03-2012     |    Published - 16-04-2012
Volume - 6   Issue - 2    |    Publication Date - April 2012  Table of Contents
Multi-senor Data Fusion, Image-based Fusion, Data Fusion Via Non-linear Convolution, Situation Assessment
Sensor data fusion is the process of combining data collected from multi sensors of homogeneous or heterogeneous modalities to perform inferences that may not be possible using a single sensor. This process encompasses several stages to arrive at a sound reliable decision making end result. These stages include: senor-signal preprocessing, sub-object refinement, object refinement, situation refinement, threat refinement and process refinement. Every stage draws from different domains to achieve its requirements and goals. Popular methods for sensor data fusion include: ad-hock and heuristic-based, classical hypothesis-based, Bayesian inference, fuzzy inference, neural networks, etc. in this work, we introduce a new data fusion model that contributes to the area of multi-senor/source data fusion. The new fusion model relies on image processing theory to map stimuli from sensors onto an energy map and uses non-linear convolution to combine the energy responses on the map onto a single fused response map. This response map is then fed into a process of transformations to extract an inference that estimates the output state response as a normalized amplitude level. This new data fusion model is helpful to identify sever events in the monitored environment. An efficiency comparison with similar fuzzy-logic fusion model revealed that our proposed model is superior in time complexity as validated theoretically and experimentally.
CITED BY (3)  
1 You, J. (2014). Hierarchical Multi-sensors Data Fusion for Enhanced Context Inference. International Journal of Control and Automation, 7(2), 189-196.
2 Bai, J., Ma, Y., Li, J., Li, H., Fang, Y., Wang, R., & Wang, H. (2014). Good match exploration for thermal infrared face recognition based on YWF-SIFT with multi-scale fusion. Infrared Physics & Technology, 67, 91-97.
3 Suh, D., & You, J. (2013). Data Fusion with Reduced Calculation for Contextual Inference.
1 Google Scholar 
2 CiteSeerX 
3 refSeek 
4 Scribd 
5 SlideShare 
6 PdfSR 
A. Turolla, L. Marchesotti and C.S. Regazzoni, “Multicamera Object Tracking in Video Surveillance Applications”, DIBE, University of Genoa, Italy
Bodo Robert, Jackso Bennett, and Papanikolopoulos Nikolaos, “Vision-Based Human Tracking and Activity Recognition,” 2002. AIRVL, Dept. of Computer Science and Engineering, University of Minnesota. http://mha.cs.umn.edu/Papers/Vision_Tracking_Recognition.pdf
Boult Terrance E., “Geo-spatial Active Visual Surveillance on Wireless Networks,” Proceedings of the 32nd Applied Imagery Pattern Recognition Workshop. http://vast.uccs.edu/.../PAPERS/IEEE-IAPR03-Geo-Spatial_active_Visual_Surveillance-On- Wireless-Networks-Boult.pdf
Brooks Alex and Williams Stefan, “Tracking People with Networks of Heterogeneous Sensors,” ARC Centre of Excellence in Autonomous Systems. School of Aerospace, Mechanical, and Mechatronic Engineering, University of Sydney, NSW Australia, 2003 www.acfr.usyd.edu.au/publications/downloads/2004/Brooks210/Brooks03Tracking.pdf
Chang Edward Y. and Wang Yuan-Fang, “Toward Building a Robust and Intelligent Video Surveillance System: A Case Study,” Dept. of Electrical and Computer Engineering Dept. of Computer Science, Univ. of California, 2003. www.cs.ucsb.edu/~yfwang/papers/icme04_invited.pdf
Chang Edward Y. and Wang Yuan-Fang, “Toward Building a Robust and Intelligent Video Surveillance System: A Case Study,” Dept. of Electrical and Computer Engineering Dept. of Computer Science, Univ. of California, 2003. www.cs.ucsb.edu/~yfwang/papers/icme04_invited.pdf
Chen Datong, Malkin Robert, Yang Jie, Multimodal Detection of Human Interaction Events in a Nursing Home Environment, School of Computer Science, Carnegie Mellon University, Sixth International Conference on Multimodal Interfaces (ICMI'04), Penn State University, State College, PA, October 14-15, 2004
Collins Robert T., Lipton Alan J., Fujiyoshi Hironobu and Fellow Takeo Nade, IEEE, “Algorithms for Cooperative Multi-sensor Surveillance,” 2001. Processing of the IEEE, VOL. 89, NO. 10, October 2001.
Ellis Tim. Multi-camera Video Surveillance. 2002. Information Engineering Center, School of engineering, City university, London. 0-7803-7436-3/02 2002 IEEE.
Gerosa L., Valenzise G., Tagliasacchi M., Antonacci F., and Sarti A.. Scream And Gunshot Detection In Noisy Environments, Dipartimento di Elettronica e Informazione, Politecnico di Milano, Italy, VISNET II, a network of excellence 2006.
Goh King-Shy, Miyahara Koji, Radhakrishan Regunathan, Xiong Ziyou, and Divakaran Ajay, Audio-Visual Event Detection based on Mining of Semantic Audio-Visual Labels, MERL – A MITSUBISHI ELECTRIC RESEARCH LABORATORY, http://www.merl.comTR- 2004-008 March 2004
Hall David L. and McMullen Sonya A. H. Mathematical Techniques in Multisensor Data Fusion, 2nd edition, 2004. Artech House, INC. Norwood, MA.
Klapuri, Audio signal classification, ISMIR Graduate School, October 4th-9th, 2004, http://mtg.upf.edu/ismir2004/graduateschool/people/Klapuri/classification.pdf
Kogut Greg, Blackburn Mike, Everett H.R., “Using Video Sensor Networks to Command and Control Unmanned Ground Vehicles,” Space and Naval Warfare Systems Center San Diego, 2000. www.spawar.navy.mil/robots/pubs/usis03diva.pdf
Koller D., Weber J., Huang T., Malik J., Ogasawara G., Rao B., and Russell S., “ Toward Robust Automatic Traffic Scene Analysis in Real-Time,” IEEE Computer Science Division University of California, Berkeley, CA, 1994. http://dx.doi.org/10.1109/ICPR.1994.576243
Ma Yunqian, Miller Ben, Buddharaju Pradeep, Bazakos Mike, “Activity Awareness: From Predefined Events to New Pattern Discovery,” Proceedings of the Fourth IEEE International Conference on Computer Vision Systems (ICVS 2006). www.cs.colostate.edu/icvs06/Program.pdf
MatLab Documentation on Fuzzy Logic. MatLab7 R14. The MathWorks Documentation. http://www.mathworks.com/access/helpdesk/help/toolbox/fuzzy/fuzzy.html?BB=1
MatLab Documentation on Signal Processing – Signal Windowing models. MatLab7 R14. The MathWorks Documentation. http://www.mathworks.com/documentation/signalprocessing/hamming
Meyer Michael, Ohmacht Thorsten and Bosch Robert GmbH and Michael Hotter, “Video Surveillance Applications Using Multiple Views of a Scene,” IEEE AES Systems Magazine, March 1999.
Niu Wei, Long Jiao, Han Dan, and Wang Yuan-Fang, “Human Activity Detection and Recognition for Video Surveillance,” the 2004 IEEE International Conference on Multimedia and Expo. www.cs.ucsb.edu/~yfwang/papers/icme04_tracking.pdf
Sensory Physiology Lettuces at University Minnesota Dulutth, 03.17.2012. http://www.d.umn.edu/~jfitzake/Lectures/DMED/SensoryPhysiology/GeneralPrinciples/Codi ngTheories.html
Siebel Nils T. and Maybank Steve, “Fusion of Multiple Tracking Algorithms for Robust People Tracking, Annotated Digital Video for Intelligent Surveillance and Optimized Retrieval (ADVISOR),”. Computational Vision Group, Department of Computer Science, The University of Reading, Reading RG6 6AY, England, 2001. www.cvg.reading.ac.uk/papers/advisor/ECCV2002.pdf
Snidaro L., Niu R., Varshney P.K., and Foresti G.L., “Automatic Camera Selection and Fusion for Outdoor Surveillance Under Changing Weather Conditions,” Dept. of Mathematics and Computer Science, University of Udine, Ital, Department of EECS, Syracuse University, NY, 2003. www.ecs.syr.edu/research/SensorFusionLab/Downloads/Rrixin%20Niu/avss03.pdf
Stauffer Chris, Automated Audio-visual Activity Analysis, Compute Science and Artificial Intelligence Laboratory, MIT-CAAIL-TR-2005-057, AIM-2005-026, 09, 20, 2005
Temko Andrey, Malkin Robert, Zieger Christian, Macho Dusan, Nadeu Climent, and Omologo Maurizio, Acoustic Event Detection And Classification In Smart-Room Environments: Evaluation Of Chil Project Systems, TALP Research Center, UPC, Barcelona, Spain, interACT, CMU, Pittsburgh, USA, ITC-irst, Povo (TN), Italy Zaragoza • Del 8 al 10 de Noviembre de 2006.
Trivedi Mohan M., Gandhi Tarak L., and Huang Kohsia S., “Distributed Interactive. Video Arrays for Event Capture and Enhanced Situational Awareness,” in the 2005 IEEE Intelligent Systems.
Turollu A., Marchesotti L. and Regazzoni C.S., “Multicamera Object Tracking In Video Surveillance Applications,” DIBE, University of Genoa, Italy, 2001. http://cmp.felk.cvut.cz/cvww2006/papers/39/39.pdf
Varshney Pramod K., Mehrotra Kishan G., and Mohan Chilukuri K., Decision Making and Reasoning with Uncertain Image and Sensor Data, Syracuse University. http://wwwvideo. eecs.berkeley.edu/vismuri/meeting2006/syracuse.ppt
Dr. Aaron Rababaah
University of Maryland Eastern Shore - United States of America