Home   >   CSC-OpenAccess Library   >    Manuscript Information
Camera as Mouse and Keyboard for Handicap Person with Troubleshooting Ability, Recovery, and Complete Mouse Events
Kohei Arai, Ronny Mardiyanto
Pages - 46 - 56     |    Revised - 30-11-2010     |    Published - 20-12-2010
Volume - 1   Issue - 3    |    Publication Date - December 2010  Table of Contents
MORE INFORMATION
KEYWORDS
Camera mouse, blinking, mouse events, keyboard shortcuts, troubleshooting, neck fatigue
ABSTRACT
Camera mouse has been widely used for handicap person to interact with computer. The utmost important of the use of camera mouse is must be able to replace all roles of typical mouse and keyboard. It must be able to provide all mouse click events and keyboard functions (include all shortcut keys) when it is used by handicap person. Also, the use of camera mouse must allow users troubleshooting by themselves. Moreover, it must be able to eliminate neck fatigue effect when it is used during long period. In this paper, we propose camera mouse system with timer as left click event and blinking as right click event. Also, we modify original screen keyboard layout by add two additional buttons (button “drag/ drop” is used to do drag and drop of mouse events and another button is used to call task manager (for troubleshooting)) and change behavior of CTRL, ALT, SHIFT, and CAPS LOCK keys in order to provide shortcut keys of keyboard. Also, we develop recovery method which allows users go from camera and then come back again in order to eliminate neck fatigue effect. The experiments which involve several users have been done in our laboratory. The results show that the use of our camera mouse able to allow users do typing, left and right click events, drag and drop events, and troubleshooting without hand. By implement this system, handicap person can use computer more comfortable and reduce the dryness of eyes.
CITED BY (16)  
1 于江麗. (2016). Study on Computer Input Device Using Head Movement for People with Disabilities.
2 張超. (2016). Study on Environmental Control System for People with Serious Disabilities.
3 Arai, K. (2016). Computer Input Just by Sight and Its Applications in Particular for Disable Persons. In Information Technology: New Generations (pp. 995-1007). Springer International Publishing.
4 Yoshimura, H., Hori, M., Shimizu, T., & Iwai, Y. (2015). Appearance-Based Gaze Estimation for Digital Signage Considering Head Pose. International Journal of Machine Learning and Computing, 5(6), 507.
5 Arai, K. (2015). Computer Input by Human Eyes Only and It’s Applications. In Intelligent Systems in Science and Information 2014 (pp. 1-22). Springer International Publishing.
6 Zhang, C., Ishimatsu, T., Yu, J., Murray, L., & Shi, L. (2015, August). Vision-based displacement sensor for people with serious spinal cord injury. In Mechatronics and Automation (ICMA), 2015 IEEE International Conference on (pp. 772-777). IEEE.
7 Nabati, M., & Behrad, A. (2015). 3D Head pose estimation and camera mouse implementation using a monocular video camera. Signal, Image and Video Processing, 9(1), 39-44.
8 Mangaiyarkarasi, M., & Geetha, A. Cursor control system using facial expressions for human-computer interactions. International Journal in Computer Science &Electronics (IJTCSE), Annamalai University, Chidambaram, India. ISSN, 0976-1353.
9 Arai, K. (2013). Lecturer’s e-Table (Server Terminal) Which Allows Monitoring the Location at Where Each Student is Looking During Lessons with e-Learning Contents Through Client Terminals. INTERNATIONAL JOURNAL OF ADVANCED RESEARCH IN ARTIFICIAL INTELLIGENCE, 2(6).
10 Arai, K., & Mardiyanto, R. (2013). Method for psychological status estimation by gaze location monitoring using eye-based human-computer interaction. Editorial Preface, 4(3).
11 Kohei Arai. (2012). Human-computer interaction and its application system based on the line-of-sight. Image e-Journal, 41 (3), 296-301.
12 Kohei Arai, & Mardiyanto, R. (2012). Helper robot. Image e-Journal with the voice communication capabilities and line-of-sight cruise control function, 41 (5), 535-542.
13 Kohei Arai, & Mardiyanto, R. (2012). Robot arm control and feeding support system based on the line-of-sight input. The Institute of Electrical Engineers Journal C (Electronics and Information Systems Division magazine), 132 (3), 416-423.
14 Arai, K., & XiaoYu, G. (2012). Method for 3D Object of Content Representation and Manipulation on 2D Display Using Human Eyes Only. 한국콘텐츠학회 2012 추계종합학술대회, 49-50.
15 Agustian, I., & Risanuri, H. (2012). Mouse Kamera dengan Deteksi Wajah Realtime dan Deteksi Kedip Berbasis Metode Haarcascade dan SURF.
16 Arai, K. (2012). Method for leaning efficiency improvements based on gaze location notifications on e-learning content screen display. International Journal of Advanced Research in Artificial Intelligence, 1(3), 1-6.
1 Google Scholar 
2 CiteSeerX 
3 refSeek 
4 Scribd 
5 SlideShare 
6 PDFCAST 
7 PdfSR 
ChangZheng Li, Chung-Kyue Kim, Jong-Seung Park, "The Indirect Keyboard Control System by Using the Gaze Tracing Based on Haar Classifier in OpenCV," ifita, vol. 2, pp.362-366, 2009 International Forum on Information Technology and Applications, 2009.
Christopher & Dana Reeve Foundation, http://www.christopherreeve.org
Gary Bradski, Andrian Kaebler: ”Learning Computer Vision with the OpenCV Library”, O’REILLY, 341-348, (2008).
Hailing Zhou, Lijun Xie, Xuliang Fang, "Visual Mouse: SIFT Detection and PCA Recognition," cisw, pp.263-266, 2007 International Conference on Computational Intelligence and Security Workshops (CISW 2007), 2007.
Jilin Tu, Thomas Huang, Hai Tao, "Face as Mouse Through Visual Face Tracking," crv, pp.339-346, The 2nd Canadian Conference on Computer and Robot Vision (CRV'05), 2005.
John J. Magee, Matthew R. Scott, Benjamin N. Waber, Margrit Betke, "EyeKeys: A RealTime Vision Interface Based on Gaze Detection from a Low-Grade Video Camera," cvprw vol. 10, pp.159, 2004 Conference on Computer Vision and Pattern Recognition Workshop (CVPRW'04) Volume 10, 2004.
M.E. Erdem, I.A. Erdem, V. Atalay, A.E. Cetin, "Computer vision based unistroke keyboard system and mouse for the handicapped," icme, vol. 2, pp.765-768, 2003 International Conference on Multimedia and Expo - Volume 2 (ICME '03), 2003
National Institute of Neurological Disorders and Stroke, http://www.ninds.nih.gov/disorders/ sci/detail_sci.htm
Yun Fu, Thomas S. Huang, "hMouse: Head Tracking Driven Virtual Computer Mouse," wacv, pp.30, Eighth IEEE Workshop on Applications of Computer Vision (WACV'07), 2007
Zhu Hao, Qianwei Lei, "Vision-Based Interface: Using Face and Eye Blinking Tracking with Camera," iita, vol. 1, pp.306-310, 2008 Second International Symposium on Intelligent Information Technology Application, 2008.
Professor Kohei Arai
Saga University - Japan
arai@ip.is.saga-u.ac.id
Mr. Ronny Mardiyanto
Institut Teknologi Sepuluh Nopember - Japan


CREATE AUTHOR ACCOUNT
 
LAUNCH YOUR SPECIAL ISSUE
View all special issues >>
 
PUBLICATION VIDEOS