Home   >   CSC-OpenAccess Library   >    Manuscript Information
HRI for Interactive Humanoid Head Amir-II for Visual Tracking and Servoing of Human Face
Aseef Iqbal, Amir A Shafie, Md Raisuddin Khan, M Farid Alias, Jamil Radhi
Pages - 220 - 231     |    Revised - 01-07-2011     |    Published - 05-08-2011
Volume - 2   Issue - 3    |    Publication Date - July / August 2011  Table of Contents
Humanoid Head, Human-Robot Interaction, Face Detection, Visual Servoing
In this paper, we describe the HRI (Human-Robot Interaction) system developed to operate a humanoid robot head capable of visual tracking and servoing of human face through image processing. The robotic humanoid head named Amir-II, equipped with a camera and servoing mechanism is used as the platform. The Amir-II tracks the human face within the field-of-vision (FOV) while the servoing mechanism ensures the detected human face remains at the center of its FOV. The algorithm developed in this research utilizes the capability offered by scientific computing program MATLAB along with its Image Processing Toolbox. The algorithm basically compares the locations of the face in the image plane that is detected from the static face image captured from real-time video stream. The calculated difference is then used to produce appropriate motion command for the servo mechanism to keep track of the human face moving within the range of its FOV.
CITED BY (1)  
1 Akhtaruzzaman, M., Shafie, A. A., & Rashid, M. (2012). Designing an Algorithm for Bioloid Humanoid Navigating in its Indoor Environment. Journal of Mechanical Engineering and Automation, 2(3), 36-44.
1 Google Scholar 
2 CiteSeerX 
3 refSeek 
4 Scribd 
5 SlideShare 
6 PdfSR 
A. A. I. Shafie, A. Khan, M.R., "Visual tracking and servoing of human face for robotic head Amir-II," in International Conference on Computer and Communication Engineering(ICCCE), 2010, Kuala Lumpur, Malaysia, 2010, pp. 1-4.
A. Azarbayejani, T. Starner, B. Horowitz, and A. Pentland, "Visually controlled graphics,"Pattern Analysis and Machine Intelligence, IEEE Transactions on, vol. 15, pp. 602-605,1993.
A. Billard, B. Robins, K. Dautenhahn, and J. Nadel, "Building Robota, a Mini-Humanoid Robot for the Rehabilitation of Children with Autism," the RESNA Assistive Technology Journal, vol. 19, 2006 2006.
B. Moghaddam and A. Pentland, "Probabilistic visual learning for object representation,"Pattern Analysis and Machine Intelligence, IEEE Transactions on, vol. 19, pp. 696-710,1997.
C. Breazeal, "Socially intelligent robots," interactions, vol. 12, pp. 19-22, 2005.
C. L. Breazeal, Designing sociable robots. Cambridge, Mass.: MIT Press, 2002.
C. R. Zhao Wenyi, "A Guided Tour of Face Processing," in Face Processing: Advanced Modeling and Methods, ed: Academic Press, 2006, pp. 3-53.
D. Terzopoulos and K. Waters, "Analysis and synthesis of facial image sequences using physical and anatomical models," Pattern Analysis and Machine Intelligence, IEEE Transactions on, vol. 15, pp. 569-579, 1993.
F. Chaumette and S. Hutchinson, "Visual Servoing and Visual Tracking," in Springer Handbook of Robotics, ed, 2008, pp. 563-583.
H. K. Marek P. Michalowski, "Rhythm in human-robot social interaction," IEEE Intelligent Systems, vol. 23, pp. 78-80, 2008.
H. Kozima, "Infanoid: An experimental tool for developmental psycho-robotics,"International Workshop on Developmental Study, 2000.
H. Kozima, M. Michalowski, and C. Nakagawa, "Keepon - A Playful Robot for Research,Therapy, and Entertainment," International Journal of Social Robotics, vol. 1, pp. 3-18,2009.
K. M. Shafie A., "Design and Development of Humanoid Head," in Proceeding of International Conference of Man Machine System (ICOMMS), Langkawi, Malaysia, 2006.
K. W. Takanori Shibata, Tomoko Saito, Kazuo Tanie "Human Interactive Robot for Psychological Enrichment and Therapy," in Social Intelligence and Interaction in Animals,Robots and Agents (AISB) 2005, University of Hertfordshire, Hatfield, England, 2005, pp.98-107.
M. N. K. a. s. A. A. Shafie. , N. I. Taufik Y., "Humanoid Robot Head," in 3rd International Conference on Mechatronics (ICOM), Kuala Lumpur, Malaysia, 2008.
M. Nilsson, J. Nordberg, and I. Claesson, "Face Detection using Local SMQT Features and Split up Snow Classifier," in Acoustics, Speech and Signal Processing, 2007. ICASSP 2007. IEEE International Conference on, 2007, pp. II-589-II-592.
M. S. Bartlett, G. Littlewort, M. Frank, C. Lainscsek, I. Fasel, and J. Movellan,"Recognizing facial expression: machine learning and application to spontaneous behavior," in Computer Vision and Pattern Recognition, 2005. CVPR 2005. IEEE Computer Society Conference on, 2005, pp. 568-573 vol. 2.
M. S. J. K. G. Oh, S.-J. Kim and S. S. Park, "Function and driving mechanism for face robot, buddy," The Journal of Korea Robotics Society, vol. 3, pp. 270277, 2008.
M. Zecca, Y. Mizoguchi, K. Endo, F. Iida, Y. Kawabata, N. Endo, K. Itoh, and A. Takanishi,"Whole body emotion expressions for KOBIAN humanoid robot - preliminary experiments with different Emotional patterns - " in Robot and Human Interactive Communication, 2009.RO-MAN 2009. The 18th IEEE International Symposium on, 2009, pp. 381-386.
P. Maja and B. Marian Stewart, "Machine Analysis of Facial Expressions," in Face Recognition, Kresimir Delac and M. Grgic, Eds., First Edition ed Viena, Austria: I-Tech Education and Publishing, 2007, pp. 377-416.
T. Matthew and P. Alex, "Eigenfaces for recognition," J. Cognitive Neuroscience, vol. 3, pp.71-86, 1991.
W. P. Rosalind, "Affective computing: challenges," Int. J. Hum.-Comput. Stud., vol. 59, pp.55-64, 2003.
W. Zhao, R. Chellappa, and A. Krishnaswamy, "Discriminant analysis of principal components for face recognition," in Automatic Face and Gesture Recognition, 1998.Proceedings. Third IEEE International Conference on, 1998, pp. 336-341.
Y. I. Tian, T. Kanade, and J. F. Cohn, "Facial Expression Analysis," in Handbook of Face Recognition, K. J. Anil and Z. L. Stan, Eds., ed: Springer, 2005, pp. 247-276.
Y. Yang, S. Ge, T. Lee, and C. Wang, "Facial expression recognition and tracking for intelligent human-robot interaction," Intelligent Service Robotics, vol. 1, pp. 143-157, 2008.
Mr. Aseef Iqbal
International Islamic University - Malaysia
Associate Professor Amir A Shafie
International Islamic University - Malaysia
Associate Professor Md Raisuddin Khan
International Islamic University - Malaysia
Mr. M Farid Alias
International Islamic University - Malaysia
Mr. Jamil Radhi
International Islamic University - Malaysia