Home   >   CSC-OpenAccess Library   >    Manuscript Information
Novel Hybrid Approach to Visual Concept Detection Using Image Annotation
Sanjay M. Patil, Kishor K. Bhoyar
Pages - 1 - 12     |    Revised - 31-12-2018     |    Published - 01-02-2019
Volume - 13   Issue - 1    |    Publication Date - February 2019  Table of Contents
Image Concept Detection, Low-level Features, Tags, Weighted Features.
Millions of images are being uploaded on the internet without proper description (tags) about these images. Image retrieval based on image tagging approach is much faster than Content Based Image Retrieval (CBIR) approach but requires an entire image collection to be manually annotated with proper tags. This requires a lot of human efforts and time, and hence not feasible for huge image collections. An efficient method is necessary for automatically tagging such a vast collection of images. We propose a novel image tagging method, which automatically tags any image with its concept. Our unique approach to solve this problem involves manual tagging of small exemplar image set and low-level feature extraction of all the images, hence called a hybrid approach. This approach can be used to tag a large image dataset from manually tagged small image dataset. The experiments are performed on Wang's Corel Dataset. In the comparative study, it is found that, the proposed concept detection system based on this novel tagging approach has much less time complexity of classification step, and results in significant improvement in accuracy as compared to the other tagging approaches found in the literature. This approach may be used as faster alternative to the typical Content Based Image Retrieval (CBIR) approach for domain specific applications.
1 Google Scholar 
2 refSeek 
3 Doc Player 
4 Scribd 
5 SlideShare 
A. Elmoataz, F. Nouboud, O. Lézoray and D. Mammass, "Editorial of the Special Issue on Advances in Low-Level Image Representations for Processing and Analysis", SIViP, March 2016, Vol.10, Issue 3, pp. 421-422.
C. Krishna Mohan and B. Yegnanarayana, "Classification of sport videos using Edge Based Features and Autoassociative Neural Network Models", SIViP, Vol.4, No. 1, Mar. 2010, pp. 61-73.
D. Gupta, A.K. Singh., D. Kumari and Raina, "Hybrid Feature Based Natural Scene Classification using Neural Network", Int. Jour. of Computer Apps., 2012, pp. 48-52.
E.Guldogan and M.Gabbouj, "Feature Selection for Content Based Image Retrieval", SIViP, Vol. 2, No. 3, Sep. 2008, pp. 241-250.
G.V. Sangamnerkar and K.K. Bhoyar, "A Neural Network Color Classifier in HSV Color Space", Int. Conf. on Industrial Automation and Comp., 12-13th Apr. 2014.
J.Kim, B.S.Kim and S.Savarese, "Comparing Image Classification Methods: K-Nearest-Neighbor and Support-Vector-Machines", Proceedings of the 6th WSEAS international conference on Computer Engineering and Applications, USA, Jan. 25-27, 2012.
L. Feng and B. Bhanu, "Semantic Concept Co-Occurrence Patterns for Image Annotation and Retrieval", IEEE Trans. on Pattern Analysis and Machine Intelligence, Vol.38, No. 4. Apr. 2016.
M. Naphade and J. R. Smith, "On the Detection of Semantic Concepts at TRECVID", Proc. of the 12th Annual ACM Int. Conf. on Multimedia, New York, USA, 2004, pp.660-667.
M. Wang and X. Hua, "Active Learning in Multimedia Annotation and Retrieval: A Survey", ACM Transactions on Intelligent Systems and Tech., 2011.
M.I. Mandel, R. Pascanu, D. Eck, Y.Bengio, L. M. Aiello, R. Schifanella, and F. Menczer, "Contextual Tag Inference", ACM Trans. on Multimedia Computing, Communications and Applications, 2011.
M.J. Swain and D.H. Ballard, "Color Indexing", Int. Jour. of Computer Vision, Vol. 7, Issue 1, 16- 21, Nov.1991, pp. 11-32.
N. Ali, K.B. Bajwa, R. Sablatnig, Z. Mehmood, "Image Retrieval by Addition of Spatial information based on Histograms of Triangular Region", Computer and Electrical Engineering., Vol. 54, Aug. 2016, pp. 539-550.
N. Zhou, W.K. Cheun g, G. Qiu, and X. Xue, "A Hybrid Probabilistic Model for Unified Collaborative and Content-Based Image Tagging", IEEE Transactions on Pattern Analysis and Machine Intelligence, Vol. 33, NO. 7, Jul. 2011.
P. Koniusz, F. Yan, P.Gosselin and K. Mikolajczyk, "Higher-order Occurrence Pooling for Bags-of-Words: Visual Concept Detection", IEEE Trans. on Pattern Analysis and Machine Intelligence, Vol. 39, No. 2, 2016.
P. Shrivastava, K.K. Bhoyar and A.S. Zadgaonkar, "Image Classification Using Fusion of Holistic Visual Descriptions", Int. Jour. Image, Graphics and Signal Processing, 2016, pp.47-57.
P.G. Foschi, D. Kolippakkam, H. Liu and A. Mandvikar, "Feature Extraction for Image Mining", Proc. in Int. workshop on Multimedia Information System, 2002, pp. 103-109.
R. Min and H.D. Cheng, "Effective Image Retrieval using Dominant Color Descriptor and Fuzzy Support Vector Machine", Pattern Recognition, Vol.42, No.1, Jan.2009, pp. 147-157.
R.Hong, M.Wang, Y.Gao, D.Tao, X. Li, and X.Wu, "Image Annotation By Multiple-Instance Learning With Discriminative Feature Mapping and Selection", IEEE Transactions On Cybernetics, Vol. 44, No. 5, May 2014.
S. Papadopoulos, C. Sagonas, L. KompatsiarisI and A. Vakali, "Semi-supervised Concept Detection by Learning the Structure of Similarity Graphs", Advances in Multimedia Modeling, Lecture Notes in Computer Science, Vol. 7732, Springer, Berlin, 2013.
T. Tsirelis and A. Delopoulos, "Automatic Ground-truth Image Generation from user Tags", 12th International Workshop on Image Analysis for Multimedia Interactive Services, 2011.
X. Li, "Tag Relevance Fusion for Social Image Retrieval", Multimedia Systems, Vol.23, No. 1, Feb. 2017, pp 29-40.
Y. Yang, Y. Gao, H. Zhang, J. Shao and T. S. Chua, "Image Tagging with Social Assistance", Proceedings of International Conference on Multimedia Retrieval, ICMR'14,Glasgow,United Kingdom, Apr. 2014.
Z. Mehmood, F.Abbas, T. Mahmood, M.Arshad Javid, A. Rehman, "Content-Based Image Retrieval Based on Visual Words Fusion versus Features Fusion of Local and Global Features", Arabian Jour. for Science and Engineering, Jan. 2018.
Z.C. Lipton, C. Elkan and B. Naryanaswamy , "Optimal Thresholding of Classifiers to Maximize F1 Measure", Calders T., Esposito F., Hüllermeier E., Meo R. (eds) Machine Learning and Knowledge Discovery in Databases. ECML PKDD 2014. Lecture Notes in Computer Science, Vol. 8725. Springer, Berlin, Heidelberg.
Mr. Sanjay M. Patil
Research Scholar, Department of Computer Technology, Yeshwantrao Chavan College of Engineering, Nagpur, 441110, India - India
Mr. Kishor K. Bhoyar
Professor, Department of Information Technology, Yeshwantrao Chavan College of Engineering, Nagpur, 441110, India - India