Back close

A semantic classification of images by predicting emotional concepts from visual features

Publication Type : Journal Article

Publisher : School of Information Technology and Engineering, Vellore Institute of Technology, Vellore, Tamil Nadu, India.

Url :

Keywords : Content-Based Image Retrieval, color, texture, shape, descriptor, deep convolution neural network, visual features

Campus : Amritapuri

School : School of Engineering

Department : Computer Science

Year : 2020

Abstract : Classification of emotion based on the image is a trivial task and hence a challenging issue in Content-Based Image Retrieval (CBIR) technique in the framework called Emotion-Based Image Retrieval (EBIR) system. This paper discusses emotion predication system that automatically predicts the semantic meaning of human emotion and uses visual features in order to ease the process of feature extraction. The emotion-based on the image is the subjectivity which plays a major role in the image retrieval process. The main motivation of this study is to predict the human emotion from an image. In the proposed work, the color, texture and shape are used as feature concepts to predict the semantics of emotion which are related with an image and features extracted by dominant color structure descriptors for color feature extraction, homogeneous texture descriptor(edge histogram) for texture feature extraction and region-based or contour-based descriptor(shape spectrum) for the shape feature extraction. Deep convolution Neural Network (Deep CNN) is used for classification into 6 basic emotion classes like anger, disgust, fear, happiness, sadness, and surprise by using color emotion factors. For training and testing the images, real-time data such as wallpaper, textile, and painting database is used. Experimental results of approach are evaluated and compared with classifier algorithms by using the measures of precision, recall, and accuracy. The prediction system also measures the arousal, valence anddominance value in order to measure the performance of EBIR approach/system.

Cite this Research Publication : Tamil Priya, D., Divya Udayan, J, 2019, ”A semantic classification of images by predicting emotional concepts from visual features”, TEST Engineering and Management, 59(6), pp- 42-70 (SCOPUS Index)

Admissions Apply Now