Intelligent Sign Language Recognition Using Image Processing Techniques: A Case of Hausa Sign Language

S. T. Hassan, J. A. Abolarinwa, C. O. Alenoghena, S. A. Bala, M. David, P. Enenche

Abstract


Hausa sign language (HSL) is one of the main sign language in Nigeria. It is a means of communication medium among deaf-mute Hausas in northern Nigeria. HSL includes static and dynamic hand gestures. In this paper we present an intelligent recognition of static, manual and non-manual HSL using a Particle Swarm Optimization (PSO) to enhanced Fourier descriptor. A vision-based approach was used. A Red Green Blue (RGB) digital camera was used for image acquisition and Fourier descriptor was used for features extraction.  The features extracted were enhanced by PSO and fed into artificial neural network (ANN) which was used for classification. High average recognition accuracy of 93.9% was achieved; hence, intelligent recognition of HSL was successful.   


Full Text:

PDF

References


M.F Tolba, "Recents development in sign language recognition system," IIEEE, pp. xxxvi-xlii, 2013.

C. Dong, "American sign language alphabet recognition using microsloft kinect," IEEE, pp. 44-50, 2015.

Li Lei and Que Dashun, "Design of data-glove and Chinese sign language recognition system based on ARM9," IEEE, pp. 1130-1135, 2015.

A.S.Elons, "Arabic sign language recognition using leap motion sensor," IEEE, pp. 330-335, 2014.

A. S. Ghotkar, "Vision based multi-feature hand gesture recognition for Indian sign language manual," International journal on smart sensing and intelligent systems vol. 9, NO. 1, pp. 124-147, 2016.

Abdulazeez Ahmed et al, " Hearing impairment in asemi-urban community in north-west Nigeria," European journal of preventive medicine, pp.113-119, May,2006 .

G. K. Archana and S. Ghotkar, "Hand segmentation techniques for hand gesture recognition," International journal of human computer interaction (IJHCI), pp. 15 - 25, 2012.

G. Saggio, "A novel array of flex sensor for goniometric glove," Elsevier, pp. 119-126, November 2013.

Jayash Kumar Sharma, Rajeev Gupta and Vinay Kumar, "Numerical gesture recognition using leep motion sensor," Internaltionl conference on computation inteligent and communication Network ,IEEE , pp. 411-413, 2015.

Giulio Marin, Fabio Dominio and Pietro Zanuttigh, "Hand gesture recognition with jointly calibrated leap motion and depth sensor," Springer science and business media new york, pp. 14991-15015, 2016.

Siddharth S. Rautaray and Ampanm Argrawal, "Vision based hand gesture recognition for human computer interaction:a survay," Spring science and business media, pp. 1-54, November 2012.

J. Angur and M. Jarman, "An automated Bengali sign language recognition system based on fingertip finder algorithm," International journal of electronics & informatics, pp. 1-9, 2015.

G. Adithya V., "Artificial neural network based method for Indian sign language recognition ," Proceedings of 2013 IEEE Conference on Information and Communication Technologies (ICT 2013), India, 2013.

Peng Jinye and Yang Quan, "Chinese sign language recognition for a vision-based multi-features classifier," International Symposium on computer Science and computational technology, IEEE, China, pp.194-197,2008.


Refbacks

  • There are currently no refbacks.