G. Balakrishnan This email address is being protected from spambots. You need JavaScript enabled to view it.1, G. Sainarayanan1 , R. Nagarajan2 and Sazali Yaacob2
1AI Research Group, School of Engineering and Information Technology, Universiti Malaysia Sabah, Locked Bag No. 2073, 88999, Kota Kinabalu, Malaysia 2School of Mechatronics, Northern Malaysia University College of Engineering, 01000 Kangar, Perlis, Malaysia
Received: September 12, 2005 Accepted: June 22, 2006 Publication Date: March 1, 2007
Visually impaired find their navigation difficult as they often lack the needed information for bypassing obstacles and hazards. Electronic Travel Aids (ETAs) are devices that use sensor technology to assist and improve the blind user’s mobility in terms of safety and speed. Modern ETAs does not provide distance information directly and clearly. This paper proposes a method for determining distance using a stereo matching method to help blind individuals for their navigation. The system developed in this work, named Stereo Vision based Electronic Travel Aid (SVETA), consists of a computing device, stereo cameras and stereo earphones, all molded in a helmet. An improved area based stereo matching is performed over the transformed images to calculate dense disparity image. Low texture filter and left/right consistency check are carried out to remove the noises and to highlight the obstacles. A sonification procedure is proposed to map the disparity image to stereo musical sound, which has information about the features of the scene infront of the user. The sound is conveyed to the blind user through stereo headphones. Experimentations have been conducted and preliminary investigations have proven the viability of this method for applying in real time environment.
[1] World Health Organization, webpage: http://www. who.int//mipfiles/2400/AllenFoster.pdf
[2] Wong, F., Nagarajan, R., Yaacob, S. and Chekima, A., “Electronic Travel Aids for Visually Impaired A Guided Tour,” Proceedings of Conference in Engineering in Sarawak, pp. 377382 (2000).
[3] Kay, L., “An Ultrasonic Sensing Probe as a Mobility Aid for the Blind,” Ultrasonics, Vol. 2, pp. 5359 (1964).
[4] Pressey, N., “Mowat Sensor,” Focus 3, pp. 3539 (1977).
[5] Meijer, P., “An Experimental System for Auditory Image Representations,” IEEE Transactions on Biomedical Engineering, Vol. 39, pp. 112121 (1991).
[6] Sainarayanan, G., “On Intelligent Image Processing Methodologies Applied to Navigation Assistance for Visually Impaired,” Ph. D. Thesis, University Malaysia Sabah (2002).
[7] Capp, M. and Picton, P., “The Optophone: An Electronic Blind Aid,” Engineering Science and Education Journal, Vol. 9, pp. 137143(2000).
[8] Zelek, J., Bromley, S., Aamar, D. and Thompson, D., “A Haptic Glove as a Tactile Vision Sensory Substitution for Way Finding,” Journal of Visual Impairment and Blindness, pp. 621632 (2003).
[9] Kawai, Y. and Tomita, F., “A Support System for Visually Impaired Persons to Understand Three-Dimensional Visual Information Using Acoustic Interface,” IEEE 16th Conference on Pattern Recognition, Vol. 3, pp. 974977 (2002).
[10] Brown, Z. and Hager, D., “Advances in Computational Stereo,” IEEE Trans. Pattern Analysis and Machine Intelligence, Vol. 25, pp. 9931008 (2003).
[11] Dhond, U. R. and Aggarwal, J. K., “Structure from Stereo,” IEEE Transaction on Systems, Man and Cybernatics, Vol. 19, pp. 14891510 (1989).
[13] Hirschmüller, H., Innocent, P. R. and Garibaldi, J. M., “Real Time Correlation Based Stereo Vision with Reduced Border Errors,” International Journal of Computer Vision, Vol. 47, pp. 229246 (2002).
[14] Fusiello, A., Roberto, V. and Trucco, E., “Efficient Stereo with Multiple Windowing,” Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 858863 (1997).
[15] Elliott, R., Fundamentals of Music, New Jersey: Prentice-Hall (1971).
We use cookies on this website to personalize content to improve your user experience and analyze our traffic. By using this site you agree to its use of cookies.