A Development of Multi-Language Interactive Device using Artificial Intelligence Technology for Visual Impairment Person

A Development of Multi-Language Interactive Device using Artificial Intelligence Technology for Visual Impairment Person

Book reader

image-text conversion

Text-to-speech

Google Cloud

Artificial Intelligence

Visual Impairment People

The issue of lacking reference books in braille in most public building is crucial, especially public places like libraries, museum and others. The visual impairment or blind people is not getting the information like we normal vision do. Therefore, a multi languages reading device for visually impaired is built and designed to overcome the limitation of reference books in public places. Some research regarding current product available is done to develop a better reading device. This reading device is an improvement from previous project which only focuses on single language which is not suitable for public places. This reading device will take a picture of the book using 5MP Pi camera, Google Vision API will extract the text, and Google Translation API will detect the language and translated to desired language based on push buttons input by user. Google Text-to-Speech will convert the text to speech and the device will read out aloud in through audio output like speaker or headphones.   A few testings have been made to test the functionality and accuracy of the reading device. The testings are functionality, performance test and usability test. The reading device passed most of the testing and get a score of 91.7/100 which is an excellent (A) rating.

Harum, Norharyati Binti

M. S. K, Nur’aliah Izzati

Emran, Nurul Akmar

Abdullah, Noraswaliza

Zakaria, Nurul Azma

Hamid, Erman

Anawar, Syarulnaziah

International Journal of Interactive Mobile Technologies (iJIM); Vol. 15 No. 19 (2021); pp. 79-92

1865-7923

International Association of Online Engineering (IAOE), Vienna, Austria

2021-10-12

Copyright (c) 2021 Norharyati Binti Harum, Nur’aliah Izzati M. S. K, Nurul Akmar Emran, Noraswaliza Abdullah, Nurul Azma Zakaria, Erman Hamid, Syarulnaziah Anawar

application/pdf

eng

info:eu-repo/semantics/article

info:eu-repo/semantics/publishedVersion

Peer-reviewed Article