Architecture for Real-Time Visualizing Arabic Words with Diacritics Using Augmented Reality for Visually Impaired People | SpringerLink
Skip to main content
Springer Nature Link
Log in

Architecture for Real-Time Visualizing Arabic Words with Diacritics Using Augmented Reality for Visually Impaired People

  • Conference paper
  • First Online:
Advanced Information Networking and Applications (AINA 2021)

Part of the book series: Lecture Notes in Networks and Systems ((LNNS,volume 225))

Abstract

The number of visually impaired people is continuously increasing around the world due to the aging of the population. Several methods of communication are needed as solutions to perform their daily activities as Arabic text which appear everywhere and contains several diacritical marks such as i’jām, consonant score and tashkil. Accordingly, several architectures have adopted different techniques to detect and recognize Arabic words without diacritics and few are capable of reading the Arabic word with diacritics. In this context, a new architecture based on Augmented Reality (AR) is proposed in order to detect and recognize Arabic letters with diacritical marks in real-time. The proposed architecture shows great potential for using AR engine to detect Arabic words with diacritics within orientation, writing style and complex background. In addition, it improves the visualization by reading the detected Arabic words with diacritics through a created dataset. Our work aims to improve the user’s experience and simplicity for partially sighted and visually impaired people.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution

Subscribe and save

Springer+ Basic
¥17,985 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Chapter
JPY 3498
Price includes VAT (Japan)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
JPY 22879
Price includes VAT (Japan)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
JPY 28599
Price includes VAT (Japan)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Similar content being viewed by others

References

  1. Mostafa, A., Elsayed, A., Ahmed, M., Mohamed, R., Adel, M., Ashraf, Y.: Smart educational game based on augmented reality. Technical report, EasyChair (2020

    Google Scholar 

  2. Mori, B., Giovent‘u, C.: An augmented reality (ar) experience forlorenzo lotto. In: Virtual and Augmented Reality in Education, Art, and Museums, pp. 324–332. IGI Global (2020)

    Google Scholar 

  3. Andriyandi, A.P., Darmalaksana, W., Maylawati, D.S., Irwansyah, F.S., Mantoro, T., Ramdhani, M.A.: Augmented reality using featuresaccelerated segment test for learning ta. Telkomnika 18(1), 208–216 (2020)

    Article  Google Scholar 

  4. Wei, Z.-H., Du, X.-P., Cao, L.: Research on the text detection and recognition in natural scene images. In: Eleventh International Conference on Graphics and Image Processing (ICGIP 2019), vol. 11373, p. 113730F. International Society for Optics and Photonics (2020)

    Google Scholar 

  5. Ahmed, S.B., Razzak, M.I., Yusof, R.: Progress in cursive wild text recognition. In: Cursive Script Text Recognition in Natural Scene Images, pp. 85–92. Springer, Heidelberg (2020)

    Google Scholar 

  6. Elleuch, H., Wali, A., Samet, A., Alimi, A.M.: A real-time eye gesture recognition system based on fuzzy inference system for mobile devices monitoring. In: International Conference on Advanced Concepts for Intelligent Vision Systems, pp. 172–180. Springer, Heidelberg (2016)

    Google Scholar 

  7. Elleuch, H., Wali, A., Samet, A., Alimi, A.M.: Interacting with mobile devices by fusion eye and hand gestures recognition systems based on decision tree approach. In: Ninth International Conference on Machine Vision (ICMV 2016), vol. 10341, p. 103410D. International Society for Optics and Photonics (2017)

    Google Scholar 

  8. Abdelhedi, S., Wali, A., Alimi, A.M.: Human activity recognition based on mid-level representations in video surveillance applications. In: 2016 International Joint Conference on Neural Networks (IJCNN), pp. 3984–3989. IEEE (2016)

    Google Scholar 

  9. Beltaief, I., Halima, M.B.: Deep fcn for Arabic scene text detection. In: 2018 IEEE 2nd International Workshop on Arabic and Derived Script Analysis and Recognition (ASAR), pp. 129–134. IEEE (2018)

    Google Scholar 

  10. Turki, H., Halima, M.B., Alimi, A.M.: Text detection in natural scene images using two masks filtering. In: 2016 IEEE/ACS 13th International Conference of Computer Systems and Applications (AICCSA), pp. 1–6. IEEE (2016)

    Google Scholar 

  11. Ayed, A.B., Halima, M.B., Alimi, A.M.: Map reduce based text detection in big data natural scene videos. In: INNS Conference on BigData, pp. 216–223 (2015)

    Google Scholar 

  12. Turki, H., Halima, M.B., Alimi, A.M.: Scene text detection images with pyramid image and mser enhanced. In: 2015 15th International Conference on Intelligent Systems Design and Applications (ISDA), pp. 301–306. IEEE (2015)

    Google Scholar 

  13. Selmi, Z., Halima, M.B., Wali, A., Alimi, A.M.: A framework of text detection and recognition from natural images for mobile device. In: Ninth International Conference on Machine Vision (ICMV 2016), vol. 10341, p. 1034127. International Society for Optics and Photonics (2017)

    Google Scholar 

  14. Turki, H., Halima, M.B., Alimi, A.M.: A hybrid method of natural scene text detection using msers masks in hsv space color. In: Ninth International Conference on Machine Vision (ICMV 2016), vol. 10341, p. 1034111. International Society for Optics and Photonics (2017)

    Google Scholar 

  15. Sassi, M.S.H., Jedidi, F.G., Fourati, L.C.: A new architecture for cognitive internet of things and big data. Procedia Comput. Sci. 159, 534–543 (2019)

    Article  Google Scholar 

  16. Syahidi, A.A., Tolle, H., Supianto, A.A., Arai, K.: Bandoar: real-time text based detection system using augmented reality for media translator banjar language to Indonesian with smartphone. In: 2018 IEEE 5th International Conference on Engineering Technologies and Applied Sciences (ICETAS), pp. 1–6. IEEE (2018)

    Google Scholar 

  17. Sassi, M.S.H., Fourati, L.C.: Architecture for visualizing indoor air quality data with augmented reality based cognitive internet of things. In: International Conference on Advanced Information Networking and Applications, pp. 405–418. Springer, Cham (2020)

    Google Scholar 

  18. Ardian, Z., Santoso, P.I., Hantono, B.S.: Argot: text-based detection systems in real time using augmented reality for media translator aceh-Indonesia with android-based smartphones. In: Journal of Physics: Conference Series, vol. 1019, p. 012074. IOP Publishing (2018)

    Google Scholar 

  19. Rajendran, P.S., Christian, I.S., Shedge, M.S.: Aredai augmented reality based educational artificial intelligence system (2019)

    Google Scholar 

  20. Gupta, T., Sisodia, M., Fazulbhoy, S., Raju, M., Agrawal, S.: Improving accessibility for dyslexic impairments using augmented reality. In: 2019 International Conference on Computer Communication and Informatics (ICCCI), pp. 1–4. IEEE (2019)

    Google Scholar 

  21. Sassi, M.S.H., Fourati, L.C., Jedidi, F.G.: Business information architecture for big data and Internet of Things. In: 2019 15th International Wireless Communications Mobile Computing Conference (IWCMC), pp. 1749–1756. IEEE (2019)

    Google Scholar 

  22. Sassi, M.S.H., Jedidi, F.G., Fourati, L.C.: A new architecture for cognitive internet of things and big data. Procedia Comput. Sci. 159, 534–543 (2019)

    Article  Google Scholar 

  23. Zhao, Y., Hu, M., Hashash, S., Azenkot, S.: Understanding low visionpeople’s visual perception on commercial augmented reality glasses. In: Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems, pp. 4170–4181 (2017)

    Google Scholar 

  24. Huang, J., Kinateder, M., Dunn, M.J., Jarosz, W., Yang, X.-D., Cooper, E.A.: An augmented reality sign-reading assistant for users with reduced vision. PloS one 14(1), e0210630 (2019)

    Article  Google Scholar 

  25. Sassi, M.S.H., Jedidi, F.G., Fourati, L.C.: Computer-aided software engineering (CASE) tool for big data and IoT architecture. In: 2019 15th International Wireless Communications Mobile Computing Conference (IWCMC), pp. 1403–1410. IEEE (2019)

    Google Scholar 

  26. Huang, J.: A hololens application to aid people who are visually impaired in navigation tasks (2017)

    Google Scholar 

  27. Sassi, M.S.H., Fourati, L.C.: Investigation on deep learning methods for privacy and security challenges of cognitive IoV. In: 2020 International Wireless Communications and Mobile Computing (IWCMC), pp. 714–720. IEEE (2020)

    Google Scholar 

  28. Ouali, I., Ghozzi, F., Taktak, R., Sassi, M.S.H.: Ontology alignment using stable matching. Procedia Comput. Sci. 159, 746–755 (2019)

    Article  Google Scholar 

  29. Ouali, I., Sassi, M.S.H., Halima, M.B., Ali, W.: A new architecture based ar for detection and recognition of objects and text to enhance navigation of visually impaired people. Procedia Comput. Sci. 176, 602–611 (2020)

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. REGIM-Lab: Research Groups in Intelligent Machines, National Engineering School of Sfax, University of Sfax, BP 1173, 3038, Sfax, Tunisia

    Imene Ouali, Mohamed Ben Halima & Ali Wali

  2. Digital Research Center of Sfax (CRNS), Laboratory of Signals, systeMs, aRtificial Intelligence and neTworkS (SM@RTS), Sfax, Tunisia

    Mohamed Saifeddine Hadj Sassi

Authors
  1. Imene Ouali
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Mohamed Saifeddine Hadj Sassi
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Mohamed Ben Halima
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Ali Wali
    View author publications

    You can also search for this author in PubMed Google Scholar

Editor information

Editors and Affiliations

  1. Department of Information and Communication Engineering, Fukuoka Institute of Technology, Fukuoka, Japan

    Leonard Barolli

  2. Department of Computer Science, Ryerson University, Toronto, ON, Canada

    Isaac Woungang

  3. Faculty of Business Administration, Rissho University, Tokyo, Japan

    Tomoya Enokido

Rights and permissions

Reprints and permissions

Copyright information

© 2021 The Author(s), under exclusive license to Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Ouali, I., Hadj Sassi, M.S., Ben Halima, M., Wali, A. (2021). Architecture for Real-Time Visualizing Arabic Words with Diacritics Using Augmented Reality for Visually Impaired People. In: Barolli, L., Woungang, I., Enokido, T. (eds) Advanced Information Networking and Applications. AINA 2021. Lecture Notes in Networks and Systems, vol 225. Springer, Cham. https://doi.org/10.1007/978-3-030-75100-5_25

Download citation

Publish with us

Policies and ethics

Search

Navigation