Ontology Based Fusion Engine for Interaction with an Intelligent Assistance Robot

Abstract

Every human continuously interacts with his environment and its entities. To interact with the environment, humans use language and physical expression to understand the events and be understood. These communication methods are natural features acquired at birth, with a few exceptions. Unfortunately, some people face interaction difficulties because of disabilities or illnesses. To remedy to these problems, researchers have been designing assistance robots which can imitate human interaction using multiple modalities. To do so, the robot must be able to interact with humans using natural methods used by people such as speech, gestures, eye movements, etc. The robot must be able to understand and execute the commands issued by the user through the different modalities. To do so, we propose a smart system that will use a knowledge base to achieve the three tasks of “sensing-understanding-acting” in an ambient environment.