Multi-mode Natural Language Processing for human-robot interaction

Article type: Research Article

Authors: Xie, Jiongkun^{; *} | Chen, Xiaoping | Ji, Jianmin

Affiliations: Multi-Agent Systems Lab., University of Science and Technology of China, He Fei, China. E-mails: [email protected], [email protected], [email protected]

Correspondence: [*] Corresponding author. E-mail: [email protected].

Abstract: As more and more open knowledge resources become available, it is interesting to explore opportunities of enhancing autonomous agents’ capacities by utilizing the knowledge in these resources, instead of hand-coding knowledge for agents. A major challenge towards this goal lies in the translation of the open knowledge organized in multiple modes, unstructured or semi-structured, into the internal representations of agents. In this paper we present a set of multi-mode NLP techniques to formalize the open knowledge for autonomous agents. Two case studies are reported in which our robot, equipped with the multi-mode NLP techniques, succeeded in acquiring knowledge from the microwave oven manual and from the open knowledge database, OMICS, and solving problems that could not be solved before the robot acquired the knowledge. Experiments for evaluating the performance of our approach show that our approach is promising.

Keywords: Multi-mode NLP, open knowledge, autonomous agents, human-robot interaction, semantic parsing

DOI: 10.3233/WEB-150325

Journal: Web Intelligence, vol. 13, no. 4, pp. 267-278, 2015