JOIV : International Journal on Informatics Visualization
Vol 6, No 3 (2022)

Image Presentation Method for Human Machine Interface Using Deep Learning Object Recognition and P300 Brain Wave

Nakajima, Rio (Unknown)
Rusydi, Muhammad Ilhamdi (Unknown)
Ramadhani, Salisa Asyarina (Unknown)
Muguro, Joseph (Unknown)
Matsushita, Kojiro (Unknown)
Sasaki, Minoru (Unknown)



Article Info

Publish Date
30 Sep 2022

Abstract

Welfare robots, as a category of robotics, seeks to improve the quality of life of the elderly and patients by availing a control mechanism to enable the participants to be self-dependent. This is achieved by using man-machine interfaces that manipulate certain external processes like feeding or communicating. This research aims to realize a man-machine interface using brainwave combined with object recognition applicable to patients with locked-in syndrome. The system utilizes a camera with pretrained object-detection system that recognizes the environment and displays the contents in an interface to solicit a choice using P300 signals. Being a camera-based system, field of view and luminance level were identified as possible influences. We designed six experiments by adapting the arrangement of stimuli (triangular or horizontal) and brightness/colour levels. The results showed that the horizontal arrangement had better accuracy than the triangular method. Further, colour was identified as a key parameter for the successful discrimination of target stimuli. From the paper, the precision of discrimination can be improved by adopting a harmonized arrangement and selecting the appropriate saturation/brightness of the interface.

Copyrights © 2022






Journal Info

Abbrev

joiv

Publisher

Subject

Computer Science & IT

Description

JOIV : International Journal on Informatics Visualization is an international peer-reviewed journal dedicated to interchange for the results of high quality research in all aspect of Computer Science, Computer Engineering, Information Technology and Visualization. The journal publishes state-of-art ...