Evaluating the Potential of Using EEG Based BCI Method in User Experience Research

Abstract

Evaluation of user experience (UX) is one of the important research topics in the field of Human Computer Interaction. The use of methods such as task analysis, observations, and surveys in UX evaluation assesses traditional usability components like efficiency and effectiveness. However, these methods are not sufficient to evaluate other components of UX such as users' feelings, perceptions, and beliefs about a product. Therefore, it is believed that the use of brain computer interface (BCI) based electroencephalography (EEG) method, alongside traditional methods, will provide more objective findings. Within the scope of this study, both traditional methods and the EEG method were implemented together. For this purpose, the UX evaluation of Udemy website, a massive open online course system, was conducted through a user study involving 13 voluntary participants. Data were collected using the Affect Grid Questionnaire, user experience questionnaire short Version, positive impact and negative impact scale and website analysis and measurement inventory to evaluate participants' UX. EEG data were also collected during the interaction using Emotiv Epoc device, a BCI technology, and attention and meditation data were analyzed. The findings indicated that traditional methods and the EEG method supported each other for many of the participants.