Innovative Mobile Application for supporting Musical Instrument Education using Biofeedback

OData support
Supervisor:
Dr. Forstner Bertalan
Department of Automation and Applied Informatics

Based on several research activities, the well-known model of reinforcement learning is

proven to be successful in real-life learning situations, because human brain just as machines is able to effectively learn this way. This project is an innovative approach to use this fact in educating musical instruments, powered with an interactive mobile application via a thi-form system. The application can be connected through a MIDI interface to instruments wished to have. Choice of instrument has no effect on the learning process: wind- , keyboard- and string instruments. An EEG device is monitoring the user’s brain activity, thus provide real-time feedback on the effectiveness of the learning process so difficulty of practice can be changed to increase effectiveness. The user has to solve different lectures while based on the measured brain activity and actual performance, the application manipulates the difficulty of the current lecture, adapts to the user and rewards good performance. Its purpose is to provide a good experience through lectures based on the user’s current performance.

The customized experience and the sense of accomplishment during the game causes increased dopamine production in the brain, empowers reward-motivated behavior and learning becomes an effective and fun activity. Dopamine helps learning and makes time spent with learning feel shorter. Users don’t just enjoy using applications like that, but they tend to become returning users. Besides that, the social integration affects human competitive spirit, users are coming back more and more often and learn lectures in depth.

The goal of the project is to use mobile and tablet applications to prove the increase of learning effectiveness in several related researches with other institutions.

Downloads

Please sign in to download the files of this thesis.