Gesture based vigilance analysis

OData support
Dr. Lengyel László
Department of Automation and Applied Informatics

Nowadays, information technology is more and more present in our everyday life. Intelligent mobile devices are used in numerous ways. Such devices are able to constantly monitor their environment, for example while a vehicle is operated. A mobile device could watch the driver and process the data gathered by the OBD II on-board diagnostic tool and thus provide medical aid monitoring the vigilance of the driver. This could play an important role preventing accidents caused by falling asleep.

Safety has top priority while driving, therefore such an application should be easy to use, should not distract the driver and should provide reliable results, when it determines the level of tiredness of the driver, based on visual gestures and incoming sensor data.

To measure the driver’s reaction time, the application periodically asks for a hand gesture, which has to be shown to the camera so it can be recognised. This way, the driver do not need to pay too much attention to the device and can concentrate on the road, which otherwise could highly increase the chance of an accident. By processing and forwarding the reaction time and the on-board diagnostic results, the change in the driver’s level of tiredness can be determined. Then, it is possible to inform the driver, change his behaviour and therefore decrease the chance of an accident.


Please sign in to download the files of this thesis.