The main aim of this study is to develop a simple method that allows the recognition of the state of the eye (open/closed) and to distinguish between blinking and winking. It is the simplest action that is always available and does not interfere with the tasks in most situations. We chose to use blink/wink to solve the problem. The basic motivation for undertaking the research is the need for effective and hands-free generation of system events that are normally provided by the mouse keys. However, cursor movement control is not enough to replace a computer mouse. It is also possible to use additional sensors, e.g. For this purpose, the identification of head movements based on the head image or facial image analysis is often used. There are many known solutions that allow for mowing the cursor without using hands. In both these situations, the success of the application depends on the correctness of the recognition of the closing and opening of the eyes. Such identification can sometimes be simpler than the analysis of a thermogram or a search for other signs of life such as heart rate or periodic local changes in the level of carbon dioxide.
#Blink app wink registration#
We can also consider a different application where the registration of blinking can be a sign of human presence. Such an application would be universal, but the basic problem is the correct recognition of the user’s winking. An application that replaces the clicking of the mouse keys by eye gestures can be considered. To control such events, the mouse is equipped with a few (1 to 3) keys. A computer mouse is the most popular pointing device today, which allows not only the selection of an appropriate object but also the generation of an appropriate system event. In contrast, winking can be an additional control element in complex systems, for game players, and in situations where the users have busy hands. Certain advanced applications of this method of communication have also been reported thus far. For these people, blinking/winking can be an effective way of transmitting information or controlling devices. Supporting communication with a computer for disabled or paralyzed people is a difficult but very important task. However, this activity can be very useful in multimedia applications.
From year to year, new devices use more and more interesting methods of control and communication: touch, gestures, and body language what else does the future hold? The use of eye gestures (as blinking/winking interpretation) is a relatively new form of communication, but with “visible” potential.īlinking is a simple physiological activity to which we do not attach much significance. Multimodal interaction is a method of communication that plays an increasingly important role in the technical applications of everyday life. The new method of control by eye gestures was accepted by the participants of this study. The introduced solution allows for effective and correct eye state recognition. In the second application, the control of mouse keys is replaced with eye gestures interpreted from a winking analysis. In the first one, blinking recognition allows us to check whether safety glasses are used appropriately. This result implies that the proposed solution can be effectively applied to real-world scenarios. The total correctness of the eye state recognition is 99.68% (99.94% for open eyes and 99.42% for closed ones). The new solution is tested in two types of experiments: with 2 × 5000 pictures of open and closed eyes and with a group of 30 participants.
Further, the use of infrared radiation limits the influence of external disturbing factors such as lighting conditions and pollution. The proposed method works irrespective of the user’s location and his/her gaze direction. Placing the camera close to the eye allows us to simplify the complicated image analysis. Wearable technology has been used in the introduced solution. The main aim of this study is to propose a simple method that allows the recognition of the state of the eye: open or closed and to distinguish between blinking and winking. The use of blinking and winking, interpreted as “eye gestures,” is considered. The problem of multimodal interaction is discussed.