An individual Human computer interference system is being introduced. In olden times, as an input device the mouse and keyboard were used by human computer interference system. Those people who are suffering from certain disease or illness cannot be able to operate computers. The idea of controlling the computers with the eyes will serve a great use for handicapped and disabled person. Also this type of control will eliminate the help required by other person to handle the computer. This measure will be the most useful for the person who is without hands through which they can operate with the help of their eye movements. The movement of the cursor is directly associated with the center of the pupil. Hence our first step would be detecting the center of point pupil which is indicating by the LED. This process of pupil detection is implemented using the Raspberry Pi, Pi Camera and OpenCV, numpy array and scikit. The Raspberry Pi has a SD card slot which is used for placing the SD card. The SD card is boosted with the operating system that is required starting up of Raspberry Pi. The Raspberry Pi will get executed once the application program is loaded into it. This process of pupil detection is implemented using the Raspberry Pi, Pi Camera and OpenCV, numpy array and scikit. This data will process to the arduino pro mini the only arduino will control the pc and virtual keypad. This project uses eye blink senor which is uses to detect the blinks at particular duration of time to operate mouse movements like left-right movement, up-down movement and left-right clicks. This eye blink sensor is interfaced to the Arduino pro mini which is consisting of mouse file inside it. Arduino pro mini will control the PC accordingly which is connected to the PC through USB. And also, this system consists of virtual keypad. A virtual keyboard is software that is used to emulate a standard keyboard. A picture of a keyboard is displayed on a computer screen and by using this system user points and clicks on the pictures of keys to enter text with the help of eye blinks.  

The objectives of the project include:

• Controlling PC and virtual keypad through eye movement.
• Controlling curser movements like left-right movement, up-down movement and left-right clicks.
• To achieve this task using Raspberry pi zero 2w, arduino pro mini and pi camera processor.

  The major building blocks of this project are:

• Power supply.
• Raspberry pi zero 2W.
• Pi camera.
• Eye blink sensor.
• Arduino promini.
• Push Buttons.
• SD card.
• LED indicator.
• USB to PC.

  Software’s used:

• Python language.
• Linux OS.
• OpenCV, Scikit, numpy array.
• Mouse file.

   

   

Block diagram:    

   

  video: