Hand gesture recognition system

• Designed a system to control the computer mouse and keyboard functions using a real time camera. • Implemented in MATLAB using the Java Robot class functions and image processing algorithms for color detection.

ALGORITHM

1.Using a web cam, real time information from the video was captured. 2. Each individual image frame was processed, and flipped. 3. The RGB image was converted to a gray scale image. 4. Thresholds for red, green and blue were defined. 5. Color detection and extraction of the different colors from the gray scale image was implemented. 6. Detected images were converted into Binary images. 7. Boundary of the image was computed and its centroid calculated. 8. Using the coordinates of the centroid, position of the mouse pointer was calculated. 9. Java Robot class was initialized and an object was created, which was linked to the mouse drivers. 10.Different colors were assigned to perform functions of left and right click, and mouse scroll.