This work presents a room automation system using hand gestures which is meant for physically impaired. The objective of project is to develop an algorithm for recognition of hand gestures with reasonable accuracy. Most of the gesture recognition system fails when the background is complex, here in our method we use hand detection in complex background. Feature from motion (Motion history image) are used to classify the gestures. Kinect sensor is used to get the input video which will give the depth map from which we will get the location of the people performing gesture. Different gestures are used to switching on and off function for an Electrical appliance. Arduino Board is used to interface between the computer and the appliances.