Privacy and Security are two of the most important universal rights. To ensure security in our daily life through technology, a lot of research is going on. Among them facial recognition is a popular and well-established technology. In this technology, faces are detected and identified out of images and with the help of Internet of Things (IoT), it becomes even more useful and precise. Using face recognition and IoT, we aim to create a smart door, which secures the gateway on the basis of who we are. In our proof of the concept of such a smart security system, we have used Viola-Jones method to detect faces and Eigenfaces method to recognize people. A Raspberry Pi has been used as the microprocessor for ensuring low-cost and small size of the system. The door will open automatically for the known person upon receiving command from the processor. On the other hand, photo of the unknown will be uploaded to a webserver while an email is sent to the owner of the place containing a link to the image. From the website of the system, the owner can then allow/block entry and also trigger an alarm from anywhere in the world