2018
IOT based door locking system
A
SEMINAR REPORT ON PROJECT:
IOT BASED DOOR LOCKING SYSTEM
USING
IMAGE PROCESSING
SUBMITTED TO UNIVERSITY OF PUNE
FOR PARTIAL FULFILLMENT
OF THE REQUIREMENTS FOR THE DEGREE OF
BACHELOR OF ENGINEERING
In
Electronics and Telecommunication
By
GAIKWAD AALHAD K.
DESHMUKH ANIKET A.
CHAUDHARI PRANAV B.
Exam No. B150073129
Exam No. B150073128
Exam No. B150073126
Under the Guidance of,
Prof. Mrs. P. S. DESHPANDE
DEPT. OF ELECTRONICS AND TELECOMMUNICATION
PUNE VIDYARTHI GRIHA’S COLLEGE OF ENGINEERING AND TECHNOLOGY,
PUNE-9
APRIL 2018
1
PVG’s COET
2018
IOT based door locking system
Department of Electronics and Telecommunication Engineering
PUNE VIDYARTHI GRIHA’S COLLEGE OF ENGINEERING AND
TECHNOLOGY, PUNE 9
CERTIFICATE
This is to certify that the Seminar Report entitled
IOT BASED DOOR LOCKING SYSTEM
USING
IMAGE PROCESSING
Has been successfully completed by
GAIKWAD AALHAD K.
Exam No. B150073129
DESHMUKH ANIKET A.
Exam No. B150073128
CHAUDHARI PRANAV B.
Exam No. B1500730126
towards the partial fulfillment of the degree of Bachelor of Engineering in Electronics and
Telecommunication as awarded by the Savitribai Phule Pune University, at Pune Vidyarthi
Griha’s College of Engineering during the academic year 2018-19.
Prof. Mrs. P. S. Deshpande
Project Guide
Place: PVG’s COET,Pune.
Date:
2
/
/ 2018
PVG’s COET
Prof. Mrs. K. J. Kulkarni
HOD Of E &TC
2018
IOT based door locking system
ACKNOWLEDGEMENTS
We would like to express our heartfelt thanks to Prof. Mrs. Priya S. Deshpande and Prof.
Mrs. V. U. Gongane for introducing us to this project. Their guidance on all minute details and their
help on technical aspects of our project were of utmost importance to us.
We also extend our gratitude to our Head of Department, Dr. Mrs. K. J. Kulkarni for her
valuable support and guidance. We are also thankful to our E&TC Department for providing support
and encouragement at all points during this project. We are immensely gratified towards out project
evaluators for their constant tips and advices.
We are also extremely happy to acknowledge and express our sincere gratitude to our parents
for their constant support and encouragement. Last but not the least we thank our lab assistants, nonteaching staff and our well-wishers.
Aalhad Gaikwad
Aniket Deshmukh
Pranav Chaudhari
3
PVG’s COET
2018
IOT based door locking system
CONTENTS
Index
Chapter No.
Title
Page No.
Abstract
1.
Introduction
6
2.
Literature Survey
7
3.
Design of the System
8
3.1. Block Diagram
10
3.2. Working of the System
12
3.3. Flowchart of Working
13
3.4. Basic Working of Blocks
14
4.
Proposed System Specifications
18
5.
Conclusion
16
6.
Future Scope
17
7.
Tentative Cost Calculations
18
Appendix
A. References
4
19
PVG’s COET
2018
IOT based door locking system
ABSTRACT
Home security is growing field. To provide security to home, face recognition system can be
implemented. A standard UBS camera captures the image to identify the person. It’s a prototype that
identifies the visitor. If the door recognizes the visitor, it will greet them by name, and the door will be
unlocked named opened. If they aren’t identified the door will be firmly locked. The system will
perform the detection and recognition rapidly in real time. This project utilizes the basic web cam, and
the internet connection to create a door that unlocks itself via facial recognition. If the visitor at the
door is recognized, the door will be unlocked! This project adds mainly four features: security, safety,
control and monitoring to home automation. Firstly, the system needs a face authentication for the user
to be able to enter the home(locked/unlocked). When an unauthenticated try to log in, this face will be
captured and would be sent to g-mail as an attachment. The system should also support remote home
control. Temperature sensor is used for home temperature monitoring, the date can be visualized
remotely in real time.
5
PVG’s COET
2018
IOT based door locking system
CHAPTER-1:
INTRODUCTION
We want to provide high level security to home by using IoT technology. IoT is new
technology which has made an enormous impact on the modern world. The IoT can be defined as the
system of interconnected mechanical, electrical and computing devices and other objects like animals,
humans which are given a unique identifier and this system has an ability to transfer data over a wide
network of such interrelated systems without requiring human-to-human or human-to-computer
interaction. In short, the IoT has an ability to make things self-instructed. Hence it can make significant
impact on modern security technologies
Home security has become a solemn issue in the society. Anyone can be harassed in its own
house. Older security systems can’t tackle some situations like hacking, break down in the system.
Unwanted persons like thieves, murderers and some known criminals will try to intrude in the home
any time they want. These days are not that secured and hence can be easily hacked. Even intruders
have found their way to take over these gadgets. So, to avoid such situations, we have to develop the
system in such way that no one should get an intrusion to the system. The use of IoT will enhance
some security level as well as it will help in accessing and controlling the system remotely. Therefore,
we are trying to develop a face recognizable automated door unlocking system using an IoT. IoT will
enable sensing, actuating and communication in the system. System can be made automated easily.
So, we can go on developing a smart home by extending this security system. To develop this, we will
use a Raspberry Pi micro-controller board for system development, a pi camera module for face
recognition and a programmable stepper motor to open door lock. We will install appropriate Linux
based Raspberry pi operating system on raspberry pi micro-controller board. For the door unlocking
system, we will place a stepper motor at door latch. This motor will be programmed in such a way that
when the system authenticates the person in front of the camera, the motor will rotate to open latch.
We will use image processing technology to authenticate the person to enter in home. For image
processing, we will use pi camera module. Pi camera module is attached to Raspberry pi, and it aids
to store various faces in the databases. When someone wants to enter in home, he should stand in front
of the camera. Camera will recognize the face and compares with the faces stored in the LFW database.
If the face matches, the door will be automatically unlocked, otherwise a warning call will be sent to
the owner of the house.
6
PVG’s COET
2018
IOT based door locking system
CHAPTER-2:
LITERATURE SURVEY
In today’s fast paced and ever-changing world security is one of the basic needs of our lives.
Use of technology in the field of security plays an important role in increasing the security as well as
reducing the manpower efforts. Y. Januzaj proposed real time access control for face recognition using,
Raspberry pi instead of GSM services and relay. The limitation of the work was it couldn’t control the
background light situation and ambient light conditions.
H.L. win has proposed a door lock access system which consists of three subsystems: to be
Commented [check thi1]: put reference Number
specific face recognition, face detection, and automated door access control. Face recognition is
actualized by using the PCA (Principal Component Analysis). The door will open itself for the known
person in command of the microcontroller and caution will ring for the unknown person. Demerit of
this system is input images are taken through a web camera continuously until the ‘stop camera’ button
is pressed. Somebody is required at the location to check unauthorized person’s images or status of the
system and take further appropriate action. Personal computer (PC) is associated with the
microcontroller, the entire system will not work if PC is crashed or Non-Function.
M. Chowdhury had implemented security system where if any person came at the door it was
notified to the home owner via e-mail and twitter then the user could see the person standing at the
door using camera from remote location. The image of the person got captured and sent to twitter and
e-mail. They stated that user couldn’t control the door remotely. They had concluded that this system
was useful for preventing unauthorized access. The limitation of this work was that the alert generated
was sent to the mail and twitter account but if the user didn’t have internet connection on his/her phone,
he/she couldn’t check the mail and couldn’t recognize that any unauthorized person was trying to
access the door.
G. Senthil Kumar proposed a work on Embedded Image Capturing System Using Raspberry
Pi. In this work, they captured the image and compared it with the database but the limitation was the
system couldn’t work properly in the ambient light condition. M. Carikci proposed a work on A Face
Recognition System based on Eigen face method in which they used Eigen method for face recognition
and Euclidean distance method to compare the image of the person concerned with the images in the
database. It was very efficient and fast method and also gave high accuracy. S. Jogdand proposed a
work on Implementation of Automated Door Accessing System with Face Design and Recognition in
7
PVG’s COET
Commented [check thi2]: put reference number
2018
IOT based door locking system
which they used Viola Jones method for face detection and PCA (Principal Component Analysis) for
the comparison of images. The limitation of this work was that it is not robust and the efficiency is
less. U. Sowmiya Developed to connect any door with internet. In this system user also implemented
PIR sensor and camera. PIR sensor used for detecting person and camera used for capturing the video
of the person who comes at the door. The video was sent through 3g dongle to authorized person. They
had also discussed some advantages of this system. They had concluded use of this system in banks,
hospitals etc. But their proposed model didn’t provide the facility of sending messages to the
authorized people. J. Kartik Have proposed two systems are proposed, one is based on GSM
technology and other uses a web camera to detect the intruder. The first security system uses a web
camera, installed in house premises, which is operated by software installed on the PC and it uses the
Internet for communication. The camera identifies movement of any intruder before the camera
measurements or camera range. The product imparts to the planned client through Internet arrange
and, in the meantime, it gives a sound alarm. The second security system is SMS based and utilizes
GSM innovation to send the SMS to the owner.
8
PVG’s COET
2018
IOT based door locking system
CHAPTER-3:
DESIGN OF THE SYSTEM
3.1: Block Diagram –
Camera
Display
Raspberry Pi
Door locking
hardware
Facial database
IOT
Template
database
Internet
Fig 3.1: General Block Diagram
9
PVG’s COET
Commented [check thi3]: power supply block not show n
2018
IOT based door locking system
3.2: Working of the System –
•
The project will be conducted step-wise in the following manner:
a) A standard UBS camera captures the image to identify the person.
b) A standard UBS camera captures the image to identify the person.
c) If they aren’t identified the door will be firmly locked.
d) This project utilizes the basic web cam, and the internet connection to create a door that
unlocks itself via facial recognition. If the visitor at the door is recognized, the door will be
unlocked.
When a guest arrives at the home and finds the door to be locked, he/she presses the switch at the door.
This switch has been implemented using a pushbutton switch in the system developed. The GPIO 24
pin to which the switch is connected is continuously monitored by the system. In case a key press is
detected the system proceeds with the next steps of the program.
The system designed interacts with the guest using a set of speakers. The board provides audio output
via the 3.5 mm jack. Whenever the system needs to intimate the guest about the steps, it plays the
corresponding wav file saved in its home directory. For example, when the guest presses the switch at
the door a .wav file is played asking the guest to stand in front of the camera.
The image of the guest is captured by the web-and sent to the primary host and if needed to the
secondary host. The reply received determines whether the door is to be unlocked or not.
The algorithm used for the implementation of the proposed system is shown in Figure 2 using a
flowchart.
The implementation of the design of the proposed system was done using the Raspberry Pi 3 Model B
board. The Raspberry Pi is a single-board computer developed in the UK by the Raspberry Pi
Foundation. It is a board with features which are very useful in electronics projects.
Commented [check thi4]: need to add in component
specification
The board features:
•
•
•
•
•
•
10
On-board 10/100 Ethernet RJ45 jack
Dual USB Connector port
3.5 mm jack
HDMI Audio Output
26 dedicated GPIO pins
Including a UART
PVG’s COET
2018
IOT based door locking system
•
•
•
•
An i2c bus
A SPI bus with two chip selects
I2S audio
3.3 V, 5 V and ground
The board supports video output through the HDMI and RCA Video Ports. e requirements of the
project included switch inter-face, internet connectivity, USB webcam support, 3.5 mm speakers
support and actuator interface. Hence, this board was a desirable choice for the system. It is powered
using 5 V via Micro USB connector. Its power ratings are 5 V DC, 700-1500 mA.
The software was developed on the embedded Linux based Raspbian OS. The programming of the
Raspberry Pi has been done using the Python Programming Language. The scripts were written in the
Python IDLE v2.710. The different tasks have been accomplished by importing the necessary library
modules and using the appropriate functions.
The flowchart shows the sequence of steps followed by the system depending on the different possible
conditions.
11
PVG’s COET
2018
IOT based door locking system
3.3 Flowchart of working:
E-mail notification
12
PVG’s COET
2018
IOT based door locking system
3.4 Basic Working of Blocks
3.4.1 Switch Monitoring
The pushbutton switch has been connected to the GPIO 24 pin. The Raspberry Pi. GPIO library module
has been imported and named as GPIO. The GPIO 24 pin has been configured as input. The value of
this pin is checked to detect if there has been a key press.
3.4.2 Image Capture
Camera library modules have been imported and a new function capImg () has been defined. In the
function definition, a camera object is created. Upon calling this function a 480x320 image is captured
with the name “person.jpg” and is saved in the “/home/pi” directory.
3.4.2 Door Unlock
When the host grants permission to the guest to enter the door is unlocked. To unlock the door, a
function called open-door () has been defined. In the prototype developed, a 5 V solenoid actuator has
been used to demonstrate the unlocking of the door.
13
PVG’s COET
2018
IOT based door locking system
CHAPTER-4:
PROPOSED SYSTEM SPECIFICATIONS
4.1 Raspberry Pi
•
•
•
•
•
•
•
•
•
•
•
•
Quad Core 1.2 GHz Broadcom BCM2837 64bit CPU
1GB RAM
BCM43438 wireless LAN and Bluetooth Low Energy (BLE) on board
100 Base Ethernet
40-pin extended GPIO
4 USB 2 ports
4 Pole stereo output and composite video port
Full size HDMI
CSI camera port for connecting a Raspberry Pi camera
DSI display port for connecting a Raspberry Pi touchscreen display
Micro SD port for loading your operating system and storing data
Upgraded switched Micro USB power source up to 2.5A
Fig. raspberry pi 3 model B
14
PVG’s COET
2018
IOT based door locking system
4.2 Camera
The Raspberry Pi Camera Module v2 replaced the original Camera Module in April 2016. The v2
Camera Module has a Sony IMX219 8-megapixel sensor (compared to the 5-megapixel Omni Vision
OV5647 sensor of the original camera).
The Camera Module can be used to take high-definition video, as well as stills photographs. It’s easy
to use for beginners, but has plenty to offer advanced users if you’re looking to expand your
knowledge. There are lots of examples online of people using it for time-lapse, slow-motion, and
another video cleverness. You can also use the libraries we bundle with the camera to create effects.
You can read all the gory details about IMX219 and the Exmor R back-illuminated sensor architecture
on Sony’s website, but suffice to say this is more than just a resolution upgrade: it’s a leap forward in
image quality, colour fidelity, and low-light performance. It supports 1080p30, 720p60 and VGA90
video modes, as well as still capture. It attaches via a 15cm ribbon cable to the CSI port on the
Raspberry Pi.
Fig. Raspberry Pi camera module
4.3 Display
Size: 3.5 (inch)
Resolution: 480*320 (dots)
Touch: resistance touch
Size: 85.5*60.6 (mm)
Product weight: 148 (g)
15
PVG’s COET
2018
IOT based door locking system
CHAPTER-5:
CONCLUSION
The security system, proposed, is low cost, low power consuming system. This system can
easily provide high level of security as it combines two modern technologies together i.e. Face
recognition and IoT. These are rapidly growing technologies in industries and scientists are still
researching on them. Therefore, these two have made a significant impact on security system
development. Due to these, the security will almost double. Remote controlling and monitoring are
possible because of using IoT and Face recognition has made it almost impossible to hack.
16
PVG’s COET
2018
IOT based door locking system
CHAPTER-6:
FUTURE SCOPE
This security system is a combination of face recognition system and IoT. These two technologies
are growing technologies and with the help of them, much advancement can be done. There are many
face recognition algorithms developed till date but none of them are proper and hence each one has its
disadvantages. Hence in the future a proper designing in the face recognition algorithm can be done
and a new algorithm can be introduced. The technology is scalable therefore new modifications can be
easily done. New hardware can be easily attached hence new smart home concept can be implemented.
Everything in that home will be smart. That means we don’t need to give command to hardware every
time. Hardware itself will know do’s and don’ts.
17
PVG’s COET
2018
IOT based door locking system
CHAPTER-7:
TENTATIVE COST CALCULATIONS
Sr. No
Cost for
Equipment
Quantity Approx. Price
INR
1
Raspberry Pi 3 Model B
1
2500
2
Raspberry Pi Camera Module
1
2095
3
Solenoid lock
1
813
4
Display
1
1500
5
Basic ICs and electronic Components
-
2,000
6
PCB design fabrication cost
-
3,000
Total (INR)
11,908/Table 11.1: List of expenses
18
PVG’s COET
2018
IOT based door locking system
A. REFERENCES
[1] S.V. Thate, A.S. Narote, S.P. Narote, “Human face Detection and Recognition in Videos”, 21-24 September
2016, Jaipur, India.
[2] Anagha S. Dhalvikar, Dr R.K.Kulkarni “Face detection and facial expression recognition System”, 2014
International conference Mumbai.
[3] Andrea Zanella, Angelo Castellani,” Internet of Things for smart cities.”,14th February 2014, IEEE internet
of things journal conference.
[4] Kumar mandela, Ramu Parupalli , “Mobile Based Home Automation Using IOT”, 2015 International
conference on instrumentation
[5] Shaik Anwar, D. Kishore,” IoT based Home security system with alert and door access control using Smart
Phone”, December 2016, IJERT
19
PVG’s COET