International Journal of Engineering Trends and Technology (IJETT) – Volume 8 Number 10- Feb 2014
Design and Implementation of Low Cost Projection
Based Interactive Surface
Sujata Somkuwar#1, Ranjana Shendel*2, A. tayal#3
1
Department of Computer Science and Engineering, Nagpur University,
G.H. Raisoni Institute of Engineering and Technology for Women,
Nagpur-440034, India
2
Department of Computer Science and Engineering, Nagpur University,
G.H. Raisoni Institute of Engineering and Technology for Women,
Nagpur-440034, India
3
Department of Computer Technology, Nagpur University
Priydarshini College of Engineering, Nagpur-441110, India
1
Abstract- In multi- touch system touch technology is used ,in that
touch sensing is utilized as an input. It existed far and wide in
our daily life such as on smart phones or different types of
portable devices. However, current touch systems suffer from
many limitations. This project propose a new large surface multitouch system, it uses only a single special camera, mini projection
system and partial hand wearable system, which is easy to setup
and has low entry cost .In this prototype system, it will provide
very robust and works flawlessly almost any surface as flat and
non-flat surface. This project can effectively overcome several
limitations existed in previous systems. Main challenge behind
the projector, camera and wearable system set up is proper
placement of every component in order to give ease of system
accessing .
Keywords- Multi touch,
Projector system, HIM
IR Camera, hand wearable system,
I. INTRODUCTION
Information Technology has advanced tremendously over the
past few decades especially on HCI (Human Computer
Interaction). Research on HCI has been very active where
plenty of companies and research groups are actively
researching and improving on this field. HCI minimize the
barrier between human and computer by understanding the
user’s intention. One of the most famous interaction methods
is touch sensing because it is the most natural way for human
to interact with computer as touch is the most sensitive sense
among human’s five senses.
The main advantage of touch technology is the system is
able to work simultaneously on data input and system
controlling. There are various methods to implement a touch
system, which are normally categorized into two types:
Sensor-based and Vision-based. In the early days, resistive
touch method is frequently used. This method required
minimum space between the screen and sensor. When user
applies pressure on the surface, touch coordinate will be
detected using different signals. This method is able to, detect
inputs from any object, but the touch sensitivity is poor and
the touch screen has low resolution. It is mainly because the
sensor is placed above the screen. Recently, capacitive touch
ISSN: 2231-5381
sensor has replaced resistive touch sensor as the most
frequently used touch sensing technology, as seen on different
touch devices. The touch surface is coated with conductive
material. When a small voltage is applied to this layer via
some conductive object such as fingers, the coordinate of the
object can be detected . It is able to detect multiple touch
points, but it greatly depends on the conductive material. Yet,
this method still possesses many restrictions on touching.
Non-conductive object will not trigger the touch action. On
the other hand, there are different methods in vision-based
touch system too.
The most frequently used methods are FTIR (Frustrated
Total Internal Reflection), DI (Diffused Illumination) and LLP
(Laser Light Plane Illumination). All of these methods have a
common characteristic which is IR (Infrared) Sensor with IR
Emitter are being used. Each method is differentiated by the
IR sensor’s position and the IR emitting method. They do
have a common advantage, which is very robust at detecting
touch points. However, their weakness is they are very
sensitive at illumination. In order to work perfectly, a stable
environment is preferred.
Existing touch systems mostly focused on small devices
such as smart-phones and portable devices. There are large
multi-touch systems available such as Microsoft Surface but it
is extremely expensive. This system proposes and develop a
new surface multi-touch system using low cost camera. This
system requires only a single camera for the touch detection
without any support of other devices. The system is very
robust and does not affect by illuminations of surrounding
environment. It is also able to work on almost any surface
including non-flat surface.
In this paper we are Designing a stated system which
leasing a regular solid surface to which the projection is
illuminated become a touch sensitive screen ,with the entire
system comprising a projector and IR camera.
II. LITERATURE REVIEW
Many researcher discuss various techniques such as SeokMin Hong, Yung-Fu Tan, Hui-Shyong Yeo, Byung-Gook Lee
propose new large surface multitouch system, named as “1-
http://www.ijettjournal.org
Page 509
International Journal of Engineering Trends and Technology (IJETT) – Volume 8 Number 10- Feb 2014
inch UniTouch System”. They uses only a single Kinect
camera, which is easy to setup and has low cost. Several
essential image-processing techniques is also utilised to
improve the system robustness and accuracy [1].
Xiaoqiong Wang and Liwei Wang propose a large screen
multi-touch system integrated with multi-projector. They
implies multiple infrared cameras behind the screen to capture
the image changes in multi-user finger contact surface, filters
the visible light images projected by projectors, collects the
remaining infrared image and transfers it into a computer, then
detects and tracks various operations of multi-fingers via
image recognition algorithm [2].
Kevin O’ Mahony, Jian Liang, Kieran Delaney propose the
SIIS system is validated with both 2-D and 3-D applications to
demonstrate the effectiveness and flexibility of multi-touch
interactions and usability of the multi-touch interface for
engaging with real-time sensor information [4].
Antti Virolainen, Arto Puikkonen and Tuula Kärkkäinen
propsed a multi-touch screen using a material which has been
very little (or not at all) used in pervasive computing – ice.
They provide their experience of building a multi-touch
display from an unconventional material, and the views of
what should be taken into account when designing an
interactive ice installation. In addition, they seek to offer an
inspirational viewpoint on how interactive systems could be
integrated to everyday life environments [5].
H. M. Elfekey and H. A. Bastawrous present a new touchsensing technique for the implementation of a simple and
cost-effective touch keyboard based on the AC hum
phenomenon which exists in the vicinity of any AC source[6].
Byoungjoo Lee, Insung Hong, Yoonsik Uhm and Sehyun
Park, propose an infrared LED based system suitable to be
used in multi users. To solve coordinate recognition problems
in collinear in a 2-dimensional bi-axial coordinate system,
they design 2- dimensional tri-axial coordinate multitouch
system using infrared LEDs. The comparing result between
two systems shows that the recognition rate in the biaxial
coordinate system is 49 percent and the recognition rate in the
tri-axial coordinate system is 99percent [7].
III. PROPOSED RESEARCH METHODOLOGY
Figure1.2: Projection View
ISSN: 2231-5381
Diff. X = IR X - Projector X ,
Real X = Current X _ Diff X
Diff. Y = IR Y -Projector Y,
Real Y = Current Y _ Diff
In this, we first performed our experiment in a stable
environment by selecting a flat table, followed by experiment
on non-flat surfaces. We can call this system as Pro-Cam
system it has a projector illuminating a display pattern to a
planar projection surface that is imaged by a camera. The
intrinsic parameter and extrinsic relationship of these two
electronic instruments are relative to projection surface are
fixed, the image.
IV. PROPOSED PLAN OF WORK
IR Camera
Microcontroller
USB to TTL
Application
Hardware Interface
Module
Computer
System
Figure 2: System Architecture
Main base of proposed system is proper synchronization
between the IR camera which will be used to location the
moving IR pointer device and projector which will be used to
convert plane surface in to display. The main objective of this
research is to verify the touch area by using information from
IR camera. We use different approaches with existing
methods to verify the touch area on flat and non-flat surface.
Figure 1.1: IR Plane
Figure 3: Finding the differential X and Y
Wii- IR camera it doesn’t return frame or images to the
system, it will simply provides a ‘X’ & ‘Y’ coordinates of the
detected IR point. The problem was that we encountered a
difficulty in getting connecting wiimote (paining)and having
laptop between wiimote and controller. Hence we have
decided to use IR camera and a microcontroller.
Hardware interface module (HIM) introduced as hardware
/software solution for our design application connection
problems at very low cost.The typical features of HIM such as
SBC(Single board computer)with added communication
interfaces and circuitry design. HIM available with two
standard connector . One labeled as NETWORK and the other
is DEVICE. The IR sensors do not have an intelligent
communication interface and required direct connection to an
A/D convertor. The HIM provides all the necessary
interfacing, signal conditioning and A/D conversion routines
for the IR sensors.
In this system first IR Camera will capture the coordinates of touch point, this co-ordinates or data will send to
http://www.ijettjournal.org
Page 510
International Journal of Engineering Trends and Technology (IJETT) – Volume 8 Number 10- Feb 2014
microcontroller.IR camera is a TTL system. Microcontroller
act as controller to send data collected from IR camera to the
Computer system via USB to TTL. HIM connected between
Computer system and our application .It provide necessary
interfacing for the system.
1.
2.
V. FURTHER PLAN
After detecting the arbitrary co-ordinates, next
module will include synchronization with projection
display.
After that we will establishing interaction between
projection system ,IR camera and computer system.
VI.CONCLUSION
Although there are various methods of multi-touch
systems proposed, it is difficult to be used as applications
because of high complexity of structure, high cost, and low
display capability. Hand gesture recognitions is the way to
interact with vision enabled computers and other machines.
To achieve high applicability and complement these
disadvantage ,the propose system primarily focused on the
study of work done in the area of hand gesture recognition
using single camera, mini projection system and partial hand
wearable system ,Which convert any flat surface in to touch
screen system. User can easily access wall, desk, canvas, etc.
surface as a computer display system and control all the
computation activity of the computer.
VII. REFERENCES
[1]
Seok-Min Hong, Yung-Fu Tan, Hui-Shyong Yeo, Byung-Gook Lee,”1inch UniTouch System using Kinect” , IEEE 2013.
[2] Xiaoqiong Wang and Liwei Wang, “Large Screen Multi-Touch System
Integrated WithMulti –Projector”,IEEE,2011.
[3]LvRuihua,Han Lu “Research on WPF4-Based Multi-touch System
Development Technology”, IEEE 2012
[4]Kevin O’ Mahony, Jian Liang, Kieran Delaney “A Real-time System for
Sensor Information Interactive Visualization with Multi-touchTechnology”
,IEEE , 2010.
[5] RongChang,Feng Wang and Pengfei You, “A Survey on the
Development of Multi-touch Technology”,IEEE , 2010.
[6]Byoungjoo Lee, Insung Hong, YoonsikUhm and SehyunPark ”The MultiTouch System with High Applicability using Tri-axialCoordinate Infrared
LEDs”, IEEE 2009.
[7]H. M. Elfekey, H. A. Bastawrous,”Design and Implementation of a New
Thin Cost Effective ACHum Based Touch Sensing Keyboard” ,IEEE 2013.
[8]Sun Zhenying, Wang Yigang Ye Lexiao “Research on human-computer
interaction with laserpenin projection display” IEEE 2008.
[9]Jangwoon Kim, J ewan Park, HyungKwan
“HCI(Human
Computer
Interaction)
touchTabletopDisplay”,IEEE 2007.
Kim Chilwoo Lee
Using
Multi-
[10] Jingwen Dai and Ronald Chung,” Making any planar surface into a
touch-sensitive display by a mere projector and camera”,2012 IEEE
ISSN: 2231-5381
http://www.ijettjournal.org
Page 511