Internet of Intelligent Things and
Robot as a Service
智能物联网和机器人即是服务
陈以农 （Yinong Chen） Ph.D.
亚利桑那州立大学
Arizona State University, Tempe, Arizona, U.S.A.
JICSIT/ITAIC 2011 Keynote
1
智能物联网和机器人即是服务
Outline
1
物联网： Internet of Things (IoT)
2
智能物联网： Internet of Intelligent Things (IoIT)
3
机器人即是服务： Robot as a Service (RaaS)
4
在教育中的应用： Application in Education
2
2
Definition
•
•
•
•
Internet of Things (IoT) refers to uniquely identifiable
(through URI) objects (things), and their virtual representations in
an Internet structure (http://en.wikipedia.org/wiki/Internet_of_Things).
The concept was initially applied in the Radio-Frequency
Identification RFID-tags to mark the Electronic Product Code (AutoID Lab).
IoT concept is later extended to refer to the world where physical
objects are seamlessly integrated into the information network,
and where the physical objects can become active participants in
business processes.
Internet of Intelligent Things (IoIT) deals with intelligent devices
with adequate computing and communication capacity.
– Add distributed computing and communication capacity
– Add distributed intelligence to IoT.
3 3
IoT and IoIT
Web-based
computing is
the engine of
IoT and Big Data
analysis is the
gas
Physical things
Simple
devices
Virtual things
Intelligent
devices
Distributed
intelligence
adds benefits
to centralized
computing
Internet and
Web-Based
Internet
Computing
photos
sensors
service
Web pages
cameras
controllers
robots
smart phones
satellites
4
Increasing Number of IoT Devices
http://www.symplio.com/2011/09/4-infographics-about-internet-of-things/
2008
5 billion
2012
15 billion
5
5
15B IoT Devices are the main Source of Big Data
DeviceGenerated
data
Big Data
HumanGenerated
data
Source:
Intel Embedded Research and Education Summit 2013
6
Current Efforts in Device Integration (1)
Augmented Reality
• Pachube (https://pachube.com)
– Data infrastructure for users to build their Internet of
Things: Users send to Pachube and use API to access;
– Manage real-time data from sensors, devices, and
environments
– Big Data Source
Server
User
hardware
User
data
API
Client
application
7
Current Efforts in Device Integration (1)
Augmented Reality
• Wikitude World Browser (http://www.wikitude.com/)
– Organize and display information about users'
surroundings in a mobile camera view (virtual world).
– Similar to Pachube, but focus on photos and videos;
– Case 1: Create your own virtual word with your photos
and videos and share it with family and friends;
– Case 2: Use public photos and videos to create new
virtual world;
– Case 3: For a point of interest (restaurant, park, etc.),
find its virtual world and comments .
8
Current Efforts in Device Integration (1)
Augmented Reality
• Monocle Apps of Yelp
– Implementing Augmented Reality in mobile apps
(Android phone and iPhone);
– These apps combine data collected by the phone’s
compass, camera, and GPS system, as well as virtual
data available online, to create the real physical
world;
– You can see things like the location of Twitter users
and local restaurants in the physical world, even if
they are miles away.
9
Current Efforts: Device Integration (2)
• Devices Profile for Web Services (DPWS) defines Web
Service interfaces for devices;
• DPWS enables secure Web Service messaging,
discovery, description, and eventing on resourceconstrained devices;
• DPWS specification was initially published in 2004 and
was submitted for standardization to OASIS in 2008.
DPWS 1.1 was approved as OASIS Standard together
with WS-Discovery 1.1 and SOAP-over-UDP 1.1 2009;
• Microsoft .Net Framework Class Library defined classes
for supporting DPWS device programming
Reference: http://en.wikipedia.org/wiki/Devices_Profile_for_Web_Services
10
Current Efforts: Device Integration (2)
• Device with Built-in
Service Interface, for
example:
• Netduio Plus: Works with
.Net Micro Framework to
facilitate service to device
communication
http://www.amazon.com
11
Intel Embedded Research
& Education Summit
February 22-24, 2012,
Intelligent
Intel Embedded System
Group
Chandler, Arizona
Source:
http://embedded.communities.intel.com/servlet/JiveServlet/do
wnloadBody/7148-102-1-2394/Accelerating-the-Transition-toIntelligent-Systems.pdf
http://blogs.intel.com/embedded/2012/02/ieres-2012-day-1/
1212
Accelerating the Transition to Intelligent Systems
http://blogs.intel.com/embedded/2012/02/ieres-2012-day-1/
1313
The Evolution of Intelligent Devices
http://blogs.intel.com/embedded/2012/02/ieres-2012-day-1/
Intelligent
System
Embedded
system 1414
Competences and Opportunities
http://blogs.intel.com/embedded/2012/02/ieres-2012-day-1/
1515
Embedded Intelligent Systems Challenges
http://blogs.intel.com/embedded/2012/02/ieres-2012-day-2/
• Exponential growth in compute-capable connected devices.
• Fragmented market with entrenched and successful solution
providers  low-cost, fast-time-to-market, application-specific
• Increasing need for specialized content processing requires
specialized HW/SW responses
• Extremely tight cost, space, power, and thermal constraints
• Embedded systems have much longer life support requirements
(7 year supply, 10 year reliability)
• Unique security challenges require hardened SW & HW to ensure
user trust
• Need for intelligent sensing, perception, and real-time analytics
• Trend toward cyber-physical systems / Internet of Things
1616
Intel Architecture for IoT: Areas of Focus
http://blogs.intel.com/embedded/2012/02/ieres-2012-day-2/
• 2011 Intel IoT Focus:
Simple, Safe, Scalable architecture for
Connected Devices
• 2012 Intel IoT Focus:
Immediate problem areas refined:
– Device Identity
– Device Integrity
– Application Integrity
– Integrity Management
Security at
Device Level
1717
ASU Research and Education on
Internet of Intelligent Things and
Robot as a Service
1818
Cloud Computing and IoIT as a Service




Software as a Service
Platform as a Service
Infrastructure as a Service
X as a Service
 IoIT as a Service
 Cyber Physical Devices
 Device as a Service
 Robot as a Service (RaaS)
19
Device Integration in Cloud
Computing
Software as a Service
Platform as a Service
Infrastructure as a Service
Test as a Service
X as a Service
IoIT as Service
Robot as a Service
Service Interface in
HTTP, URI, REST.
WSDL, SOAP, etc.
20
Current Efforts: Robot as a Service
Application
repository
Service
Broker
Arm motion services
Drive services
Maze navigations
Range sensor services
RaaS Unit
Sumo games
Compass sensor services
Ball (soccer) games
Touch sensor services
Dancing
Thermo sensor services Services and
Power plants
applications
Windmill services
Robot cops
Communication services Directory
Roadside assistants
Input/output services
Robot pets
Timing services
Patient care
Service
Event services
Repository
Simulation services
with selfhosting
RaaS supports two modes
• Activate an existing application
• Compose a new Web application, which using the services
21
RaaS Interfacing with the Cloud Environment
•
••
•
••
••
•
••
••
Ar m m o
t ionse rvic es
D
r i ve ss er
vicoesr se rvic es
Range
ens
Com pas s s ensor se r v
i ce s
Touch s ensor se rvic es
Ther
m o se n
s ors ervic es
M usndm
ic D
Wi
il Jsls er
er vviicc eses
Com m unic at ionse rvic es
ITinput
ou
ts p
uer tv
m i /ng
i sece rvs ic es
Event
Si
m ul sater
iovnicse esr v
i ce s
RaaS unit
OS & drivers
Hardware
Internet and
Cloud
SaaS, PaaS, IaaS
Communication
•
••
•
••
•
•
•
M aze nav
ig
a ti o
ns
Sum
Bal l o( sogam
cce res )games
Danci ng
Power cop
pl sants
Robot
Roads i de ass is ta n
ts
Robot pets
Pat i ent car e
•
••
•
••
••
•
••
••
Ar m m o
t ionse rvic es
D
r i ve ss er
vicoesr se rvic es
Range
ens
Com pas s s ensor se r v
i ce s
Touch s ensor se rvic es
Ther
m o se n
s ors ervic es
M usndm
ic D
Wi
il Jsls er
er v
viicc eses
Com m unic at ionse rvic es
ITinput
/ ou
ts p
u
m i ng
er v
it cese srvic es
Event
s ioernvseic res vice s
Si
m ul at
RaaS unit
Ser vi ces andapplic at ionsDir ect ory
M aze nav
ig
a ti o
ns
Sum
Bal l o( sogam
cce res )games
Danci ng
Power cop
pl sants
Robot
Roads i de ass is ta n
ts
Robot pets
Pat i ent car e
Ser vi ces andapplic at ionsDir ect ory
•
••
•
••
•
•
•
OS & drivers
Hardware
22
RaaS in Could Environment
Watch the Video at: http://vimeo.com/9740048
RaaS
RaaS
RaaS
RaaS
RaaS
23
Robotic Programming
Web Apps
Phone Apps
Computer Science
Concepts
Visual
Programming
Robotic
Programming
Intel Architecture
Cornell Cup Robot
2013
24
From Programming to Concepts
http://venus.eas.asu.edu/WSRepository/eRobotic/
Finite State
Machine
Algorithm and
efficiency
Computer
simulation
Web
programming
Communication
between Web robot
and physical robot
25
Right-Wall-Following Algorithm
Turning
Left90
leftFinished
Turned
Left
Touch-Sensor
Touched
Turned
Right
rightFinished
Turning
Right90
DistanceMeasured
> BaseDistance + 400
Start
Forward
26
Autonomous Maze Navigation
Start
DistanceMeasured
< 400
Forward
rightFinished
Turning
Right
Turned
Right
RightDistance  DistanceMeasured
Resum180
Finished
DistanceMeasured
>= rightDistance
Turning
Left
leftFinished
Resume
180
DistanceMeasured
< rightDistance
Turned
Left
http://www.public.asu.edu/~ychen10/teaching/cse101/
mms://venus.eas.asu.edu/roboticscamp/furi/2011/Maze.wmv
27
Intel-Based Robot
Cornell Cup: http://venus.eas.asu.edu/WSRepository/eRobotic/video2013.wmv
28
Programming Android Systems
http://venus.eas.asu.edu/WSRepository/eRobotic/
29
Based on Service-Oriented Computing
Developers who
understand
database, ontology,
and matching
End
user
White pages
Software
engineers who
understand the
application
domain
Service brokers
Yellow pages
Registry
Green pages
Service repository
Internet
Application builders
Applications
Service requesters
Service providers
Active Objects
Traditional
objectoriented
programmers,
active objects
hosting
Service developers
30
Support from a Service Repository
http://venus.eas.asu.edu/WSRepository/
• Computing services, such encryption
• Data storage services, such as storing
messages
• Web services, such as weather, movie
• Graphic services, such as image verifier
• Robotics apps services, such as maze,
driving assistance.
31
Developing a Secure phone messenger, where the
senders have full control of the messages
 This RESTful service call
transfer data to the REST
service at the given URL;
 The two page are in the same
solution and we can use local
URL
 Another real phone does not
have a URL.
Message
Queue
Service
3232
How are Confidentiality Guaranteed?
Encryption
Decryption
Service
SSL is
necessary
SSL is
necessary
Message
Queue
Service
Encrypted text
Encrypted
text stored
Encrypted text
SSL does
not help
3333
Energy Calculator for Smart home App
http://venus.eas.asu.edu/WSRepository/smarthome/smarthome.html
34
ASU Service Repository
http://venus.eas.asu.edu/WSRepository/
•
•
•
•
•
SOAP/WSDL Services
RESTful Services
Workflow services
Web applications
Robot as Service
Contact Info:
35
Interactive App
http://venus.eas.asu.edu/WSRepository/eRobotic/
Right-Wall-Following Algorithm
36