Your systems. Working as one. Understanding the Internet of Things Protocols DDS, MQTT, XMPP, & AMQP OMG Sept 2013 Stan Schneider, PhD What is the Internet of Things? © 2013 Real-Time Innovations, Inc. Permission granted to distribute with this legend. 2 What is the Internet of Things? • Cisco “Internet of Everything” – …the latest wave of the Internet -- connecting physical objects…to provide better safety, comfort, and efficiency • IBM “Internet of Things” – …a completely new world-wide web, one comprised of the messages that digitally empowered devices would send to one another. It is the same Internet, but not the same Web. • GE “Industrial Internet” – …convergence of machine and intelligent data…to create brilliant machines • RTI “Your Systems. Working as One.” – …an entirely new utility. As profound as the cell network, GPS, or the Internet itself. The Internet of Things and the Intelligent Systems it enables will fundamentally change our world. © 2013 Real-Time Innovations, Inc. Permission granted to distribute with this legend. 3 What Connects the Things? IoT Standard Protocols © 2013 Real-Time Innovations, Inc. Permission granted to distribute with this legend. 4 MQTT: Collect Device Data Message Queuing Telemetry Transport (MQTT) © 2013 Real-Time Innovations, Inc. Permission granted to distribute with this legend. 5 © 2013 Real-Time Innovations, Inc. Permission granted to distribute with this legend. 6 DDS: Distribute Device Data Real-Time Analytics & Control Operator HMI Sensors IT and/or Cloud Integration Actuators Data Distribution Service (DDS) © 2013 Real-Time Innovations, Inc. Permission granted to distribute with this legend. 7 XMPP Extensible Messaging and Presence Protocol (XMPP) © 2013 Real-Time Innovations, Inc. Permission granted to distribute with this legend. 8 AMQP: Process Device Data (on Servers) Advanced Message Queuing Protocol (AMQP) © 2013 Real-Time Innovations, Inc. Permission granted to distribute with this legend. 9 Connecting the Internet of Things Web Services and Business Apps Server-to-Server (S2S) • S2S – – – – Biz intelligence Centralized/ESB ~100ms MQ/AMQP • D2S Device to Server (D2S) – – – – Collect data Hub & spoke ~10ms MQTT/CoAP • D2S->P – Link sparse endpoints – XMPP Device-to-Device Devices and Intelligent Systems © 2013 Real-Time Innovations, Inc. Permission granted to distribute with this legend. • D2D – – – – Control, distribute DataBus ~.01ms DDS 10 DDS Builds Intelligent Systems © 2013 Real-Time Innovations, Inc. Permission granted to distribute with this legend. 11 DDS: The Software DataBus • Data centric – Like a database for moving data • Decouples modules – Like SOA • Plug and play flexibility – Like a hardware bus Data-Centric DataBus™ Messaging Bus • Peer-to-peer performance – Like streaming protocols • Standards-based interoperability – Like TCP/IP Scalable, high performance, reliable infrastructure © 2013 Real-Time Innovations, Inc. Permission granted to distribute with this legend. 12 Managing State • Data centric – Single version of truth – Known structure – Clear rules for access, changes, updates • Technologies – Database – Data-centric middleware © 2013 Real-Time Innovations, Inc. Permission granted to distribute with this legend. 13 Intelligent Distributed Systems Need… • Reliable Operation • Deterministic Performance • System Integration • Flexible Transports • Crisp Interface Design • Easy Tech Upgrades • Multi-Channel Connections • Open Architecture • Wireless Links • • • • • • • • • • Legacy Integration Hardware in the Loop Scalability Database Integration High Throughput Reliable Uptime Industry Interoperation Small Device Connection Large Fan In/Out Real-Time and IT Integration © 2013 Real-Time Innovations, Inc. Permission granted to distribute with this legend. 14 Reliable Operation • The LPD-17 Ship-Wide Area Network (SWAN) runs machinery, damage control, steering, magnetic signature, mission control, navigation, communication • Redundant networks, data, sensors and RTI middleware provide non-stop reliability © 2013 Real-Time Innovations, Inc. Permission granted to distribute with this legend. 15 Real-Time Performance • The Ship Self Defense System is the “last line of defense” • SSDS coordinates highspeed radars, targets defensive missiles, and directs 1000+ rounds/sec at incoming cruise missiles • SSDS is at sea now • RTI delivers messages in real time © 2013 Real-Time Innovations, Inc. Permission granted to distribute with this legend. 16 System Integration • RTI is the leading vendor of combat system messaging • RTI connects disparate systems, merges multiple languages on multiple operating systems, handles DIL links and legacy interfaces for LCS • RTI enables easy, large-scale integration © 2013 Real-Time Innovations, Inc. Permission granted to distribute with this legend. 17 Navy Open Architecture • Next-generation of – – – – – – Aegis DDG 1000 SSDS LCS (both variants) LPD-17 Many more, US and allies • Highly distributed systems include radar, weapons, displays, controls • Standards-based, highperformance middleware avoids vendor lock-in and future-proofs the architectural design © 2013 Real-Time Innovations, Inc. Permission granted to distribute with this legend. 18 Fast Emergency Response • Exelis (ITT) C4i provides command and control systems for military and civilian agencies (fire/police/emergency response) • RTI Connext DDS connects GUIs to servers that route voice and video • RTI met the critical needs: scalability, routing, recording © 2013 Real-Time Innovations, Inc. Permission granted to distribute with this legend. 19 EMS System Platform • The largest EMS equipment provider will use RTI for their entire product line…for the next 20 years • Provides emergency response equipment to 60% of the world’s emergency vehicles • RTI middleware provides easy connectivity, performance, reliability, medical certification option © 2013 Real-Time Innovations, Inc. Permission granted to distribute with this legend. 20 EMS Remote Monitoring Connecting devices with hospitals to provide better treatment while en-route 4G/LTE © 2013 Real-Time Innovations, Inc. Permission granted to distribute with this legend. 21 High Throughput Medical Imaging • RTI powers Varian’s NMR and MRI product lines • Any one of the sixteen MRI receivers can saturate a 1Gbit network. “RTI delivered great functionality at a low cost. Using RTI middleware saved us a lot of money, time, and effort compared to our previous in-house developed solution.” • RTI controls and optimizes network use to handle megabytes of load without losing data © 2013 Real-Time Innovations, Inc. Permission granted to distribute with this legend. 22 High Rate Distributed Control • The Minimally Invasive Robotic Surgery (MIRS) system at DLR coordinates three robots to perform delicate heart surgery. • The system closes a distributed loop between the robots and the remote surgeon’s control at 3kHz. • RTI delivers messages in real time © 2013 Real-Time Innovations, Inc. Permission granted to distribute with this legend. 23 Hospital Patient Safety • Preventable hospital error is the 6th leading cause of death • DocBox integrates devices with a decision engine to improve patient safety • RTI Connext ties together devices, services, and displays in real time “RTI Connext DDS met all our needs – whether we’re handling 12 patients, or 200.” -- DocBox Founder, Tracy Rausch © 2013 Real-Time Innovations, Inc. Permission granted to distribute with this legend. 24 Industry Interoperation • The Integrated Clinical Environment (ICE) standard specifies interoperability for medical devices • All ICU & operating room devices — from blood pressure cuffs to intravenous pumps to ventilators — could be interconnected according to the ICE standard – Complete logging – Automatic error detection – Better care • The DDS standard and RTI middleware enables plug & play interoperability across manufacturers © 2013 Real-Time Innovations, Inc. Permission granted to distribute with this legend. 25 Clinical Decision Support Systems Administration HL7/EMR Gateway, Enterprise, 3rd Party Care Area Workstations, Storage, Historical Room Devices © 2013 Real-Time Innovations, Inc. Permission granted to distribute with this legend. 26 CDS System of Systems © 2013 Real-Time Innovations, Inc. Permission granted to distribute with this legend. 27 Hospital Integration • Hospital net challenge – 1000s of patients, >100k devices – Wired/wireless/ISM – Moving patients – 100% uptime, security – Real-time waveforms • RTI advanced response – – – – – Smart data filtering Routed deployment Optimized updates Automated test harness Control plane © 2013 Real-Time Innovations, Inc. Permission granted to distribute with this legend. 28 Reliable Uptime • Mevion’s ProtonBeam Radiation Therapy system zaps tumors with accelerated protons • The treatment must be continuous for 3040 days; downtime endangers treatment success • With RTI, Mevion’s PBRT delivers dependable treatment at low cost © 2013 Real-Time Innovations, Inc. Permission granted to distribute with this legend. 29 24x7 Operation RTI Connext DDS was selected for its extensive compliance with the Object Management Group (OMG) DDS standard; its high security rating; its wide support of tools and programming languages, and its reputation for performance, scalability and 24/7 reliability. – Sid Koslow, Chief Technology Officer, NAV CANADA. Air Traffic Control for Canada 2nd largest ANSP in the world 80 sites © 2013 Real-Time Innovations, Inc. Permission granted to distribute with this legend. 30 Flexible Transports "In the past we probably would have developed an expensive, proprietary system for data communications. By using RTI, we were able to deliver a proven, reliable and cost effective solution to our customers.” • CAE, one of the world's leading providers of simulation and training, uses RTI over high-bandwidth IEEE1394 for its flight simulator • Middleware provides transport portability and architecture interoperability - Peter Jarvis, Chief Designer © 2013 Real-Time Innovations, Inc. Permission granted to distribute with this legend. 31 Database Integration • Light and strong advanced composites make advanced aircraft quiet and efficient • Lund Engineering uses RTI to integrate the composite inspection system • Critically, all data must be saved for validation; RTI’s database integration saves all data to permanent storage © 2013 Real-Time Innovations, Inc. Permission granted to distribute with this legend. 32 Advanced Ground Stations • General Atomics Ground Control Stations deliver real-time data acquisition, analysis, and response for unmanned aircraft systems such as Predator® • GA selected RTI for proven software & services • Middleware and open architecture speeds development, lowers costs © 2013 Real-Time Innovations, Inc. Permission granted to distribute with this legend. 33 Interoperable Open Architecture • RTI leads in defining a standard architectures for unmanned vehicles and avionics • RTI chairs the architecture for UCS (ground stations) and is key at FACE (avionics) • RTI is building a DO178C-level A safety-certified DDS © 2013 Real-Time Innovations, Inc. Permission granted to distribute with this legend. 34 DDS Enables Open Architecture Navy CCRL OSD UCS AF Avionics GVA DEF STAN 23-09 Army COE© 2013 Real-Time Innovations, Inc. Permission granted to distribute with this legend. 35 Advanced Automotive • The VW Driver Assistance and Integrated Safety system combines radars, laser range finders, and video to assist safe operation • It helps avoid obstacles, detect lane departures, track eye activity, and safely negotiate bends • Advanced safety systems must connect to existing hardware. RTI middleware bridges high speed networking to the CAN bus © 2013 Real-Time Innovations, Inc. Permission granted to distribute with this legend. 36 Modular HIL Testing • A modern car contains 100+ CPUs • Audi uses hardware-inthe-loop simulation to feed realistic data to components in a lab for testing • RTI middleware enables a modular test environment that scales to work with hundreds of devices © 2013 Real-Time Innovations, Inc. Permission granted to distribute with this legend. 37 Rail Asset Tracking • Wi-Tronix systems wirelessly monitor highvalue mobile assets such as locomotives, industrial equipment and marine vessels • RTI addressed critical issues such as optimized flow and discovery process over a wireless network • RTI middleware works effectively over lossy wireless networks © 2013 Real-Time Innovations, Inc. Permission granted to distribute with this legend. 38 Fan Out/Fan In • Blue Force Tracker (JBC-P) must process 200,000+ tracks. • The legacy design was: – – – – – Proprietary 1.5m SLOC 12,000 tracks 11 servers w/88 cores Unreliable • The DDS design is: – – – – – – © 2013 Real-Time Innovations, Inc. Permission granted to distribute with this legend. 100% standards based 50k SLOC 250,000 tracks 80% of a single core Fully redundant Reliable multicast 39 Monitoring Tokyo Traffic • Tokyo traffic system provides real-time information to commuters and officials • RTI middleware coordinates hundreds of traffic monitors and information kiosks • Various server & client platforms, types of links • RTI supports widearea deployment © 2013 Real-Time Innovations, Inc. Permission granted to distribute with this legend. Transportation 40 Industrial Automation • Schneider PLCs operate modern factories • Manufacturing requires fast data, even with limited memory and processing power • RTI middleware connects powerful computers to deeply embedded devices with limited memory DDS wire spec first standardized as part of IEC 61850 © 2013 Real-Time Innovations, Inc. Permission granted to distribute with this legend. 41 Large SCADA Systems • NASA KSC’s new Constellation launch control SCADA system • RTI delivered 300k instances, at 400k msgs/sec with 5x the required throughput, at 1/5 the needed latency • NASA mitigates risk by parallel-tracking multiple DDS vendors • RTI connects thousands of sensors and actuators © 2013 Real-Time Innovations, Inc. Permission granted to distribute with this legend. 42 Scalability • Harmonic transmission and video switching equipment delivers worldwide video-ondemand • RTI handles 1,000s of clients, 1,000,000s of messages • RTI enables highperformance scalability and future extensibility © 2013 Real-Time Innovations, Inc. Permission granted to distribute with this legend. 43 Harsh Environment Operations • Joy Mining is the world’s largest mining equipment manufacturer • RTI connects the controller, operator GUI, and historian • Reliable, fast connectivity enables control, debugging, and system health monitoring for continuous mining © 2013 Real-Time Innovations, Inc. Permission granted to distribute with this legend. 44 Wireless Links • NASA’s Human-Robotic Systems prototypes robots for extraterrestrial surfaces • The project coordinates four NASA centers building four different robots. They operate in realistic environments, including over low-bandwidth, highdelay, lossy communications • RTI middleware allows these very different systems to share common data communications over disadvantaged links © 2013 Real-Time Innovations, Inc. Permission granted to distribute with this legend. 45 Flexible Data Link • NASA’s Human-Robotic Systems prototypes robots for extraterrestrial surfaces • The project coordinates four NASA centers building four different robots. • NASA uses DDS for lowbandwidth, high-delay, lossy ISS-earth communications • RTI middleware communicates over disadvantaged links © 2013 Real-Time Innovations, Inc. Permission granted to distribute with this legend. 46 Precision Instrumentation • European Southern Observatory’s Very Large Telescope can see objects four billion times fainter than can be seen with the unaided eye • The telescopes use hundreds of servo mirrors and scientific instruments • RTI middleware coordinates precise control and measurement © 2013 Real-Time Innovations, Inc. Permission granted to distribute with this legend. 47 Power Monitoring and Control • MicroGrids connect generation, load, and storage to optimize usage and eliminate traditional grid infrastructure • Deploying at large Canadian Utility • Connext™ DDS middleware seamlessly integrates apps, enforces security, merges NI LabVIEW © 2013 Real-Time Innovations, Inc. Permission granted to distribute with this legend. 48 Real-Time & IT Integration • Siemens Wind Power fields farms of 500 turbines with 100m blades • RTI enables fast control within turbines and distributed gust mitigation across the array • RTI will also integrate with predictive maintenance and business diagnostics • RTI melds real-time with IT © 2013 Real-Time Innovations, Inc. Permission granted to distribute with this legend. 49 Why a DataBus Transport? • Reduced risk – Proven, reusable, powerful • Elegant architecture – Reduced coupling speeds development – QoS control simplifies integration • Advanced capability – – – – Redundancy, fan out, fan in Transport, OS, language transparency Integration, hot-swap, scalability Security, IoT connectivity © 2013 Real-Time Innovations, Inc. Permission granted to distribute with this legend. DataBus™ 50 The DDS Ecosystem © 2013 Real-Time Innovations, Inc. Permission granted to distribute with this legend. 52 Management’s sole strategic imperative is to engage competition Bill Barnett, Stanford GSB © 2013 Real-Time Innovations, Inc. Permission granted to distribute with this legend. 53 Interoperability between the applications demonstrated by six different vendors in 2012 OCI ETRI PrismTech IBM © 2013 Real-Time Innovations, Inc. Permission granted to distribute with this legend. RTI TwinOaks 54 Our Transformation © 2013 Real-Time Innovations, Inc. Permission granted to distribute with this legend. 55 “It seems you’ve been living two lives. One of these lives has a future, and one of them does not.” The time has come for RTI to reinvent itself. RTI’s New Business Model • 100% Free: Open Community Source • Vastly simpler commercial pricing – Simple = One project metric – Fair = That metric scales with investment – Open = Predictable. No nasty surprises. Free Project IC: FACE Paid commercial license Scope: Project Free Project © 2013 Real-Time Innovations, Inc. Permission granted to distribute with this legend. Paid commercial license Scope: Project Free Project Paid commercial license Scope: Project 57 The Friction is Gone! © 2013 Real-Time Innovations, Inc. Permission granted to distribute with this legend. 58 IoT Protocol Soup App App • S2S: BI, storage, cloud, slow, 100ms • D2S: Telemetry, hub & spoke, 10ms • D2D: Control/dist, Databus, .01ms App MQ, AMQP Broker/ESB MQTT CoAP App App RS RS App DDS XMPP App App App Device Device Device Device App Device Device Device App App App Intelligent System Device © 2013 Real-Time Innovations, Inc. Permission granted to distribute with this legend. 59 About RTI • Market Leader – Over 70% DDS mw market share1 – Largest embedded middleware vendor2 – 2013 Gartner Cool Vendor for technology and Open Community Source model • Standards Leader – Active in 15 standards efforts – OMG Board of Directors – DDS authors, chair, wire spec, security, more • Real-Time Pedigree – Founded by Stanford researchers – High-performance control, tools history • Maturity Leader – ~700 designs; by far the most-used DDS – 500,000+ licensed copies – TRL 9 1Embedded Market 2VDC © 2013 Real-Time Innovations, Inc. Permission granted to distribute with this legend. Forecasters Analyst Report 60 Global Support and Distribution 2008 © 2013 Real-Time Innovations, Inc. Permission granted to distribute with this legend. 62 RTI Connext™: Edge to Enterprise Diverse Apps/Systems Data Centric Publish Subscribe High Reliability & Security Pub/Sub API (DDS subset) Pub/Sub API (Full DDS) Messaging API (DDS++ & JMS) Adapt, Xform,Route Connext Micro Connext DDS Connext Messaging Connext Integrator Small Devices RTI DataBus™ Administration Recording Persistence Monitoring Replay Logging Visualization Common Tools and Infrastructure Services © 2013 Real-Time Innovations, Inc. Permission granted to distribute with this legend. 63 One Protocol to Rule Them All? © 2013 Real-Time Innovations, Inc. Permission granted to distribute with this legend. 64 The IoT is HUGE & Varied 10ms–1s 10μs–10ms Timeliness of Response > 1s Web Services and Business Apps Server-to-Server (S2S) Control Plane Device to Server (D2S) Device-to-Device Devices and Intelligent Systems © 2013 Real-Time Innovations, Inc. Permission granted to distribute with this legend. 65 The Future is Soon The Future is Ours © 2013 Real-Time Innovations, Inc. Permission granted to distribute with this legend. 67 Find out more… www.rti.com dds.omg.org community.rti.com www.omg.org demo.rti.com www.youtube.com/realtimeinnovations blogs.rti.com www.twitter.com/RealTimeInnov www.facebook.com/RTIsoftware www.slideshare.net/GerardoPardo © 2012 RTI • ALL RIGHTS RESERVED 72