Hands-free Control of Standard
DICOM Imaging Software using
Leap Motion or Myo Controller.
Peter Stoll & José Morey
As Shown at RSNA 2014
Current Problems
Physicians often refer to patients’ medical images
before and during medical procedures.
Viewing the images requires manipulation –
scroll, zoom, window.
Sterility must be maintained during medical
procedures.
Long term use of traditional mouse and keyboard
leads to chronic pain in the neck, lower back and
wrist
As Shown at RSNA 2014
Status Quo
Keyboard and mouse manipulation of PACS
during procedures.
Multiple Disadvantages:
– Requires breaking sterility
– Time-consuming
– Risk of pathogen transmission
– Physician Frustration
As Shown at RSNA 2014
Status Quo
Options before our solution PACSpoint:
– Ask an assistant to manipulate PACS.
– Break sterility and manipulate PACS, requiring rescrub.
– Refer to images less often, or not at all – bad for
patient care!
As Shown at RSNA 2014
Our Solution
Software application
coupled with a
commercially available,
inexpensive small device,
enabling hands-free
manipulation of PACS.
As Shown at RSNA 2014
Leap Motion Controller
Device comprises three
infrared LEDs and two
stereo cameras which track
light outside the visible
spectrum.
Cameras track position and
motion.
As Shown at RSNA 2014
As Shown at RSNA 2014
Leap Motion Controller
Raw data transferred to PC or Mac via USB.
Advanced proprietary algorithms
reconstruct 3D information from the raw
data sent from the device.
As Shown at RSNA 2014
Leap Motion Controller
As Shown at RSNA 2014
Myo Controller
• Myo senses muscle movements in the arm to
recognize gestures such as making a fist or
waving left/right
• Myo also has sensors for velocity and
orientation data
• Myo is wireless and communicates with PC via
Bluetooth
As Shown at RSNA 2014
Our Software
Our patented technology allows the
manipulation of medical images in a touchless, intuitive manner that does not require a
break in physician sterility and helps prevent
contact infections.
As Shown at RSNA 2014
Features
Vendor neutral software for easy integration
into existing PACS stations.
Access to all PACS tools with an expanded
gesture recognition system.
Translates your natural hand motions for
image guidance.
Fully customizable for all users
As Shown at RSNA 2014
Benefits
Increases Scanner utilization due to faster
procedure time which leads to increased revenue
Reduces potential risk of patient infection
More ergonomic that using a traditional mouse
and keyboard- reducing eye strain, back/shoulder
pain and symptoms of carpal tunnel
ACO Q/I Applicable
ABR PQI Project
As Shown at RSNA 2014
Software Implementation
PACSpoint was written using the Python
programming language.
Libraries used:
– Leap API returns data from the device, such as
finger position and motion.
– Myo API returns data on muscle movements and
device velocity & orientation
– Keyboard and mouse manipulation package.
– Cross-platform GUI API.
As Shown at RSNA 2014
Fusion Prime
The Fusion Prime version of PACS Point uses
both the Myo and Leap at the same time
This allows users to have an even greater array
of customizable options and provides the best
of both the Myo and Leap Controller
As Shown at RSNA 2014
As Shown at RSNA 2014
Trial Data
Group 1 – Radiologist using PACSpoint to
access a series of images.
Group 2 – Radiologist instructing assistant to
access a series of images.
Time to desired image was reduced by >50%
with the use of PACSpoint technology.
Group
Cumulative Image Access Time
Group 1 – PACSpoint Group
61 seconds
Group 2 – Assistant Group
135 seconds
As Shown at RSNA 2014
Requirements
PACSpoint is vendor-neutral and will work
with all the major commercially PACS
solutions.
Windows® 7 or 8 or Mac® OS X 10.7
AMD Phenom™ II or Intel® Core™ i3, i5, i7
processor
2 GB RAM
USB 2.0 port
As Shown at RSNA 2014
As Shown at RSNA 2014
Cost
Controller
Leap
Myo
Fusion Prime
Cost
$5000.00
$7500.00
$15,000.00
License Duration
2 years
2 years
2 years
ABR Q/I Certification
Yes
Yes
Yes
ACO Q/I Applicable
Yes
Yes
Yes
Service Plan
Normal Plan
Normal Plan
Premium Plan
•
•
•
•
•
•
1 Hour Tutorial/
User
8-5 Tech Support
50 Service Hours
Software Updates
& Patches
PACS Vendor
Neutral
Upgrade Policy
Standard Rate
•
•
•
1 Hour Tutorial/
User
8-5 Tech Support
50 Service Hours
Software Updates
& Patches
•
•
Includes Normal
Plan
Custom Install
Additional Tutorial
Time
Neutral
Neutral
Standard Rate
Discount on Upgrades
As Shown at RSNA 2014
Tutorial and Learning Curve
•
•
•
Live Tutorial for all versions of PACS Point
Tutorial will be offered to all potential users
Learning Curve varies from person to person
and according to device
• Leap- 1 hour
• Myo- 30 mins
• Fusion- 1 hour
As Shown at RSNA 2014
Contact Information
– Tel 484.254.6579
– Email info@pacspoint.com
– Web http://www.pacspoint.com
As Shown at RSNA 2014