3/29/10
Markerless Motion Capture
Computer Vision Systems
BioStage
TM for the Life Sciences
October 2010
Draft Version
Page 1

Markerless Motion Capture
Camera-based Sensor-based
Video
Camera
Infra-red
Camera
Goniometer
– 1D, 2D
Inertial
Sensors
Marker-less
Systems
BioStage
Marker-based
Systems
PEAK
SIMI
Marker-based
Systems
Aktiv-Marker
Passiv-Marker
3/29/10
Electromagn.
Sensors – 3D
Xsens MVN
Animazoo IGS-190
Polhemus
Vicon
MAC
Qualisys
Optitrack motion sensors
(accelerometers) and rotation sensors
(gyroscopes) to calculate the position, orientation, and velocity
Page 2

3/29/10
Markerless Motion Capture
Anthropometry
Kinematics
 “Body”  “Motion”
BioStage
Kinetics
 “Forces”
Electromyography
 “Neuromusc.
Control”
Body-
- Dimensions
-Structure
- Proportion
Position,
Angle, Velocity, etc.
Forces,
Moments,
Pressure
Distribution
Muscleactionpotiential
Kinesiological Analysis
Data integration & Correlation
Page 3

3/29/10
Markerless Motion Capture
Planes of Motion
Page 4

Markerless Motion Capture
Joint Actions – i.e. hip
3/29/10 http://www.brianmac.co.uk/musrom.htm
http://www.physicalsolutions.co.uk/articles/Understanding%20Planes%20and%20Axes%20of%20Movement.
pdf
Page 5

3/29/10
Markerless Motion Capture
BioStage - Research

Biomechanics

Kinesiology

Exercise Science

Physical Therapy

Physical Medicine & Rehabilitation

Human Movement Science

Health, Physical Education, and Recreation

Biomedical Engineering
Page 6

3/29/10
Markerless Motion Capture
BioStage – Clinical Applications









Orthopaedics
Cerebral Palsy
Neuroscience
Physical and Occupational Therapy
Rehabilitation
Podiatry
Chiropractic
Posturology
Sports Medicine
Page 7

3/29/10
Markerless Motion Capture
BioStage – Sports Applications

Golf

Baseball Pitching and Throwing

Fitness

Biking

Tennis

Soccer
 et altri
Page 8

Markerless Motion Capture
3/29/10
Applications and Benefits for
Clinical Apps and the Academics
Page 9

3/29/10
Markerless Motion Capture
BioStage – Specific Clinical Use

Pre-and post surgery evaluations

Rehabilitative Treatment

Lower extremities - Gait Analysis

Upper body Analysis

Orthopaedic Joint Replacements

Posture Analysis

Orthotics and Prosthesis Development
Page 10

3/29/10
Markerless Motion Capture
Clinical Motion Analysis to…
 develop predictive models of pathology
 diagnose/quantify functional limitations
 identify multi-level motion problems
 document functional status
 support Healthcare Research
Page 11

Markerless Motion Capture
Motion Analysis – General Benefits











Surgeon  optimize their techniques
Surgeon  design an optimal surgical plan
Surgeon  determine if and when surgery is necessary
Implant designer  improve devices
Coach  better quantify improvement / loss of performance during training
Patient  better educated by seeing changes
Athlete  better quantify improvement by comparing with other athletes
Club owner  find out if athlete is prone for injury
PT/Rehab doctor  better quantify improvement during therapy
Health care system  long-term improvement in cost and quality of treatment
Student  Easier access to motion capture technology
Page 12 3/29/10

3/29/10
Markerless Motion Capture
Benefits for Clinical Apps
• Reduced patient preparation time
• Easier on patients with impairments
• Easier for nurses to work with patients
• More natural movement leads to higher data quality
• Immediate results and reports available to doctor and patient for review
• True and valid data comparison over repeated trials
• Reduced cost for motion analysis for the patient and the doctor
• Fun 3D immersive visuals encourage patients to exercise more often
• Improved exercise experience, patients are more actively engaged in recovery regime
Page 13

3/29/10
Markerless Motion Capture
Benefits for the Academics
• Markerless system allows all students to get hands-on experience with computerized motion analysis
• Streamlined real-time capture process for fixed class times and research timelines
• User-friendly interfaces ideal for multi-discipline and interdepartmental use
• A state-of-the-art-solution to attract students, businesses, and professionals to the University
Page 14

3/29/10
Markerless Motion Capture
Challenges

Tracking children

Tracking subjects with impairments (cannot stand or walk straight, arms close to the torso, etc.)

Tracking of amputees

Tracking of subject in wheel chairs, using walker, cane, crutches or other equipment

Tracking internal / external rotation

What validation have you done?

What is the accuracy of the data?

Do you have any publications?
Page 15

3/29/10
Markerless Motion Capture
Integration Software & Hardware
Page 16

3/29/10
Markerless Motion Capture
Integrated Motion Analysis
Kinematics
OM
Motion
Tracking
Video
TMM
Motion
Analysis
Software
Force Plates
Forces and
Moments
Kinetic
EMG
Muscle
Activity
Page 17

3/29/10
Markerless Motion Capture
Integration The MotionMonitor
Kinetics
Real Time Animation Kinematics EMG
Page 18

3/29/10
Markerless Motion Capture
Integration Force Plates

Measurement of floor reaction forces in 3 dimensions
Page 19

3/29/10
Markerless Motion Capture
Integration EMG

Wireless EMG electrodes
Page 20

3/29/10
Markerless Motion Capture
Validation and Accuracy
Page 21

Markerless Motion Capture
BioStage Model
BioStage Model
Tracking of 21 Segments
Segment length directly measured or derived from separate measurements
Static and dynamic
(functional) user calibration
Length ratios based on
Drillis and Contini (1966)
3/29/10 Page 22

3/29/10
Markerless Motion Capture
Joint Degree of Freedom
BioStage Model
Head/Neck: 3DoF
Neck/Upper Chest: 1DoF
Upper Chest/Mid Torso: 3DoF
Mid / Lower Torso:
Hip Joint:
3DoF
3DoF
Knee Joint:
Ankle Joint:
3DoF
1DoF
Shoulder Joint:
Elbow Joint:
Wrist:
3DoF
1DoF
Locked to lower arm
Page 23

3/29/10
Markerless Motion Capture
Validation study in Cologne





Evaluation and Acurracy tests
Comparison with Vicon system
Jan 2010 – Jun 2010
Goal: Proof translational accuracy of 5mm and rotational accuracy of 3deg
Problem: Reference marker-less with marker-based
Institut für
Biomechanik und Orthopädie
German Sports Science University in Cologne
Prof. G.P. Brueggemann
Kai Oberländer
Page 24

3/29/10
Markerless Motion Capture


Show accuracy
Validate vs existing systems
 provide a fitting system that ensures precise, repeatable, consistent length measurements of human bones/segments.
 deliver anthropometric measurements through a defined protocol in a totally "non-invasive" method in real-time.


 evaluate BioStage, its performance, and to assess its accuracy, reliability and suitability for use in research, sports and clinical settings.
perform an assessment of errors that affect temporal, kinematic, and kinetic variables when estimated by means of the proposed markerless system compared to the existing markerbased motion capture systems using reflective markers currently used in motion analysis.
validate BioStage for biomechanical research, sports and clinical use
Page 25

Markerless Motion Capture
Validation and Accuracy Overview
3/29/10
26
Page 26

Markerless Motion Capture
Validation and Accuracy Overview
3/29/10
27
Page 27

Markerless Motion Capture
Validation and Accuracy Overview
3/29/10
28
Page 28

Markerless Motion Capture
•
•
•
2D Video Analysis / Full Range of Motion
Gait
Squatting
Pendulum motion
3/29/10
29
Page 29

Markerless Motion Capture
Validation and Accuracy Overview
3/29/10
30
Page 30

Markerless Motion Capture
Validation and Accuracy Overview
3/29/10
31
Page 31

Markerless Motion Capture
Validation and Accuracy Overview
3/29/10
32
Page 32

Markerless Motion Capture
Validation and Accuracy Overview
3/29/10
33
Page 33

Markerless Motion Capture
Validation and Accuracy Overview
3/29/10
34
Page 34

Markerless Motion Capture
Validation and Accuracy Overview
3/29/10
35
Page 35

Markerless Motion Capture
Validation and Accuracy Overview
3/29/10
36
Page 36

Markerless Motion Capture
Validation and Accuracy Overview
3/29/10
37
Page 37

3/29/10
Markerless Motion Capture
Tradeshows
Page 38

Markerless Motion Capture
3/29/10

CSM (Combined Section Meeting)

ACSM (American College of Sports Med)

APTA (American PT Association)

ASB (American Society of Biomechanics)

ISBS (Internat. Society of Biom.in Sports)

GCMAS (Gait and Clinical MovAnal Society)

AACPDM (American Academy for Cerebral
Palsy and Developmental Medicine )
Page 39