Ideation Process
Innovation Situation Questionnaire
1. Brief description of the problem
Proof of concept that visual recognition software can be used in real-time orthopedic surgery
in knee alignment
2. Information about the system
2.1 System name
Robust Computer Vision System
2.2 System structure
OpenCV and C++
2.3 Functioning of the system
Manipulate video frames for image analysis
2.4 System environment
Visual Studio and C++
3. Information about the problem situation
3.1 Problem that should be resolved
Inaccurate knee alignment systems
3.2 Mechanism causing the problem
Calibration of alignment device is based on surgeon skill
3.3 Undesired consequences of unresolved problem
Inaccurate alignment causing surgical complications
3.4 History of the problem
Orthopedic knee alignment surgery is largely dependent on surgeon feel and experience.
When mistakes are made, there are no ways to improve upon the mistake.
3.5 Other systems in which a similar problem exists
00Other areas of orthopedic surgery outside of knee alignment
3.6 Other problems to be solved
00Assist the surgeon in accurate calibration before the surgery begins
4. Ideal vision of solution
00Hope to create a visual program that will assist the surgeon before the first bone shaving
occurs so the patient does not need to lose excess bone
5. Available resources
00OpenCV library, bone model
6. Allowable changes to the system
00 Completely changing the software and camera system is theoretically possible. The
system is limited by surgeon cooperation
7. Criteria for selecting solution concepts
00Sucess criteria is measured by how the system works with the surgical process and if it
actually improves the alignment process
8. Company business environment
00Financial resources from the BME department, human resources are 2 Seniors in
engineering from Vanderbilt.
9. Project data
Project name: limb alignment system development
Project Abstract:
-
-
Proof of Concept that visual recognition software can be applied to the field of
limb alignment in real-time for surgical procedures
Improve the method of limb alignment used during surgical procedures because
the current method is costly, time consuming, accuracy is dependent on the
calibration - surgeon setting up the instrument.
Create a new method that is more efficient, can be used in real-time, more
economically profitable for hospitals.
Team
Professor Michael Miga:
Professor Miga is a member of the Biomedical Engineering department of
Vanderbilt University. He is well experienced with computer modeling and image
analysis.
Dave Martinez:
Mr. Martinez has a background is over 30 years in orthopedic product and process
development his education is in mechanical engineering .specializing in orthopedics. He
has experience in the mechanical nature of the different types of orthopedic replacements
used in surgeries that require limb alignments and is experienced in the use of two
methods of Computer Aided Navigation., infrared and electromagnetic technologies.
Currently, he is also the head -responsible for of marketing and sales and technical
support sales for Zimmer-Melia, a Zimmer franchised distributor for TN , KY and
WVA.. Dave brings so he has the necessary technical necessary knowledge to determine
if the product and method is to make a device, more marketable, more economically
favorable as compared to the current technology, and how to make the product appealing.
Hao Luo
Hao Luo is a student of electrical engineering at Vanderbilt University. He has
worked in a robotics lab specializing in visual recognition software. He is experienced
with object based programming and electrical devices.
Megan Luh
Megan Luh is a student of biomedical engineering at Vanderbilt University. She
has worked with edge detection software and object programming. She is familiar with
human physiology and interactions between materials and tissue.
Work Plan
Work Plan
November
Project Planning
Surgery observation
Familiarizing with software
Understanding camera system
Planning the best markers on the replacement part
December
Write the basic software for visual detection/recognition of some markers
January
Determine the best marker and programming to detect several
February
Integrate several cameras into the system and continue to update the program to
triangulate several camera's view
March
integrate markers onto a tibia replacement part and x-ray the image
April
Work from the x-ray image and trouble shoot the software
Should finish the proof of concept portion of the experiment
We hope to achieve a proof of concept for the tibia by the end of the project. This project
can be continued with improvements in the software/alignment calculation program and
if needed, better equipment. Eventually, the software needs to be tested on cadavers or
during surgery. The final goal is a finished product that is marketable.
Problem Formulation
01. Build the Diagram
00
2. Directions for Innovation
00
12/8/2009 9:42:15 PM Diagram1
1. Find an alternative way to obtain [the] (Input image from camera) that provides or enhances
[the] (Detect Edge).
2. Find an alternative way to obtain [the] (Detect Edge) that offers the following: provides or
enhances [the] (Detect calculatable contours), does not require [the] (Input image from
camera).
3. Find an alternative way to obtain [the] (Detect calculatable contours) that offers the
following: provides or enhances [the] (Alignment algorithm), does not require [the] (Detect
Edge).
4. Find an alternative way to obtain [the] (Alignment algorithm) that offers the following:
provides or enhances [the] (Output Results), does not require [the] (Detect calculatable
contours).
5. Find an alternative way to obtain [the] (Output Results) that does not require [the]
(Alignment algorithm).
6. Consider transitioning to the next generation of the system that will provide [the] (Output
Results) in a more effective way and/or will be free of existing problems.
12/8/2009 9:43:46 PM Diagram1
» 1. Find an alternative way to obtain [the] (Input image from camera) that provides or
enhances [the] (Detect Edge) and (color differentiation).
2. Find an alternative way to obtain [the] (Detect Edge) that offers the following: provides or
enhances [the] (Detect calculatable contours), does not require [the] (Input image from
camera).
3. Find an alternative way to obtain [the] (Detect calculatable contours) that offers the
following: provides or enhances [the] (Alignment algorithm), does not require [the] (Detect
Edge) and (color differentiation).
4. Find an alternative way to obtain [the] (Alignment algorithm) that offers the following:
provides or enhances [the] (Output Results), does not require [the] (Detect calculatable
contours).
5. Find an alternative way to obtain [the] (Output Results) that does not require [the]
(Alignment algorithm).
6. Consider transitioning to the next generation of the system that will provide [the] (Output
Results) in a more effective way and/or will be free of existing problems.
7. Find an alternative way to obtain [the] (color differentiation) that offers the following:
provides or enhances [the] (Detect calculatable contours), does not require [the] (Input image
from camera).
12/8/2009 9:45:09 PM Diagram1
1. Find an alternative way to obtain [the] (Input image from camera) that provides or enhances
[the] (Detect Edge) and (color differentiation).
2. Find an alternative way to obtain [the] (Detect Edge) that offers the following: provides or
enhances [the] (Detect calculatable contours), does not require [the] (Input image from camera)
and (x-ray image).
3. Find an alternative way to obtain [the] (Detect calculatable contours) that offers the
following: provides or enhances [the] (Alignment algorithm), does not require [the] (Detect
Edge) and (color differentiation).
4. Find an alternative way to obtain [the] (Alignment algorithm) that offers the following:
provides or enhances [the] (Output Results), does not require [the] (Detect calculatable
contours).
5. Find an alternative way to obtain [the] (Output Results) that does not require [the]
(Alignment algorithm).
6. Consider transitioning to the next generation of the system that will provide [the] (Output
Results) in a more effective way and/or will be free of existing problems.
7. Find an alternative way to obtain [the] (color differentiation) that offers the following:
provides or enhances [the] (Detect calculatable contours), does not require [the] (Input image
from camera) and (x-ray image).
8. Find an alternative way to obtain [the] (x-ray image) that provides or enhances [the] (Detect
Edge) and (color differentiation).
12/8/2009 9:45:26 PM Diagram1
»» 1. Find an alternative way to obtain [the] (Input image from camera) that offers the following:
provides or enhances [the] (Detect Edge) and (color differentiation), does not require [the] (xray image).
2. Find an alternative way to obtain [the] (Detect Edge) that offers the following: provides or
enhances [the] (Detect calculatable contours), does not require [the] (Input image from camera)
and (x-ray image).
3. Find an alternative way to obtain [the] (Detect calculatable contours) that offers the
following: provides or enhances [the] (Alignment algorithm), does not require [the] (Detect
Edge) and (color differentiation).
4. Find an alternative way to obtain [the] (Alignment algorithm) that offers the following:
provides or enhances [the] (Output Results), does not require [the] (Detect calculatable
contours).
5. Find an alternative way to obtain [the] (Output Results) that does not require [the]
(Alignment algorithm).
6. Consider transitioning to the next generation of the system that will provide [the] (Output
Results) in a more effective way and/or will be free of existing problems.
7. Find an alternative way to obtain [the] (color differentiation) that offers the following:
provides or enhances [the] (Detect calculatable contours), does not require [the] (Input image
from camera) and (x-ray image).
8. Find an alternative way to obtain [the] (x-ray image) that provides or enhances [the] (Detect
Edge), (color differentiation) and (Input image from camera).
12/8/2009 9:46:09 PM Diagram1
1. Find an alternative way to obtain [the] (Input image from camera) that offers the following:
provides or enhances [the] (Detect Edge) and (color differentiation), does not require [the] (xray image).
2. Find an alternative way to obtain [the] (Detect Edge) that offers the following: provides or
enhances [the] (Detect calculatable contours), does not require [the] (Input image from camera)
and (x-ray image).
3. Find an alternative way to obtain [the] (Detect calculatable contours) that offers the
following: provides or enhances [the] (Alignment algorithm), does not require [the] (Detect
Edge) and (color differentiation).
4. Find an alternative way to obtain [the] (Alignment algorithm) that offers the following:
provides or enhances [the] (Output Results), does not require [the] (Detect calculatable
contours).
5. Find an alternative way to obtain [the] (Output Results) that does not require [the]
(Alignment algorithm).
6. Consider transitioning to the next generation of the system that will provide [the] (Output
Results) in a more effective way and/or will be free of existing problems.
7. Find an alternative way to obtain [the] (color differentiation) that offers the following:
provides or enhances [the] (Detect calculatable contours), does not require [the] (Input image
from camera) and (x-ray image).
8. Find an alternative way to obtain [the] (x-ray image) that provides or enhances [the] (Detect
Edge), (color differentiation) and (Input image from camera).
Prioritize Directions
01. Directions selected for further consideration
00 1. Find an alternative way to obtain [the] (Input image from camera) that provides or
enhances [the] (Detect Edge) and (color differentiation).
1.1. Improve the useful factor (Input image from camera).
higher resolution camera
1.2. Obtain the useful result without the use of [the] (Input image from camera).
N/A
1.3. Increase effectiveness of the useful action of [the] (Input image from camera).
N/A
1.4. Synthesize the new system to provide [the] (Input image from camera).
N/A
1.5. Apply universal Operators to provide the useful factor (Input image from camera).
N/A
1.6. Consider resources to provide the useful factor (Input image from camera).
N/A
1. Find an alternative way to obtain [the] (Input image from camera) that offers the following:
provides or enhances [the] (Detect Edge) and (color differentiation), does not require [the] (xray image).
1.1. Improve the useful factor (Input image from camera).
N/A
1.2. Obtain the useful result without the use of [the] (Input image from camera).
N/A
1.3. Increase effectiveness of the useful action of [the] (Input image from camera).
N/A
1.4. Synthesize the new system to provide [the] (Input image from camera).
N/A
1.5. Apply universal Operators to provide the useful factor (Input image from camera).
N/A
1.6. Consider resources to provide the useful factor (Input image from camera).
N/A
1. Find an alternative way to obtain [the] (Input image from camera) that offers the following:
provides or enhances [the] (Detect Edge) and (color differentiation), does not require [the] (xray image).
1.1. Improve the useful factor (Input image from camera).
N/A
1.2. Obtain the useful result without the use of [the] (Input image from camera).
N/A
1.3. Increase effectiveness of the useful action of [the] (Input image from camera).
N/A
1.4. Synthesize the new system to provide [the] (Input image from camera).
N/A
1.5. Apply universal Operators to provide the useful factor (Input image from camera).
N/A
1.6. Consider resources to provide the useful factor (Input image from camera).
N/A
2. List and categorize all preliminary ideas
We hope to achieve a proof of concept for visual recognition.
Using OpenCV to program a web camera to detect contour edges on a white sheet of
paper
Triangulate 2 camera input frames with openCV
Integrate x-ray images
Develop Concepts
01. Combine ideas into Concepts
00concepts are already combined
2. Apply Lines of Evolution to further improve Concepts
00This does not really apply since nothing can be compiled together