MURI Project Proposal Form
Date of submission: April 21, 2014
Proposed project title: Development of a virtual reality based psychophysical
assessment method to capture the perceived arm position
of the amputee phantom limb
Principal Mentor
Name: Christian Rogers
Phone number: 317-274-4144
Department: Computer Information &
Graphics Technology
Co-mentor
Name: Ken Yoshida
Phone number: 317-274-9714
Department: Biomedical Engineering
Co-mentor
Name: Dan Baldwin
Phone number: 317-274-0017
Department: Computer Information &
Graphics Technology
Co-mentor
Name: Benjamin Smith
Phone number: 317-278
Department: Music & Arts Technology
Title: Assistant Professor
Email: rogerscb@iupui.edu
School: Engineering & Technology
Title: Associate Professor
Email: yoshidak@iupui.edu
School: Engineering & Technology
Title: Clinical Assistant Professor &
Program Director
Email: danbaldw@iupui.edu
School: Engineering & Technology
Title: Assistant Professor
Email: bds6@iupui.edu
School: Engineering & Technology
Please note that preference will be given to projects that include mentors from multiple disciplines.
1
MURI Proposal Form updated 10_7_13
Total number of students requested: __6____________
(Note: The total number of students must exceed by two the number of mentors)
Total Number of freshmen and/or sophomores to be recruited: _0_________________
(Note: Preference will be given to projects that include at least one freshman and/or sophomore)
Disciplines or majors of students (preference will be given to projects that include at least two disciplines
or majors): _Computer Graphics Technology, Computer Information Technology, Kinesiology___
Skills expected from students: (2) 3D Modeling and Rendering, (1) Programming Experience in C Sharp,
Names of students you request to work on this project.
(Mentors are invited to recommend students that they would prefer to work on the proposed project.
Please provide an email address and a rationale; for example, a student may have an essential skill, may
already be working on a similar project, or may be intending to apply to graduate school to pursue the
same area of research.)
The Center for Research and Learning will consider the students requested below, but cannot guarantee
placement of specific students on teams.
Name of Student:
Student’s Email:
1)_________________
______________
________________________
2)_________________
______________
________________________
3)_________________
______________
________________________
4)_________________
______________
________________________
5)_________________
______________
________________________
6)_________________
______________
________________________
2
MURI Proposal Form updated 10_7_13
Rationale:
Overview and Objectives
Amputation of a limb is a procedure of last resort where the loss of the limb is required for the survival or
to preserve the long term quality of life of the patient. The amputation traumatically alters the body image,
but often leaves sensations that refer to the missing body part [1]. The amputee has a ghostly sensation
of the presence of and sensations emanating from the missing limb. This sensation, called the phantom
sensation, is present in nearly all amputees [2] and curiously as well as from those who were congenitally
born without limbs [3]. Although many phantom sensations are typically non-painful, between 50-80%
amputees develop neuropathic pain that refer to the phantom, also called phantom limb pain (PLP). Both
peripheral and central nervous system factors have been implicated as determinants of PLP and phantom
limb sensation [4]. Also, PLP may be triggered by physical (changes in the weather) and psychological
factors (emotional stress). Recent evidence suggests that PLP may be intricately related to neuroplastic
changes in the cortex, and that providing sensory input to the stump or amputation zone may modulate
these changes. However, the understanding of why PLP occurs is still poor, the basic research results
have not been tested on a large scale in the clinic, and there are no fully effective, long-term treatments
readily available on the market.
A project sponsored by the European Union, EPIONE, aims to challenge the status-quo of PLP therapy
by offering technological solutions that will invasively or non-invasively induce natural, meaningful
sensations to the amputee to restore the neuroplastic changes in the cortex and thereby control and
alleviate PLP. Dr Yoshida and IUPUI is part of the EPIONE multi-center trial that will assess the effect of
cortical neuroplastic, psychological and
cognitive components of pain and
integrate the knowledge into clinical
guidelines. As part of the assessment to
assess the daily change in PLP
sensations, a battery of psychophysical
tests consisting of a set of standard clinical
questionnaires [5]–[8] will be given to the
amputee subject. These tests focus strictly
on measuring the subject's sensation of
pain. However, this research presents
itself as an opportunity to also
longitudinally measure and track the nonpainful phantom sensations, such as the
proprioceptive sensations referred to the
positions of the phantom hand and wrist.
The phantom limb itself presents
sensations of the limb that is perceived by
the subject ranging from as it was before
amputation, to deformed with missing or
extended parts, with/without normal joint
positions, retracted or extended from its
Figure 1: Illustration of the variety of phantom sensations that
normal position, etc. [1]
have been reported. Limbs may be as it was before amputation
(a), diminished in size (c,d), or in impossible positions for the
normal limb (e,g,h). From [9]
3
MURI Proposal Form updated 10_7_13
These sensations can place the body part in a normal configuration, to one that is impossible to attain
with a normal limb.
Part of the challenge in capturing these descriptions from the amputee is the difficulty of describing the
sensations themselves. As a result, quantitative descriptions, let alone data tracking the daily changes in
the phantom sensations, are nearly impossible to find in the literature. Moreover, upper limb amputees,
the focus of the EPIONE study, would only have the use of their remaining limb to describe, their
sensations on their missing limb.
The application of computer graphics, virtual reality and computerized image capture technologies may
reduce this challenge and facilitate the quantification of the phantom limb position.
Specific Aim: Develop and validate a computerized virtual representation of a hand that could be easily
manipulated by the end user to quickly and accurately capture the position and salient features of the
phantom limb sensation.
Approach
The project aims to develop the software in the following three steps: 1) Develop various models of hand
positions in preparation for integration with the user interface. 2) Develop an interface for amputees to
mimic the phantom sensation. 3) Conduct pilot testing on the user interface testing for overall usability
and design and also for the level of functionality and ability to mimic the phantom sensation with ablebodied volunteers.
Application development
In order to fully evaluate the overall effectiveness of 3D virtualization and the ability to mimic phantom
sensations, a pilot study will be conducted.
We envision a research study where Computer Graphics Technology, Computer Information Technology
and Biomedical Engineering students will work together to build an effective 3D visualization tool for
aiding those with phantom limb syndrome to communicate phantom sensations accurately and easily.
In order to conduct the pilot study, 3D models will be developed with Maya 3D software. The user
interface and application core will be developed utilizing the Unity 3D development environment. Two of
the undergraduate students will participate in the creation of the user interface. One student will be
responsible for the 3D modeling of the hand and its facets and both will work together to integrate the
models within Unity 3D.
To test the effectiveness of the 3D virtualization tool, the biomedical engineering students will perform a
limited scale pilot study with able-bodied volunteers. The non-dominant limb of the volunteers will be
hidden behind a blind, outside of the visual field of the volunteer. They will be asked to put their limb in a
random position while they attempt to capture the finger, wrist, hand and forearm position on the 3D
model. The actual position and captured position will be compared to determine the reproducibility and
accuracy of the virtualized 3D model.
4
MURI Proposal Form updated 10_7_13
A Gantt chart of the proposed project follows:
Sep
Oct
Nov
Dec
Jan
Feb
Mar
April
3D
Development
Unity
Integration
Pilot Testing
Data
Collection
Analysis
Development, validation and deployment of the proprioceptive sensation capturing software will enable
the amputee to easily log the perceived sensation of his/her phantom limb into the computer. The
technique and data will be used as part of a study to assess methods to affect the phantom sensation
using daily surface electrical stimulation. The pilot data from these assessments will be used as
preliminary data to accompany a future grant proposal to the National Institutes of Health. The method
constitutes a novel method to capture and track the sensory perception of limbs and would be of interest
to other researchers and clinicians who are interested in tracking sensory perception of limbs following
therapy. Upon successful completion of the project, we will approach IURTC to attempt translation of the
software.
Team composition and tasks
Due to the highly the interdisciplinary nature of the project a highly interdisciplinary team will be formed.
The project team will be composed of mentors and students from the Computer Graphics Technology,
Music and Arts Technology, and Biomedical Engineering departments. The principal mentor of the project
will be Dr. Christian Rogers (CGT).
Biomedical Engineering Mentor – Dr. Yoshida
In addition to regular meetings with the entire project team to discuss project status and any issues, the
biomedical engineering mentor will help the students sort through the relevant literature related to
phantom limb syndrome and the communication methods for describing the sensations experienced by
those with amputees. The biomedical engineering mentor will also assist the students in the development
of the IRB submission forms, train the students to record and interpret the data, and write any data
processing programs necessary for analysis.
Biomedical Engineering Students
The biomedical engineering students will be responsible for performing literature reviews and
summarizing known research as it relates to phantom limb syndrome and its effects on the amputee. The
students will also be responsible for drafting IRB forms, recruiting subjects for tests. These students will
analyze and interpret data from the pilot study and report findings.
5
MURI Proposal Form updated 10_7_13
Animation Mentor – Dr. Rogers & Mr. Baldwin
In addition to regular meetings with the entire project team the animation mentor will coach the animation
students (CGT) through designing the various models of hands and arms to specifications that will be
used in the pilot study. The animation mentor will work closely with the biomedical engineering mentor to
provide accurate modeling as to what those with phantom limb syndrome perceive. The animation mentor
will train students to work effectively in a production team, maintain good design practices and teamwork,
and appropriately interface with the rest of the team.
Programming Mentor – Dr. Smith
The programming mentor will guide the programming students on the functionality of the user interface
and interaction design, guiding students on using and developing in Unity, creating targeted interaction
schemes, and integrating 3D models. Additionally, the programming mentor will guide the students on
good code management and production practices, and functioning as an integral member of a production
team.
Animation and Programming Students
These students will be responsible for the design and development of the 3D models and user interface
that will be utilized in the pilot study. They will work closely with their mentors and the Biomedical
Engineering mentor and students to incorporate the feedback from the participant studies and tailor the
environments appropriately.
Participants in the research will have the benefit of working in a multidisciplinary environment with
expertise in the fields of animation, interface design, biomedical engineering and backend software
construction. Students will be able to broaden their skills by working in this environment, gain an overall
knowledge of the research process as well as how research is applied to real-world situations that can
benefit those with phantom limb syndrome. On a larger scope, the project aims to leverage expertise in
very different disciplines to integrate the expertise and tools of animation and computer graphics
techniques to develop an application that addresses an important research need. It aims to build working
teams to harness the very different expertise and talents of engineering technology and engineering
students and faculty towards an emerging field that involves the application of virtual reality to medical
rehabilitation therapies.
MURI Project Management
To facilitate communication between the co-mentors and the undergraduate researchers, an Oncourse
project site will be requested and used as the project information repository and primary communication
tool. The Forum tool will be used as the official communication pathway and communication archive in the
project. All participants will be required to enable forum notifications and watch for all threads and
postings. The undergraduate researchers will be requested to assign 3 officers amongst themselves: a
general project leader to coordinate management of the research activities, a project accounts manager
to administer the research budget and purchases, and communications officer to act as the single point of
contact for external communications. Biweekly meetings with the co-mentors will take place on Mondays
and Fridays during the project period. Monday meetings will be used to plan activities for the week, while
Friday meetings will be used to report upon progress during the week.
The project is designed to develop and reinforce team group work in research. The participation in both
6
MURI Proposal Form updated 10_7_13
parts of research, management and technical, will be imposed upon the group. The technical skills of 3D
modeling, user interface design, and Unity programming will be reinforced and developed. These
activities will aim to produce as deliverables a project report consisting of the technical and management
activities in the project, and participation in the Undergraduate Research Day with a poster presentation
of the project. We will aim to publish the results of the research activities, initially as a conference paper
at either the IEEE-EMBS or BMES meeting. As with the previous MURI project, it is anticipated that the
preliminary work developed by the MURI team will become the seed of a Masters or PhD thesis project.
We also hope to identify potential future candidates to take graduate research positions for future projects
within the lab.
Budget
The project will use a 3D model of the upper limb and a user interface to accurately render and capture
the perceived arm position of the amputee phantom limb. If successful, the component to capture the
proprioceptive sensations emanating from the phantom limb will be included in the EPIONE multi-center
trial. However, since the scope of this project is outside the specific aims and outside the funding budget
items of the EPIONE project, direct funding from the project would be limited.
The following items are required for its successful completion.
MS Kinect (2)
LabView
Unity License (2)
Miscellaneous
Total:
$320.00
$1238.00
$298.00
$70.00
$1926.00
The Kinect is a way to measure the actual position of the subject’s arm, which we will use to compare
with the perceived position. Two are specified because we would like to have higher resolution on the
hand and general position of the lower arm, elbow and write. We will also have the ability to use it as a
bootstrap for the position of the amputee’s hand.
The purchase for Labview would allow a direction connection with MS Kinect via an adaptor.
The Unity License must be purchased for the implementation of the 3D models into an interactive
environment and for allowance to work with the MS Kinect.
Risk management
This project will involve development of a computer aided psychophysical test paradigm that captures the
perceived position of a subject's arm. As part of the validation process, able-bodied subjects will be asked
to use the developed software to measure the accuracy of the method. Furthermore, once implemented
and validated, the software will be used as part of a battery of clinical assessments in the EPIONE
project. In both cases, IRB approval will be sought to enable pilot research to be conducted on the
volunteers as part of the EPIONE protocol to be submitted to the IRB in the time frame of May – June
th
2014. We anticipate having an approved protocol no later than the 4 quarter of 2014 to enable the
st
limited pilot study with able bodied volunteer to take place in the 1 quarter of 2015.
7
MURI Proposal Form updated 10_7_13
Dan Baldwin, M.F.A.
CURRICULUM VITAE
NAME
Baldwin, Dan L.
EDUCATION
Undergraduate:
Graduate:
Continuing Education:
Bachelor of Fine Arts (B.F.A.), Painting
Indiana University, Bloomington, Indiana
(1996)
Master of Fine Arts (M.F.A.), Illustration
Savannah College of Art and Design, Savannah, Georgia
(2000)
Certificate, The Art of Caricature with Jason Seiler
Schoolism: Education Evolved, Imaginism Studios Inc.
(2011)
ACADEMIC APPOINTMENTS
Associate Chair
Director
Assistant Clinical Professor
Interim Director
Assistant Professor
Department of Computer Information and Graphics Technology
Purdue School of Engineering and Technology
Indiana University-Purdue University Indianapolis
(August 2012-Present)
Computer Graphics Technology
Purdue School of Engineering and Technology
Indiana University-Purdue University Indianapolis
Department of Computer Information and Graphics Technology
(August 2012-Present)
Computer Graphics Technology
Purdue School of Engineering and Technology
Indiana University-Purdue University Indianapolis
Department of Computer Information and Graphics Technology
(August 2012-Present)
Computer Graphics Technology
Purdue School of Engineering and Technology
Indiana University-Purdue University Indianapolis
Department of Computer Information and Graphics Technology
(August 2011-August 2012)
Computer Graphics Technology
Purdue School of Engineering and Technology
Indiana University-Purdue University Indianapolis
Department of Design and Communication Technology
(July 2007-August 2012)
Department of Mechanical Engineering Technology
(August 2005-July 2007)
New Media
Indiana University School of Informatics
Indiana University-Purdue University Indianapolis
(August 2001-July 2005)
1
Dan Baldwin, M.F.A.
CURRICULUM VITAE
Adjunct Assistant Professor
Media Arts and Science
Indiana University School of Informatics
Indiana University-Purdue University Indianapolis
(August 2005-Present)
Adjunct Faculty
New Media
Indiana University School of Informatics
Indiana University-Purdue University Indianapolis
(January 2001-July 2001)
Graduate Teaching Assistant Illustration
School of Communication Arts
Savannah College of Art and Design
(September 1999-June 2000)
OTHER APPOINTMENTS AND PROFESSIONAL CONSULTANTSHIPS
Freelance Illustrator
Dan Baldwin Illustration
(1996-Present)
PROFESSIONAL ORGANIZATIONS
•
•
•
•
•
Member: American Society for Engineering Education (ASEE)
Member: Association for Computing Machinery's Special Interest Group on Graphics and
Interactive Techniques (ACM SIGGRAPH)
Member: MG (Motion Graphics) Collective
Member: Indianapolis Flash Users Group
Member: The World Association for Case Method Research & Application
HONORS AND AWARDS
•
•
•
•
•
•
•
•
•
•
•
Member: Faculty Colloquium on Excellence in Teaching (FACET) (2010-Present).
Best Film Runner-Up (industry category) for the short animated film Emo-tional Identity,
Indiana Motion Graphics Collective, 2011.
Official Film Entry Emo-tional Identity ORANJE Film Lounge, 2011.
Outstanding Teacher Award, Purdue School of Engineering and Technology, 2010 ($1000).
IUPUI Organizational Campus Achievement Award, IUPUI ACM SIGGRAPH Student
Chapter (Faculty Advisor), 2008.
IUPUI Favorite Professor Award, presented by IUPUI student Athlete, 2008.
IUPUI Organizational Campus Achievement Award, IUPUI ACM SIGGRAPH Student
Chapter (Faculty Advisor), 2007.
IUPUI Favorite Professor Award, presented by IUPUI student Athlete, 2005.
Honorable Kentucky Colonel, bestowed by Paul E. Patton, Governor of Kentucky, 2003.
Trustees Teaching Award, Indiana University School of Informatics, 2003 ($2500).
Bronze Medal Society of Illustrators Los Angeles, 38th Annual Illustration West, 2000.
2
Biographical Sketch
Benjamin D. Smith, D.M.A.
(a) Professional Preparation
Post-doctoral Fellow, National Center for Supercomputing Applications
D.M.A. in Composition
M.M. in Composition
B.M. in Composition
University of Illinois
University of Illinois
University of Illinois
Ithaca College
2012
2011
2007
2002
(b) Appointments
• 2013-present, Assistant Professor, Music and Arts Technology, Computer Information and Graphics
Technology, Indiana University - Purdue University Indianapolis (IUPUI), IN
• 2012-2013, Lead Technical Engineer, Information Technology Services, Case Western Reserve University
(CWRU), Cleveland, OH
• 2012-2013, Adjunct Assistant Professor, Computer Science, Case Western Reserve University, Cleveland, OH.
• 2012-2013, Artist in Residence, Cleveland Institute of Art (CIA), OH.
• 2005-2011, Research Assistant, Computer Science, University of Illinois at Urbana-Champaign
(c) Related Publications and Patents Pending
1.
Smith, Benjamin D. “Tracking Creative Musical Structure: the Hunt for the Intrinsically Motivated
Generative Agent.” Workshop on Musical Metacreation (MUME) at the Ninth AAI Conference on
Artificial Intelligence and Interactive Digital Entertainment (AIIDE'13). Stanford, CA: AAAI 2013.
2.
Smith, Benjamin D. and Guy E. Garnett. “Improvising Musical Structure with Hierarchical Neural Nets.”
Workshop on Musical Metacreation (MUME) at the Eighth AAAI Conference on Artificial Intelligence
and Interactive Digital Entertainment (AIIDE'12). Stanford, CA: AAAI, 2012.
3.
Smith, Benjamin D. and Guy E. Garnett. “Advancing Expert Computer-Human Interaction with Music.”
ICMC 2012. Slovenia: ICMA, 2012.
4.
Smith, Benjamin D. and Guy E. Garnett. “Unsupervised Play: Machine Learning Toolkit for Max.” New
Interfaces for Musical Expression (NIME) 2012. Ann Arbor, MI: ICMA, 2012.
5.
Smith, Benjamin D. and Guy E. Garnett. “Reinforcement Learning and the Creative, Automated Music
Composition.” evoMUSART 2012. Malaga, Spain: Springer, 2012.
6.
Smith, Benjamin D. and Guy E. Garnett. “The Education of the AI Composer: Automating Musical
Creativity.” Paper presented to the Music, Mind and Invention Workshop, The College of New Jersey,
Ewing, NJ, March 29-31, 2012.
7.
Smith, Benjamin D. and Guy E. Garnett. “Machine Listening: Acoustic Interface with ART.” 2012 ACM
International Conference on Intelligent User Interfaces. Lisbon, Portugal: ACM, 2012
8.
Smith, Benjamin D. and Guy E. Garnett. “Machine Listening: ART and the Intelligent Acoustic Interface.”
Paper presented to the 2nd University of Illinois Postdoctoral Research Symposium, Urbana, Illinois,
January, 2012.
9.
Smith, Benjamin D. and Guy E. Garnett. “Interactive High-Performance Computing for Music.” ICMC
2011. Huddersfield, UK: ICMA, 2011.
10.
Smith, Benjamin D. and Guy E. Garnett. “The Self-Supervising Machine.” NIME 2011. Oslo, Norway:
May, 2011.
(d) Synergistic Activities
N/A
(e) Collaborators & Other Affiliations
Dr. Guy E. Garnett
Lev Gonick
Dr. Marvin Schwartz
Mary Pietrowicz
Dr. Robert McGrath
Dr. Matthew Thibeault
Nicholas Jaworski
Dr. Scott Deal
(f) Teaching Activities.
• Sound Design for Visual Media – Spring 2014 – Senior level 3-credit elective for Computer Graphics
Technology students at IUPUI.
• Music Technology III – Fall 2013 – Final course in core sequence for BS students in Music Technology.
• Computer Game Design and Development – Spring 2012 – Introduction to game design and programming for
Computer Science students at CWRU.
• Technical Game Design – Spring 2012 – Course in technical design for computer games aimed at upper level
undergraduate art and design students at the CIA.
(g) Professional Societies
• Academic Computing Machinery – Member
• International Computer Music Association – Member
(h) Research Contracts Awarded (omits cost share portion)
• 2014-2015 PI – IUPUI Arts and Humanities Internal Grant: BIG TENT: An Immersive Inter-media
Performance Environment – $15,000.
• 2012-2013 Senior Personnel – NSF CISE:EAGER Telehealth and Wellness for Senior Citizens Utilizing InHome Gigabit HD Multipoint Videoconferencing – $300,000.
(i) Awards and Honors
N/A
Biographical Sketch
Christian Rogers, Ph.D. – Co-PI
(a) Professional Preparation
Ph.D. in Curriculum & Instruction, Educational Technology
ME in Career & Technology Education
BS in Visual Communication Technology
University of Toledo
Bowling Green State University
Bowling Green State University
2013
2006
2004
(b) Appointments
• 2013-present, Director, Assistant Professor of Computer Graphics Technology, Indiana University - Purdue
University Indianapolis (IUPUI), IN
• 2012-2013, Lecturer in Visual Communication Technology, Bowling Green State University, Bowling Green,
Ohio
• 2006-2012, Instructor in Visual Communication Technology, Bowling Green State University, Bowling Green,
Ohio
(c) Related Publications and Patents Pending
1.
C Rogers. Asking the Right Questions to Get the Right Answers. The Conference on Human Development
in Asia. Hiroshima, Japan. March 2-4, 2014
2.
C Rogers. The Utilization of Rasch Measurement to Evaluate a Survey for Online Training. Journal for the
Liberal Arts & Sciences. Oakland University. 18 (2)
3.
C Rogers, J Schnepp. Student Perceptions of an Alternative Testing Method: Hints as an Option for Exam
Questions. 2014 ASEE International Conference (accepted)
4.
C Rogers. You Don’t Need to Be in Hollywood to Learn Video: An Exercise to Reinforce Learning.
Sloan-C International Conference. Walt Disney Swan & Dolphin Resort, Orlando, Florida. November 20,
2013
5.
B Teclehaimanot, L Kidd, C Rogers. Web 2.0 and Social Networking Activities for Classroom Settings.
International Conference. Society for Information Technology and Teacher Education, South Carolina,
Charleston. March 1, 2009 - March 6, 2009.
(d) Teaching Activities.
• Digital Video & Audio Production – Fall 2014 – Junior level 3-credit course for Computer Graphics
Technology Students at IUPUI
• Multimedia 1 – Fall 2014 – Junior level 3-credit course for Computer Graphics Technology Students at IUPUI
• Intro to Video Production – Fall 2007 – Spring 2013 – Sophomore level 3-credit course for Visual
Communication Technology Students at IUPUI
• Advanced to Video Production & Motion Design – Fall 2011 – Spring 2013 – Senior level 3-credit course for
Visual Communication Technology Students at BGSU
• Intermediate to Video Production – Fall 2009 – Spring 2013 – Junior level 3-credit course for Visual
Communication Technology Students at BGSU
• Intro to Video Production – Fall 2007 – Spring 2013 – Sophomore level 3-credit course for Visual
Communication Technology Students at BGSU
• ViaMedia Service Learning Media Course – Fall 2006 – Spring 2008 – Multi-level 3-credit course for Visual
Communication Technology Students at BGSU
• Intro to Visual Communication Technology – Fall 2006 – Spring 2007 – Freshman level 3-credit course for
Visual Communication Technology Students at BGSU
(e) Professional Societies
• New Media Consortium
• Epsilon Pi Tau
• University Film & Video Association
• Sloan Consortium
• American Society for Engineering Education (ASEE)
NSF Biographical Sketch
Ken Yoshida
Professional Preparation
University of California, San Diego,
University of California, Los Angeles,
University of Utah, Salt Lake City, UT
University of Alberta, Edmonton AB Canada
Pre-AMES
B.S. Engineering (Biocybernetics)
Ph.D. Biomedical Engineering
Postdoctoral Fellow, Neuroscience
09/84-06/86
09/86-06/89
08/89-12/94
12/94-04/98
Appointments
10/06-present
11/08-present
10/01-10/06
01/01-09/01
04/98-12/00
Assoc Prof., Dept of Biomedical Engineering, Indiana Univ.-Purdue Univ. Indianapolis
Adjunct Assoc Prof. Dept of Electrical and Computer Engineering, IUPUI.
Assoc Prof., Dept. of Health Science and Technology, Aalborg Univ, Denmark
Asst Prof., Center for Sensory-Motor Interaction, Aalborg Univ, Denmark
Research Asst Prof., Center for Sensory-Motor Interaction, Aalborg Univ, Denmark
Products
Stieglitz, T., Boretius, T., Navarro, X., Badia, J., Guiraud, D., Divoux, J-L, Micera, S., Rossini, P., Yoshida,
K., Harreby, K., Kundu, A., Jensen, W., “Development of a neurotechnical system for relieving phantom
pain using transversal intrafascicular electrodes (TIME), Biomedizinische Technik
Yoshida, K., Qiao S., Himebaugh, B., Soliman, M., “Extended Analog Computer Apparatus”, Patent
Cooperation Treaty Application PCT/US2013/029133, Filed 5 Mar 2013.
Yoshida, K., Qiao S., Himebaugh, B., “Extended Analog Computer Apparatus”, US Provisional Patent
Application No. 61/606,741, Filed 5 Mar 2012.
Qiao, S., Torkamani-Azar, M., Salama, P., Yoshida, K., “Stationary Wavelet Transform and Higher Order
Statistical Analyses of Intrafascicular Nerve Recordings”, JNE, 9(5), 2012
DOI: 10.1088/1741-2560/9/5/056014
Qiao S., Odoemene, O., Yoshida, K., “Determination of electrode to nerve fiber distance and nerve
conduction velocity through spectral analysis of the extracellular action potentials recorded from
earthworm giant fibers”, MBEC,50(8), pp.867-875, 2012. DOI: 10.1007/s11517-012-0930-8
Qiao, S., Yoshida, K., "Influence of unit distance and conduction velocity on the spectra of extracellular
action potentials recorded with intrafascicular electrodes", MEP, 2012.
DOI: 10.1016/j.medengphy.2012.04.008
Other Significant Products
Kamavuako, E.N., Farina, D., Yoshida, K., Jensen, W., “Estimation of grasping force from features of
intramuscular EMG signals with mirrored bilateral training”, ABME, 40(3), pp. 648-56, 2012.
DOI: 10.1007/s10439-011-0438-7
Yoshida, K, Farina, D, Akay M, Jensen W, “Multi-channel intraneural and intramuscular techniques for
multi-unit recording and use in active prostheses”, ProcIEEE, 98(3), pp. 432 – 449, 2010.
DOI: 10.1109/JPROC.2009.2038613
Djilas, M., Azevedo-Coste, C., Guiraud, D., Yoshida, K., “Spike sorting of muscle spindle afferent nerve
activity recorded with thin-film intrafascicular electrodes”, Comp Intel Neurosci., 2010.
DOI: 10.1155/2010/836346.
Kamavuako, E.N., Yoshida, K., Jensen, W., “Variance-based signal conditioning technique: Comparison
to a wavelet-based technique to improve spike detection in multiunit intrafascicular recordings”,
Biomedical Signal Processing and Control, 4(2), pp 118-126, 2009.
DOI: 10.1016/j.bspc.2009.01.006
Farina, D., Yoshida, K., Stieglitz, T., Koch, K.P., “Multi-Channel Thin-Film Electrode for Intramuscular
Electromyographic Recordings”, J App. Physiol., 104(3), pp.821-827, 2008.
DOI: 10.1152/japplphysiol.00788.2007
Synergistic Activities
Grant Reviewer for the VA RR&D grant panel on rehabilitation engineering
Editorial board for Frontiers in Neuroengineering
International Functional Electrical Stimulation Society (Member, Former BoD member)
Non-EU participant in the European Commission Health EPIONE project and the European Research
Council DEMOVE project
Principal Faculty Advisor – IUPUI Tau Beta Zeta (currently petitioning for full Tau Beta Pi chapter status)
Collaborators
Russel Eberhart (Phoenix Data Systems), Kevin Otto (Purdue Univ), Paul Salama (IUPUI, Indianapolis),
Winnie Jensen (Aalborg U., Denmark), Thomas Stieglitz (U. Freiburg, Germany), Xavier Navarro (UAB,
Barcelona, Spain), Silvestro Micera (SSSA, Pisa, Italy), Paolo Dario (SSSA, Pisa, Italy), David Guiraud
(LIRMM, Montpellier, France), Christine Azevedo-Coste (LIRMM, Montpellier, France), Dario Farina
(Georg-August Univ Göttingen, Germany), John Schild (IUPUI, Indianapolis), Jeffery Hendrix (Biotectix
LLC), Benedict Kjærgård (Aarhus Univ Hosp, Denmark), Flemming Besenbacher (Aarhus U., Denmark),
Michael Grey (U. Birmingham, UK)
Graduate and Post-Graduate Advisors
Kenneth W. Horch (Ph.D. Advisor, Univ Utah), Richard B. Stein (Post-doc. Advisor, Univ Alberta)
Advisees
Post-Doc.: Jing Xiong (IUPUI, currently Chinese Academy of Sciences), Kristian Hennings (Aalborg U,
2006, currently an Engineer at Terma A/S), Christine Azevedo-Coste (Aalborg U, 2004, currently a
Research Scientist at INRIA (French National Lab)), Winnie Jensen (Aalborg U, 2003, currently an Assoc
Prof at Aalborg Univ)
Ph.D.: Shaoyu Qiao (Purdue, pres), Aritra Kundu (Aalborg U, pres), Bo Geng (Aalborg U, currently
PostDoc AAU), Seth Wilks (Purdue, 2011, currently a Sr Research Scientist at CVRx Inc.), Ernest
Kamavuako (Aalborg U, 2010, currently an Asst Prof at AAU), Milan Djilas (U Montpellier2, 2008,
currently a Postdoctoral fellow at the Vision Institute, Paris), Pablo Pennisi (Aalborg U, 2008, currently a
Assoc Prof at AAU), Marco Tosato (Aalborg U, 2007, currently an Analyst at ElsagDatamat), Andrei
Patriciu (Aalborg U, 2007, currently an Engineer at Neurodan A/S)
Masters: Michael Ryne Horn (IUPUI, pres), Muller Soliman (IUPUI, currently Engineer at NSWC Crane),
David Sempsrott (IUPUI, currently Engineer at Roche Diagnostics), Kevin Mauser (IUPUI, currently
Engineer at Catheter Systems Inc.), Smitha Murthy Jayaram (IUPUI, 2009) Shaoyu Qiao (IUPUI, 2009,
currently a PhD student at Purdue U)
Undergraduate Interns and Practicums Hosted: 10 (IUPUI), 10 (Aalborg U), 1 (U Alberta)
Undergraduate Research Projects Hosted: 3 teams: 2007, 2012, 2013 (Multidisciplinary Undergraduate
Research Institute - IUPUI), 2 teams 2012, 2012 (Undergraduate Research Opportunities Program –
IUPUI)
Senior Design Teams Hosted: 24 students (IUPUI) 2013, 2012, 2011, 2010, 2009, 2007
High School Interns Hosted: 1 (IUPUI)
Ongoing Research Support
European Commission FP7 HEALTH Jensen (Coordinator)
9/2013 – 8/2017.
“Natural sensory feedback for phantom limb pain modulation and therapy (EPIONE)”, Role: Co-PI
R01 DC011759-01A1 Sivasankar (PI)
4/2012 – 3/2017
“Challenges to vocal fold epithelia: functional and structural consequences”, Role: Co-Investigator
References
1.
[1]
M. J. Giummarra, N. Georgiou-Karistianis, M. E. R. Nicholls, S. J. Gibson, M. Chou, and
J. L. Bradshaw, “Corporeal awareness and proprioceptive sense of the phantom,” Br. J. Psychol.,
vol. 101, no. 4, pp. 791–808, Nov. 2010.
[2]
S. . Grüsser, C. Winter, W. Mühlnickel, C. Denke, A. Karl, K. Villringer, and H. Flor, “The
relationship of perceptual phenomena and cortical reorganization in upper extremity amputees,”
Neuroscience, vol. 102, no. 2, pp. 263–272, Jan. 2001.
P. Brugger, S. S. Kollias, R. M. Muri, G. Crelier, M.-C. Hepp-Reymond, and M. Regard, “Beyond remembering: Phantom sensations of congenitally absent limbs,” Proc. Natl. Acad. Sci., vol. 97, no.
11, pp. 6167–6172, May 2000.
V. S. Ramachandran and W. Hirstein, “The perception of phantom limbs. The D. O. Hebb lecture,”
Brain J. Neurol., vol. 121 ( Pt 9), pp. 1603–1630, Sep. 1998.
F. Baker, M. Denniston, J. Zabora, A. Polland, and W. N. Dudley, “A POMS short form for cancer
patients: psychometric and structural evaluation,” Psychooncology., vol. 11, no. 4, pp. 273–281,
2002.
K. Kroenke, R. L. Spitzer, and J. B. Williams, “The PHQ-9: validity of a brief depression severity
measure,” J. Gen. Intern. Med., vol. 16, no. 9, pp. 606–613, Sep. 2001.
G. Tan, M. P. Jensen, J. I. Thornby, and B. F. Shanti, “Validation of the Brief Pain Inventory for
chronic nonmalignant pain,” J. Pain Off. J. Am. Pain Soc., vol. 5, no. 2, pp. 133–137, Mar. 2004.
R. H. Dworkin, D. C. Turk, K. W. Wyrwich, D. Beaton, C. S. Cleeland, J. T. Farrar, J. A.
Haythornthwaite, M. P. Jensen, R. D. Kerns, D. N. Ader, N. Brandenburg, L. B. Burke, D. Cella, J.
Chandler, P. Cowan, R. Dimitrova, R. Dionne, S. Hertz, A. R. Jadad, N. P. Katz, H. Kehlet, L. D.
Kramer, D. C. Manning, C. McCormick, M. P. McDermott, H. J. McQuay, S. Patel, L. Porter, S.
Quessy, B. A. Rappaport, C. Rauschkolb, D. A. Revicki, M. Rothman, K. E. Schmader, B. R.
Stacey, J. W. Stauffer, T. von Stein, R. E. White, J. Witter, and S. Zavisic, “Interpreting the clinical
importance of treatment outcomes in chronic pain clinical trials: IMMPACT recommendations,” J.
Pain Off. J. Am. Pain Soc., vol. 9, no. 2, pp. 105–121, Feb. 2008.
“Neurological Disorders - 3.2 Phantom Sensations,” 18-Apr-2014. [Online]. Available:
http://neurological-disorders.wikispaces.com/3.2+Phantom+Sensations. [Accessed: 18-Apr-2014].
[3]
[4]
[5]
[6]
[7]
[8]
[9]
All university policies with respect to research must be followed. The usual risk management
assurances must be provided where appropriate (animal use, radiation safety, DNA, human
subjects protocols) in accordance with the university policies. No funds may be released without
risk-management assurances, where needed. Project proposals without required compliance
approvals will be reviewed but the funds will not be released until approval is given by the
university.
Further information on risk management is available from http://researchadmin.iu.edu/cs.html
Please check any risk assurances that apply to this proposal:
Animals (IACUC Study #): _________________
8
MURI Proposal Form updated 10_7_13
Human Subjects (IRB Study #): _____Will be submitted in May/June 2014_______________
r-DNA (IBC Study #): _____________________
Human Pathogens, Blood, Fluids, or Tissues must be identified if used: ______
Radiation : ______
Other : ______
The Center for Research and Learning generally shares the text of funded proposals on the
web so that prospective students can learn about available MURI projects. Please let us know if
it is OK with you to post your proposal on the CRL MURI webpage by checking one of the
following answers:
YES
NO
NOTE: If you indicated that it is not OK to share your full proposal via the web, you will be
asked to send us a few short summary paragraphs that can be used to describe your project to
potential undergraduate scholars. These will be posted on the MURI website and attached to
the application for the students to review.
1) Please indicate any dates that mentors will not be available for students during the summer
such as planned vacations, conferences, etc.
Dan Baldwin - none
Christian Rogers – none
Benjamin Smith- none.
Ken Yoshida – 6/20 – 7/1 (ICNR Conference)
9
MURI Proposal Form updated 10_7_13
Appendix
Past MURI Mentoring Activities
Title of Past MURI Project:
Development of a biofeedback testing platform for evaluating sensory feedback and volition through an advanced
neuroprosthetic device
Date Awarded:
Oct 2007
Date Completed: Dec 2008
Description of Project:
The project aims to design, develop and implement a psychophysical testing protocol and instrumentation to
efficiently quantify and map the volitional intentions and sensory feedback perceived by a subject following multichannel surface stimulation and recording. The system will be the first step towards developing a method to be used
to evaluate an amputee subject interacting with a neuroprosthetic electrode implanted in the amputee’s peripheral
nerve. It further aims to introduce tools and concepts across disciplines to the MURI scholars through cross
pollination and group work on a multidisciplinary project involving psychophysics, bioinstrumentation, and object
oriented software design
Mentors Involved in Project:
Ken Yoshida (BME), Sean O’Conner (IUSM)
Students Involved in Project:
David Sempsrott, Brandon Brungard, Sriharsha Muttineni, Magali Carret
Description of Basic Project-related Student Learning Outcomes:
The protocol, instrumentation and software developed by the MURI team served as the basis of a successful
application to the European Commission (TIME) 2008-2012. It formed the initial starting point for a PhD student
thesis project. Bo Geng, the PhD student from Aalborg University is co-mentored by Dr Yoshida and Dr Jensen
(Aalborg University), and has published 2 full papers, and 5 conference papers.
Title of Past MURI Project:
Towards estimating the position of the leg using sensory information intercepted by neuroprosthetic electrodes
Date Awarded:
June 2012
Date Completed: Aug 2012
Description of Project:
The project aims to merge two lines of research taking place within the Bioellab (Dr Yoshida's lab):
1. Development of a robotic end point effector
10
MURI Proposal Form updated 10_7_13
2. Development of neural signal processing algorithms.
The first phase of the research will concentrate on work with the robotic end-effector. The second phase of the
research will concentrate on the analysis of the neural signal processing algorithm.
Mentors Involved in Project:
Ken Yoshida (BME), Paul Salama (ECE)
Students Involved in Project:
Jimmy G. Corcoran, Daniel L. French, Eric R. Wolf, Thawngzapum Lian
Description of Basic Project-related Student Learning Outcomes:
Group management and learning. Mechanics of the leg, and measurement of all 6 mechanical DOFs. Programming
Matlab GUIs, digital signal processing using SWT.
Title of Past MURI Project:
Training the Extended Voltage Manifold Computer (EVMC)
Date Awarded:
Aug 2013
Date Completed: June 2013 (projected)
Description of Project:
The preliminary work has developed methods to understand the voltage manifold and develop an architecture to
implement linear filters with the EVMC platform. The concept of EVMC was validated using finite element method
(FEM) simulations and using a non-real-time hardware implementation of the EAC. They demonstrated that the
theory that was developed accurately and precisely predicted and actual behavior of the physical device. When
applied to a specific neural signal processing task, they demonstrated signal processing steps for improving the
signal to noise ratio and linear shape classification techniques can be implemented on the EVMC. However, these
did not demonstrate the potential for computation speed or take advantage of the families of solutions that exist on
the EVMC manifold.
In general, this project involves the exploration of theory of operation of the EVMC to understand methods to apply
automatic machine learning techniques, Particle Swarm Optimization and the Generalized Hebbian Algorithm will
be explored to implement the means to train neural networks based upon the EVMC architecture. Two specific
research aims in this project are as follows: 1) the development of methods to train the EVMC modules and 2) the
development of strategies to realize input and output locations on the manifold sheets.
Mentors Involved in Project:
Ken Yoshida (BME), Paul Salama (ECE)
Students Involved in Project:
Michael Bertram, Nhan Do, Lucas Gramlin
Description of Basic Project-related Student Learning Outcomes:
11
MURI Proposal Form updated 10_7_13
Group management and learning. Matlab integration of Comsol, programming and implementation of particle
swarm optimization, and exploration of back propagation.
Name and Signature of the Principal Mentor:
(typing in the full name suffices as signature for electronic copies)
_Christian Rogers___________Christian B. Rogers_________________4/21/14
Name
Signature
Date
12
MURI Proposal Form updated 10_7_13