!"#$%&'(&)#$*+$,--*./(0*-$1(2'#34$$
Adaptive Test Strategies Using
5)#$*&)$%*)6*)/(#$%&'(&)#3$!&-#7$
PATFrame
+*)$,--*./(0*-8
2009 ESD
Symposium
2010 Annual Meeting
Poster
Session
Poster
Session
Start date Jan 2008
Research
Group:
Expected
Graduation
Date:System
June 2011Design and Management
9*(0./(0*-$:$;)*<'#=
Motivation
Corporations develop on-going cultures similarly to the way
nations do. This research investigates whether certain cultures
“A battle
seldom survives
firstinnovation:
contact with the
enemy.
align
withplan
different
types of
incremental
and radical;
Strategy is a system of expedients”
disruptive and sustaining.
-Helmuth von Moltke the Elder
German Generalfeldmarschall
What is going on? Companies innovate but may not be matching their
type of innovation to their corporate culture.
How did it get that way? Companies create their corporate strategy
Like
battle
a test
plan isassessments
predicated
on of
basedaon
marketplan,
analysis
and external
instead
looking inward information.
at their own strengths
styles.
incomplete
We and
don’t
know what
failures our testing will uncover, so even the best
:K\LVQ¶WLWZRUNLQJQRZ"&RPSDQLHVIRUFHDVWUDWHJ\RQWKHLU
test
plan can
“overcome
by events”
any time.
employees
that isbe
addressing
the external
world andat
forces
employees and the culture to act differently from its authentic form.
Embracing the second part of von Moltke’s famous
quote, we realize that the best “strategy” for T&E is
adaptation. We Hypothesis:
propose a Prescriptive and
Adaptive Testing Framework (PATFrame) that
Corporate
culture
enables testers to address the rapidly evolving
and innovation
type Systems Test
needs of Unmanned
and Autonomous
(UAST).
reinforce or detract
from each other.
The PATFrame Team
?#2$@&#3(0*-A3B
Are certain corporate cultures better suited to certain types of
innovation? If so, how can a company create an innovation
strategy that fits its own culture and prepares it to compete in the
external market? Does perspective matter? That is, does seeing
a corporation as determined by the particular people comprising
it or seeing it as an entity through which different people flow
influence this research?
John T. Hess
(OOHQ&]DLND0DVWHU¶V6WXGHQW
johnhess@mit.edu
9#("*7*'*>2
What
is PATFrame?
Following a literature review of appropriate sociological models
for cultural classification and technology and business models
PATFrame
is a Decision
Addressing
for innovation,
I selected
the modelsSupport
in which toSystem
investigate
a
relationship.
Then I identified
candidate
companies
from which to
Questions
Posed
by the
Test Community:
collect data. The data to collect from each company include:
cultural data and innovation data to identify cultural pattern and
much testing
current
type. is enough?
•How innovation
•How long will testing take? How much will it cost?
How do I test effectively given the compressed schedule of
•!"#$;'/--#7$I#3#/)E"
a “Rapid Acquisition” program?
Using
sociological
categorizations
developed
Hofstede and the
I measure
the quality
of myby
tests?
•Howthedo
models for innovation developed by Utterback, Abernathy,
What
are
the
most
valuable
tests
for
my
system?
•
Christensen, Henderson, Brown, Miller and Friesen, identify where
I prioritize
my
tests?
•How
each
testshould
corporation
falls in each
model
and run statistical regression
to
determine
correlations.
do Isignificant
make sure
my tests are representative of the
•How
operational environment?
•How do I get more knowledge for my dollar?
•What are the unique challenges in testing UAS’s and
Systems of Systems (SoS’s)?
•How do I test a SoS without explicit requirements?
•How does my system affect the SoS in which it operates?
•What are the most valuable tests for my SoS?
Sponsors and Transition Partners
ESD
MIT
Technology and
Policy Program
Thesis
advisor:
Dr.Dr.
Ricardo
Thesis
advisor:
Ricardo Valerdi
Valerdi
Reader:Deborah
ProfessorNightingale
J. Utterback
Professor
CD6#E(#7$%*-()0<&(0*Methodologies
Leveraged
Ultimately, be able to help align corporate innovation strategy
corporate
culture and encourage
corporate
culture to
Design
of Experiments
Modeling
•with
•Cost
Defect innovation.
Modeling
•engender
•Exploratory Testing
Simulation
Testing
•Initially,
•Evolutionary
determine whether a relationship
exists between
culture and innovation strategy
or whether
external
Real Options
Basedthe
Test
•corporate
•Mission
environment
influence
in innovation
Decision
Theoryis the primary and
Evaluation
•market
strategy.
•Ontologies
•Bayesian Probability
•Value Based Testing
•System Dynamics
Unmanned Systems from MIT
5EF-*G'#7>=#-(3
3URIHVVRU-DPHV8WWHUEDFNDQG³'LVUXSWLYH7HFKQRORJ\
3UHGDWRURU3UH\´FODVV
3URIHVVRU2OLYLHUGH:HFNDQG³6\VWHP3URMHFW0DQDJHPHQW
(6'´
3URIHVVRU'HERUDK1LJKWLQJDOHDQG³,QWHJUDWLQJWKH/HDQ
(QWHUSULVH(6'-´
Dr. Ricardo Valerdi, Masters Thesis Advisor
H0(#)/(&)#$I#.0#G
Afuah, A. and J.M. Utterback. "Emergence of a New Supercomputer Architecture." Technological Forecasting and Social Change, vol 40,
1991: 315-328.
Brown, W.B. and N. Karagozoglu. "A Systems Model of Technological Innovation." IEEE Transactions on Engineering Management, Vol 36,
No.1, February 1989, 1989: 11-16.
Christensen, C.M. and M.E. Raynor. The Innovator's Solution: Creating and Sustaining Successful Growth. Boston: Harvard Business School
Press, 2003.
Ettlie, E.J. and W.P. Bridges. "Environmental uncertainty
andcourtesy
organizational
technology policy." IEEE Trans. Eng. Manag., vol EM-29, no1,
Images
of mit.edu
1982.
Fowler, F.C. "Applying Hofstede's Cross-Cultural Theory of Organizations to School Governance: A French Case Study." Reports Comparative and International Education Society Conference. Toronto: Comparative and International Education Society, 1999. 1-35.
Hage, J. and R. Dewar. "Elite values versus organizational structure in predicting innovation." Admin. Sci. Quart., vol 18, 1973.
Hofstede, G. Cultures and Organizations: Software of the Mind. London: McGraw-Hill Book Company, 1991.
Kelly, G. "Seducing the elites: The politics of decision making and innovation in organizational networks"." Acad. Manag. Rev., 1976: 66-72.
McGregor, J. The World's Most Innovative Companies; Businessweek. April 17, 2008.
http://images.businessweek.com/ss/08/04/0417_mostinnovative/index_01.htm (accessed Nov 10, 2008).
Miller, D. and P.H. Friesen. "Innovation in Conservative and Entrepreneurial Firms: Two Models of strategic Momenetum." Strategic
Management Journal, Vo 3, No 1. (Jan.-Mar., 1982), 1982: 1-25.
von Hippel, E. Democratizing Innovation. Cambridge: The MIT Press, 2005.
Acknowledgments
This material is based upon work supported by the Department of Defense,
United States Army, White Sands Missile Range, NM. under contract #
W9124Q-09-P-0230
Ellen Czaika
eczaika@mit.edu
Any opinions, findings and conclusions or recommendations expressed in
this material are those of the author(s) and do not necessarily reflect the
views of the Department of Defense, United States Army, Whites Sands