Design of Experiments - Ohio Northern University

advertisement
Unit 1 (part 2): The Taguchi Method: Minimizing the Number of
Experiments
Concepts:
Students should explore establishing experiments to measure specified
dependent variables, and be able to calculate the necessary experiments.
Objectives:
Students will learn how to determine the number of experiments necessary
for a given number of variables with given number of levels.
Useful websites:
The Michigan Chemical Process Dynamics and Controls Open Text Book:
http://controls.engin.umich.edu/wiki/index.php/Design_of_experiments_via
_taguchi_methods:_orthogonal_arrays
Wikipedia: Genichi Taguchi: http://en.wikipedia.org/wiki/Genichi_Taguchi
A more complex site with many array choices:
http://www2.research.att.com/~njas/oadir/index.html
Activity Sheets:
Taguchi Exercise
Engage:
Review the concepts of experiments, dependent and independent variables
and defining the number of levels of each variable. Review the answers
from the previous class to the following questions:
1. Why would we want to define the number of variable we will control
before doing an experiment?
2. Why would we want to minimize the number of experiments?
© 2010, Ohio Northern University: Dr. Debra Gallagher, Dr. Robert Verb, Dr. Ken Reid and Ben McPheron
Explore:
1. Review the ‘ice cream experiments’ from the teacher background with
students in the classroom. Lead the students through the development
of the final answer of the number of experiments.
2. During the ice cream example, show the Taguchi selection table and
discuss how to look up the number of experiments using the table (by
specifying the number of input variables and number of levels for
each).
3. Have students work through the questions on the “Taguchi Exercise”
worksheet.
4. Working in pairs, ask each student team to come up with an
experiment, listing each independent variable and the specific levels
they would test. Try to come up with 8-12 input variables with 3-4
levels: then determine the number of experiments required.
Explain:
1. Discuss the results of the ice cream experiment.
2. Review the solution of the Taguchi Exercise worksheet.
3. Determine the number of possible input variables we could control in
growing algae in small tanks, and the number of experiments we need
in full factorial and Taguchi methods.
Extend:
The Taguchi method can also be used to determine which input
variable, when changed, has the most dramatic effect on the dependent
variable we’re testing. This is often called the standard deviation analysis.
This will be covered soon.
Evaluate:
1. Use student solutions to the Taguchi Experiment Exercise
© 2010, Ohio Northern University: Dr. Debra Gallagher, Dr. Robert Verb, Dr. Ken Reid and Ben McPheron
Teacher Notes:
Design of experiments (DoE) or experimental design is very commonly used to figure
out how a number of variables work together toward some result. As we have seen, the
disadvantage is that adding a variable or a level result in a big increase in the number of
experiments.
The Taguchi Method is a way to minimize the number of experiments needed to
determine the effect of independent variables with specific numbers of levels. The basic
process is
-
-
Define the number of variables and levels
Look up the proper Taguchi Array
o The arrays can be derived or developed, but they are readily available to
look up
Perform the experiments as indicated
Analyze the results to determine the optimal combination of independent
variables.
Types of experimentation:
Full factorial experiments involve testing each possible combination of variables. In
cases with a small number of variables, like our ice cream example, there is usually no
need to reduce the number of experiments. When we have a medium amount of variables
and levels, the Taguchi method allows us to test a specific, smaller number of
combinations, then analyze the results to find the optimal solution. With a large number
of input variables, we might choose to do a random test, testing some random
combinations of variables.
As a guideline:
 Factorial design: suitable for 1-3 input variables
 Taguchi method: suitable for 3 to 50 inputs variables
 Random experiments: suitable for over 50 input variables.
© 2010, Ohio Northern University: Dr. Debra Gallagher, Dr. Robert Verb, Dr. Ken Reid and Ben McPheron
Let’s revisit our experiment with making the best ice cream cone given these inputs:
Cone: sugar cone or regular cone
Ice cream: vanilla or chocolate
Topping: dip, sprinkles, none
Texture: soft, regular
Number of tests = 2 levels * 2 levels * 3 levels * 2 levels = 24 experiments
Vanilla, sugar cone, dip, soft
Vanilla, reg cone, dip, soft
Chocolate, sugar cone, dip, soft
Vanilla, reg cone, dip, soft
Vanilla, sugar cone, dip, reg tex
Vanilla, reg cone, dip, reg tex
Chocolate, sugar cone, dip, reg tex
Vanilla, reg cone, dip, reg tex
Vanilla, sugar cone, sprinkles, soft
Vanilla, reg cone, sprinkles, soft
Chocolate, sugar cone, sprinkles, soft
Vanilla, reg cone, sprinkles, soft
Vanilla, sugar cone, sprinkles, reg tex
Vanilla, reg cone, sprinkles, reg tex
Chocolate, sugar cone, sprinkles, reg tex
Vanilla, reg cone, sprinkles, reg tex
Vanilla, sugar cone, none, soft
Vanilla, reg cone, none, soft
Chocolate, sugar cone, none, soft
Vanilla, reg cone, none, soft
Vanilla, sugar cone, none, reg tex
Vanilla, reg cone, none, reg tex
Chocolate, sugar cone, none, reg tex
Vanilla, reg cone, none, reg tex
Using the Taguchi selection chart:
We’ll use the Taguchi method to reduce the number of experiments we need to do to
determine the best ice cream cone. To use the Taguchi method, we refer to the Taguchi
selection chart:
(see
http://controls.engin.umich.edu/wiki/index.php/Design_of_experiments_via_taguchi_met
hods:_orthogonal_arrays for more detail)
Number of parameters: 4
Number of levels (the maximum number): 3
Taguchi chart tells us to use: L9 array.
We look up the L9 array and it shows us which
combinations to test:
L9:
What about blocks with no values? Use
a random value… for example, under
Cone in row 7, we can put either Sugar
or Regular. There really is no
statistical advantage to one or the
other; often one is cheaper or easier to
test. As we will see, we may be able to
duplicate a test…
© 2010, Ohio Northern University: Dr. Debra Gallagher, Dr. Robert Verb, Dr. Ken Reid and Ben McPheron
L9 (filled in)
Exp
1
2
3
4
5
6
7
8
9
Cone
Sugar
Sugar
Sugar
Regular
Regular
Regular
Ice cream
Vanilla
Chocolate
Vanilla
Chocolate
Vanilla
Chocolate
L9 (filled in, with random values in blank boxes)
Exp
Cone
Ice cream
1 Sugar
Vanilla
2 Sugar
Chocolate
3 Sugar
Vanilla
4 Regular
Vanilla
5 Regular
Chocolate
6 Regular
Vanilla
7 Sugar
Vanilla
8 Regular
Chocolate
9 Regular
Vanilla
Topping
Dip
Sprinkles
None
Sprinkles
None
Dip
None
Dip
Sprinkles
Texture
Soft
Regular
Topping
Texture
Dip
Sprinkles
None
Sprinkles
None
Dip
None
Dip
Sprinkles
Soft
Regular
Regular
Soft
Soft
Regular
Regular
Soft
Soft
Regular
Regular
Soft
Soft
Note that we were able to duplicate a few tests: rows 3 and 7 are the same, and rows 4
and 9 are the same.
Officially, the number of experiments we’ll need to do = 9
Realistically, the number is 7 (we’ll record our results of row 3 and row 4 in their
identical rows 7 and 9)


Full factorial test: 24 experiments
Taguchi: 9 experiments (or in this case, 7 will work)
Another example: if we have 23 inputs to control with 2 – 3 levels,


Full factorial test: 3*3*3*3*3*… (23 times) = 323 experiments =
94,143,178,827 experiments
Taguchi: the selection chart shows we would use an L36, or 36 experiments
© 2010, Ohio Northern University: Dr. Debra Gallagher, Dr. Robert Verb, Dr. Ken Reid and Ben McPheron
Running the Experiments:
First, determine how you will measure the dependent variable. In most cases, you want a
maximum or minimum number: which experiment grew the most algae, which
experiment resulted in the lowest cost. For our ice cream example, you may have to
assign the deliciousness of the ice cream cone a scale of 1 – 100.
Use the input variable values indicated in the Taguchi chart to run each experiment. For
example, on the above ice cream experiment, you would eat:
 Vanilla soft-serve on a sugar cone, with dip,
 Chocolate, regular ice cream on a sugar cone with sprinkles,
 Vanilla, regular ice cream on a sugar cone (plain),
 etc.
… and record the deliciousness of the ice cream cone in each of the 9 cases.
It is often useful to do multiple tests of each case (whether using factorial or Taguchi).
Analyzing the results:
The question: if we only test 9 combinations out of the possible 24, how can we know
which is best?
Let’s assume we made 2 ice cream cones testing each of our test conditions, and collected
the following data (and averaged all of the experiments for each setup):
L9 (filled in, with random values in blank boxes) Each level is named 1, 2 or 3 (for the next table)
Exp
1
2
3
4
5
6
7
8
9
Cone
Sugar 1
Sugar 1
Sugar 1
Regular 2
Regular 2
Regular 2
Sugar 1
Regular 2
Regular 2
Ice cream
Vanilla 1
Chocolate 2
Vanilla 1
Vanilla 1
Chocolate 2
Vanilla 1
Vanilla 1
Chocolate 2
Vanilla 1
Topping
Dip 1
Sprinkles 2
None 3
Sprinkles 2
None 3
Dip 1
None 3
Dip 1
Sprinkles 2
Texture
Soft 1
Regular 2
Regular 2
Soft 1
Soft 1
Regular 2
Regular 2
Soft 1
Soft 1
1
88
78
82
77
57
80
72
68
77
2
86
77
84
81
54
80
84
62
81
© 2010, Ohio Northern University: Dr. Debra Gallagher, Dr. Robert Verb, Dr. Ken Reid and Ben McPheron
avg
87
77.5
83
79
55.5
80
78
65
79
Next, average each factor value. For example, notice that experiments 1, 6 and 8 all had
dip, 2, 4 and 9 have sprinkles and 3, 5 and 7 have nothing.
Level 1
Level 2
(87+77.5+83+78) / 4=
(79+55.5+80+65+79) / 5=
81.375
71.7
Ice cream
81
66
Topping
77.333
78.5
Texture
73.1
79.625
Cone
Level 3
72.166
The simple averages show that, in this case,
 Cone: level 1 is better than level 2 (or sugar is better than plain)
 Ice cream: level 1 is better than level 2 (vanilla is better than chocolate)
 Topping: level 2 is slightly better than level 1 or level 3 (sprinkles are slightly
better than dip, which is better than nothing) and
 Regular ice cream is preferred over soft serve.
Our ideal cone should be: vanilla, regular ice cream on a sugar cone with sprinkles!
Notice that this wasn’t one of the test cases, but our data shows this should be the best.
(You might want to make a vanilla, regular ice cream on a cone with sprinkles to test
your experimental results!)
© 2010, Ohio Northern University: Dr. Debra Gallagher, Dr. Robert Verb, Dr. Ken Reid and Ben McPheron
Download