Scoring Guide - Office of Superintendent of Public Instruction

Wild About Radishes PCA Scenario Map, Results, and Scoring Rubrics
Title: Wild About Radishes (2006 and 2007 Exam)
Authors: SALTers
Grade: 8
Description: Students investigate the effect of acidity of water on the height that radish plants grow.
Grade Level Expectation &
Evidence of Learning Codes
Item Description
Inquiry
in Science
Changes
in Systems
Structure
of Systems
Properties
of Systems
WASL Evidence of Learning
for the Grade Level Expectation
Application
of Science
System of Science
Answer & Results
A
B
C
2%
11%
62%
21%
10%
65%
10%
1
Identify a controlled variable in an
investigation.
IN02b
2.1.2
3%
*2
Identify the manipulated variable in an
investigation.
IN02c
2.1.2
6%
*3
Identify the responding variable in an
investigation.
IN02d
2.1.2
6%
Write a scientific conclusion,
including supporting data from an
investigation, using inferential logic.
Identify how to increase the reliability
of the results of an investigation (e.g.
5 repeating an investigation exactly the
same way increases the reliability of
the results).
IN03a
2.1.3
4
*6
Describe how the method of an
investigation ensures reliable results
7
(e.g. multiple trials ensure more
reliable results).
Identify the different sources of matter
8 and energy required for life processes
in plants and animals
Compare human body systems to
9 another organism’s systems (e.g.
human lungs to plant leaves).
10
Point Total = 15
Actual Science WASL= 62 pts.
9%
CH08b
1.3.8
1%
IN09a
2.2.4
1%
ST08c
1.2.8
24%
IN02e
2.1.2
3
20%
40%
12
80%
40%
correct
66%
correct
8%
6%
45%
19%
44%
correct
SA Rubric
CH08a
1.3.8
Construct a logical plan for a
controlled investigation
19%
84%
correct
SA Rubric
IN09b
2.2.4
Identify how organisms acquire
materials for life processes
correct
D
7%
44%
49%
14%
correct
48%
correct
13%
ER Rubric
0
0%
20%
MC=7pts, SA=4pts,
ER=4pts
45%MC,36%SA,19%ER
Note: Points on the WASL are balanced among the Systems of Science with 33% Physical Systems, 33%
Earth/Space Systems, and 33% Living Systems.
*Typical pilot results. These items were not part of the 2007 Grade 8 Operational Science WASL.
Published by the Science Assessment Team of the Washington Office of the Superintendent of Public Instruction on September 27, 2007
Copyright © 2007by Washington Office of the Superintendent of Public Instruction (OSPI)
All rights reserved. Educational institutions within the State of Washington have permission to reproduce this document. All other individuals wishing to
reproduce this document must contact OSPI.
OSPI Science Assessment
1
February 18, 2016
Wild About Radishes PCA Scenario Map, Results, and Scoring Rubrics
Scoring Rubric and Results for Item 4: Write a Conclusion
Value
Points
Performance Description
A 2-point response demonstrates the student understands the GLE: Explaining IN03a
(2.1.3) Apply understanding of how to construct a scientific explanation using evidence
and inferential logic BY writing a scientific conclusion, including supporting data from
an investigation, using inferential logic.
2007
Results
Mean =
0.5 pts
4
12%
A 1-point response demonstrates the student has partial understanding of the GLE.
2-3
28%
A 0-point response demonstrates the student has little or no understanding of the GLE.
0-1
Example: Radish plants with a pH of 6 grew the tallest. The average plant height was
0.5 cm for pH 4 water. The plants grew to 9.0 cm tall with the pH 7 water. The plants
were shortest for pH 4 and pH 5 water.
57%
Blank =
2%
Acidity of Water vs. Average Plant Height
Acidity of Water
(pH)
Average Plant Height
(centimeters)
4
0.5
5
0.5
6
12.5
7
9.0
OSPI Science Assessment
2
February 18, 2016
Wild About Radishes PCA Scenario Map, Results, and Scoring Rubrics
Scoring Rubric and Results for Item 4: Write a Conclusion (continued)
Attributes of a Conclusion for Awarding Value Points
Note: The italicized print is the part of the “Example” credited for the value point.
Description of Attributes
Value
Points
2007
Results
1
41%
Conclusive statement correctly answers the investigative question (or correctly states
whether the hypothesis/prediction was correct): Radish plants with a pH of 6 grew the
tallest.
Attribute Notes:
1. A vague conclusive statement (e.g. the acidity of the water did affect the plant height)
cannot be credited, but other value points can be credited.
2. A response with an incorrect conclusive statement or no conclusive statement may not be
credited any value points.
3. A response with both a correct and an incorrect conclusive statement (e.g. The higher the
pH the taller the plants…Plants had the greatest height at pH 6.) cannot be credited but
other value points can be credited, if separate from any contradictory statements.
Supporting data should at least be over the entire range of the conditions investigated. Thus, the
minimum reported data are the lowest and highest conditions of the manipulated variable for
quantitative data (responding variable when the manipulated variable information is descriptive).
Supporting data for pH 4 water: The average plant height was 0.5 cm for pH 4
water.
1
36%
Supporting data for pH 7 water: The plants grew to 9.0 cm tall with the pH 7 water.
1
31%
1
30%
Explanatory language, separate from the conclusive statement, is used to connect or
compare the supporting data to the conclusive statement: The plants were shortest for
pH 4 and pH 5 water.
Attribute Notes:
1. This point can only be credited when at least one numeric value (or the text from a
descriptive data table) for the manipulated or responding variable is included in the
response.
2. A copy of the conclusive statement cannot be credited for explanatory language. However,
a re-phrased credited conclusive statement can be credited.
3. Explanatory language comparing the range of the manipulated and/or responding variables
may be credited (e.g. When the pH was lowest, pH of 4, the plant height was the lowest,
0.5 cm.).
4. If a response misquotes trend data between the highest and lowest conditions, this value
point cannot be credited.
5. Transitional words (e.g. however, therefore, because, so, then, clearly, but) cannot be
credited as explanatory language even when added to a conclusive statement.
6. A compound sentence as a conclusive statement may be read as two separate sentences.
7. This point can only be credited if the results for pH 6 water are included somewhere in the
response (e.g. the plants were tallest for pH 6 water).
Total Possible Value Points
OSPI Science Assessment
3
4
February 18, 2016
Wild About Radishes PCA Scenario Map, Results, and Scoring Rubrics
Scoring Rubric for Item 4: Write a Conclusion
General Notes:
1. Copying the Data Table: If a response just copies the whole data table verbatim, supporting data value
points may not be credited even with a correct conclusive statement and explanatory language.
a) For grades 3-5, a translation of the whole data table into sentences is acceptable.
b) For grades 6-8 and high school, a discussion of the whole data table may be acceptable when the data
table is minimal with a very small number of data cells.
2. Supporting Data: Responses must give the precise numerical values or precise descriptive language from
the data table for both the manipulated and responding variables.
a) Average data (if given) rather than trial data, or data from the end of the investigation, must be included
for grades 6-8 and high school.
b)
For grades 3-5, consistent trial data, or data before the completion of the investigation when
measuring a responding variable over time, can be credited.
c) Rounded numerical values cannot be credited.
d) Units and significant figures are not necessary for credit.
e) Minor language differences in descriptive data may be acceptable as decided in range finding.
f) For grades 3-5, the manipulated variable may be implied.
3. Derived Data: Responses giving their own derived data between conditions can be credited for supporting
data and explanatory language (e.g. the plant with pH 6 water was 3.5 cm taller than the plant with pH 7
water).
a) When the derived data uses the lowest and/or highest conditions, one or both supporting data points can
be credited.
b) Minor arithmetic errors in derived values are acceptable as decided in range finding (e.g. pH 6 helped
plants grow 3 cm taller than the next best pH).
4. Responses may use the terms acidity and pH interchangeably. Responses with a misconception about the
relationship between pH and acidity (e.g. pH of 7 is the most acidic water) may be creditable.
OSPI Science Assessment
4
February 18, 2016
Wild About Radishes PCA Scenario Map, Results, and Scoring Rubrics
Scoring Rubric and Results for Item 7: Describing Sources of Error
2007
Results
Performance Description
Mean =
1.1 pts
A 2-point response demonstrates the student understands the GLE: Evaluating Methods of
Investigation IN09a, c (2.2.4) Understand how to make the results of scientific investigations
reliable and how to make the methods of investigation valid BY describing how the method of an
investigation ensures reliable results AND/OR is valid.
The response describes two possible sources of error in Amanda’s investigation by:
Identifying two possible sources of error in the investigation
AND
Describing how each source of error could have affected the investigation results.
Examples:
34%
Identify possible sources of error
Describe how source could have affected
investigation
Amanda may have accidentally given some of the
plants too much water.
Too much water could stunt plant growth.
Amanda only did the experiment one time with
one batch of seeds.
There might have been something wrong with
the batch of seeds used, which could affect
how the plants grow.
If half of the pots were in the shade, then the
Supplying plants with different amounts of
plants that were in the sun might dry out more
sun creates a second manipulated variable.
quickly than those grown in the shade.
A 1-point response demonstrates the student has partial understanding of the GLE.
The response identifies one possible source of error in the investigation and describes how this
source of error could have affected the investigation results.
OR
The response identifies two possible sources of error, but does not describe how each source of
error could have affected the investigation results.
44%
19%
A 0-point response demonstrates the student has little or no understanding of the GLE.
Blank =
4%
General Notes:
1. A response must indicate how a variable would be a source of error to receive credit for identifying a
source of error. Responses that only identify the variable may not receive credit. (E.g. Water may not
receive credit, but one plant might have received more water than others would receive credit.)
2. Responses discussing rate of growth (of any plant part), rate of photosynthesis or change in amount of
food (from photosynthesis) may be credited for how the source of error could have affected the
investigation results.
OSPI Science Assessment
5
February 18, 2016
Wild About Radishes PCA Scenario Map, Results, and Scoring Rubrics
Scoring Rubric for Item 10: Plan an Investigation
Value
Points
2007
Results
Mean =
2.3 pts
A 4-point response demonstrates the student understands the GLE Planning and
Conducting Safe Investigations IN02e (2.1.2) Understand how to plan and conduct
scientific investigations BY constructing a logical plan for a controlled or field
investigation.
7-9
30%
A 3-point response demonstrates the student partially understands the GLE.
5-6
20%
A 2-point response demonstrates the student has limited understanding of the GLE.
3-4
9%
A 1-point response demonstrates the student has very little understanding of the GLE.
1-2
20%
Performance Description
17%
A 0-point response demonstrates the student has almost no understanding of the GLE.
0
Blank =
4%
Value
Point
2007
Results
1
38%
1
33%
1
58%
Attributes of a Controlled Investigation for Awarding Value Points
Investigation
Attributes
Prediction
Prediction
Reason
Description of Attribute
The prediction portion of the hypothesis must answer the given
question including the effect of the manipulated (changed) variable
amount of pH 6 water) on the responding (dependent) variable
(height of plants).
A hypothesis must give a related reason for the prediction. …
because plants need water to grow.
Attribute Note: This point cannot be awarded without an attempt at a
prediction.
A list of the minimum materials needed to perform the procedure
(e.g. plants or plant seeds, pots, pH 6 water, measuring devices for
water and height of plants).
Materials
Attribute Notes:
1. The ‘right’ amount of materials (e.g. 6 pots) needed to carry out the
procedure does not need to be given in the materials list.
2. If pre-measured amounts of materials are listed in the materials list, a
measuring device may not be needed in the materials list.
1. Standard classroom materials do not need to be listed: paper, pencil,
and safety equipment (e.g. goggles, aprons, gloves, tongs).
OSPI Science Assessment
6
February 18, 2016
Wild About Radishes PCA Scenario Map, Results, and Scoring Rubrics
Scoring Rubric for Item 10: Plan an Investigation (continued)
Attributes of a Controlled Investigation for Awarding Value Points (continued)
Investigation
Attributes
Procedure
One Controlled
(kept the same)
Variable
Manipulated
(changed)
Variable
Responding
(dependent)
Variable
Description of Attribute
Value
Point
2007
Results
The written or diagrammed procedure is evaluated as follows:
up to 6
At least one controlled (kept the same) variable is identified or
implied in the procedure or the materials list (e.g. pH of water,
same type of seeds, same small plant pots, time between
watering, same number of seeds in a pot, duration of
investigation, amount of soil in pot).
1
58%
Only one manipulated (changed) variable (amount of pH 6 water)
is identified or implied in the procedure or data table (if given).
1
57%
1
50%
1
52%
The responding (dependent) variable (height of plants) is
identified or implied in the procedure or data table (if given).
Attribute Note:
1. The terms pH 6 or water may be credited as pH 6 water.
The procedure states or implies measurements are recorded
periodically or gives a data table.
Record
Measurements
Attribute Note:
1. If artificial data for the responding variable is given, no value point
may be awarded.
2. The phrase ‘take measurement’ cannot be used to mean record.
Trials
are Repeated
More than one trial for all conditions is planned, or implied in a
data table, to measure the responding variable (e.g. multiple
seeds in one pot or multiple pots at same conditions).
1
25%
Logical Steps
The steps of the procedure are detailed enough to repeat the
procedure effectively (examples of illogical steps: no ending time
indicated, states Set up as diagrammed, but diagram is
inadequate, recording vague data or results).
1
32%
Total Value Points Possible
9
OSPI Science Assessment
7
February 18, 2016
Wild About Radishes PCA Scenario Map, Results, and Scoring Rubrics
Item 10: Plan an Investigation (continued)
General Notes:
1.
Inappropriate Procedures: If the response does not plan an appropriate procedure for the given
question, the response may not earn any of the possible procedure value points.
Examples:
a) Repeats the procedure from the scenario
b) Measures only one condition (therefore cannot establish the controlled or manipulated variables)
c) Purposefully changes more than one variable simultaneously
d) Writes a procedure that is too vague to possibly be appropriate
e) Writes a prediction instead of a procedure
2.
Naming Attributes: If the response names a bulleted attribute listed after “Procedure that includes:”
without including that attribute in the procedure, the attribute point cannot be credited. When a bulleted
attribute is named and implied in the response, both must be correct to be credited.
3.
Clarifying Vagueness in Procedures:
a) Vague materials used in the procedure (e.g. add 1mL) may be credited if the vagueness is clarified in
the materials list (e.g. 1mL, 2mL, and 3mL of solution).
b) Measuring a vague parameter (e.g. size of plant instead of height) may be credited as a manipulated or
responding variable. However, a vague parameter is difficult to repeatedly measure, so the logical
steps value point cannot be credited.
c) The term “repeat” at the end of a step refers to that step only.
d) The term “repeat” as a separate step (or in a new paragraph) refers to the whole procedure.
e) The term “repeat,” when qualified, cannot be credited for multiple trials (e.g. repeat if necessary,
repeat as desired).
f) A vague action that calls for the manipulated variable to be changed (e.g. increase the temperature by
5˚ C) without indicating how many times, gives no end to the investigation so the logical steps value
point cannot be credited.
g)
At high school, a vague action that calls for the manipulated variable to be changed without
indicating how many times cannot be credited for more than two conditions of the
manipulated variable.
h) When a procedure conflicts with the labeled diagram, the procedure is too illogical to be effectively
repeated. Therefore, the logical steps value point cannot be credited, but the procedure can be scored
for attributes that are not in conflict.
4. The terms pH 6 or water may be credited as pH 6 water.
OSPI Science Assessment
8
February 18, 2016