Example of Student Doing a Mastery Assignment.

advertisement
Example of Student Doing a Mastery Assignment.
Introduction to Maple T.A. Mastery Assignments
This document presents an example of a student working through a Maple T.A. Mastery assignment to
demonstrate both the flow of the assignment and its utility to support student mastery. The mastery
assignment is composed of questions or questions groups. When individual questions are used, the
student will be repeatedly given that question until they have gotten it correct (i.e. mastered it); use of
individual questions in Mastery Assignments does not make much sense unless the question is
algorithmically generated so that the student is actually answering a different (but similar question) each
time it is asked. A Question Group is a set of questions that assess a common skill or topic, but have
different wording, numeric values or real world applications. Questions in a group can also be
algorithmically generated giving question groups a large degree of variability. In a mastery assignment,
Maple T.A. will randomly draw questions from a group unit a preset number of those questions have been
answered correctly. For example, a question group chosen to test understanding of density may be
composed of questions that require the student to calculate mass, volume or density given the other two
variables; may involve liquid, gas or solid samples composed of different substances or mixtures and
may have volumes determined directly (i.e. with a graduated cylinder), from dimensions (length, width,
radius, etc.) or determined by difference (irregular objects). Question group may be set up by selecting 10
different density questions. The assignment designer would select the questions from the list provided
(see example figure below).
The assignment designer can type in a Group Name (see box) and the hit the “Add as Group” box. The
Question Group appears in an assignment question list (below) to the right of the available questions list
(see below).
This is identified as item one in the assignment. The line starting “Randomly pick . . .“ indicates that this
is a Question Group: if a single question had been selected only the first line would appear (see below).
After “Randomly pick” is a drop down box menu that allows the assignment designer to select the
number of questions in the group that must be answer correctly. Changing that number to 5 in a Mastery
Assignment would mean that a student would have to answer 5 of these questions correctly in order to
complete the assignment. By doing so, a student is assumed to have reached an acceptable level of
mastery. The “+” and “-“ boxes allow the number of points rewarded for a correctly answered question to
be changed. “Total Points” is the total number of points that can be gained for the entire assignment and
“Total # Questions” is the number of questions that must be answered correctly for the assignment to be
considered completed. Mastery assignments can be graded so that a student completing the assignment
gets full credit, regardless of how many wrong answers they made along the way. This encourages
students to keep working until they have “mastered” the assignment material.
Actual Example of Student Doing a Mastery Assignment
Top of Typical Course Page.
Visible Assignments are listed. Available assignments are shown in Blue. Generally, once an assignment
was made available in the ASU General Chemistry Redesigned Course, it was set to unlimited end date so
that students could use it for practice whenever they needed it.
Note the fourth “assignment” is unavailable with an end date set before the start of the semester. This is a
dummy assignment that is being used as a “section header” to give more organization to the assignment
list. Because of the large number of drills, pretests and assignments1 used in the course, this added
organization was needed to facilitate quick location of assignments by students. This is the work-around
that we came up with as Maple T.A. does not provide any means of organizing the assignment list other
than question order.
Further down on the list is the assignment selected by the student for this example . . .
1
Drills and pretests are used in the Skill Gateways. Assignments are associated directly with the lecture.
This is the Assignment View of the first question. In later examples we will be showing the question only
to minimize the length of this document. However, the student will have this view whenever they are
viewing a question in Mastery Mode.
The student selects the correct answer by clicking on the appropriate radio button.
Then the student checks to see whether or not the answer was correct by clicking “Grade”
In mastery mode, “Grade” means click the current question. The result is shown below.
The above figure shows the full answer response window. When question feedback is shown in the
remainder of this document, only the area inside the highlighted box will be shown.
The answer response is at the right. In this case the student answered correctly. Additional comments or
question feedback is given under “Comment:”. The comment ideally would give sufficient information
for a student missing the assignment to figure out what is required similar questions right. Remember in
the mastery assignment, students who get a question wrong will continue to be given similar questions
until they get the specified number correct.
This question does not have a comment. An appropriate comment for the question would have been . . .
The figure below indicates where metals are found on the periodic table. You should be able to locate the
locations of nonmetals without any help. Confirm that Co is in the indicated region.
Figures have to be kept to a limited size, because Maple T.A. We plan on adding comments of this sort to
these questions as we maintain and improve the ASU written question banks.
On the left, is a progress sheet that lists each of the questions or question groups in the assignment. The
dark green bar to the right of question 2 indicates that question group has been answered correctly the
required number of times. The “1/1” to the right of the green bar indicates that 1 question has been
answered correctly out of 1 required. A “1/3” would indicate that 1 question has been answered correctly
out of 3 required questions; in this situation (partial completion of a question group requirement) a light
green bar would have been shown indicating partial completion of the required number of correct answers
for that group. A yellow bar indicates that the question type has be answered one or more times without
any correct responses. No bar indicates that no questions from that group have been asked (or answered)
yet. If there is no bar, a yellow bar or a light green bar the student will be asked additional question from
that question or question group.
IMPORTANT
It is important at this point that students do not select “Finish Session” unless all topics show a green bar
next to them: when pushed, Maple T.A. assumes that the student is finished working on the assignment
and grades it based on what has been completed. Quitting before all items have dark green bars is the
equivalent of giving up. If the student wishes to quit Maple T.A. and resume the assignment later, they
should hit : “Quit and Save”.
To continue answering more questions, the student should select “Next”.
The next question that appears in this session is shown on the top of the next page. This is one of the
questions from item 10 and was provided by Prentice Hall ca. 2004 as part of the PHGA
Note that the question has a hint. If the student clicks on “Hint 1”, they get the following in a pop-up
window:
The section reference in this hint refers to an out of Print version of a different textbook2 than was used
for the course redesign. Material of this sort will be shown for example in this report. Questions from
PHGA questions banks are copyrighted materials and cannot be provided by ASU or THECB for others
to use.
To illustrate answer specific feedback that is available for multiple choice questions in Maple T. A., and
incorrect answer was selected
The Maple T.A. response obtained by clicking “Grade” is shown below:
Note that the feedback contains the student’s answer, the correct answer and a comment aimed at helping
the student understand what was done wrong. Note that the comment specifically addresses the wrong
answer selected by the student. A different wrong answer would have resulted in a different comment.
2
Chemistry, 4th Edition, John McMurry and Robert C. Fay, 2004, Prentice Hall, Upper Saddle River, NJ.
Also note the yellow bar to the right of the Topic 10 title indicating that the question has been attempted
and all attempts (in this case only one) made have been wrong.
The student would click on “Next” at this point to get the next question.
Again, an incorrect answer is given to illustrate what would happen. Clicking “Grade” gives
Notice even when “Comments” are not available, students can be given feedback in the form of the
correct answer. Whether hints, correct answers or comments are displayed are all instructor controllable.
In the ASU General Chemistry Course Redesign, the goal was to make these tools available for
independent student learning and so these features were all routinely turned on. To make this approach
effective a large number of algorithmically generated questions need to be used. Maple T. A. has the
advantage of having both algorithmically generated questions and the ability to randomly select questions
from a set of ideally equivalent questions. This combination results in the ability to generate assignments
that can be take multiple times and appear almost totally (or totally) unique.
A little later on the student sees the following after answering a question:
Note that question 5 is still showing a yellow bar, indicating that it has been answered, but not correctly
yet. The question happens to be from Question 5.
It happens to be the same question that was asked earlier: He. However, it could have easily asked about
H, C, N, O or F. When answered correctly (nonmetal), the following feedback is given:
Note that the yellow bar after Topic 5 has changed to dark green.
Again, a little later on the student has gotten to the following point:
Notice that more of the topics have green bars. Also notice that Question 1 (a true/false question) has yet
to be asked. The next question is
(Scandium is a metal)
The feedback for answering this question is
Some time later . . .
The student still has not answered a question from Topic 10 correctly, but now gets a Topic 10 question.
Notice that it is a different question. Again this is a PHGA database question. The feedback gives:
Finally after answering one last question correct, the student gets the following feedback.
Note that the green bar from top to bottom and the “100% Progress to mastery” indicate that the student
has completed the assignment. Also note that the “Next” option is no longer available. The student can
now click on “Finish Session” to get full credit for the assignment. The approach that we have taken
with mastery assignments is that as long as the students works to this point, full-credit is given. The hope
is to give the students an added incentive to doing the drills because it is a guaranteed grade.
Clicking “Finish Session” gives the following:
Clicking “View Details” gives a detailed accounting of the student’s work. A partial example of the
output is given below. Records of this sort can be pulled up for review by the student or faculty member
at any time and can be used for reviewing purposes by the student or to help identify student difficulties
by the instructor.
Download