2013 NACTEI Conference
The Marriott Renaissance Phoenix Downtown  Phoenix, Arizona
May 8, 2013
1. Activity:
Walk a Mile in
Your Students’
Shoes
6. Summary:
People, Process,
Product, and
Progress
2. Arizona’s Skill
Standards
Assessment
System
5. Arizona’s
New
Workplace Skills
4. Adding
Dimensions to
Teaching and
Learning
Questions?
3. Activity:
Item
Development/
Analysis Process
State of Arizona
Department of Education
Office of John Huppenthal
Superintendent of Public Instruction
Dear Student,
Welcome to the Arizona Skill Standards Assessment System designed to measure knowledge and skills attained in
Career and Technical Education (CTE) programs.
Assessments are linked to program standards validated by Arizona business and industry leaders. Students,
teachers, and administrators receive immediate results for continuous learning and program improvement.
The Arizona Skill Standards Commission, top business and industry leaders throughout Arizona, issues certificates
and technical skill transcripts documenting knowledge and skill attainment useful to prospective employers.
Sincerely,
CONTINUE
John Huppenthal
Superintendent of Public Instruction
Student Agreement
Student Agreement
-
I will NOT:
I will
NOT:
copy
this assessment.
- copy this assessment.
use additional information or materials.
- use additional information or materials.
or use
electronic
equipment.
- talk
talkduring
duringthe
theassessment
assessment
or use
electronic
equipment.
- share
sharecontent
contentwith
with
others
after
the
assessment.
others after the assessment.
I understand that:
- I can usethat:
the computer calculator and/or pencil/paper provided for
I understand
Icomputations.
can use the computer calculator and/or pencil/paper provided for computations.
- If I fail to comply with the assessment requirements, I face consequences,
If I fail to comply with the assessment requirements, I face consequences, including the
including the
invalidation
ofresults
my assessment
results
and/or district discipline.
invalidation
of my
assessment
and/or district
discipline.
AGREE
1. Architectural Drafting
What type of door is illustrated in the drawing?




a. Bifold
b. Pocket
c. Exterior
d. Interior
2. Fashion Design and Merchandising
An outfit requires 2 ¼ yards of fabric for the skirt and 1 ½ yards for the top. If the
fabric is $5.00 per yard, what is the total cost of the fabric?




a. $19.75
b. $19.50
c. $17.00
d. $18.75
3. Nursing Services
Which statement about HIPAA privacy and security rules is CORRECT?
 a. Residents/patients can decide which family members have access to their
medical information.
 b. A nursing assistant has access to the records of all residents/patients in the
facility.
 c. When resident/patient information is found outside a secure location, it
must be destroyed.
 d. Any family member can ask to see the resident/patient’s medical records.
4. Welding Technologies
When setting up a SMAW welding machine, what two factors determine the
amperage setting?




a. Electrode length and polarity
b. Type of machine and length of weld
c. Thickness of the metal and the electrode size
d. Polarity and arc length
5. Culinary Arts
A recipe calls for 2/3 cup of liquid. What is the total amount of liquid needed if
the recipe is tripled?




a. 1 1/2 cups
b. 1 1/3 cups
c. 2 cups
d. 1 2/3 cups
6. Law, Public Safety and Security
Double jeopardy refers to a situation in which a defendant cannot be prosecuted
for a criminal offense for which he or she has already been tried. What
amendment to the U.S. Constitution guarantees this right?




a. 10th Amendment
b. 1st Amendment
c. 3rd Amendment
d. 5th Amendment
7. Engineering Sciences
The solar water heating system in the diagram is designed to transfer heat from
the solar panel to the hot water tank. The heat is transferred to and from the
water pipes through heat exchangers. The system will be MOST efficient if the
heat exchangers are made of what material?




a. Porcelain
b. Copper
c. Glass
d. Plastic
8. Fire Service
In a solid stream nozzle, what determines the flow?




a. Pump size and available water
b. Nozzle pressure and size of discharge opening
c. Nozzle pressure
d. Length of hose
9. Automotive Technologies
Which safety precaution must be taken when inspecting a cooling system?




a. Secure all locking devices on all coolant adjustments and attachments.
b. Check hydraulic fluid in the lift system used to check expansion plugs.
c. Wear rubber gloves to protect your hands.
d. Never remove the radiator cap when the engine is extremely hot.
10. Business Management and Administrative Services
What budget categories are used to determine a company’s ability to pay current
debt?




a. Current assets and liabilities
b. Current payroll and deductions
c. Current short-term and long-term goals
d. Current purchases, returns, and allowances
1. Architectural Drafting
What type of door is illustrated in the drawing?




a. Bifold
b. Pocket
c. Exterior
d. Interior
2. Fashion Design and Merchandising
An outfit requires 2 ¼ yards of fabric for the skirt and 1 ½ yards for the top. If the
fabric is $5.00 per yard, what is the total cost of the fabric?




a. $19.75
b. $19.50
c. $17.00
d. $18.75
3. Nursing Services
Which statement about HIPAA privacy and security rules is CORRECT?
 a. Residents/patients can decide which family members have access to their
medical information.
 b. A nursing assistant has access to the records of all residents/patients in the
facility.
 c. When resident/patient information is found outside a secure location, it
must be destroyed.
 d. Any family member can ask to see the resident/patient’s medical records.
4. Welding Technologies
When setting up a SMAW welding machine, what two factors determine the
amperage setting?




a. Electrode length and polarity
b. Type of machine and length of weld
c. Thickness of the metal and the electrode size
d. Polarity and arc length
5. Culinary Arts
A recipe calls for 2/3 cup of liquid. What is the total amount of liquid needed if
the recipe is tripled?




a. 1 1/2 cups
b. 1 1/3 cups
c. 2 cups
d. 1 2/3 cups
6. Law, Public Safety and Security
Double jeopardy refers to a situation in which a defendant cannot be prosecuted
for a criminal offense for which he or she has already been tried. What
amendment to the U.S. Constitution guarantees this right?




a. 10th Amendment
b. 1st Amendment
c. 3rd Amendment
d. 5th Amendment
7. Engineering Sciences
The solar water heating system in the diagram is designed to transfer heat from
the solar panel to the hot water tank. The heat is transferred to and from the
water pipes through heat exchangers. The system will be MOST efficient if the
heat exchangers are made of what material?




a. Porcelain
b. Copper
c. Glass
d. Plastic
8. Fire Service
In a solid stream nozzle, what determines the flow?




a. Pump size and available water
b. Nozzle pressure and size of discharge opening
c. Nozzle pressure
d. Length of hose
9. Automotive Technologies
Which safety precaution must be taken when inspecting a cooling system?




a. Secure all locking devices on all coolant adjustments and attachments.
b. Check hydraulic fluid in the lift system used to check expansion plugs.
c. Wear rubber gloves to protect your hands.
d. Never remove the radiator cap when the engine is extremely hot.
10. Business Management and Administrative Services
What budget categories are used to determine a company’s ability to pay current
debt?




a. Current assets and liabilities
b. Current payroll and deductions
c. Current short-term and long-term goals
d. Current purchases, returns, and allowances
•
Reliable test application
•
Assessment link on Arizona Department of Education (ADE) home page
•
Online delivery with real-time feedback
 Student Status Report – individual and total student results by standards
and measurement criteria
 Score Distribution Report – assessment data and a line graph with percent
of students at score levels
 Program Performance Report – JTED, district, and school data by state
score and ADE pass score
•
Two testing windows
•
Student certificates and transcripts
Spring 2008
•
•
13 assessments
4,829 students
Spring 2011
•
•
•
51 assessments
15,765 students
12,786 certificates and transcripts
Spring 2009
•
•
30 assessments
10,446 students
Spring 2010
•
•
•
49 assessments
14,507 students
11,637 certificates and transcripts
Spring 2012
•
•
•
49 assessments
17,532 students
13,814 certificates and transcripts
Spring 2013
•
•
•
49 assessments offered
17,536 students
13,725 certificates and transcripts
WEDO oversees the development of the assessments and manages
the database system that includes –
•
•
•
•
•
Test Item banks
History of item performance
Data on assessment results over time
Item analysis reports
Ability to assemble 100-item assessments for online delivery
Arizona CTE Skill Standards and Assessment System / Arizona Department of Education in Partnership with the University of Arizona / May 2013
(Don’t repeat “oven” in options.)
What kind of oven uses forced circulating air?
a. Convection
b. Conventional
c. Revolving
d. Deck
(Capitalize words such as “first” and “best”.)
What is the FIRST step when preparing to key a hand-written document?
a. Review the document to determine format.
b. Read the document thoroughly for content.
c. Key a rough draft for the document.
d. Proofread the document for errors.
(Each option is a complete sentence followed by a period.)
What is the BEST method for determining seasonal sales promotion strategies?
a. Collect data on buying trends of the target market.
b. Place certain items on sale and calculate total revenue.
c. Review newspaper ads for local competition.
d. Circulate product coupons and track their redemption.
Problem: The stem leads the reader to the correct answer.
What type of search engine crawls the internet looking for recently created pages
and updates?
a. Spider-based
b. RSS
c. Directory
d. Pay per click
Modified: The stem is adjusted to eliminate the “animated” language.
What type of search engine looks for recently created pages and updates?
a. Spider-based
b. RSS
c. Directory
d. Pay per click
Problem: Passive “would be” is used when active “is” is more direct.
What would be the PRIMARY purpose of DHCP?
a. It assigns IP addresses.
b. It assigns protocol instruction to a server.
c. It assigns domain names automatically.
d. It assigns a new user name.
Modified: Stem is in active voice. Distractors are shortened by using
gerunds.
What is the PRIMARY purpose of DHCP?
a. Assigning IP addresses
b. Assigning protocol instructions to a server
c. Assigning domain names automatically
d. Assigning user name
CULINARY ARTS
KNOWLEDGE DIMENSION
A. Factual Knowledge
B. Conceptual Knowledge
C. Procedural Knowledge
Total Number of Items
1. Remembering
181
10
17
208
2. Understanding
21
8
2
31
81%
3. Applying
1
1
40
42
4. Analyzing
1
4
5
10
19%
5. Evaluating
0
1
2
3
Total
204
24
66
294
1. Remembering
32
12
4
48
2. Understanding
21
35
12
68
60%
3. Applying
4
5
19
28
4. Analyzing
6
19
3
28
40%
5. Evaluating
1
14
5
20
Total
64
85
43
192
ENGINEERING SCIENCES
KNOWLEDGE DIMENSION
A. Factual Knowledge
B. Conceptual Knowledge
C. Procedural Knowledge
Total Number of Items
1. Difficulty Index. Percentage of students who answered the item correctly
2. Discrimination Index. Difference between students who know the content
and those who do not
3. Distractor Analysis. Percentage of students who chose each option
An item is flagged when it falls below these parameters:
• Difficulty Index of .45 with Discrimination Index of .3
OR
• Difficulty Index of .5 with Discrimination Index of .25
This item is not flagged.
PROGRAM: Early Childhood Education
STANDARD: ESTABLISH AN ENVIRONMENT TO PROMOTE LEARNING AND DISCOVERY
MEASUREMENT CRITERION: Arrange the physical environment to facilitate planned
and spontaneous activities
Difficulty Index: 0.6378 / Discrimination Index: 0.4762
Blooms ID: C3
Item Status: Edited
What action BEST encourages spontaneous painting activity for
children?
* 81 (63.78%) – Keeping paint containers at a child’s level
38 (29.92%) – Instructing each child how to paint
4 (3.15%) – Placing paint brushes on a high counter
4 (3.15%) – Storing extra butcher paper in cabinet
This item is flagged.
PROGRAM: Sports Medicine and Rehabilitation Services
STANDARD: APPRAISE WELLNESS AND HEALTH PROMOTION
MEASUREMENT CRITERION: Identify different types of exercise needed for special populations
Difficulty Index: 0.4218 / Discrimination Index: 0.2245
Blooms ID: B5
Item Status: New
What is the BEST activity for preventing bone density loss in an elderly
person?
* 62 (42.18%) – Strength/resistance training
50 (34.01%) – Swimming
22 (14.97%) – Stretching
13 (8.84%) - Running
Interior Design and Merchandising
Mathematics
Standard
Mathematical
Practices
CTE Standard /
Measurement
Criterion
Application of
Mathematics
Standard
Example of Mathematics Standard in (CTE Program name)
Automotive Technologies
Mathematics
Standard
Mathematical
Practices
CTE Standard /
Measurement
Criterion
Application of
Mathematics
Standard
Example of Mathematics Standard in (CTE Program name)
Advanced Construction Technologies
Mathematics
Standard
Mathematical
Practices
CTE Standard /
Measurement
Criterion
Application of
Mathematics
Standard
Example of Mathematics Standard in (CTE Program name)
Entrepreneurship
Mathematics
Standard
Mathematical
Practices
CTE Standard /
Measurement
Criterion
Application of
Mathematics
Standard
Example of Mathematics Standard in (CTE Program name)
Workforce Education Development Office (WEDO)
University of Arizona, Department of Agricultural Education
714 E Van Buren Street
Phoenix AZ 85006-3364
Maggie Mangini, Ed.D.
Executive Director, WEDO
602-827-2332
maggiemangini@email.arizona.edu
Judy Balogh
Project Director
602-827-2328
judybalogh@email.arizona.edu
Lynne Bodman Storms
Senior Program Coordinator
602-827-2329
lynnestorms@email.arizona.edu