Central Washington University Assessment of Student Learning – Aviation

Aviation Assessment Report, 12/13/13

Central Washington University

Assessment of Student Learning – Aviation

Academic Year of Report: Fall 2012 to Spring 2013

College: CEPS

Department

Program

Aviation

Bachelor of Science in Professional Pilot

Specializations: Flight Officer (FO) & Commercial Pilot (CP)

Check here if your assessment report covers all undergraduate degree programs: [X]

Check here if your assessment report covers all graduate degree programs: [ ]

1.

What student learning outcomes were assessed this year, and why?

The four learner outcomes listed below were assessed this year because data were collected for all areas

(knowledge, skills and attitudes) pertaining to those criteria and programs. The department will assess other specializations in the Aviation Management degree after the department is successful in hiring an experienced full-time management faculty member to assist with this task.

1. Apply the foundational knowledge, skills and attitudes necessary to fly commercial transport aircraft in a safe and efficient manner.

This outcome relates to Department Goal 1 - Provide for an outstanding academic, professional growth experience for students at all CWU locations, College Goal 2 - Prepare students to participate in an increasingly diverse economy and environment, University Goals 1 - Maintain and strengthen an outstanding academic and student life on the Ellensburg Campus and 6 - Build inclusive and diverse campus communities that promote intellectual inquiry and encourage civility, mutual respect and cooperation. Assessments were conducted to meet department and Federal Aviation Administration (FAA)

Title 14 Code of Federal Regulations (CFR) Part 141 regulatory and quality of instruction standards.

2. Interpret, calculate and analyze meteorological, aerodynamic, performance and loading factors to conduct safe and efficient commercial flights.

This outcome relates to Department Goal 1 (see above),

College Goal 2 (see above) and University Goals 1 and 6 (see above). Assessments were conducted to meet department and FAA Title 14 CFR Part 141 regulatory and quality of instruction standards.

3. Demonstrate knowledge, skills and attitudes to effectively operate aircraft airframe, powerplant, navigation and communication systems in a multi-crew environment, including crew resource management (CRM), hazardous attitudes assessment, and aeronautical decision making (ADM). This outcome relates to Department Goal 1 (see above), College Goal 2 (see above) and University Goals 1 and 6

(see above). Assessments were conducted to meet department and FAA Title 14 CFR Part 141 regulatory and quality of instruction standards.

4. Describe the physiological and psychological limitations to flight crew performance (including personal limitations, hazardous attitudes and antidotes, and pilot decision making) and effectively manage these limitations in the flight environment. This outcome relates to Department Goal 1 (see above), College Goal 2 (see above) and University Goals 1 and 6 (see above). Assessments were conducted to meet department and FAA 14 CFR Part 141 regulatory and quality of instruction standards.

1


2.

How were they assessed?

A) Methods of Assessment, and B) Who was assessed:

Outcomes 1, 2, 3, and 4 were assessed through national FAA certification written examinations (29 students enrolled in AVP 142, 24 students enrolled in AVP 242 and 25 students enrolled in AVP 354), FAA end of course (EOC final) written examinations (30 students enrolled in AVP 142, 24 students enrolled in

AVP 242, 36 students enrolled in AVP 352 (18 in Ellensburg, 18 at MLC) and 25 students enrolled in AVP

354), and FAA EOC practical flight test examinations (22 students enrolled in lab AVP 103, 21 students enrolled in AVP 203, 6 students enrolled in AVP 301, 11 students enrolled in AVP 306 and 9 students enrolled in AVP 401).

Note: With the exception of one section of AVP 352, taught to 18 students winter 2013 at the Moses Lake

Center (MLC), these courses and examinations were all taught at the CWU Ellensburg campus. With the exception of AVP 352, MLC students transfer in to CWU with equivalents completed at Big Bend

Community College.

All examinations were graded based on FAA computer test standards or FAA practical flight test standards pertinent to the certificate or rating for which the student was enrolled.

Skills assessed include the following (non-comprehensive) list of content knowledge , operational skills and appropriate attitudes as applied to each lab course, EOC exam, or FAA certificate as listed in documents

FAA-S-8081-14A, FAA-S-8081-4D, FAA-S-8081-12B, or FAA-S-8081-6C with Changes 1 & 2). See http://www.faa.gov/training_testing/testing/ for full text of those criteria – those documents are far too extensive to include in this report.

Aircraft control (all flight maneuvers required for FAA certifications)

Flight planning and decision making

Navigational skills

Aircraft systems knowledge

Airport operations

Air traffic control procedures (VFR and IFR) and radar services

Meteorological considerations

Interpretation and application of weather reports and forecasts

Theory and application of instrument navigation

Assessment of hazardous attitudes

Application of pilot decision making skills

Situational awareness

Workload management

Aeromedical factors

Aerodynamics

Weight and balance

Night operations

High altitude operations

Federal Aviation regulations and publications

The National Airspace System

Airworthiness requirements

Fundamentals of instruction

Human behavior

2


Commercial pilot operations

Instrument flight rules

Pilot certification and logbook endorsements

Flight Instructor responsibilities

In addition, Outcomes 1 through 4 were partially assessed through surveys given to students at the

Ellensburg campus: 22 students who completed AVP 142, 19 students who completed AVP 242 and 22 students who completed AVP 354. The Likert-scale survey is designed to measure students’ perceptions of their experience in these courses.

Outcome 2 was also partially assessed through pass rates of 38 students who completed AVP 211

Meteorology for Pilots and 25 students who completed AVP 312 Aviation Weather Services. These two courses are not taught by CWU at the MLC, so only Ellensburg students were assessed.

Crew resource management (CRM) skills in Student Learner Outcome 3 were also partially assessed through pass rates of 7 students who completed AVP 489 Turbojet FTD, CRJ-200 winter 2013 and spring 2013 quarters. This course is not offered at the MLC, so only Ellensburg students were assessed.

Outcome 4 was also partially assessed through surveys given to 42 students at the Ellensburg campus who completed AVP 337 Aviation Physiology & Survival (two sections) and 24 students at the Moses Lake

Center who completed AVP 337 Aviation Physiology & Survival (one section). It was also partially assessed through surveys given to 25 students at the Ellensburg campus who completed AVP 340 Human

Factors in Flight (one section) and 13 students at the Moses Lake Center who completed AVP 340 Human

Factors in Flight (one section). The Likert-scale survey is designed to measure self-perception of improvement of knowledge of the physiological and psychological limitations of pilot performance and improvement in their ability to effectively manage these limitations in the flight environment as a result of taking these courses.

Outcome 1, along with measures of general satisfaction with the CWU and Midstate Aviation flight training program, was partially assessed through a survey given to 6 graduating senior Ellensburg campus Flight

Officer (FO) & 5 graduating senior Ellensburg campus Commercial Pilot (CP) students who participated in the “Senior Exit Survey” at the end of the spring 2013 quarter.

C) When it was assessed:

Students were assessed each quarter depending on which FAA course they were enrolled in:

Fall quarter 2012: AVP 103, AVP 203, AVP 301, AVP 401

Winter quarter 2013: AVP 103, AVP 142, AVP 203, AVP 242, AVP 301, AVP 306, AVP 352, AVP 401

Spring quarter 2013: AVP 103, AVP 203, AVP 301, AVP 306, AVP 354, AVP 401

Students enrolled in AVP 142 and AVP 242 were assessed through a survey administered at the end of winter quarter 2013.

Students enrolled in AVP 354 were assessed through a survey administered at the end of spring quarter 2013.

Students enrolled in AVP 211 Meteorology for Pilots and AVP 312 Aviation Weather Services, were assessed at the end of winter 2013 quarter.

Students enrolled in AVP 489 Turbojet FTD, CRJ-200 were assessed in the quarter they took the course

(winter 2013 and spring 2013).

3


Students who completed AVP 337 Aviation Physiology & Survival and AVP 340 Human Factors in Flight were assessed through surveys administered at the end of their respective quarters (fall 2012, winter 2013 and spring 2013).

3.

What was learned? The following tables show stated criteria and goals for each criterion.

Criteria 1, 2, 3, 4, 5 and 6 below are applicable to all four student learning outcomes:

Students will:

1. Apply the foundational knowledge, skills and attitudes necessary to fly commercial transport aircraft in a safe and efficient manner.

2. Interpret, calculate and analyze meteorological, aerodynamic, performance and loading factors to conduct safe and efficient commercial flights.

3. Demonstrate knowledge, skills and attitudes to effectively operate aircraft airframe, powerplant, navigation and communication systems in a multi-crew environment, including crew resource management (CRM), hazardous attitudes assessment and aeronautical decision making (ADM).

4. Describe the physiological and psychological limitations to flight crew performance (including personal limitations, hazardous attitudes and antidotes, and pilot decision making) and effectively manage these limitations in the flight environment.

Criterion 1: Ellensburg campus students enrolled in FAA ground schools passed national FAA certification written examination on the first attempt with a minimum score of 80%.

Quarter Class *n Criterion 1

Passed FAA written exam on the first attempt with a minimum score of 80%.

Goal for Criterion 1:

80% of students met criterion 1.

**CWU

Average Test

Score, FAA written

FAA National

Average

Airmen

Knowledge

Test Scores

(2011 stats)

Win13

Win13

AVP

142

AVP

242

Spr13 AVP

354

*** Spr13 AVP

448

13/29

16/24

23/25

45%

67%

92%

Not Met

Not Met

Exceeded

79.9%

81.5%

87.1%

84.2%

79.4%

86.61

0/0 FOI

N/A

FIA

N/A

FOI FIA FOI

N/A N/A

FIA

N/A

FOI

82.9

FIA

81.8

*n = number of students who passed FAA written exam on the first attempt with at least 80% / number of students who completed FAA written exam

** average test score of those who completed FAA written exam

*** not offered 12/13 due to insufficient enrolment

4


Criterion 2: Ellensburg campus students enrolled in FAA ground schools passed FAA end of course

(EOC final) written examinations on the first attempt with a minimum score of 80%.

Quarter Class *n Goal for Criterion 2 Goal for Criterion 2:

80% of students met criterion 2

Win13 AVP 142 30/30

Win13 AVP 242 20/24

Win13 AVP 352 17/18

Win13** AVP 352 18/18

Spr13 AVP 354 23/25

Spr12*** AVP 448 N/A

Passed EOC written exam on the first attempt with a minimum score of 80%.

100 %

83 %

94%

100%

92%

N/A

Exceeded

Exceeded

Exceeded

Exceeded

Exceeded

N/A

*n = number of students who passed EOC written exam on the first attempt / number of students who completed EOC written exam

**Taught at MLC

*** not offered 12/13 due to insufficient enrolment

Criterion 3: Ellensburg campus students enrolled in flight labs passed FAA end of course (EOC) practical flight test examination on the first attempt.

Quarter Class *n Goal for Criterion 3

% Passed EOC flight exam on the first attempt

Fall 2012



AVP 103



AVP 203



AVP 301



AVP 306



AVP 401

Win 2013



AVP 103



AVP 203



AVP 301



AVP 306



AVP 401

Spr 2013



AVP 103



AVP 203



AVP 301

Su 2013



AVP 306



AVP 401



AVP 103

2/2

2/2

2/2

0/0

7/7

1/1

1/1

1/1

4/4

1/1

15/18

12/18

3/3

5/7

1/1

1/1

100%

100%

100%

N/A

100%

100%

100%

100%

100%

100%

83%

67%

100%

71%

100%

100%

Goal for Criterion 3:

80% of students met criterion 3

Exceeded

Exceeded

Exceeded

N/A

Exceeded

Exceeded

Exceeded

Not met

Exceeded

Exceeded

Exceeded

Not met

Exceeded

Not met

Exceeded

Exceeded

TOTALS

Total

Total

Total

Total

Total

AVP 103

AVP 203

AVP 301

AVP 306

AVP 401

19/22

15/21

6/6

9/11

9/9

86%

71%

100%

82%

100%

Exceeded

Not met

Exceeded

Exceeded

Exceeded

*n = number of students who passed EOC flight exam on the first attempt / number of students who completed EOC flight exam

5


Criterion 4: Survey results from 22 students at the Ellensburg campus who completed AVP 142.

Question: Strongly Disagree Neutral Agree Strongly

Private Pilot Ground School

1. The AVP 141/142 Private Pilot Ground School has met the requirements required by the Federal Aviation

Regulations.

2 The Private Pilot Ground School training met my expectations.

3. I feel that the Private Pilot Ground School has

Disagree

1

2

2

7

8

Agree

20

14

12 prepared me to pass the FAA Written Test.

4. I was able to understand aircraft performance information and how to go about calculating it.

5. The Private pilot ground school gave me an overall good understanding of airplane aerodynamics and aircraft systems.

6. After the ground school, I am now able to distinguish between the different classes of airspace and identify the rules for each.

7. The Federal Aviation Regulations (FAR’s) were presented in a way that allowed me the understand them.

1

1

1

4

3

5

10

11

11

9

7

7

9

8

8. When going through the basic meteorological process, I was able to understand the information being presented.

9. If I had difficulty on certain subject areas, I was able to obtain help outside the classroom.

10. I am overall satisfied with the Aviation classes that

I have taken so far.

11. I feel that the Private Pilot Courses (AVP 141,

142, 221, 211) has prepared me to be a safe and competent private pilot.

12. I feel that the training received in the FAA 141 ground school classes and the FAA 141 flight training received at Midstate were complementary in terms of timing and instruction.

Total

Quarter Students

Surveyed

Winter 13 AVP 142 n

22 90%

0 (0%)

Goal for Criterion 4

80% percent agree or strongly agree

1

4 (>1%)

1

3

3

22 (8%)

8

6

10

10

7

Goals for Criterion 4:

80% of students surveyed met criterion

4

Exceeded

13

13

12

12

11

99 (38%) 138 (52%)

6




Disagree

5

Agree

14

Instrument Pilot Ground School

1. The AVP 242/242 Instrument Pilot Ground

School has met the requirements required by the

Federal Aviation Regulations.

2 The Instrument Pilot Ground School training met my expectations.

3. I feel that the Instrument Pilot Ground School 1

2

2

9

10

8

6 has prepared me to pass the FAA Written Test.

4. I was able to understand the flight instruments and understand how they operate.

5. Holding was presented to me in a way that allowed me to understand and conduct holding.

6. Through the instrument ground school, I am now able to interpret and understand instrument approach charts.


8. I have seen program changes occur as a result of the feedback that I have provided.

10. I am overall satisfied with the Aviation classes that I have taken so far.

11. I feel that the Instrument Pilot Courses (AVP

241, 242, 312) has prepared me to be a safe and competent instrument pilot.


Total

1

1

1

1

1

1

1

1

2

2

1

1

3

8

4

3

6

7

10

8

5

8

10

10

6

9

6

9

10

1

5

6

3

4 (2%)

3 (16%)

7 (4%) 32 (15%) 88 (42%) 77 (37%)

Results from question 9, which is structured differently than the rest of the questions above, are included below:

9. The quality of instruction I have received this N/A Decreased Same Improved year compared to last year has: 1 (5%) 8 (42%) 7 (37%)

Quarter

Winter 13

Students

Surveyed n

AVP 242 19



79%


80% of students surveyed met criterion 5

Not met

7




Disagree

6

Agree

16

Commercial Pilot Ground School

1. The AVP 354 Commercial Pilot Ground School has met the requirements required by the Federal Aviation

Regulations.

2 The Commercial Pilot Ground School training met my expectations.

3. I feel that the Commercial Pilot Ground School has

1

1

12

13

9

8 prepared me to pass the FAA Written Test.

4. The advanced systems were presented to me in a way that allowed me to understand them.

5. I was able to understand advanced aircraft performance information and how to go about calculating it.

6. The weight and balance and weight shift formula were covered enough to give an understanding of their operations.


8. I have seen program changes occur as a result of the feedback that I have provided.

10. I am overall satisfied with the Aviation classes that

I have taken so far.

11. I feel that the Commercial Pilot Courses (AVP

354, 322, 340) has prepared me to be a safe and competent instrument pilot.


Total

1

1

2

1

5

5

7

4

8

4

1

6

9

10

12

11

9

9

13

7

8

7

2

7

3

9

8

6

1 (1%) 4 (2%) 42 (17%) 111 (46%) 83 (34%)

Results from question 9, which is structured differently than the rest of the questions above, are included below:

9. The quality of instruction I have received this year compared to last year has:

Decreased:

1 (5%)

Same:

11 (58%)

Improved:

7 (37%)

Quarter

Spring 13

Students

Surveyed

AVP 354 n

22



80%


80% of students surveyed met criterion

6

Met

8


Criterion 7 results below apply to Student Learner Outcome 2: Interpret, calculate, and analyze meteorological, aerodynamic, performance and loading factors to conduct safe and efficient commercial flights.

Ellensburg campus students enrolled in AVP 211 Meteorology for Pilots and AVP 312 Aviation Weather

Services who passed the course with a minimum of 80% mastery level.

Quarter

Winter 13

Fall 12

Class

AVP 211

AVP 312 n

36/38

22/25


Passed course with a minimum score of 80%.

95%

88%


80% of students in each course met criterion 7

Exceeded

Exceeded

Criterion 8 results below apply to Student Learner Outcome 3: Demonstrate knowledge, skills, and attitudes to effectively operate aircraft airframe, powerplant, navigation and communication systems in a multi-crew environment, including crew resource management (CRM), hazardous attitudes assessment and aeronautical decision making (ADM).

Ellensburg campus students enrolled in AVP 489 Turbojet FTD, CRJ-200 who passed the course with a minimum of 80% mastery level.

Quarter Class n

Fall 2012

Winter 2013

Spring 2013

Sum 2013

AVP 489 0

AVP 489 4

AVP 489 3

AVP 489 0

Goals for Criterion 8

Passed course with a minimum score of 80%. n/a

100%

100%

100%


80% of students in course met criterion 8 n/a

Exceeded

Exceeded

Exceeded

9


Criterion 9 results below apply to Student Learner Outcome 4: Describe the physiological and psychological limitations to flight crew performance (including personal limitations, hazardous attitudes and antidotes, and pilot decision making) and effectively manage these limitations in the flight environment.

Results for 19 students who completed AVP 337 Aviation Physiology & Survival and participated in the survey below at the Ellensburg campus Winter 2013.

Question:

“As a result of taking AVP 337 …

1. …my understanding of the physiological aspects of flight has grown considerably.”

2. …I’m more confident in my ability to recognize the physiological limitations of flight”

3. … I’m more confident in my ability to successfully avoid the hazards associated with these physiological limitations”

4. …I believe my ability to make safe aeronautical decisions has significantly improved”

Total

Strongly

Disagree

1 (%)

Disagree Neutral

1 (%)

Agree

5 (%)

8 (%)

5 (%)

7 (%)

Strongly

Agree

14 (%)

10 (%)

13 (%)

12 (%)

1 (>1%) 0 (0%) 1 (>1%) 25 (33%) 49 (64%)


Surveyed n Goal for Criterion 9


97%



Exceeded Winter 2013 AVP 337 19

Results for 23 students who completed AVP 337 Aviation Physiology & Survival and participated in the survey below at the Ellensburg campus Spring 2013.

Question:






Total

Quarter

Spring 2013

Students

Surveyed

AVP 337 n

23

Strongly

Disagree

2

2

2

2

8 (9%) agree

88%

Disagree

0 (0%)


80% percent agree or strongly

Neutral

1

1

1

3 (3%)

Agree

8

8

5

7

28 (30%)

Strongly

Agree

13

12

15

13

53 (58%)



Exceeded

10


Results for 24 students who completed AVP 337 Aviation Physiology & Survival and participated in the survey below at the Moses Lake Center Spring 2013.

Question:






Total

Strongly

Disagree

Disagree Neutral

1

0 (0%) 1 (1%)

3

2

3

1

Agree

12

12

13

12

9 (9%) 49 (51%)

Strongly

Agree

9

10

8

10

37 (39%)






Spring 2013 AVP 337 24 90% Exceeded

Average for all three AVP 337 courses taught this period:

Total 9 (3%) 1 (<1%) 13 (5%) 102 (38%) 139 (53%)

11


Results for 25 students who completed AVP 340 Human Factors in Flight and participated in the survey below at the Ellensburg campus Fall 2012.

Question:


1. …my understanding of the psychological aspects of flight has grown considerably.”

2. …I’m more confident in my ability to recognize the psychological limitations to flight and avoid them”


4. …I better understand the concepts of crew resource management and as a result I feel I can effectively use all available resources to achieve safe and efficient flight.”

Total

Quarter

Fall 2012

Students

Surveyed

AVP 340 n

25

Strongly

Disagree

0 (0%)

Disagree

0 (0%)



97%

Neutral

1

2

3 (3%)

Agree

17

17

17

10

51 (61%)



Exceeded

Strongly

Agree

8

8

7

13

36 (36%)

Results for 13 students who completed AVP 340 Human Factors in Flight and participated in the survey below at the Moses Lake Center Fall 2012.

Question:


1. …my understanding of the psychological aspects of flight has grown considerably.”

2. …I’m more confident in my ability to recognize the psychological limitations to flight and avoid them”


4. …I better understand the concepts of crew resource management and as a result I feel I can effectively use all available resources to achieve safe and efficient flight.”

Total

Strongly

Disagree

Disagree




99% Fall 2013 AVP 340 13

Average for all three AVP 340 courses taught this period:

Total 0 (0%) 0 (0%)

Neutral

1

0 (0 %) 0 (0%) 1 (1 %)

Agree

11

8

7

6

Strongly

Agree

2

5

5

7

32 (62%) 19 (37%)



Exceeded

4 (3%) 83 (58%) 55 (39%)

12


Criterion 10 results below partially assess Student Learner Outcome 1: Apply the foundational knowledge, skills, and attitudes necessary to fly commercial transport aircraft in a safe and efficient manner.

It is also included to indicate overall general strengths and weaknesses, from the graduate’s perspective, of the CWU and Midstate Aviation flight training program.

Results for 6 graduating senior Flight Officer (FO) & 5 Commercial Pilot (CP) students who participated in the “Aviation Senior Exit Survey” at the Ellensburg campus Spring 2013.

1. Central Washington University’s

Aviation Department programs met my expectations.

N/A Strongly

Disagree

Disagree Neutral Agree Strongly

1

Agree

10

2. This program prepared me for entry into the aviation industry.

1 10

3. I felt confident in the Aviation

Department’s faculty knowledge.

1 10

1 10

4. Aviation Department faculty were approachable.

5. Aviation Department faculty effectively taught industry-related material.

6. Aviation Department faculty varied delivery methods of course material.

7. Aviation Department faculty conducted themselves professionally.

8. Aviation Department faculty treated me with respect.

9. The academic advising provided by the faculty every quarter was useful in completing my degree.

10. I felt knowledgeable about the activities taking place in the department.

11. I felt confident in Aviation

Department’s part-time lecturer’s knowledge.

12. Aviation Department part-time lecturers effectively taught industry related material.

13. Text books required for Aviation courses were relevant to course material.

14. Aviation curricula appear relevant to the aviation industry.

15. I have had an opportunity to provide feedback to the Aviation

2

1

2

1

1

2

3

1

3

5

6

5

1

9

6

10

10

11

8

4

4

5

10

11

13

Department.

16. Changes occurred as a result of feedback I have provided.

17. I understand why changes may not have occurred as a result of feedback provided.

18. Aviation Department curricula and Midstate Aviation curricula are complementary.

19. Effective communication existed between Midstate Aviation and the Aviation Department.

20. Expectations listed in the

Standard Operating Procedures in relation to the completion of flight training were reasonable.

21. I was scheduled enough on the

Master schedule to complete my certificates/ratings on time.

22. Midstate Aviation flight instructors were approachable.

23. Midstate Aviation flight instructors treated me with respect.

24. Midstate Aviation flight instructors returned my inquiries.

25. Midstate Aviation flight instructors used scheduled flight time effectively.

26. Midstate Aviation flight instructors used scheduled ground time effectively.

27. I felt confident in Midstate

Aviation flight instructors’ knowledge.

28. Midstate Aviation flight instructors conducted standardized instruction.

29. Midstate Aviation flight instructors were prepared for lessons.

30. Midstate Aviation flight instructors were available to meet my scheduling needs.

31. Midstate Aviation flight instructors conducted themselves professionally.

32. The Chief Flight Instructor and

Assistant Chief Flight Instructor were approachable.

33. The Chief Flight Instructor and

2

2

2

2

2

2

2

2

2

2

2

2

1

2

2

2

2

2

1

1

14

1

1

1

3

1

2

1

2

4

1

4

3

2

3

2

1

1

1

5

2

2

2

1


2

1

5

4

4

2

6

2

3

4

9

8

4

8

7

7

6

5

7

3

6

6

6


Assistant Chief Flight Instructor treated me with respect.

34. Midstate Aviation office personnel were approachable.

2 1 2 6

35. Midstate Aviation office personnel treated me with respect.

2 2 7

36. Midstate Aviation office personnel considerately communicated with me regarding scheduling issues.

2 1 8

37. Midstate Aviation office personnel considerately communicated with me regarding charges to my account.

2 1 2 1 5

38. Aircraft rental rates are comparable to other flight schools with equivalent aircraft.

2 1 2 5 1

39. The quality of Midstate Aviation aircraft are above average.

2 2 7

40. The maintenance of Midstate

Aviation aircraft is excellent.

2 9

41. The flight training I received from Midstate Aviation prepared me well for a career as a professional pilot.

2 2 7

Please rate the following questions

Very

Poor

Poor Fair Good Very

Good

7

42. How would you rate the overall quality of flight instruction received from your flight instructors at

Midstate Aviation, Inc.?

1 3

43. How would you rate the overall quality of instruction you received from Aviation Faculty?

1 10

44. How would you rate the overall quality of the CWU Aviation program?

3 8

Total

Total with “N/As” dropped

51 (11%) 5 (1%) 1 (<1%) 32 (7%) 92 (19%) 302 (63%)

0 (0%) 5 (1%) 1 (<1%)) 32 (7%) 92 (21%) 302 (70%)



80% percent agree/strongly agree and good/very good

*91% Spring 13 Graduating Seniors 11

*”N/As” dropped from total to compute percentage for Criterion 10



Exceeded

15


Summary:



Criterion goal 1 (see page 4) was exceeded in only 1 of 3 FAA certification examinations associated with AVP 142, 242 and 354 (448 was not taught during the review period). The percentage of students who passed the FAA written exam on the first attempt with a score of at least 80% was 45 percent and 67 percent, for AVP 142 and 242, respectively. However, not captured in the data is the fact that the percentage of students who achieved the minimum required score to pass the FAA written certification exam (70 percent) on the first attempt was 93 percent (27 out of 29) and 96 percent (23 out of 24), for these same courses, respectively. o The departmental expectation of 80% of students achieving a minimum score of 80% on these certification examinations—criteria established before annual assessment data were available—may be too high of a goal. Data collected over the past few years indicates failure to consistently reach this goal, in spite of measures taken to increase the level of learning in these classes (i.e., more practical homework assignments, greater expectations, more comprehensive and challenging examinations and an additional credit hour for one course, etc.). This inability no doubt has to do with the fact that FAA written examination scores do not count toward any course grade, and therefore, students may not be as motivated to reach these goals as they are to meet them for stage and end of course (EOC) examinations which do count in grading. o Mean FAA certification examination scores (Criterion 1) were above national means for 2 out of 3 FAA certification examinations associated with AVP 142, 242 and 354, compared to the previous review period where they were above national mean scores for 4 out of 4 examinations. The average FAA certification examination score for AVP 142, the course that did not meet this criterion, was 9% lower (at 79.9%) than the average score (89%) in the previous review period. With the absence of the previous instructor who had several years of experience teaching this course, these results could have been partly due to a new, less experienced instructor, who had never taught this course before



As per the previous review period, criterion goal 2 was exceeded in all FAA end of course (EOC final) written examinations administered in association with AVP 142, 242, 352 and 354.



As per previous review periods, criterion goal 3 was met or exceeded in 4 out of 5 FAA end of course (EOC) practical flight examinations associated with AVP 103, 203, 301, 306 and 401. It was not met in AVP 203, where only 71% (15/21) passed the EOC flight exam on the first attempt.

However, there was significant improvement in pass rates for AVP 301, the course that didn’t meet the criteria during the previous review period with only 70 percent passing the EOC. The pass rate for this course during this review period was 100%.



With the exception of one course, survey results met criteria for 8 out of 9 surveys administered

(Criteria 4, 6, 9 & 10). Survey results for criterion 5 were not met at 79%. Compared to the previous reporting period, responses were down for the three FAA 14 CFR Part 141 courses (AVP 142, 242 and 354) and the three AVP 337 sections (average), but were slightly up for the AVP 340 sections

(average) and the Senior Exit survey. Responses were still very positive with 80% to 97% percent of responses indicating “Agree” or “Strongly Agree” for all surveys administered except for AVP 242. o Survey results dropped for AVP 142: 90% of responses were “agree” or “strongly agree;” last year it was 94%. o Survey results dropped for AVP 242: 79% of responses were “agree” or “strongly agree;” last year it was 86%.

16

Aviation Assessment Report, 12/13/13 o Survey results dropped for AVP 354: 80% of responses were “agree” or “strongly agree;” last year it was 87%. o Average survey results dropped for AVP 337 (three sections): 91% of responses were “agree” or “strongly agree;” last year it was 99%. o Survey results improved slightly for AVP 340 (two sections): 97% of responses were “agree” or “strongly agree;” last year it was 96%. o Senior Exit survey results improved slightly in Spring 2013: 91% of responses were “agree” or

“strongly agree;” last year it was 90%.



Criterion goal 7 was exceeded for students enrolled in AVP 211 and AVP 312. The percentage of students who passed the aviation weather courses with a minimum score of 80 percent increased considerably to 95% of students enrolled in AVP 211 (compared to 83% previous period) but dropped from 95% (previous period) to 88% of students enrolled in AVP 312. This may have to do with moving the AVP 312 course ahead by one quarter (winter to fall) beginning fall 2012. The instructor did not feel the students were as prepared to successfully accomplish the assignments, especially the major cross-country exercise that integrated navigation and weather data, as were previous students who had the benefit of completing AVP 241 (where instrument navigation and IFR weather minimums topics are learned) before taking this course



Criterion goal 8 was exceeded for all 7 senior students enrolled in AVP 489 Turbojet FTD, CRJ-200.

4.

What will the department or program do as a result of that information?



The department will consider either lowering Criterion Goal 1 from 80% to 70% of students attaining a minimum score of 80% on national FAA certification written examination on the first attempt, or consider instituting additional measures to assist students in achieving these goals

(perhaps including these scores in associated course letter grades as extra credit toward letter grade, not necessarily FAA course percentage scores).



The department will also consider using a more experienced instructor to teach AVP 142 (faculty workload permitting).

5.

What did the department or program do in response to last year’s assessment information?

 No major changes were made in response to last year’s assessment information. This is mainly due to the fact that the department was somewhat challenged regarding staffing during the last review period: we lost two of five FT faculty members at Ellensburg, replaced them with two temporary

NTT faculty and spent the year in a search process to fill them as FTTT positions.

 Last year’s assessment report received the highest possible program scores in all five areas in the

2011-2012 Assessment of Student Learning Report: Feedback for the Department of Aviation . There were no suggestions for improvement.

6.

Questions or suggestions concerning Assessment of Student Learning at Central Washington

University:

-none

17

Central Washington University Assessment of Student Learning – Aviation

Central Washington University

Assessment of Student Learning – Aviation

Related documents

Products

Support

Central Washington University Assessment of Student Learning – Aviation

Central Washington University

Assessment of Student Learning – Aviation

Related documents

Add this document to collection(s)

Add this document to saved

Suggest us how to improve StudyLib