Central Washington University Assessment of Student Learning Department and Program Report Academic Year of Report: 2010-2011 Department: Psychology College: COTS Program: MS Experimental Psychology 1. What student learning outcomes were assessed this year, and why? In answering this question, please identify the specific student learning outcomes you assessed this year, reasons for assessing these outcomes, with the outcomes written in clear, measurable terms, and note how the outcomes are linked to department, college and university mission and goals. The MS Experimental Psychology program is committed to a holistic and thorough review of student learning, including program policies, independent faculty assessments of student performance in addition to more traditional student learning objectives. For the 2010-2011, academic year, the MS Experimental Psychology program has decided to assess all seven of our Student Learning Objects (SLOs). Please see Appendix 1 “Psychology Student Learning Outcomes (200708) for a list of these SLOs and a summary of related department, college, and university mission and goals. In 2010-2011, the program allowed the changes made in 2009-2010 to take effect, including improvements to the ABA specialization program, moving the faculty assessments to an on-line format, and recruiting for the next school year. Additionally, the deadline this year was changed to December 2011. It makes more sense to talk about our program in terms of the entire academic year (Fall though Summer) because it keeps cohorts of students together. As such, this is the first assessment report that has allowed an assessment of one full academic year. We see this as an improvement and wanted to use this opportunity to get a clear one-year snapshot of the program. We commend the CWU assessment team for their willingness to make this happen. This is the first year we have used the standardized format adopted by the Psychology Department. Because we employ a number of assessment measures and because we combine assessment of student learning with policy measures that directly effect student performance, this report represents an integration of assessments. For this first assessment with the new format, we wanted to include all seven SLOs as a baseline for future assessments. Through this integration, we hope to make direct changes to the Student Learning Outcomes Assessment Plan for the MS Experimental Psychology program. The Assessment Plan has not been revised since 2007-08 and therefore does not reflect some of our most useful measures of student learning (i.e. Annual Survey of Student Performance). Finally, we want to acknowledge that this report addresses program goals as well as student learning objectives. Therefore, there is much more information in this report than is required or requested by the university. However, we find it helpful to have all of the program assessments and measures of student learning integrated into the same report. For readers who are interested in focusing specifically on the assessment of student learning objectives, please see the following information: Annual Survey of Student Performance (p. 7) Student Learning Objectives (Table 10, pp. 11-18) Annual Survey of Student Performance (Faculty reports, pp. 19-20) Student Learning Objectives (SLOs) (pp. 20-22) What will the department or program do as a result of that information? (p. 22) What did the department or program do in response to last year’s assessment information? (pp. 23-24) Brief Program Overview As a very brief overview, the MS Experimental Psychology program differs from other graduate degree programs in psychology due to two distinct specializations: General Experimental Psychology and Applied Behavior Analysis. While these specializations overlap in terms of core 1 courses, they have very different short-term and long-term goals. The General Experimental Psychology specialization typically attracts students with a primary interest in research. Although not all applicants do so, the majority apply to our program with the intention of continuing their education at the doctoral level. The range of interests within this group is extremely broad, and includes cognitive neuroscience, brain-based behavior, animal behavior (e.g. avian, canine, primate), learning and memory, health psychology, and internet-based/social media research (to name only a few). The Applied Behavior Analysis specialization is primarily a terminal degree program designed to prepare students to sit for the Board Certified Behavior Analyst exam. While some graduates may go one to doctoral-level study, the majority go on to direct employment with community service agencies, private schools and/or school districts, or with business consulting agencies. Due to these differences, our student needs vary tremendously. Because of the broad spectrum of specialty areas within the program, there is no single rubric for assessing student learning. However, the one defining feature of both specializations is the focus on empirical, scientific evidence. This focus on data and research makes the master’s thesis process one of the best mechanisms for evaluating whether students in both specializations are making meaningful progress toward developing skills that are highly relevant for their disciplines. As such, the thesis process was identified early on as having key components critical to the assessment process. Nevertheless, additional assessment methods have also been employed in an attempt to develop a clear picture of how our students are doing in their graduate training program. 2. How were they assessed? In answering these questions, please concisely describe the specific methods used in assessing candidate learning. Please also specify the population assessed, when the assessment took place, and the standard of mastery (criterion) against which you will compare your assessment results. If appropriate, please list survey or questionnaire response rate from total population. A) What methods were used? B) Who was assessed? C) When was it assessed? Please see Appendix 1 “Psychology Student Learning Outcomes (2007-08) for a summary of methods employed, which students were assessed, and when the assessments took place. A variety of methods were employed to gather relevant data on student learning. In most cases, the data were restricted to graduate students. Only those graduate students in their first or second year in the program are assessed annually. Third year students and beyond typically are working on their master’s thesis or on internship, or both. Typically they are not enrolled in formal classes; as such we simply track their progress/activity but do not include them in the GPA and grades assessments. Several sources of information were used to compile this report. - Psychology Department Student files o Admissions materials o Courses of Study o Option Approval Forms o Independent Study and Cooperative Education forms o Miscellaneous communications - Unofficial transcripts o Enrollment Information o Quarterly GPA o Credits and grades for individual courses - Annual Survey of Student Progress (given to faculty at the end of every spring quarter). - MS Experimental Psychology Student Learning Objectives (see attached) 2 A. CLASS DEMOGRAPHICS: Only those graduate students in their first or second year in the program are assessed annually for demographics. Department records were used to identify the needed information in the Fall 2011. Student academic records/files were tracked/reviewed for: 1. Number of students admitted to the program 2. Incoming GPA and GRE Scores 3. Academic/Thesis Advisor assignments 4 Number of prerequisite courses required upon entry 5. Total Number of MS Exp Psych students by year 6. Time to Completion B. ANNUAL SURVEY OF STUDENT PERFORMANCE: All active MS Experimental Psychology students (N=32) were reviewed, by the faculty, using an on-line survey administered in Spring 2011. Of the 12 faculty invited to participate, a total of 6 faculty responded. Students could be reviewed by more than one instructor or by the same instructor more than once (for different classes). Each assessment was independent and based on one instructor for a single course. We tracked faculty ratings for the graduate students in the program on 11 different dimensions: SURVEY ITEMS Overall academic performance Mastery of Content Knowledge Analytical Skills (Quantitative) Analytical Skills (Logical) Comprehension Skills Expressive Skills (Written) Expressive Skills (Verbal) Appreciation for Empirical Evidence Potential Success in Program Attitude and Disposition C. COURSE OFFERINGS AND ENROLLMENTS: Course offerings and enrollments reported for 20102011 are reported for MS Experimental Psychology students only. Other students may have also been enrolled. Data are based on the Annual Survey of Student Performance. Course PSY504 PSY 505 PSY 541 PSY 550 PSY 551 PSY 553 PSY 554 PSY 555 PSY 558 PSY 52 Title Thesis Management Psychology Colloquium Adv Cognitive Psychology Research in Natural Environments Behavior Analysis Single-Subject Design Behavioral Interventions Design and Analysis Advanced Statistics Adv Principles of Learning 3 PSY 576 PSY 578 PSY 580 PSY 587 PSY 651 PSY 684 PSY 595 PSY 700 Comparative Psychology Applied Physiological Psychology Current Issues in Psychology Ethics in Exp Psych and ABA Adv Applied Behavior Analysis Internship in Applied Exp Psych Graduate Research Thesis D. PROGRAM BENCHMARKS: Data are based on the Annual Survey of Student Performance. Thesis advisors identified those students who have completed the following in 2010-2011: HSRC Approval IACUC Approval Content Coursework Completed Has taught a class Was a GTA Attended a professional conference Presented Thesis Data professionally Thesis Defense meeting E. TIME TO COMPLETION: Data related to time to completion have been gathered on MS Experimental Psychology students since 2001. Data are based on student unofficial transcripts. F. STUDENT LEARNING OBJECTIVES: Finally, see Appendix 1 “Psychology Student Learning Outcomes for 2010-2011” for a summary of the criteria used to assess SLOs, a list of the classes in which students were assessed. Also outline is the relationship between program SLOs, program goals, related departmental goal, related college goals and related university goals. 4 3. What was learned? In answering this question, please report results in specific qualitative or quantitative terms, with the results linked to the outcomes you assessed, and compared to the standard of mastery (criterion) you noted above. Please also include a concise interpretation or analysis of the results. Ten new students were admitted to the MS Experimental Psychology program this year. Six females and four males. Five were accepted into the General Experimental specialization; five were admitted to the ABA specialization. However, one student changed from the general experimental specialization to the ABA specialization resulting in a 4:6 split, respectively. By the end of winter quarter, three students had left the program withdrew or on-leave), resulting in a final 3:4 split between the two specializations respectively. Note that all students are included in the academic demographic. A. Class Demographics Table 1. Average GPA and GRE scores for incoming graduate students for the last 3 years. Academic Year 2008-2009 GPA GRE-Quant GRE-Total 3.4 625 625 2009-2010 3.53 585 585 2010-2011 3.54 495 495 Table 2. Enrollments made and accepted per academic year and assignments to advisors. 20072008 0 20092010 0 20102011 0 1 2 1 n/a 2 (-1) 1 M. Jensvold (CHCI) 3 0 0 S. Lonborg 0 2 1 M. Matheson 0 1 (-1) 0 D. Polage n/a 1 0 S. Schepman* n/a n/a n/a E. Street† n/a n/a 3 0 2 4 n/a 3 (-1) n/a Academic Advisor M. Fallshore (.5) K. Gabriel R. Greenwald W. Williams† R. Zayac † ABA & Gen Exp Psy program faculty Department Co-chair Table 3. Number of students entering the program with prerequisite courses needed. Academic Year PSY 300 PSY 362 PSY 363 PSY 301* 2007-2008 N/A 0 1 0 2008-2009 N/A 0 1 0 2009-2010 0 0 2 0 2010-2011 1 1 1 1 5 * PSY 301 is required only for ABA specialization students Table 4. Number of students meeting program, departmental and graduate school benchmarks Benchmark 2010-2011 2009-2010 Total/Target Students enrolled Course of Study Approvals on file 10 (100%) 10 (100%) 20 (100%) 10 (100%) 10 (100%) 20 (100%) COS forms approved in 1st quarter 10 (100%) 10 (100%) 20 (100%) Option Approval Forms on file 3 (30%) 10 (100%) 13 (65%) n/a 2* (20%) 2* (20%) n/a 2* (100%) 2* (100%) Thesis Defense meetings Theses Accepted by Graduate School * One additional student from an earlier cohort also defended and had her thesis accepted by the graduate school. A total of three MS degrees were conferred in Experimental Psychology in 2010-2011. Table 5. Number of currently active graduate students relative to total number of students initially admitted per year. 2007-2008 1/5 2008-2009 4/8 2009-2010 10/13 6 2010-2011 10/10 B. ANNUAL SURVEY OF STUDENT PERFORMANCE Table 6. Annual Survey of Student Performance Summary Superior Good Adequate Less than adequate Poor Insufficient knowledge Overall academic performance 30 (57.7%) 18 (34.6%) 4 (7.7%) 0 0 0 Mastery of Content Knowledge 27 (51.9%) 21 (40.4%) 4 (7.7%) 0 0 0 Analytical Skills (Quantitative) 19 (36.5%) 19 (36.5%) 2 (3.8%) 1 (1.9%) 0 11 (21.2%) Analytical Skills (Logical) 35 (67.3%) 13 (25.0%) 4 (7.7%) 0 0 0 Comprehension Skills 30 (57.7%) 20 (38.5%) 2 (3.8%) 0 0 0 Expressive Skills (Written) 32 (61.5%) 16 (30.8%) 2 (3.8%) 0 1 (1.9) 1 (1.9) Expressive Skills (Verbal) 26 (50.0%) 20 (38.5%) 4 (7.7%) 1 (1.9%) 0 1 (1.9) Appreciation for Empirical Evidence 40 (76.9%) 10 (19.2%) 1 (1.9%) 0 0 1 (1.9) Potential Success in Program 30 (57.7%) 17 (32.7%) 2 (3.8%) 1 (1.9%) 1 (1.9) 1 (1.9) Attitude and Disposition 24 (46.2%) 21 (40.4%) 4 (7.7%) 2 (3.8%) 0 1 (1.9) 7 C. COURSE OFFEREINGS AND ENROLLMENTS Table 7. Course Offering and Enrollment Summary: Data derived from Annual Survey of Student Performance Course Title PSY504 PSY 505 PSY 541 PSY 550 PSY 551 PSY 553 PSY 554 PSY 555 PSY 558 PSY 562 PSY 576 PSY 578 PSY 580 PSY 587 PSY 651 PSY 684 PSY 595 PSY 700 Thesis Management Psychology Colloquium Adv Cognitive Psychology Research in Natural Environments Behavior Analysis Single-Subject Design Behavioral Interventions Design and Analysis Adv Statistics Adv Principles of Learning Comparative Psychology Applied Physiological Psychology Current Issues in Psychology Ethics in Exp Psych and ABA Adv Applied Behavior Analysis Internship in Applied Exp Psych Graduate Research Thesis 8 Offered in 2010-2011 yes no no yes yes yes no no no yes yes yes no yes yes no yes yes Number of MS Exp Psy Students 8 0 0 12 12 6 0 0 0 7 5 9 0 1 8 0 17 6 D. PROGRAM BENCHMARKS (as reported by faculty) Table 8. Benchmark Summary: Data derived from Annual Survey of Student Performance Benchmark Faculty Reports (n) 3 0 5 1 7 5 1 1 HSRC Approval IACUC Approval Content Coursework Completed Has taught a class Was a GTA Attended a professional conference Presented Thesis Data professionally Thesis Defense meeting 9 Percent of Total Faculty Reports (%) (5.8%) (0.0%) (9.6%) (1.9%) (13.5%) (9.6%) (1.9%) (1.9%) E. Time-to-Completion Table 9. Time-to-Completion data for students in the MS Experimental psychology program. Data go back to graduates from 2008. Graduates from 2010-2011 are listed at the bottom. Student/ Advisor Program Redfield (Williams) Todd (Fallshore) Manjarrez (Eubanks) Tate (Stahelski) Rutledge (Gabriel) Mack (Matheson) Buckner (Jensvold) Stadner (Jensvold) Jones (Matheson) Sherril (Matheson) Potosky (Jensvold) Crnich (Matheson) Thygesen (Williams) Puffer (Matheson) Scott (Williams) MS Gen Exp Metzler (Jensvold) James (Gabriel) MS Gen Exp Dodgen (Polage) MS Gen Exp MS Gen Exp MS Gen Exp MS Gen Exp MS Gen Exp MS Gen Exp MS Gen Exp MS Gen Exp MS Gen Exp MS Gen Exp MS Gen Exp MS Gen Exp MS Gen Exp MS Gen Exp MS Gen Exp MS Gen Exp Year Enrolled Fall 2005 Fall 2002 Fall 2001 Fall 2004 Fall 2007 Fall 2005 Fall 2002 Fall 2005 Fall 2006 Fall 2005 Fall 2007 Winter 2009 Fall 2008 Fall 2004 Fall 2005 Fall 2007 Fall 2009 Fall 2009 Mean Year Completed Winter 2008 Spring 2008 Summer 2008 Spring 2009 Summer 2009 Summer 2009 Fall 2009 Winter 2010 Winter 2010 Spring 2010 Summer 2010 Summer 2010 Summer 2010 Summer 2010 Summer 2010 Fall 2010 Time-toCompletion 2.5 Summer 2011 Summer 2011 2 4.75 7.25 5.75 2.25 4 6.25 4.5 4.5 5.75 4.25 1.5 2.25 6.25 5.25 4.25 2 4.18 10 F. STUDENT LEARNING OBJECTIVES (SLOs) Table 10. SLO Assessment Summary Student Learning Outcomes Criterion of Mastery Assessment Results 1. Write in the language of the discipline, using the elements of style described in the Publication Manual of the American Psychological Association. GPA above 3.0 and no grade lower than a C in required core content and elective classes on student’s course of study form. Ten second-year students (100%) received a 3.0 or higher overall in 2010-2011. The average GPA for the year was 3.70. • The average GPA in Fall 2010 was 3.52; only one student failed to earn a 3.0. • The average GPA in Winter 2011 was 3.70; all students earn a 3.0 or higher. • The average GPA in Spring 2011 was 3.96; all students earn a 3.0 or higher. Only one student attended summer school; she earned a 4.0. Ten first-year students (100%) received a 3.0 or higher overall in 2010-2011. The average GPA for the year was 3.78. • The average GPA in Fall 2010 was 3.71; only one student failed to earn a 3.0. • The average GPA in Winter 2011 was 3.79; all students earn a 3.0 or higher. • The average GPA in Spring 2011 was 3.83; all students earn a 3.0 or higher. Three students attended summer school; they all earned above a 3.0; the average GPA was 3.97. Successful completion and approval of the thesis proposal as signified by the signing of the option approval form by the thesis committee. Ten second-year students (100%) and ten first-year students (100%) have approved course of study forms. In both cases, COS forms were submitted in the first quarter of the students’ first year in the program. Successful approval of research proposals by IACUC or HSRC committees, when relevant. Faculty reported that three HSRC protocols were submitted and accepted. HSRC approvals are not maintained in student files. Therefore, we must rely on faculty reports. Successful defense of the thesis as signified by the signing of the thesis signature pages by the thesis chair and committee. This item cannot be tracked independently of the acceptance of the thesis by the graduate school. Two (20%) second-year students successfully defended their theses. Successful acceptance of the written thesis by the graduate school. Of the two students who successfully defended their theses, both (100%) theses were accepted by the graduate school. A third student from a previous cohort also finished her thesis. Degrees for all 3 students were posted officially in 20102011. Additional Indicators Written expressive skills were assessed by faculty in the Annual Survey of Student Progress. Thirty two (61.5%) of the faulty evaluations for this item were rated as superior; Sixteen (30.8%) were rated as 11 2. Describe and perform data analyses for particular data sets such as traditional descriptive statistical analyses, inferential statistical analyses, sequential analyses, singlesubject designs and/or multivariate analyses. GPA above 3.0 and no grade lower than a C in required core content and elective classes on student’s course of study form good; Two (3.8%) were rated as adequate. Only one comment (1.9%) was rated as poor. SAME AS #1 Ten second-year students (100%) received a 3.0 or higher overall in 2010-2011. The average GPA for the year was 3.70. • The average GPA in Fall 2010 was 3.52; only one student failed to earn a 3.0. • The average GPA in Winter 2011 was 3.70; all students earn a 3.0 or higher. • The average GPA in Spring 2011 was 3.96; all students earn a 3.0 or higher. Only one student attended summer school; she earned a 4.0. Ten first-year students (100%) received a 3.0 or higher overall in 2010-2011. The average GPA for the year was 3.78. • The average GPA in Fall 2010 was 3.71; only one student failed to earn a 3.0. • The average GPA in Winter 2011 was 3.79; all students earn a 3.0 or higher. • The average GPA in Spring 2011 was 3.83; all students earn a 3.0 or higher. Three students attended summer school; they all earned above a 3.0; the average GPA was 3.97. Successful defense of the thesis as signified by the signing of the thesis signature pages by the thesis chair and committee. SAME AS #1 Two (20%) second-year students successfully defended their theses. Successful acceptance of the written thesis by the graduate school. SAME AS #1 100% of theses submitted (N=3) were accepted by the graduate school. Degrees were posted officially in 2010-2011. Additional indicators Quantitative analytical skills were assessed by faculty in the Annual Survey of Student Progress. Nineteen (35%) of faulty evaluations were rated as superior; An equal number (36.5%) were rated as good; Two (3.8%) were rated as adequate. Only one comment (1.9%) was rated as less than adequate. Logic-based analytical skills were assessed by faculty in the Annual Survey of Student Progress. 100% of faculty comments were rated as adequate or better. Thirty five (67.3%) faculty evaluations were rated as superior; Thirteen (25%) were rated as good; Four (7.7%) were rated as adequate. 12 3. Describe, assess and utilize common research designs in psychology. GPA above 3.0 and no grade lower than a C in required core content and elective classes on student’s course of study form. SAME AS #1 Ten second-year students (100%) received a 3.0 or higher overall in 2010-2011. The average GPA for the year was 3.70. • The average GPA in Fall 2010 was 3.52; only one student failed to earn a 3.0. • The average GPA in Winter 2011 was 3.70; all students earn a 3.0 or higher. • The average GPA in Spring 2011 was 3.96; all students earn a 3.0 or higher. Only one student attended summer school; she earned a 4.0. Ten first-year students (100%) received a 3.0 or higher overall in 2010-2011. The average GPA for the year was 3.78. • The average GPA in Fall 2010 was 3.71; only one student failed to earn a 3.0. • The average GPA in Winter 2011 was 3.79; all students earn a 3.0 or higher. • The average GPA in Spring 2011 was 3.83; all students earn a 3.0 or higher. Three students attended summer school; they all earned above a 3.0; the average GPA was 3.97. Successful defense of the thesis as signified by the signing of the thesis signature pages by the thesis chair and committee. SAME AS #1 Two (20%) second-year students successfully defended their theses. Additional Indicators Mastery of content knowledge was assessed by faculty in the Annual Survey of Student Progress. This skill requires fluency with research design. 100% of faculty comments rated student mastery of content as adequate or higher. Twenty seven comments (57.7%) rated the students’ mastery of content knowledge as superior; Twenty one (40.4%) rated them as good; four (7.7%) rated them as adequate. Comprehension was also assessed by faculty in the Annual Survey of Student Progress. This skill requires fluency with research design as well. 100% of faculty comments rated student mastery of content as adequate or higher. Thirty comments (57.7%) rated the students’ comprehension as superior; Twenty (38.5%) rated them as good; Two (3.8%) rated them as adequate. 4. Design, conduct, and report psychological research. GPA above 3.0 and no grade lower than a C in required core content and 13 SAME AS #1 Ten second-year students (100%) received a 3.0 or higher overall in 2010-2011. The elective classes on student’s course of study form average GPA for the year was 3.70. • The average GPA in Fall 2010 was 3.52; only one student failed to earn a 3.0. • The average GPA in Winter 2011 was 3.70; all students earn a 3.0 or higher. • The average GPA in Spring 2011 was 3.96; all students earn a 3.0 or higher. Only one student attended summer school; she earned a 4.0. Ten first-year students (100%) received a 3.0 or higher overall in 2010-2011. The average GPA for the year was 3.78. • The average GPA in Fall 2010 was 3.71; only one student failed to earn a 3.0. • The average GPA in Winter 2011 was 3.79; all students earn a 3.0 or higher. • The average GPA in Spring 2011 was 3.83; all students earn a 3.0 or higher. Three students attended summer school; they all earned above a 3.0; the average GPA was 3.97. Successful completion and approval of the thesis proposal as signified by the signing of the option approval form by the thesis committee. Successful defense of the thesis as signified by the signing of the thesis signature pages by the thesis chair and committee. Proposal meetings are formally tied to the Option Approval Form which is typically signed at the end the proposal meeting. By 2010-2011, all ten (100%) of second year students had option approval forms signed. Only three (30%) of first-years students had option approval forms signed in 2010-2011. SAME AS #1 Two (20%) second-year students successfully defended their theses. Successful acceptance of the written thesis by the graduate school SAME AS #1 100% of theses submitted (N=3) were accepted by the graduate school. Degrees were posted officially in 2010-2011. Additional indicators Appreciation for empirical evidence was assessed by faculty in the Annual Survey of Student Progress. This skill overlaps with the ability to design, conduct and report on complex scientific findings. 100% of faculty comments were rated as adequate or better. Forty (76.9%) of the faulty evaluations for this item were rated as superior; Ten (19.2%) were rated as good; One (1.9%) were rated as adequate. SAME AS #1 Written expressive skills were assessed by faculty in the Annual Survey of Student Progress. This skill overlaps with the 14 ability to design, conduct and report on complex scientific findings. Thirty two (61.5%) of the faulty evaluations for this item were rated as superior; Sixteen (30.8%) were rated as good; Two (3.8%) were rated as adequate. Only one comment (1.9%) was rated as poor. SAME AS #2 Quantitative analytical skills were assessed by faculty in the Annual Survey of Student Progress. This skill overlaps with the ability to design, conduct and report on complex scientific findings. Nineteen (35%) of faulty evaluations were rated as superior; An equal number (36.5%) were rated as good; Two (3.8%) were rated as adequate. Only one comment (1.9%) was rated as less than adequate. SAME AS #2 Logic-based analytical skills were assessed by faculty in the Annual Survey of Student Progress. This skill overlaps with the ability to design, conduct and report on complex scientific findings. 100% of faculty comments were rated as adequate or better. Thirty five (67.3%) faculty evaluations were rated as superior; Thirteen (25%) were rated as good; Four (7.7%) were rated as adequate. Same as #3 Mastery of content knowledge was assessed by faculty in the Annual Survey of Student Progress. This skill overlaps with the ability to design, conduct and report on complex scientific findings. 100% of faculty comments rated student mastery of content as adequate or higher. Twenty seven comments (57.7%) rated the students’ mastery of content knowledge as superior; Twenty one (40.4%) rated them as good; four (7.7%) rated them as adequate. Same as #3 Comprehension was also assessed by faculty in the Annual Survey of Student Progress. This skill overlaps with the ability to design, conduct and report on complex scientific findings. 100% of faculty comments rated student mastery of content as adequate or higher. Thirty comments (57.7%) rated the students’ comprehension as superior; Twenty (38.5%) rated them as good; Two (3.8%) rated them as adequate. 15 5. Describe and contrast major theoretical and practical concepts in core content areas of research including behavior analysis, cognitive psychology, comparative psychology, and/or physiological psychology. GPA above 3.0 and no grade lower than a C in required core content and elective classes on student’s course of study form. SAME AS #1 Ten second-year students (100%) received a 3.0 or higher overall in 2010-2011. The average GPA for the year was 3.70. • The average GPA in Fall 2010 was 3.52; only one student failed to earn a 3.0. • The average GPA in Winter 2011 was 3.70; all students earn a 3.0 or higher. • The average GPA in Spring 2011 was 3.96; all students earn a 3.0 or higher. Only one student attended summer school; she earned a 4.0. Ten first-year students (100%) received a 3.0 or higher overall in 2010-2011. The average GPA for the year was 3.78. • The average GPA in Fall 2010 was 3.71; only one student failed to earn a 3.0. • The average GPA in Winter 2011 was 3.79; all students earn a 3.0 or higher. • The average GPA in Spring 2011 was 3.83; all students earn a 3.0 or higher. Three students attended summer school; they all earned above a 3.0; the average GPA was 3.97. Additional indicators Expressive Verbal Skills were assessed by faculty in the Annual Survey of Student Progress. The ability to understand and express oneself in class in important to describing and contrasting content knowledge. Thirty-two comments (50%) rated the students’ verbal expression as superior; Twenty (38.5%) rated them as good; four (7.7%) rated them as adequate; one (1.9% rated) them as less than adequate. SAME AS #1 Mastery of content knowledge was assessed by faculty in the Annual Survey of Student Progress. 100% of faculty comments rated student mastery of content as adequate or higher. Twenty seven comments (57.7%) rated the students’ mastery of content knowledge as superior; Twenty one (40.4%) rated them as good; four (7.7%) rated them as adequate. SAME AS #1 Comprehension was also assessed by faculty in the Annual Survey of Student Progress. 100% of faculty comments rated student mastery of content as adequate or higher. Thirty comments (57.7%) rated the students’ comprehension as superior; Twenty (38.5%) rated them as good; Two (3.8%) rated them as adequate. SAME AS #2 Quantitative analytical skills were assessed by faculty in the Annual Survey of 16 Student Progress. Nineteen (35%) of faulty evaluations were rated as superior; An equal number (36.5%) were rated as good; Two (3.8%) were rated as adequate. Only one comment (1.9%) was rated as less than adequate. SAME AS #2 Logic-based analytical skills were assessed by faculty in the Annual Survey of Student Progress. 100% of faculty comments were rated as adequate or better. Thirty five (67.3%) faculty evaluations were rated as superior; Thirteen (25%) were rated as good; Four (7.7%) were rated as adequate. Same as #3 Mastery of content knowledge was assessed by faculty in the Annual Survey of Student Progress. 100% of faculty comments rated student mastery of content as adequate or higher. Twenty seven comments (57.7%) rated the students’ mastery of content knowledge as superior; Twenty one (40.4%) rated them as good; four (7.7%) rated them as adequate. Same as #3 Comprehension was also assessed by faculty in the Annual Survey of Student Progress. 100% of faculty comments rated student mastery of content as adequate or higher. Thirty comments (57.7%) rated the students’ comprehension as superior; Twenty (38.5%) rated them as good; Two (3.8%) rated them as adequate. SAME AS #4 Appreciation for empirical evidence was assessed by faculty in the Annual Survey of Student Progress. This skill overlaps with the ability to design, conduct and report on complex scientific findings. 100% of faculty comments were rated as adequate or better. Forty (76.9%) of the faulty evaluations for this item were rated as superior; Ten (19.2%) were rated as good; One (1.9%) were rated as adequate. 6. Engage in scholarly and professional activities, including presenting research at formal and/or informal professional events GPA above 3.0 and no grade lower than a C in required core content and elective classes on student’s course of study form 17 SAME AS #1 Ten second-year students (100%) received a 3.0 or higher overall in 2010-2011. The average GPA for the year was 3.70. • The average GPA in Fall 2010 was 3.52; only one student failed to earn a 3.0. • The average GPA in Winter 2011 was 3.70; all students earn a 3.0 or higher. • The average GPA in Spring 2011 was 3.96; all students earn a 3.0 or higher. Only one student attended summer school; she earned a 4.0. Ten first-year students (100%) received a 3.0 or higher overall in 2010-2011. The average GPA for the year was 3.78. • The average GPA in Fall 2010 was 3.71; only one student failed to earn a 3.0. • The average GPA in Winter 2011 was 3.79; all students earn a 3.0 or higher. • The average GPA in Spring 2011 was 3.83; all students earn a 3.0 or higher. Three students attended summer school; they all earned above a 3.0; the average GPA was 3.97. Successful oral defense of the master’s thesis SAME AS #1 Two (20%) second-year students successfully defended their theses. . 100% of graduate students will submit thesis research to CWU SOURCE Conference Minimum of 75% of graduate students will submit research proposals to a regional, national or international conference within 1 year of graduation 7. Performing professional skills in a supervised practice setting such as research teams, internships, and graduate research courses. GPA above 3.0 and no grade lower than a C in internships, relevant graduate research courses, and thesis work No data were collected on SOURCE specifically. According to the Annual Survey of Student Progress, five graduate students attended a professional conference and one student presented their data professionally. All of the students were currently enrolled students. No data were collected from or about graduates of the program. No details were gathered on specific conferences. SAME AS #1 Ten second-year students (100%) received a 3.0 or higher overall in 2010-2011. The average GPA for the year was 3.70. • The average GPA in Fall 2010 was 3.52; only one student failed to earn a 3.0. • The average GPA in Winter 2011 was 3.70; all students earn a 3.0 or higher. • The average GPA in Spring 2011 was 3.96; all students earn a 3.0 or higher. Only one student attended summer school; she earned a 4.0. Ten first-year students (100%) received a 3.0 or higher overall in 2010-2011. The average GPA for the year was 3.78. • The average GPA in Fall 2010 was 3.71; only one student failed to earn a 3.0. • The average GPA in Winter 2011 was 3.79; all students earn a 3.0 or higher. • The average GPA in Spring 2011 was 3.83; all students earn a 3.0 or higher. Three students attended summer school; they all earned above a 3.0; the average GPA was 3.97. 18 Three students successfully completed supervised practice credits in PSY 694: Internship in Experimental Psychology and ABA. All three students were ABA specialization students. The three internship sites were: Elmview; the Selah School District; HeadStart. Based on these assessment results we can draw the following conclusions: A. Class Demographics • Overall admission goals for incoming students continue to be met. Undergraduate GPA and GRE scores generally exceed our minimum requirements. One exception was due to a miscommunication on the part of the special Education program. Their website has been corrected and we do not anticipate more such exceptions. • Whereas some faculty tend to accept at least one incoming student annually, there are others who accept many more. This is typical for Drs. Street and Williams who are the primary advisors for the ABA program. Dr. Williams accepts animal behavior students in experimental psychology as well. TAs the ABA program grows, at least one more BCBA faculty will be needed to manage the student-advising load. • Some faculty do not accept students every year. This suggests additional recruiting efforts may be needed. • Prerequisite courses do not appear to be a problem, except for students applying to the ABA specialization from degree programs other than psychology, such as Education. Advanced statistics (Psy 363) is also a course that occasionally appears as a needed prerequisite. Identification of prerequisites earlier in the admission process would allow incoming student to consider summer school as an option. • Program, departmental and graduate school benchmarks are generally being met; however, the goal to have an option approval form completed by the end of the first year may be overly ambitious. Recommend continuing to watch this one item for trends. • Three students graduated in 2010-2011. Our remaining graduate student base is heavily weighted toward the most recent two years. This is a huge improvement relative to previous years. A large backlog of Nth year students have completed the program (or withdrawn). However, it is important to note that 2011-2012 will be the first year where ABA students will engage in internships off-site. This may slow the 2-year process down for them; three years may be a more appropriate goal for them. • The average time to completion since 2008 is 4.18 years. However, it is important to note that this year two of the students completed the program in 2 years. Both were general experimental psychology students. With recent changes to the program, it will be important to continue to track time to completion in order to find ways to help students through the thesis process. B. Annual Survey of Student Performance (Faculty reports) • In the areas of overall performance, mastery of content knowledge, analytical skills (logical) and comprehension, the faculty reported 100% of the graduate students in their courses were reaching adequate or better achievement. • In the area of analytical skills (quantitative and logical), faculty reported that 93% and 100% of the students assessed (N=41) had reached adequate or better levels of mastery, respectively. Only 3 and 4 student reports fell below the good/superior range, respectively • In the area of expressive skills, written skills appear to be slightly stronger than verbal skills but most student assessments fall above the level of Adequate. More effort may need to made to help students develop their verbal skills (e.g. class presentations, teaching, conferences). • The highest assessment rating was for Appreciation of Empirical Evidence. 100% of those assessed, rate as adequate or higher. More than 75% of the assessments reached the superior range. Another 19.2% were rated as good. • Although limited to only a few observations, there is a concern that several students may not succeed in the program. However, three first-year students, and one second-year student have already left the program or taken an extended leave of absence. One of the students for whom a concern was raised has left the program. The other student remains for whom concerns were raised. She has now completed her coursework with 19 3.321 GPA and is on ABA internship (off site) as of Fall 2011. As with many in her ABA cohort, she has yet to complete a thesis proposal. A meeting with her thesis advisor and/or the program director is warranted. • An overwhelming majority of observations by faculty suggest the development of good/superior development of dispositions appropriate to Experimental Psychologists among the 2 student cohorts. • We would like our students to present course content and/or original research in classes or professional conferences. Conference attendance is low than we would like, but having the opportunity to teach is even lower. C. Course Offerings and Enrollment • Some classes are offered in alternate years to ensure adequate enrollments. This is critical for both ensuring adequate class size for both FTE and experiential reasons. • Whereas some enrollments appear to be slightly lower than others, many such courses are service/required courses for other psychology graduate programs, and/or for other graduate programs on campus. So the reported numbers only identify the number of MS Experimental Psychology students enrolled in a course, they do not reflect total enrollments. • All ABA courses are offered every year to ensure that students can leave Ellensburg for their 1-year internship. D. Program, Departmental and Graduate School Benchmarks. • Enrollment has not increased in the last year. • Students are meeting with faculty early in the first quarter to complete the Course of Study form. This is especially important for students relying on financial aid. • Course of study forms are being approved in a timely manner as well. • Option approval forms are not being submitted as quickly as planned. It may well be that the goal to complete a proposal and the option approval form by the end of the first year is overly ambitious. • HSRC and IACUC approvals are not documented formally. This dependent measure is obtained only indirectly. • Our MS Experimental Psychology graduate students are not getting an opportunity to teach. • We would like our students to present course content and/or original research in classes or professional conferences. But conference attendance is lower than we would like, and having the opportunity to teach is even lower. • Thesis defense meetings are very difficult to track. There is no formalized procedure for documenting the meeting in the student’s departmental file. Measurement of this criterion is indirect and needs to be addressed. • Two second-year students earned their degrees. Two additional students from previous years also had their theses accepted by the graduate school. E. Time to Completion • Although the General MS Experimental program is only 48 credits, the mean time to completion is 4.18 years. • It appears that progress through the thesis process (e.g. proposal, HSRC/IACUC approval, data collection and thesis defense) requires more than 2 years. • No ABA students have finished the program but 2 students have been in the program for 4 years, and two have been in the program for 3 years. Three are expected to finish in 2011-2012. One student is working without having completed his thesis and appears to be making no progress. • An adjusted expectation of 2-3 years for the ABA program seems appropriate. F. Student Learning Objectives (SLOs) 1. Write in the language of the discipline. • It appears that nearly all of our students are acquiring the necessary writing skills based on GPA, proposal/option approval completion, thesis completion and faculty assessments. • For both first- and second-year students in the program, GPAs remain well above the 3.0 requirement. 20 • No students earned less than a C in their coursework. • All second year students have completed a proposal and option approval form. (Correction to SLO needed) • Four students completed the writing of their theses, defended and had their papers accepted by the graduate school. No students failed to have their thesis approved. • Progress through the thesis process continues to be slow in general. Lack of writing/organizational skills may be part of the problem. The new Psychology Colloquium class may help offset this challenge as thesis management techniques may be moved into the PSY 505 course in the future. 2. Describe and perform data analyses • Students are acquiring the quantitative and logical skills as expected. A few students continue to need more experience (namely thesis work) to achieve mastery. • For both first- and second-year students in the program, GPAs remain well above the 3.0 requirement. No students earned less than a C in their coursework. It may be necessary to consider research and design courses independently for this goal to see if improvements can be made there. • For many students, assessment occurs before the analyses of their own thesis data. As such, an entrance/exit exam for research design and statistics may be a viable way to assess mastery. 3. Describe, assess, and utilize research designs. • Students are acquiring the necessary research design skills based on GPA, thesis completion and faculty assessments. • By the end of the fall quarter of their second year, most General Experimental Psychology specialization students have mastered research design sufficiently to propose a thesis. This time line may be delayed 1-yr in the ABA specialization due to the internship requirement. 4. Design, conduct, and report psychological research. • Students are acquiring the necessary skills needed to design, conduct and report on research, based on GPA, proposal/option approval completion, thesis completion and faculty assessments. • All students showed adequate to superior appreciation for empirical evidence- a hallmark of the field. • Three quarters of the students were rated as superior. 5. Content Area Mastery • Students are demonstrating high levels of mastery in experimental psychology content courses, based on GPA, proposal/option approval completion, thesis completion and faculty assessments. • Students have earned GPAs over 3.0 in all course work. • Faculty rank all students as adequate or higher for content mastery, comprehension, expressive (verbal) skills, logic based analytical skills, and appreciation of empirical evidence. All of these are crucial to the ability to contrast theoretical and practical concepts within the field. • Over 70% of students were rated good to superior on quantitative analytical skills. For those who score below the adequate range, a post-thesis exit exam may establish late mastery. 6. Scholarly and Professional Activities. • Students are required to participate in a minimum of two professional meetings: the thesis proposal and the thesis defense. Adequate performance is required for completion of the degree. • The program has set a goal of having 100% of graduate students present their thesis research at the CWU Source conference. Two important problems are apparent. First, Source occurs once per year. Students graduate throughout the year. They may not longer be local residents when Source occurs. Many students have relocated and may not consider the travel worthwhile or affordable. We are challenged to make this goal a priority for our students before they leave. Second, we did not gather data specific to SOURCE. this needs to addressed in the Annual Survey of Student Performance. • The program has set a goal of having 75% of graduate students present their thesis research at regional, national or international conferences within one year of graduation. We did have 5 students attend a professional conference but only one presented thesis data. The same issue of travel applies here as well. Even regional conferences can be located at extremely distance sites. Cost and timing are a real limiting factors. 7. Perform Professional Skills in Supervised Practice Settings. 21 • Graduate students in the Applied Behavior Analysis specialization are required to complete 12 credits of supervised Cooperative Education credits as part of their program. As such, 100% of students in this program complete this objective. • Although General Experimental Psychology students have taken advantage of this option in the past, in 2010-2011, none of the Students in the Gen Exp Psy specialization completed an internship or Cooperative Education requirement. 4. What will the department or program do as a result of that information? In answering this question, please note specific changes to your program as they affect student learning, and as they are related to results from the assessment process. If no changes are planned, please describe why no changes are needed. In addition, how will the department report the results and changes to internal and external constituents (e.g., advisory groups, newsletters, forums, etc.). • The MS Exp Psy Program Committee will meet early in January 2012 to develop a plan to revisit and revise the SLO Assessment plan and the mastery criteria. This should be done annually. • Greater attention needs to be paid to narrowing the assessment measures for each SLO to those specific courses that related directly to the learning objectives. • Mastery criteria for each SLO need to be reconsidered and revised to ensure relevancy and accessibility of the data. •Additional measures for each of the SLO need to be considered. Presently, the assessments are tied too closely to course work and Graduate school benchmarks. - Add items from the Annual Faculty Survey of Student Progress - • Active recruiting is critical for the health of the MS Experimental Psychology program. Our target of 6 general experimental students and 6 ABA students has yet to be achieved. • A discussion regarding a pretest/posttest related to research and analytical methods is warranted. • Given the highly variable nature of thesis results, the timing of graduate program completion, and the constraints on professional travel for students who have already graduated, it may be appropriate to consider a more reasonable goals for professional presentations. • Efforts need to be made at the instructor level to give GTAs and other graduate students an opportunity to teach a class so we can more directly assess Verbal Expressive Skills and provide a forum for professional presentations. • Internships for non-ABA students need to be explored directly by the faculty in those fields. • The program needs support from department faculty, the college dean and the university provost to add an additional BCBA-trained faculty member to replace Dr. Zayac. Presently, we are searching for Dr. Libby Street’s replacement, as she will retire at the end of 2012. DR. Zayac’s position was never replaced and the program requires a minimum of three fulltime, tenure track faculty to be truly viable. R. Williams is not a BCBA, and cannot even consider retraining leave without 2 fulltime BCBA colleagues. • With the addition of 1-2 new ABA faculty, it is possible that a pretest-posttest can be developed for the ABA students. It should be based on the content needed for the BACB exam, and it should be given upon arrival in the program and again shortly before program completion. • Surveying internship supervisors may be a good measure of how well our students have mastered the SLOs. • It would be helpful to survey graduates of the program over time. This is particularly true for the BCBA students who will eventually sit for the BCBA exam. Having those data will be invaluable. 22 5. What did the department or program do in response to last year’s assessment information? In answering this question, please describe any changes that have been made to improve student learning based on previous assessment results. Please also discuss any changes you have made to your assessment plan or assessment methods. 1. What student learning outcomes were assessed this year, and why? Score: 2/4 Feedback: This program measured ten (10) student learning outcomes and a number of program goals for the MS in Experimental Psychology. These student outcomes were written in clear, measureable terms and assessed knowledge, skills and attitudes. The last item has been expanded upon from previous reviews. It would be helpful if student learning outcomes were more overtly linked to department, college and university goals in the actual report itself. A simple table could be used to show what student learning goals were measured in that year and how it relates to the overall dept., college, and university goals. An effort to move to a tabled based format was implemented this year. For the time being, adding department, college and university goals in the actual report is beyond the scope of this process. A summary table has been attached but the addition of this content in the body of the report would be arduous and redundant. 2. How were they assessed? Score: 3/4 What methods were used? Who was assessed? When was it assessed? Feedback: The program should be commended for continuing to move away from student grades as a tool of student learning. The use of quarterly surveys was the main method of assessment this cycle. The program would be highly encouraged to also use direct measures (rubrics) in the future. Standards of mastery were provided for the survey data. . The program’s movement to an electronic system of assessment is positive and should prove fruitful in the coming years in terms of tracking and record-keeping. The MS Experimental Committee has discussed the possibility of more direct assessments. This is difficult with a field like experimental psychology. Student interests range from neurocognition, to animal behavior, to applied behavior analysis, to human sexuality and women’s issues, to social psychology, electronic media influences on human behavior; the list is endless. Trying to find or to develop a standardized test or rubric for all content areas is challenging at best: there is no licensing exam or governing body for general experimental psychology. It is possible that a pretest-posttest could be develop related to research methods and various analyses since these are part of the core curriculum. The ABA specialization students will be required to pass the BACB exam but it is not taken until after the student has completed the master’s degree program and 1500 hours of practicum – long after they leave CWU. Discussions with ABA faculty members suggest that a pretest-pottest may be possibly for these students. Also, we have considered tracking our ABA students to keep records on those who do or do not pass the BCBA exam. The electronic assessments were reduced to once a year, due to time constraints. Still the data gathered at the end of the academic year, provides us with the chance to survey faculty who have had with repeated exposure to the students in a variety of venues. This enhances the opportunity to see a broader range of behaviors, skills and dispositions. 3. What was learned (assessment results)? Score: 4/4 Feedback: Results are well organized, explicitly linked to outcomes and compared to an established standard of mastery. However, the program’s use may be narrower in scope and application as a result of the reliance on only survey information. Again, more focused and related direct assessments (project scores, exams, etc.) might provide results that lend themselves to greater continuous improvement and change. Our biggest changes occurred in 2008-2009 with the addition of the on-line survey of faculty. Through this survey, we have learned a great deal about how our faculty perceive our students strengths and weaknesses. We have continued to refine the survey instrument. 23 The undergraduate psychology program has begun a student work portfolio process. The MS Experimental Psychology committee has agreed to observe that process as they work out the kinks. At that point, we plan to revisit the portfolio possibility (possibly next year). It would give us another, more direct measure of student learning. But it does require evaluation of the portfolio – the assessment process needs to be efficient. How that labor is divided will also need to be addressed. Finally, the switch to the new assessment format will help track progress from year to year. 4. What will the department or program do as a result of that information? Score: 2/2 Feedback: The report evidences the consideration of assessment results. The review also notes numerous examples of identified curricular and pedagogical decisions as related to results. The department should be congratulated for continuing to seek improvement with identified challenges. The use of program handouts at conferences is a novel method of communicating with external groups. Possible inclusion of national standards through an association would also provide a needed framework for dissemination of ideas. The program is also encouraged to continue in its efforts to communicate it results with other internal and external groups. 5. How did the department or program make use of the feedback from last year’s assessment? Score: 2/2 Feedback: The review notes continued attention to feedback from assessment results and a strong interest in the assessment process. Again, the program is encouraged to continue to build upon this strong assessment culture as it can be very helpful in the placement of graduates in various educational/professional situations. This feedback from employers and other graduate programs could only strengthen the program and make it more attractive to potential students. Again, the program is encouraged to continue building on the foundation laid in the previous two years and continue to refine the assessment process. Overall, the program has gone to great length to evaluate itself in many ways. The program faculty should be commended for such an effort. The focus on student learning was a part of the overall report (see pages 20-26) completed and relied heavily on survey (indirect) evidence of student learning. The program is encouraged to continue the survey approach while adding more direct evidence in the process. This will provide additional and more focused information by which to make change and improvement. The program is congratulated on its improvement and continued focus on quality. A new program website was constructed for the General Experimental Psychology specialization last year that provide course content; requirements and a list of faculty. The MS Experimental Psychology website is new. The ABA website was updated revised (this will be done again this winter). A graduate handbook for MS Experimental Psychology was created for incoming students. A handbook for the ABA program was also created. Both handbooks provide students with ethical codes (APA and BACB), as well as important administrative information, and codes of conduct. The recommendations regarding national standards are relevant only to the ABA specialization. Information on BACB requirements for coursework, internship hours, academic content allocations, and areas of mastery required for the National Exam are included in the ABA Handbook as well. These two program-specific handbooks were included in the larger Graduate Student Handbooks provided at our new Student Orientation meeting in the fall. The program is also preparing to submit the required application materials for BACB Program Certification as soon as Dr. Street’s replacement has been hired. Program Certification with the BCBA includes being listed on their website as an approved program. This will redirect students to our program website. 6. Questions or suggestions concerning Assessment of Student Learning at Central Washington University: NA 24 Appendix 1: Psychology Student Learning Outcomes (2007-08) Program: MS Experimental Psychology Student Learning Outcomes 1. Write in the language of the discipline, using the elements of style described in the Publication Manual of the American Psychological Association. Related Program Goals Goal 1. Facilitate student progress to advanced levels of knowledge and practice in the methods and ethics of experimental psychology. Goal 5. For appropriate students, provide a foundation of knowledge and skills that supports competence in applied behavioral science positions. Related Departmental Goals Goal 2. Promote excellence in learning to prepare students for careers and advanced study. Goal 5. Support involvement of undergraduate and graduate students in psychological research. Related College Goals Related University Goals Method(s) of Assessment Who Assessed Goals I & II: Maintain and strengthen an outstanding academic and student life at all sites. Goals I & II: Maintain and strengthen an outstanding academic and student life at all sites. Assigned papers or projects in various classes. Graduate students Goal III: Provide for outstanding graduate programs that meet focused regional needs and achieve academic excellence. Goal V: Achieve regional and national prominence for the university. Thesis proposal HSRC or IACUC proposals, if relevant. Thesis document When Assessed Standard of Mastery/ Criterion of Achievement During each academic term of enrollment. GPA above 3.0 and no grade lower than a C in required core content and elective classes on student’s course of study form. At time of presentation of thesis proposal. At the time of HSRC or IACUC submission. Thesis defense Thesis submission to graduate committee and to the graduate school. Goal V: Build partnerships with private, professional, academic, government, and community-based organizations. Successful completion and approval of the thesis proposal as signified by the signing of the course of study form by the thesis committee. Successful approval of research proposals by IACUC or HSRC committees, when relevant. Successful defense of the thesis as signified by the signing of the thesis signature pages by the thesis chair and committee. Successful acceptance of the written thesis by the graduate school. 25 Student Learning Outcomes 2. Describe and perform data analyses for particular data sets such as traditional descriptive statistical analyses, inferential statistical analyses, sequential analyses, single-subject designs and/or multivariate analyses. Related Program Goals Goal 1. Facilitate student progress to advanced levels of knowledge and practice in the methods of experimental psychology. Goal 5. For appropriate students, provide a foundation of knowledge and skills that supports competence in applied behavioral science positions. Related Departmental Goals Goal 2. Promote excellence in learning to prepare students for careers and advanced study. Goal 5. Support involvement of undergraduate and graduate students in psychological research. Related College Goals Related University Goals Method(s) of Assessment Who Assessed Goals I & II: Maintain and strengthen an outstanding academic and student life at all sites. Goals I & II: Maintain and strengthen an outstanding academic and student life at all sites. Assigned papers or projects in various classes, course examinations, and thesis work. Graduate students Goal III: Provide for outstanding graduate programs that meet focused regional needs and achieve academic excellence. Goal V: Achieve regional and national prominence for the university. Goal V: Build partnerships that with private, professional, academic, government, and community-based organizations. 26 When Assessed Standard of Mastery/ Criterion of Achievement PSY 550, 553, 555, 558; 595, 700 GPA above 3.0 and no grade lower than a C in required core content and elective classes on student’s course of study form. Successful defense of the thesis as signified by the signing of the thesis signature pages by the thesis chair and committee. Successful acceptance of the written thesis by the graduate school. Student Learning Outcomes 3. Describe, assess and utilize common research designs in psychology. Related Program Goals Goal 1. Facilitate student progress to advanced levels of knowledge and practice in the methods of experimental psychology. Related Departmental Goals Goal 2. Promote excellence in learning to prepare students for careers and advanced study. Goal 5. Support involvement of undergraduate and graduate students in psychological research. Related College Goals Related University Goals Method(s) of Assessment Who Assessed Goals I & II: Maintain and strengthen an outstanding academic and student life at all sites. Goals I & II: Maintain and strengthen an outstanding academic and student life at all sites. Assigned papers or projects in various classes, course examinations, and thesis work. Graduate students Goal III: Provide for outstanding graduate programs that meet focused regional needs and achieve academic excellence. Goal V: Achieve regional and national prominence for the university. Goal V: Build partnerships that with private, professional, academic, government, and community-based organizations. 27 When Assessed PSYC 550, 553, 555. 558, 595, 700 Standard of Mastery/ Criterion of Achievement GPA above 3.0 and no grade lower than a C in required core content and elective classes on student’s course of study form. Successful defense of the thesis as signified by the signing of the thesis signature pages by the thesis chair and committee. Student Learning Outcomes 4. Design, conduct, and report psychological research. Related Program Goals Goal 1.Facilitate student progress to advanced levels of knowledge and practice in the methods of experimental psychology. Goal 5. For appropriate students, provide a foundation of knowledge and skills that supports competence in applied behavioral science positions. Related Departmental Goals Goal 2. Promote excellence in learning to prepare students for careers and advanced study. Goal 5. Support involvement of undergraduate and graduate students in psychological research. Related College Goals Related University Goals Method(s) of Assessment Who Assessed Goals I & II: Maintain and strengthen an outstanding academic and student life at all sites. Goals I & II: Maintain and strengthen an outstanding academic and student life at all sites. Assigned papers or projects in various classes, course examinations, and thesis work. Graduate students Goal III: Provide for outstanding graduate programs that meet focused regional needs and achieve academic excellence. Goal V: Achieve regional and national prominence for the university. When Assessed Standard of Mastery/ Criterion of Achievement PSY 550, 555, 553, 558, 595, 700 GPA above 3.0 and no grade lower than a C in selected design and analysis classes on student’s course of study form. Successful completion and approval of the thesis proposal as signified by the signing of the course of study form by the thesis committee. Successful defense of the thesis as signified by the signing of the thesis signature pages by the thesis chair and committee. Successful acceptance of the written thesis by the graduate school. Goal V: Build partnerships that with private, professional, academic, government, and community-based organizations. 28 Student Learning Outcomes Related Program Goals Related Departmental Goals 5. Describe and contrast major theoretical and practical concepts in core content areas of research including behavior analysis, cognitive psychology, comparative psychology, and/or physiological psychology. Goal 2. Provide a foundation in core areas of experimental psychology that supports the development of competence across a variety of subdisciplines. Goal 2. Promote excellence in learning to prepare students for careers and advanced study. Goal 3.Provide a foundation in areas of research specialization in collaboration with at least one faculty member with interest and expertise. Goal 5. Support involvement of undergraduate and graduate students in psychological research. Related College Goals Related University Goals Method(s) of Assessment Who Assessed Goals I & II: Maintain and strengthen an outstanding academic and student life at all sites Goals I & II: Maintain and strengthen an outstanding academic and student life at all sites. Assigned papers or projects in various classes, course exams, and thesis work. Graduate students Goal III: Provide for outstanding graduate programs that meet focused regional needs and achieve academic excellence. Goal V: Achieve regional and national prominence for the university. Goal V: Build partnerships that with private, professional, academic, government, and community-based organizations. 29 When Assessed Standard of Mastery/ Criterion of Achievement PSY 541, 562, 553, 554, 576, 578, 588. GPA above 3.0 and no grade lower than a C in required core content and elective classes on student’s course of study form. Student Learning Outcomes Related Program Goals Related Departmental Goals 6. Engage in scholarly and professional activities, including presenting research at formal and/or informal professional events. Goal 3.Provide a foundation in areas of research specialization in collaboration with at least one faculty member with interest and expertise. Goal 2. Promote excellence in learning to prepare students for careers and advanced study. Goal 4. Encourage the development of professional competence. Goal 5. For appropriate students, provide a foundation of knowledge and skills that supports competence in applied behavioral science positions. Goal 5. Support involvement of undergraduate and graduate students in psychological research. Related College Goals Related University Goals Method(s) of Assessment Who Assessed Goals I & II: Maintain and strengthen an outstanding academic and student life at all sites. Goals I & II: Maintain and strengthen an outstanding academic and student life at all sites. Assigned presentations in various courses, and the oral thesis defense. Graduate students Goal III: Provide for outstanding graduate programs that meet focused regional needs and achieve academic excellence. Goal V: Achieve regional and national prominence for the university. Goal V: Build partnerships that with private, professional, academic, government, and community-based organizations. 30 Required submission of research to CWU SOURCE Conference. Submission of research to a regional, national or international conference within 1 year of graduation. When Assessed Standard of Mastery/ Criterion of Achievement Various required content and elective courses on the course of study, and GPA above 3.0 and no grade lower than a C in required core content and elective classes on student’s course of study form PSY 700. SOURCE submission deadlines before graduation. External conference submissions within 1 year of graduation. Successful oral defense of the master’s thesis 100% of graduate students will submit thesis research to CWU SOURCE Conference. Minimum of 75% of graduate students will submit research proposals to a regional, national or international conference within 1 year of graduation Student Learning Outcomes Related Program Goals Related Departmental Goals 7. Performing professional skills in a supervised practice setting such as research teams, internships, and graduate research courses. Goal 3.Provide a foundation in areas of research specialization in collaboration with at least one faculty member with interest and expertise. Goal 2. Promote excellence in learning to prepare students for careers and advanced study. Goal 4. Encourage the development of professional competence. Goal 5. For appropriate students, provide a foundation of knowledge and skills that supports competence in applied behavioral science positions. Goal 5. Support involvement of undergraduate and graduate students in psychological research. Related College Goals Related University Goals Goals I & II: Maintain and strengthen an outstanding academic and student life at all sites. Goals I & II: Maintain and strengthen an outstanding academic and student life at all sites. Goal III: Provide for outstanding graduate programs that meet focused regional needs and achieve academic excellence. Goal V: Achieve regional and national prominence for the university. Goal V: Build partnerships that with private, professional, academic, government, and community-based organizations. 31 Method(s) of Assessment Who Assessed Internships, Graduate students working in applied settings. supervised field experiences, graduate research courses, and thesis work. When Assessed Psy 684, 595, 700 Standard of Mastery/ Criterion of Achievement GPA above 3.0 and no grade lower than a C in internships, relevant graduate research courses, and thesis work.