SJSU Annual Program Assessment Form Academic Year 2014-2015 Department: Psychology Program: Masters of Science in Industrial and Organizational Psychology College: Social Sciences Website: http://www.sjsu.edu/psych/Graduates/industrialpsych/index.html _ Check here if your website addresses the University Learning Goals. Program Accreditation (if any): Contact Person and Email: Howard Tokunaga, Ph. D. (Program coordinator) (howard.tokunaga@sjsuledu). Report was prepared by Drs. Howard Tokunaga and Megumi Hosoda (megumi.hosoda@sjsu.edu). Date of Report: June, 2015 Part A 1. List of Program Learning Outcomes (PLOs) No change Goal1: Students of the program will acquire a base of knowledge about the principles of psychology as they are applied to industrial and organizational settings. Objective 1a: Students will learn core psychological competencies including a. History of I/O psychology and its integration into the broader discipline b. Related fields of psychology (i.e., social psychology, personality psychology, psychometrics, motivation, learning theory) Objective 1b: Students will learn core I/O competencies including: a. Ethical, legal and professional issues b. Measurement of individual differences c. Criterion theory and development d. Job and task analysis e. Employee selection f. Performance appraisal and feedback g. Training and development h. Work motivation i. Attitude theory j. Organization theory k. Organizational development Objective 1c: Students will learn data collection and analysis skills including a. Research methods (i.e., methods, procedures, and techniques used to conduct empirical research in I/O psychology) b. Statistical methods (i.e., techniques used in the analysis of data generated by empirical research) Goal 2: Students of the program will acquire a base of knowledge about the practice of I/O psychology by applying the concepts of I/O psychology to the functioning of organizations Objective 2a: Students will perform professional activities related to I/O psychology, but not limited to: a. Administering employee surveys b. Evaluating organizational interventions c. Conducting job analyses d. Creating selection tests e. Developing performance management systems These PLOs are consistent with Society for Industrial and Organizational Psychology’s Guidelines for Education and Training at the Master’s Level Industrial and Organizational Psychology (1994). Arlington Heights, IL: Author (http://www.siop.org/guidelines.aspx) 2. Map of PLOs to University Learning Goals (ULGs) No Change ULG 1 Specialized knowledge: Depth of knowledge required for a degree, as identified by its program learning outcomes Objective 1a: Students will learn core psychological competencies Objective 1b: Students will learn core I/O competencies Objective 1c: Students will learn data collection and analytical skills ULG 2 Broad integrative knowledge: Mastery in each step of an investigative, creative or practical project (e.g., brainstorming, planning, formulating hypotheses or complex questions, designing, creating, completing, and communicating). An understanding of the implications of results of findings from a particular work in a societal context (e.g., social or economic implications of a scientific finding). ULG 3 Intellectual skills: Fluency in the use of specific theories, tools, technology and graphical representation. Skills and abilities necessary for life-long leaning: critical and creative thinking, effective communication, conscientious information gathering and processing, mastery of quantitative methodologies, and the ability to engage effectively in collaborative activities. ULG 4 Applied knowledge: The ability to integrate theory, practice, and problemsolving to address practical issues. The ability to apply their knowledge and skills to new settings or in addressing complex problems. The ability to work productively as individuals and in groups x x x x x x x x x ULG 5 Social & Global Responsibilities: The ability to act intentionally and ethically to address a global or local problem in an informed manner with a multicultural and historical perspective and a clear understanding of societal and civic responsibilities. Diverse and global perspectives through engagement with the multidimensional SJSU community. Objective 2a: Students will perform professional activities related to I/O psychology x x x Note that I/O psychology is psychology applied to the work setting and takes on a science-practitioner approach. This means that I/O psychology generates scientific knowledge and applies that knowledge to address a real issue or problem in the workplace. Therefore, almost all courses in our program have a theory and application component. In particular, thesis requirements map nicely onto ULG1, ULG2, and LUG3. Furthermore, courses like Psyc249 (Fieldwork in I/O psychology) map onto ULG4. 3. Alignment – Matrix of PLOs to Courses Psyc240 Research design and applied psychometrics Objective 1a: Students will learn core psychological competencies Objective 1b: Students will learn core I/O competencies Objective 1c: Students will learn data collection and analytical skills Objective 2a: Students will perform professional activities related to I/O psychology x x Psyc270 Seminar in I/O psychology Psyc271 Seminar in personnel psychology x X x x Stat235 Multivariate analysis Psyc249 Field work in I/O psychology Psyc272 Training and development in organizations (Elective) Psyc293 Organizational development (Elective) Psyc296 Groups at work (Elective) Psyc299 Master’s thesis or project X x x X x x X X x X (class project) X (class project) X (class project) Although Psyc249 (Fieldwork in I/O psychology) maps directly to Objective 2a, many courses (e.g., Psyc270, Psyc271, Psyc272, Psyc293, Psyc296) have an applied project where students conduct an I/O-related project. 4. Planning – Assessment Schedule We will assess objectives 1a and 1b in Psyc271 (Seminar in personnel psychology) again. 5. Student Experience The program’s PLOs are listed in Psychology department website (http://www.sjsu.edu/psych/Graduates/industrialpsych/PLOs/index.html). As mentioned earlier, these PLOS are consistent with SIOP’s Guidelines for Education and Training at the Master’s Level in Industrial and Organizational Psychology (1994) (http://www.siop.org/guidelines.aspx). These PLOs may not have been communicated to students via every single syllabus. Student feedback is not considered in the creation of the PLOs. Part B 6. Graduation Rates for Total, Non URM and URM students (per program and degree) According to the IEA website (http://www.iea.sjsu.edu/cognos/cgi-bin/cognos.cgi), the number of degrees awarded by MS I/O psychology in the last five years are 2010/2011 8 2011/2012 13 2012/2013 10 2013/2014 5 2014/2015 9 Thus, in the last 5 years, a total of 45 students were awarded with a MS degree. Graduation Rate (%) Graduation Rate (%) 2008 - 2013 89 100 90 90 80 60 54 45 40 20 0 0 2008 2009 2010 2011 Entering Class Year 2012 2013 The above figure shows graduation rates over the last six years. The average graduation rate is 61.3%, ranging from 0% to 90%. Most students finish their degree within their 3rd year. Many times, an internship turns into a full-time position in an organization, thus, some students take longer than 3 years to complete their thesis. Many of the students in the class of 2013 will graduate in August 2015. 7. Headcounts of program majors and new students (per program and degree) 2011-2012 10 2012-2013 13 2013-14 9 2014-2015 13 A number of students we admit range from 9 to 13 students in a given year. However, for each of the last four years, we have received more than 100 applications for the program. 8. SFR and average section size (per program) A minimum headcount per section is 8. Most of the time, the average headcount per section is higher than 8. Average SFR is about 4 students to 1 faculty advisor. 9. Percentage of tenured/tenure-track instructional faculty (per department) There are three MS I/O faculty. Two are tenured and one is tenure track. Part C 10. Closing the Loop/Recommended Actions The 2013-2014 assessment report indicated the possibility of a mini-course. We have been offering Psyc276 (Groups at Work). This course is an elective course and but we altered this course as consisting of two-mini courses, leadership development and performance management, rather than one course. We altered the purpose of this course to cover current topics that are of value to our students. We started mini-courses’ in order to increase the number of topics students can be exposed to within the program and we will keep offering this mini-course. 11. Assessment Data Assessment data for Objectives 1a and 1b come from Psyc271 (Applied Psychology of Human Resources). An instructor, Altovise Rogers, gave two examinations and six homework assignments throughout the semester to measure the students’ knowledge of various concepts covered in Psyc271 (i.e. legal issues, selection tests, performance appraisal, job analysis, recruitment). Results indicate that 7% received a grade of A+, 57% received a grade of A, and 36% received an a grade of A-, indicating solid performance by the students. Students in Psyc272 (Training and Development) in Fall 2014 developed a Microsoft-Excel training course material for the Industrial-Organizational (I/O) Psychology master’s program. A common refrain that has been uttered by graduates of our master program is that Microsoft Excel skills are greatly needed for I/O professionals in companies today. This was an attempt to supplement all the great preparation that we are giving our students in usage of SPSS, by also providing them with the ability to do data analyses and data visualization in Microsoft Excel as well. The students put the knowledge and skills gained in the course into practice in the building of this training course that would be offered over 2-3 weekends to alumni and graduate students. To collect data that would make this an Excel course that would be suited to solve business problems, students interviewed hiring managers, SJSU alumni, and business professors, to create this training material. They have created surveys to be distributed and worked with on-campus instructional designers to create the training content. Students in the course had very favorable reactions to this applied learning experience. One of the students in class said that “I see a lot of value in what we are doing. My classmates and I benefit from the application of the many Instructional System Design techniques that we are learning in class.” Future trainees will benefit from learning I/O related Excel skills that will help them stand out from the competition when they begin applying for internships. “Personally, I draw great satisfaction from the thought that I’m contributing to the creation of something that will remain at SJSU after I cease to walk its halls!” 12. Analysis Overall, the MS I/O psychology program is doing a great job of meeting its two major goals. These are seen from students’ course performance and a high success rate in securing internship positions, as well as a full-time job in an organization. 13. Proposed changes and goals (if any) Because of favorable reactions from our students, we will keep implementing a mini-course in Psyc276.