Assessment Report Standard Format July 1, 2007 - June 30, 2008 PROGRAM ASSESSED ___Sociology_______________________ ASSESSMENT COORDINATORS: Tracey Steele, Jacqueline Bergdahl and LaFleur Small__ YEAR ____4_____ of a ____4_____YEAR CYCLE 1. ASSESSMENT MEASURES EMPLOYED Briefly describe the assessment measures employed during the year. What was done? An exit survey was crafted for graduating seniors and administered in the fall quarter 2007. The average GPA of graduating seniors was calculated. The number of graduating seniors with a C or better in theory, methods and substantive topics was counted. The number of letters of recommendations written by faculty for students pursuing graduate education was counted. Who participated in the process? The Sociology Graduate Exit Survey was crafted by the 2007-2008 Sociology Curriculum Committee (Durr, Kim and Small). They drew thirty closed-ended questions mainly from the National Survey of Seniors Majoring in Sociology. Faculty members who had graduating sociology seniors in their class administered the exit survey: Durr (SOC306), Kim (SOC345, SOC 406), Shepelak (SOC201), Norris (SOC 457) and Orenstein (SOC 301). The average GPA of graduating seniors was calculated and the number of graduating seniors with a C or better in theory, methods and substantive topics were determined by administrative staff members Schultheis and Zurawka by examining departmental records. The number of letters or recommendation written for students pursuing graduate education was solicited by the current Curriculum committee (Bergdahl, Small and Steele) from departmental faculty by email. What challenges (if any) were encountered? There were several challenges encountered in the assessment plan process. These are discussed in detail in Assessment Plan Compliance. 1 In addition, there was a low response rate on the exit surveys: there were 34 graduating seniors and only 13 surveys were returned. Regarding senior GPA, there were thirteen students identified as graduating sociology seniors by number of hours completed who had GPAs under the minimum required for graduation (2.0). Two separate GPA calculations were calculated, one including and one excluding, these students. This is reported in Assessment Findings. 2. ASSESSMENT FINDINGS List the objectives and outcomes assessed during the year, and briefly describe the findings for each. The learning objectives within the sociology program include: preparing students for employment with substantive content and skill set of the social sciences; preparing students for graduate training; and preparing students with general critical thinking skill set for life-long learning. Based on data from the senior exit survey, six learning outcomes were assessed during the 2007-2008 year: substantive sociological knowledge, research skills, analytical skills, communication skills, ethical and moral awareness skills, and life-long learning orientation. (1) Substantive Sociological Knowledge By the time they graduate, students will demonstrate knowledge of: basic concepts in sociology, the major social institutions, the socialization process, and the theoretical formulations that serve as the foundation of the major. In the exit survey, graduating seniors were asked about substantive knowledge they learned as part of their sociology major. Over half of responding seniors strongly agreed that they learned basic sociological concepts, theories, and other substantive knowledge as part of their sociology major. Most of graduating seniors reported that they learned basic concepts in sociology, including culture, socialization, social institutions, social stratification, or social change (46.2% agree, 53.8% strongly agree), social institutions such as the economy, family, education, courts, or health care and their impact on individual (38.5% agree, 61.5% strongly agree), and the important differences in the life experiences of people as they vary by race, class, gender and other ascribed statuses (38.5% agree, 53.8% strongly agree). Most of graduating seniors also reported that they learned basic theoretical perspectives or paradigms in sociology (39.5% agree, 61.5% strongly agree) and current sociological explanations about a variety of social issues (30.8% agree, 69.2% strongly agree). (2) Research Skills By the time they graduate, students will demonstrate knowledge of basic fundamentals of social statistics and methodology. 2 Most of graduating seniors strongly agreed that they had learned to create a hypothesis with independent and dependent variables (46.2% agree, 53.8% strongly agree) and to gather information to make an argument based on evidence (46.2% agree, 53.8% strongly agree). In contrast, more than half of them agreed that they had learned to use the statistical software, SPSS, to analyze data (38.5% agree, 30.8% strongly agree) and to interpret the SPSS output (30.8% agree, 30.8% strongly agree). More than half of responding seniors agreed that they learned to evaluate the strengths and weaknesses of different research methods for answering specific research questions (46.2% agree, 38.5% strongly agree). (3) Analytical Skills By the time they graduate, students will demonstrate competence in analytical skills. About half of responding seniors strongly agreed that they obtained various analytical skills as part of their sociology major. The same amount of respondents strongly agreed that they developed the ability to apply major sociological concepts and theories to explore social issues (53.8% agree, 46.2% strongly agree), and to analyze social issues from a sociological perspective (46.2% agree, 46.2% strongly agree). Over half of responding seniors strongly agreed that they obtained the ability to develop a point of view on a social issue using reasoning and evidence (46.2% agree, 53.8% strongly agree), and to evaluate propositions or hypotheses and make judgments about them based on evidence (30.8% agree, 61.5% strongly agree). (3) Communication Skills By the time they graduate, students will demonstrate competence in communication skills. Over half of respondents strongly agreed that they obtained the ability to write a report from sociological information (15.4% agree, 61.5% strongly agree), and to organize and express ideas clearly in writing (38.5% agree, 53.8% strongly agree). About half of respondents strongly agree that they obtained the ability to organize and express ideas clearly in oral communication (38.5% agree, 46.2% strongly agree). (4) Ethical and Moral Awareness Skills By the time they graduate, students will demonstrate competence in ethical and moral awareness skills, including the honest portrayal of data. Over half of responding seniors strongly agreed that they learned to identify ethical issues in sociological research as part of their sociology major (38.5% agree, 53.8% strongly agree). (5) Life-Long Learning Orientation By the time they graduate, students will encompass the orientation toward life-long learning. 3 Over half of responding seniors agreed that they obtained the ability to engage in lifelong learning, such as seeking out new knowledge or developing a skill, as part of their sociology major (46.2% agree, 38.5% strongly agree). (8) Overall Program Experiences Most of responding seniors were satisfied with the quality of teaching (53.8% satisfied, 46.2% very satisfied). When they were asked to compare their experiences with sociology faculty with their experiences with the faculty in other departments, graduating seniors rated the quality of sociology faculty in the following manner: 15.4% fair, 53.8% good, and 30.8% excellent. Most of responding seniors were satisfied with the ease they had in getting courses needed to graduate (46.2% satisfied, 30.8% very satisfied). When they were asked to compare their experiences in sociology courses with their experiences in courses offered by other departments, 53.8% of responding seniors evaluated the quality of sociology courses as “good” and another 46.2% as “excellent.” Most of graduating seniors were satisfied with overall program experiences: 92.3% of respondents would recommend the Sociology major at Wright State University to other students. (9) Comments and Suggestions from Graduating Seniors Assessment findings suggest that most of responding seniors were satisfied with sociological knowledge and skills they obtained as part of their sociology major. They were particularly satisfied with the quality of sociology courses and faculty. Many graduating seniors offered positive comments for example, that “professors really do have a passion for sociology and they try to communicate that as best as they can,” “professors are very open-minded and willing to help,” and “advisors make sure that every student is in good standing when it is time for graduation.” Yet, some graduating seniors mentioned weaknesses in regard to advising and curriculum. 10) Advising Some graduating seniors were not satisfied with undergraduate advising (46.2% not satisfied), graduate school advising (23.1% not satisfied), and career advising (15.4% not satisfied). Graduating seniors reported diverse career goals. Some of them plan to build a career in corporations (e.g., human relations) or nonprofit organizations. Others are interested in the field of social services (e.g., human development) or criminal justice (e.g., probation officer). Still others plan on going on to graduate or professional school and further their education. However, some graduating seniors do not have clearly defined career goals yet. For example, a graduating senior said: “I am not exactly sure of my future career goals using my sociology degree.” These seniors wish to know about career options with a BA degree in sociology. 4 Some graduating seniors wished to have had information about classes in advance: “It would be very helpful if we as students would know what classes will be offered or not offered for the following quarter. . . . For seniors, like myself, it would be good to know if a class will or will not be offered for the following term. It would change my class schedule greatly.” In addition, some graduating seniors wished to have had more accurate information about classes they needed to graduate: “I feel like the sociology professors are not all on the same page. I have heard several different answers from several different professors.” 11) Curriculum A graduating senior points out that “strengths of the sociology program would be the variety of classes offered. . . . There are a lot of choices to meet the requirements.” However, some graduating seniors said they did not get the courses they needed to graduate easily. In addition, some graduating seniors wished there were more diverse sociology courses. One suggested that “the program is way too integrated with the CJ major so when asking about SOC programs you’re given the run around between the two majors.” Many graduating seniors made comments on the Research Methods sequence (SOC300, SOC306, and SOC406): “You must develop guidelines for classes that go in order (e.g., SOC306/406). And once those guidelines are developed, they must be used.” Some seniors suggested “students should have to take the Research Methods class as early as possible so it can be applied throughout.” In addition, many graduating seniors were not satisfied with the discrepancies of course requirements between professors who covered the Research Methods sequence: “Personal experience with two different faculty members for each class proved to be a problem. What I was taught and developed in SOC306 did not help me in SOC406. I should have started a project in SOC306 and continued it in SOC406. In my case what I developed in SOC306 did not work in SOC406, I was left high and dry.” 12) Facilities Most graduating seniors were satisfied with the access to necessary technology such as a computer lab (23.1% satisfied, 69.2% very satisfied). 13) Services Some graduating seniors felt that they did not get necessary information easily: “A weakness of the sociology program is the advertisement of things that are available to students. It took me almost two and a half years to realize that there was faculty to talk to about careers and graduate options.” Another graduating senior suggests: “Keep in touch with seniors so that lower level classes won’t fall through the cracks.” 14) Most graduating seniors (96.7%) earned a grade of C or better in key sociology courses. 5 Sociology Seniors earning grade C or better 2007-2008 Fall 2007 Winter 2008 SOC 300 1 of 1 n/a SOC 301 10 of 10 n/a SOC 303 n/a 14 of 14 SOC 306 3 of 3 6 of 6 SOC 406 6 of 7 6 of 6 SOC 442 3 of 3 9 of 9 Spring 2008 4 of 4 10 of 10 2 of 2 2 of 3 8 of 9 4 of 4 15) Graduating seniors had an overall average GPA of 2.519. However, there were thirteen students included who had GPAs below the minimum required by the university for graduation (2.0). The overall GPA of graduating seniors rises to 2.624 when those students are excluded. 16) Faculty wrote a total of 37 letters of recommendation for students going onto graduate education during this assessment period. 3. PROGRAM IMPROVEMENTS List planned or actual changes (if any) to curriculum, teaching methods, facilities, or services that are in response to the assessment findings. Students were not entirely satisfied with the advising they received (see item 10) Advising under Assessment Findings). The current curriculum committee has ensured that core requirements are offered several times a year, with variations in day of week and time of day slots (including evening availability at least annually). All faculty have the proposed course listings early in the year for the purposes of advising. We recently sent out the 2009-2010 draft schedule for advising purposes. As the department transitions to semesters, one of our strategies is to consider designated fall and spring core classes so students will readily know accessibility. Students did not feel prepared as they transitioned from one methods sequence to another (see item 11) Curriculum under Assessment Findings). We have for the past three years included the sequencing of the methods classes to ensure students the opportunity to take the same professor for both the 306 and 406 methods classes from one quarter to the next. For example, Dr. Lahm in teaching 306 Fall 2008 and then 406 in Winter 2009, while Dr. Bergdahl is teaching 306 in Winter 2009 and 406 in Spring 2009. Drs. Kim and Durr are also similarly scheduled in sequence. Regarding the CRJ curriculum being intertwined with the sociology curriculum – see item 11 also. One of the proposed semester models was designed to address this very issue. Our future efforts will create distinct curricula for both programs while still of course sharing some core courses. Finally, we recommend changes to the assessment process in New Assessment Developments Section of this report. 6 4. ASSESSMENT PLAN COMPLIANCE Explain deviations from the plan (if any). Senior exit focus groups were not done. The faculty member solely responsible for this measure retired and the task was not executed. Earlier assessment reports indicate that the Sociology Exit Survey was intended to replace senior exit focus groups. The Assessment plan should be changed to reflect this. Data for these purposes were collected only during the fall quarter. Portfolios were not assembled, so analysis could not be conducted. There has been insufficient planning for execution of this assessment task and no oversight or enforcement of assessment data collection activities. Assessment reports in two of the past four years, included data that were collected in a period outside the scope of the report. For example, senior exit surveys collected in the fall of 2007 were reported in the assessment report for the period July 1, 2006June 30, 2007. 5. NEW ASSESSMENT DEVELOPMENTS Describe developments (if any) regarding assessment measures, communication, faculty or staff involvement, benchmarking, or other assessment variables. Senior exit surveys will be distributed during all three regular quarters and the two summer quarters of the 2008-2009 academic year by email to all graduating seniors. Dr. Tracey Steele will conduct focus groups in the spring quarter by randomly soliciting senior sociology students for their participation until a minimum of eight seniors agree to participate. We suggest that an Assessment and Retention Committee be set up to collect, analyze and report data for the dual purposes of assessment and student retention. The current system of assessment dictated by the assessment plan is too piecemeal to be effective. The Curriculum Committee collects data, which in turn is to be analyzed by the Student Affairs Committee, then the assessment report is written by the new curriculum committee. It is also unclear who is responsible for data entry of the data collected. This system is inefficient and needs to be changed. In light of the fact that we start of new four-year cycle of assessment with the 2008-2009 academic year, this is a good time for the change. We will discuss these issues and changes during departmental faculty meetings in winter and spring quarters. 7