Assessment History Draft (Julee) REVISED 12-10-00 The initial VCSU assessment plan was developed during the 1991-92 academic year in preparation for the last NCA comprehensive evaluation. The plan had broad faculty and staff involvement and acceptance and flowed naturally from the institutional purposes. The NCA evaluation team requested submission of an assessment report in June, 1994 summarizing continuing development of institutional efforts to document student achievement. The report outlined the evolution of the Total Quality philosophy into Continuous Improvement in Teaching and Learning; receipt of a FIPSE grant used to build a foundation for system-wide reform of undergraduate education; and various other assessment initiatives undertaken after the comprehensive visit. The report was accepted by NCA. [Instructional Innovation Title III grant] 1.4 million dollar cooperative Title III grant 1998 Title 1.7 million institutional 98-03 Significant responsibility for implementation of the plan resided with the Curriculum Committee for assessment of General Education (formerly Foundations Studies) and with the Institutional Improvement Committee (formerly the Program, Planning, and Review Committee) for program assessment. Faculty members representing the academic divisions serve on both committees. The Vice President for Academic Affairs and division chairs serving on the Academic Policy and Affairs Council provide leadership and oversight for assessment processes. Forums were held during the 1991-92 academic year to acquaint faculty with the philosophy of outcomes assessment. Working sessions with the Academic Affairs and Policy Council were used to review key components of the final draft and the link between planning and assessment. The final version of the assessment plan was included in the 1992 self-study prepared for submission to the North Central Association. Individual faculty members through the academic division are responsible for developing the assessment process for the majors or program in which they teach. In addition to serving on the Curriculum Committee and the Program, Planning and Evaluation Committee, faculty members participate in various components of the assessment process and evaluate assessment results. [Student Services] The assessment of the Student Services area has always been a part of VCSU’s assessment approach and continues currently. The receipt of significant grants, namely the FIPSE, Bush, and Title III resulted in two campus-wide initiatives: the development of the abilities based model of student assessment and the VCSU degree requirement of a CD-ROM portfolio to demonstrate learning and to enhance employment prospects (Holleque p. 6 “Transforming Higher Education: Excellence within a Culture of Innovation”). Origin of the Abilities: Up until the fall semester of 1995, the General Education requirements were titled Foundation Studies. The Curriculum Committee conducted oversight of these requirements including any changes, additions, deletions, or evaluation of the courses. The Foundation Studies objectives (listed on page 36-37 of the Focused Visit Report, April 24-25, 1996) provided a common set of objectives for all Foundation Studies courses. As part of the FIPSE grant activities, faculty voluntarily met on a regular basis (Monday afternoons at 3:00 p.m.) for Learner Centered Education (LCE) meetings. A faculty member from the Division of Education and Psychology often facilitated these meetings, and the discussions focused on methods of teaching which encouraged student-centered activity and inquiry. Participating faculty members brought ideas and strategies to share with the group. These meetings provided an open form for meaningful discourse related to teaching and learning. One of the results of these LCE meetings was that the Curriculum Committee began to re-examine the Foundations Studies objectives in an attempt to determine whether or not the objectives were being met and whether or not the students were learning. The issue of “measurability” moved to the forefront as Valley City State University was preparing for the 1996 NCA Focused Visit. The University needed a method of “demonstrating” student attainment of the stated objectives. Through the LCE meetings and the actions of the Curriculum Committee, the Foundation Studies Objectives were revised. The results of the revision were seventeen “Foundation Studies Objectives Described as Abilities” (listed on pull-out page 41A of the Focused Visit Report, April 24-25, 1996). Each of these revised objectives was stated in such a way as to result in a demonstrable student achievement. Next, these objectives were revised, resulting in the eight Abilities which have become the focal point of learning assessment at Valley City State University. Specific demonstrable skills have been linked with each ability and are illustrated in the table below: Abilities Skills Aesthetic Engagement Receptivity Visualization Positive Interdependence Leadership Written Spoken Visual Performance Provides service to others Change agent skills Teaches Others Works with diversity Understands system interrelationships Gathering information Creative thinking Systems analysis Problem recognition Decision making Selects Applies Self-management Self-Worth Collaboration Communication Effective Citizenship Global Awareness Problem Solving Technology Wellness In addition to the General Education program, all academic programs have incorporated the eight Abilities into their assessment plans. The campus structure is such that programs are guided by departments and each department is part of one of the six academic divisions. Each academic division, through faculty discussion and collaboration, chose several of the eight university abilities, those most closely aligned with the goals of the division. Those abilities and their corresponding skills were then incorporated into programs, majors / minors, courses, and specific course projects. Divisions: The Division of Communication Arts and Social Science Goals: The general goals of the Division are: 1) to serve the fundamental needs of all students through courses aimed at achieving stated skills in the Communication Arts; 2) to help all students achieve a better understanding of the common cultural heritage, beliefs, and values through the study of the humanities; 3) to promote an understanding of social organization and interactions through the study of history and the social sciences; and 4) to promote global awareness and appreciation of diverse cultures through the study of language and opportunities to study in other countries. Abilities: Courses leading to a major in the Division of Communication Arts and Social Science will help students develop the following abilities: Communication: Aesthetic Engagement / Problem Solving: Problem Solving / Technology: Global Awareness: Excellent writing and speaking abilities Sophisticated analytical skills Competent researcher Synthesizes language, life, and culture Assessment Activities / Outcomes: The Division of Communication Arts and Social Science uses a multi-faceted assessment process to ensure high quality and promote valuable changes within its programs. Development of criteria and policies for admission to and continuance in the programs. Adoption of the Abilities Model. Clinical and field-based experiences with review by student, cooperating instructor or employer, and faculty mentor. Student portfolio development. Student evaluation of course objectives. Digital portfolios as an exit requirement. [Divisional improvement plan.] Assessment of student success takes place from entry to exit: General education courses are linked to the abilities. Major courses track abilities to higher levels. Portfolio development documents abilities. Successful completion of field experiences, internships, or study abroad. Divisional expectations of students are high: The Division and its programs have specific requirements, goals, and objectives. The requirements are linked to University abilities and skills. Specified course projects are linked to University abilities and skills. The Division builds systems for change through the following: Through assessment and reflection, abilities and portfolios continue to evolve. Definitions and rubrics for abilities and skills reflect University program objectives. Employer surveys provide input regarding the changing needs of the workplace. Exit information regarding new graduates is gathered through: Surveys of first-year teachers conducted by the VCSU Career Planning and Placement Office. Surveys of employers who have hired VCSU graduates conducted by the Career Planning and Placement Office. Focus group discussions with graduating seniors. Say something about how the assessment information goes back to faculty, students, programs, etc. The Division of Education and Psychology Goals: The broad goals of the teacher education program at Valley City State University are to prepare entry-level teachers who: (1) are capable of teaching and guiding students of varying backgrounds, strengths, and needs; (2) are competent decision makers; (3) are skilled in planning, implementing, and evaluating learning experience for students: (4) view decision making as a reflective process; (5) understand and are committed to the moral dimensions of teaching; (6) select and apply technology appropriately; and (7) accept the view that professional growth and development is an on-going, never-ending process. Abilities: In addition to developing the eight General Education Abilities at a higher level, students in the Education and Psychology Division will become proficient in the teaching abilities outlined in the Professional Decision Making Model; Planning, Implementing, and Evaluating. Planning: While planning, the teacher must make decisions regarding areas such as goals and objectives, the degree of background building required, and specific materials and methods to use. Implementation: The implementation function requires the teacher to carry out the plans that have been made. During the actual teaching phase numerous decisions need to be made. Often times, they need to be made quickly as the teacher responds to students reactions, comments, and instructional needs. As a result, modification of prepared plans becomes the rule rather than the exception. Evaluation: During the evaluation phase of decision making the teacher determines the degree to which the instructional objectives were attained. Determining the degree of reteaching that is needed, recording information, and reporting progress are some of the areas within the evaluation phase of decision making. Reflection: The teacher plans, implements, and evaluates by using feedback in a reflective manner. During the entire process it is essential the teacher realizes that professional growth and development is continuous. Assessment Activities / Outcomes: In its reaccreditation visit to VCSU, the 1996 visitation team from the National Council for Accreditation of Teacher Education recognized Valley City State University for Exemplary Practice and noted: Valley City State University through its collaborative work with the Center for Innovation in Instruction (CII) and the Kathryn Center, and through the initiative of its faculty in pursuing grants, has achieved a synergy of vision and mission in action which would not normally be possible for an institution of its size and financial resources. In this case, the whole is greater than the sum of its parts. Noting that institutional culture is notoriously resistant to change, VCSU has achieved virtual transformation of the culture of the entire institution…these multiple efforts have worked in concert, focusing philosophy, and broad range of human and financial resources, to create institution-wide movement toward their long range vision to be a leader in technology in education. While the entire campus community is credited for the commendable NCATE review, the unit faculty members and teacher education students played a critical leadership role and they continue to exert their influence as key players in the transformation of teaching and learning. The Division of Education and Psychology at Valley City State University has met the accreditation standards of the National Council for the Accreditation of Teacher Education since 1964. Building on a tradition of excellence and committed to continuous improvement, it uses a multi-faceted feedback loop to ensure high quality and promote effective changes within the program: Regular analysis of criteria and policies for admission to and continuance in the program. Adoption of the Abilities Model. Clinical and field-based experiences with review by student, cooperating instructor, and faculty mentor. Student portfolio development. Continuous student evaluation of course objectives. First and third year teacher education graduates complete the General Knowledge Survey to determine the degree of satisfaction related to preparation. Principal and teacher evaluation surveys accompany this survey to assess the performance of those graduates. Digital portfolios as an exit requirement. Divisional improvement plan. Assessment of student success takes place from entry to exit: General Education courses are linked to the abilities. Major courses track abilities to higher levels. Portfolio development documents abilities. Successful completion of field experiences. Departmental expectations of students are high: The Teacher Education program has specific requirements, goals, and objectives. Teacher Education program objectives are linked to specified abilities of planning, implementing and evaluation. Specified course projects are linked to University abilities and skills. The Division builds systems for change through the following: Through assessment and reflection, abilities and portfolios continue to evolve. Definitions and rubrics for abilities and skills reflect University program objectives. Field site visitations identify skills of effective teachers in today’s changing classrooms. A PT3 grant application was awarded based on technology needs in today’s schools. Exit information regarding new teachers is gathered through: Surveys of first year teachers conducted by the VCSU Career Planning and Placement Office. Surveys of administrators who have hired VCSU first year teachers conducted by the VCSU Career Planning and Placement Office. The Division of Education and Psychology is committed to meeting the needs of all learners and ensuring their success. Assessment and evaluation are critical components of that commitment. The Division of Fine Arts Goals: The Division of Fine Arts provides opportunities for all students to develop aesthetic responsiveness, cultural and global awareness, and historical and contemporary perspective. Students pursuing a comprehensive education in art or music develop a deeper understanding of these fundamental abilities. The Fine Arts Division: (1) encourages individual expression through nonverbal communication and active collaboration in creative endeavor; (2) provides elementary and secondary art and music education students with the essential knowledge and skills to become successful classroom teachers; and (3) prepares the student for professional study in Fine Arts. The Division supports the institutional mission in instructional technology while recognizing the divisional role in enriching human experience and cultivating a sense of community. The Division of Fine Arts is comprised of the Department of Art and the Department of Music. Information about Fine Arts degree programs and courses appears in the 20002002 VCSU Bulletin, pages 57-62, 72-74, and 91-93. Department of Art Goals: The primary functions of the Department of Art are: (1) providing superior training for public school art teachers; (2) providing excellent studio training for artists; and (3) contributing to the cultural environment of the campus and the community. The Department supports the institutional mission in instructional technology while recognizing the departmental role in encouraging individual expression, enriching the human experience, and cultivating an artistic community. Department of Music Goals: The goals of the Department of Music are to: (1) provide superior training for future public school music teachers; (2) assist musicians to perform at their highest possible level of ability; (3) develop in students a broad understanding of music within the context of a liberal arts education; and (4) contribute to the cultural environment of campus and community. The Abilities: The department recently applied for and received a Bush Grant entitled The Mapping and Assessing of Music Department Abilities/Skills Requirements and Student Portfolios. The purpose of this grant is to develop a comprehensive and cohesive departmental plan for Abilities and Assessment in order to: (1) Determine the specific skills and levels of the Abilities requirements for the VCSU Music Department (2) Develop language for the skill levels which better reflects the expectations and achievements of the music students at VCSU (3) Map the music courses which fulfill these requirements (4) Develop an assessment plan for the VCSU Abilities and Skills within the Music Department; to incorporate that plan into the department’s present, working assessment model (5) Develop a plan for assessing student portfolios within the department (6) Insure that all of the above areas of Abilities, mapping and assessment form a cohesive plan for future assessment Assessment Activities / Outcomes: Department of Art: Program quality is measured by internal evaluation at the department level and by comparison with state program standards. The Department meets all requirements in teacher preparation established the State Department of Public Instruction and NCATE. The Art Department has developed a portfolio review process. A small minority of students entering the art program has fairly developed art-making skills. Those students enter the program through an entrance portfolio review. The faculty members use this review to assess the student’s development and place them in the appropriate classes. The majority of the students entering the Department have limited verbal communication skills. Those students take a foundations course in order that the faculty can better assess the student’s skills and guide their development. The students, generally, follow a direct path of studio skill building courses. Each course in the program has been developed to build on the previous one. The Foundations course leads to Design, Design to Drawing I, Printmaking I, Painting I, and Ceramics I. The first level studio courses lead to the second level studio courses, and the second level to the third. If the student is not successful in fulfilling the requirements of any of the courses they work closely with the faculty, through tutoring, to accomplish the criteria of the course. The student receives the same guidance through the art history sequence. From the beginning of their art program experience the student is preparing for their senior portfolio. The senior portfolio is a screening for the senior exhibition. The student will present a professional exhibition, complete with a written artist’s statement before they qualify for graduation. The student will graduate with a completed professional portfolio that demonstrates the student’s course criteria accomplishment. The art education students also need to accomplish the professional education track for their degree. This track includes a successful PRAXIS / PPST test, the professional education sequence, the student teaching review, student teaching, and the education portfolio. The art faculty members work closely with both the student and the Education Division through this track. The Department is in the process of developing and integrating ability language assessment into the existing portfolio assessment process. The Art Department has mapped the abilities in the program and is working on the assessment as it relates to the abilities portfolio. Department of Music: Assessment: Evidence of quality in the educational programs is provided through the Department’s accreditation by the National Association of Schools of Music, through placement records of graduates, and through the Department’s Plan for Assessment of Music Student Achievement accompanied by documentation of that achievement. The Department’s assessment plan had its origins in the 1985 visit of the BUSH consultant. Over the last fifteen years it has been continuously refined, through faculty observation of test results, through additional input from the 1994 NASM consultant and the 1997 NASM evaluation team, and through recommendations made by the chair of the department who serves as an NCA consultant-evaluator and a member of the NCA Accreditation Review Council. The assessment mechanism has become a seamless part of the departmental operation, so that assessment, documentation of student achievement, review of results, adjustment of the curricula, and improvements in instruction have become a natural and ongoing part of departmental life. The department prioritizes operational and library funds to strengthen the necessary instructional areas. The Plan is understood by faculty and students alike and provides a practical and thorough system for identification of program strengths and areas for improvement, as well as for evaluation and documentation of student achievement. The Division conducts assessment in the following areas, and details regarding the assessments are available in the Divisional Narrative: Assessment of Ability to Read Musical Notation Assessment of Functional Piano Skill. Assessment of Applied Music Assessment of Professional Education Assessment of Content Knowledge and Music Teaching Competencies Peripheral Assessment Mechanisms Add here a paragraph which describes how the assessment information is used by faculty, students, program etc. Division of Health and Physical Education Goals: The Division of HPE will develop among its students the knowledge, skills, attitudes, and values that come from sports and physical activity throughout one’s life. It is the primary function of the division to: (1) prepare students for teaching and coaching; (2) promote a lifelong commitment for physical fitness among all VCSU students; and (3) support the university’s mission to a learner-centered caring community committed to continuous improvement through the use of instructional technologies. Abilities: Courses leading to a major in the Division of Health, Physical Education, and Recreation will help students develop the following abilities: Problem Solving: Wellness: Technology: Develops thoughtful and creative solutions Manages self and others professionally, for the well-being of the team or organization. Researches and presents materials competently; understands the professional potential of technological tools. Assessment Activities / Outcomes: While the entire campus community is credited for the commendable NCATE review, the unit faculty members and teacher education students played a critical leadership role and they continue to exert their influence as key players in the transformation of teaching and learning. Adoption of the Abilities Model. Clinical and field-based experiences with review by student, cooperating instructor, and faculty mentor. Student portfolio development. Continuous student evaluation of course objectives. First and third year teacher education graduates complete the HPE Alumni Survey to determine the degree of satisfaction related to preparation. Digital portfolios as an exit requirement. Divisional improvement plan. Assessment of student success takes place from entry to exit: General Education courses are linked to the abilities. Major courses track abilities to higher levels. Portfolio development documents abilities. Successful completion of field experiences. Departmental expectations of students are high: The VCSU Health & Physical Education graduate will be able to demonstrate: a.) higher order thinking skills and the application of critical thinking skills the ability to effectively communicate (i.e., written, verbal, presentation, etc.) b.) concrete application of content knowledge c.) the ability to access relevant information d.) the ability to work cooperatively e.) the appropriate use of technology Is this linked to the abilities? The divisional abilities of Communication, Problem-solving, Wellness, and Technology are four of the eight university Abilities (see appendices). Students must complete the fourth level of five of the eight Abilities in order to satisfy the graduation requirement. The fifth ability is the student’s choice, probably from his/her second major or the academic minor(s). Have you built in systems for change based on what you know? What are they? The HPE Assessment Plan, continued use of alumni surveys (every other year), course assessments, senior exit interviews, and the quality of the HPER students’ digitized portfolio will provide feedback. This program review, with feedback from the outside evaluator and the VCSU VPAA, will provide us with valuable advice on the effectiveness of the curriculum and instruction. Curricular/program changes could then be proposed for the next bulletin (catalog) for 2002-2004. Surveys: One and three year (program) graduate surveys have been administered in the following summers: 1996, 1998, & 2000 (see report in appendices by Dennis). Is there other data? Course assessments: spring, 1999, and fall and spring, 2000; senior exit interview questions (interview results spring, 2000). The Division of Mathematics and Science Goals: The Division of Mathematics and Science seeks to encourage and develop the ability of those students interested in pursuing a career in the pure and applied sciences, mathematics, and related areas. In the course of accomplishing these goals the Division also seeks to: (1) provide secondary education majors with the knowledge, skills, and attitudes which enable them to teach successfully in their chosen field of specialization; (2) provide elementary education majors the essential knowledge, skills, and attitudes, in the areas of Mathematics and Science, in order to plan and present learning activities for the elementary classroom; (3) provide courses in general education for the liberal arts student; (4) provide pre-professional students with academic counseling, courses, and programs that will prepare them for the professional field and school of their choice; and (5) provide all students and members of the community opportunities for learning experiences in areas related to Mathematics and Science. Abilities: Courses leading to a major in the Division of Mathematics and Science will help students develop the following abilities: Problem Solving / Technology: Collaboration: Global Awareness: Communication: Obtaining, organizing, and interpreting information Ability to work with others Recognize relationships Ability to convey information and knowledge Assessment Activities / Outcomes: Standardized examinations from the American Chemical Society have been administered to Chemistry classes for the last nine years. The trend shows steady improvement in student performance. The results are displayed in Table 44. ACS Test Results, 1992-2000 (HAVE THEM, JUST NEED TO PUT IN)