2010-2011 Program Report (DOC)

advertisement
Assessment Report Standard Format
July 1, 2010 - June 30, 2011
PROGRAM (S) ASSESSED: All Programs within the College of
Education and Human Services
ASSESSMENT COORDINATOR: Donna Hanby
YEAR ____3____ of a _____7____YEAR CYCLE
1. ASSESSMENT MEASURES EMPLOYED
Briefly describe the assessment measures employed during the
year.
 What was done?
 Who participated in the process?
 What challenges (if any) were encountered?
What was done?
A. National Program Approval
The College of Education and Human Services successfully completed
the national review of our master’s degree programs in Rehabilitation
Counselor Education through the Council on Rehabilitation Education, Inc.
(CORE). As indicated within the July 20, 2011 report: “CORE recognition
does not apply to other related programs in rehabilitation or counseling or
to studies at the undergraduate or post master’s levels.” The
accomplished accreditation will be recognized through the academic year
2019/2020.
B. State Program Approval
Seven programs submitted to OBR in November of 2009 for
re-approval on the seven-year timeline were all successfully reviewed this
year. The seven programs included endorsements and licensure
programs. Two undergraduate licensure programs of Career Technical
Education and Visual Arts (Art Education) and five endorsement
programs included PreK Special Needs, Reading, Literacy Specialist,
Gifted, and Transition to Work, completed the review process through the
Ohio Board of Regents. Two of the seven programs were approved for
seven years – the Gifted Needs Endorsement and Literacy Specialist
Endorsement, both are approved until 2017. The other five programs, the
PreK Special Needs Endorsement, Reading Endorsement, the
1
Visual Arts Licensure Program, Career Technical Education, and
Transition to Work Endorsement gained three years approval.
C. Program/Unit Assessment Process
The Annual Review of the Data process from the 2010-11 academic year
was shared at the September retreat, held at the Nutter Center. Faculty
and Staff receive the distribution through a flash drive, which include
both unit data and program-specific data.
1. Unit Assessment Data – aggregated results for the Impact on Student
Learning/Client Needs, Professional Dispositions, and the Portfolio
Assessments. The Portfolio is focused around the six CEHS standards of
Content Knowledge, Pedagogical/Application of Knowledge, Diversity,
Technology, Professionalism and Emotional Intelligence, submitted
through Tk20, our assessment tool.
2. Program Level Data – aggregated and disaggregated by sections and
sites from the six to eight key assessments submitted through Tk20
(required of NCATE accredited programs) and in paper format for those
not under NCATE and have chosen not to use Tk20.
3. Employer Survey – data collected across all CEHS programs from
employers who have hired our candidates over the past three years. 175
Employer surveys were distributed to various employers who have hired
CEHS students over the past three years. Seventeen completed surveys
for forty-seven CEHS graduates, a 26% return rate. During the 2009-10
academic year, the return rate was 42% and 18% were submitted during
the 2008-09 academic year.
4. Program Completer Survey – the college had a return rate of 20% for
the 2010-2011 edition of the Program Completer survey. The 2009-10
return rate for the survey was 22% and 21% for candidates who
completed a program the previous year, by June 2008.
5. At the 2009 retreat, trend data was also distributed from the past three
years of data collection for each of aforementioned assessments. CEHS is
completing the fifth year of data collection at the program and unit level
utilizing a systematic method to collect, aggregate and disaggregate and
return data results annually.
D. CEHS Program Review Process
As part of CEHS’s Strategic Plan, all programs are to be reviewed by a
three-step process. A faculty approved review form to be utilized was
approved during the spring of 2008. The process includes submission of
approval first at the dept. level, then to The Unit Assessment Committee
2
(UAC), who make a recommendation of maintaining resources, increasing
or decreasing resources, or the closure of a program. After the
recommendation of the committee occurs, the completed review is sent to
the CEHS Faculty Senate. They can accept or modify the
recommendation before forwarding the reviewed program to the CEHS
Dean for a final decision. There is also an appeal process if the program
faculty disagrees with the conclusion of the review process.
Two programs were reviewed at the Oct. 2009 meeting, The Gifted
Endorsement and Business, Organizational Management Counseling
Programs. Ten programs were reviewed during the 2009-10 academic
year. During the 2010-2011 academic year eleven programs were
reviewed through the aforementioned process. In summary, a total of 23
programs have undergone the Program Review process in the
College of Education and Human Services to date.
Who participated in the process?
A. National Program Approval
The department of Human Services, along with the Dean’s office
was involved with the Council on Rehabilitation Education, Inc.
(CORE) review process during the summer of 2011.
B. State Program Approval
For the seven Ohio Department of Education and Human Services
program approvals the following departments were engaged in the
writing and submission of program reports: The Department of
Educational Leadership for the Career Technical Education report
and the Teacher Education Department (TED) for the Gifted
Endorsement, Reading Endorsement, Transition to Work
Endorsement, Literacy Specialist Endorsement, Pre K Special
Needs Endorsement, and Visual Arts being shared by TED and
College of Liberal Arts.
C. Program/Unit Assessment Process
All degree, licensure and endorsement programs that are
connected through the College of Education and Human Services
complete the annual review of the data process. Therefore, this
includes programs that may reside in one or two colleges but
connected to the College of Education and Human Services.
Program advisors/directors lead the process with other program
level faculty reviewing and analyzing data from the previous
academic year. They also make recommended modifications based
upon data results. Next, the department chair meets with the
3
program advisor to review the program’s suggested modifications
and the annual review of the data report is submitted to the
Assistant Dean for Administration. After her review it is submitted
to the Coordinator for Assessment and Accreditation to enact the
changes within Tk20 (if it is a program that uses Tk20) and then
filed as archived data.
D. Program Review Process
The CEHS Faculty Senate delegated the process of CEHS
program reviews to the Unit Assessment Committee. The Unit
Assessment Committee consists of representatives from CEHS,
CoLA, CoSM, University Resource Analysis & CaTS, and PK12
School Partners. A subcommittee from the full Unit Assessment
Committee reviews programs during one of their six meetings held
during the academic year.
What challenges (if any) were encountered?
A. National Program Approval
No challenges were encountered for the national program approval.
B. State Program Approval
The only challenge was the amount of time it took to have some of
the seven programs reviewed. They were all submitted November
of 2009 but due to House Bill 1’s impact of moving program
approval from the Ohio Department of Education to the Ohio Board
of Regents, it took multiple years to bring closure to the review
process.
C. Program/Unit Assessment Process
The only challenge was the fact that the Asst. Dean of
Administration, who chaired the UAC and the program/unit review
process, had her time bought out by the Ohio Board of Regents last
year, to focus on the Teacher Performance Assessment (TPA) for
the state IHES.
4
D. Program Review Process
Due to the aforementioned absence of the Assistant Dean of
Administration, the Associate Dean assumed the additional
responsibility to implement the process and incorporated some
modifications of the templates and process.
2. ASSESSMENT FINDINGS
List the objectives and outcomes assessed during the year, and
briefly describe the findings for each.
Objectives were:




To achieve “National Recognition” for the graduate level
Rehabilitation Programs in CEHS through the Council on
Rehabilitation Education, Inc. (CORE)
To successfully meet the state requirements for state-level
programs (licensure/endorsement programs without a SPA) for
which included seven programs and submitted early November of
2009.
To continue the Annual Review of the Data process (Program and
Unit Assessment Process) as part of the college’s continuous
improvement plan.
To successfully complete the second year of Program Reviews, as
part of the College’s Strategic Plan, through the designated Unit
Assessment Committee’s charge by the CEHS Faculty Senate.
Findings:
A. The graduate level Rehabilitation programs received accreditation
approval until academic year 2019-2020.
B. All seven submitted ODE/OBR programs have gained approval for
three to seven years, depending upon the particular program and
submitted assessment report.
C. The Program/Unit Assessment Process (known as the Annual
Review of the Data) was successfully completed during the 20102011 academic year. (See Attached Annual Review of the Data
Submission.)
D. Twenty-three programs have completed the entire process of the
Strategic Plan’s noted Program Review. Eleven more programs
completed the review during the 2010-2011 academic year.
5
2010 – 2011 Program Review Results
#
1
2
3
Program
Community Counseling
Fall 2010
Reading Masters
Winter 2011
Principal Programs
Winter 2010
4
Superintendent
Winter 2010
5
Intervention Specialist:
Moderate to Intense
Winter 2010
Transition to Work
Winter 2010
6
7
8
Health Education
Spring 2011
Middle Childhood
Spring 2011
9
Integrated Math
Education - Spring 2011
10
School Counselor
Spring 2011
Sign Language
Interpreting
Spring 2011
11
1
2
3
4
5
Program Review Results
Close the Program
Department
Human Services
Maintain current resources
Teacher Education (TED)
Close Principal Master’s of Ed Degree
Maintain resources for Principal
Licensure Program
Close Supt. Concentration in EdS
program. Maintain resources for Supt.
Licensure program.
Maintain current resources. Reconsider
as we reassess college priorities in the
near future.
Maintain current resources. Reconsider
as we reassess college priorities in the
near future.
Maintain current resources.
Leadership Studies (LDR)
Explore feasibility of redistributing
resources to meet increased need. If
necessary, consider increasing
resources as appropriate.
Maintain current resources
Maintain current resources, consider
increasing resources as needed
Maintain current resources
Leadership Studies (LDR)
Teacher Education (TED)
Teacher Education (TED)
Health, Phys. Ed and
Recreation (HPR)
Teacher Education (TED)
College of Science and
Math/Teacher Education
(CoSM/TED)
Human Services (HS)
Human Services (HS)
Previous Program Review Results of The Current Strategic Plan
Gifted Endorsement
Maintain program, temporarily close to
Teacher Education (TED)
Fall 2009
redevelop it as a cohort/online program
Business, Organizational Maintain Status
Human Services (HS)
Management Counseling
Fall 2009
Mental Health Counseling Close per department’s request
Human Services (HS)
Winter 2010
Athletic Training
Increase Resources
Health, Phys. Ed &
Winter 2010
Recreation (HPR)
Teacher Leader Masters Maintain Resources
Educational Leadership
6
Winter 2010
6
(EDL)
Intervention Specialist:
Mild/Moderate
Winter 2010
Physical Education
Winter 2010
Curriculum Instruction:
Professional
Development
Winter 2010
Maintain Current Resources
Teacher Education (TED)
Maintain Current Resources
Heath, Phys. Ed and
Recreation (HPR)
Educational Leadership
(EDL)
9
Counseling for
Exceptional Children
Spring 2010
Close Program
Human Services (HS)
10
Integrated Language Arts
Spring 2010
Maintain Current Resources
11
Library Media
Spring 2010
Integrated Social Studies
Spring 2010
Maintain Current Resources
College of Liberal
Arts/Teacher Education
(CoLA/TED)
Educational Leadership
(EDL)
College of Liberal
Arts/Teacher Education
(CoLA/TED)
7
8
12
Close effective Fall 2012 unless
evidence can be provided that this is
a viable program without additional
resources.
Maintain Current Resources
3. PROGRAM IMPROVEMENTS
List planned or actual changes (if any) to curriculum, teaching
methods, facilities, or services that are in response to the
assessment findings.
Program Review Process
Noted modifications occurred based upon the feedback generated
the previous year and the desire of the new CEHS Leadership
team.
4. ASSESSMENT PLAN COMPLIANCE
Explain deviations from the plan (if any).
Some programs were unable to complete the annual review of the
data process. The schedule of review was revised to
accommodate the semester conversion work and some program
level requests.
7
5. NEW ASSESSMENT DEVELOPMENTS
Describe developments (if any) regarding assessment measures,
communication, faculty or staff involvement, benchmarking, or other
assessment variables.
The College of Education and Human Services is in the second year of
full implementation of the National Teacher Performance Assessment
(TPA) completed during Student Teaching/Clinical Practice. This
national performance assessment includes a 3-5 day planning,
instruction, and assessment of P-12 student learning and has a
content, specific assessment rubric developed by educators across the
nation, including university, school and accreditation representatives. It
is based upon the work of PACT in California, which has proved to be
a valid and reliable assessment for Preservice teachers. Ohio is one
of twenty-six states engaged in the development of the assessment
tool and Wright State was asked to take the lead on the facilitation of
the process for Ohio. Currently, 49 of the 51 Teacher Preparation IHEs
in Ohio are implementing the new assessment as part of the new
Metrics (House Bill 1) for which each IHE will be measured and data
reported annually to OBR. During the 2010-2011 academic year, our
Preservice teachers in several programs completed 42 portfolios. This
year more content areas are available and we have increased our level
of engagement to include each new content area available. We are
projected to submit over 200 portfolios from WSU to be scored by
calibrated scorers from WSU, Ohio and across the nation
A. National Program Approval
CACREP (Council for Accreditation of Counseling & Related
Educational Programs) review is scheduled for January of 2012.
Programs under NCATE (National Council for Accreditation of
Teacher Education) Accreditation are currently working on the
compilation of National Program Reviews (e.g., NCTE, ELCC,
NCTM, NASPE) for twenty-one programs, due mid-September.
B. State Program Approval
No
C. Program/Unit Assessment Process
The CEHS Dean and new Leadership Team are studying
the viability of the Unit Assessment Committee structure
and assessment process for the college. This corresponds with
a review process of the College’s current Strategic Plan. There
8
are also preliminary conversations about the viability of exploring
some of the proposed options of CAEP, such as only having state
approved programs rather than nationally approved programs.
9
Download