Exhibit 2.4.g.15 Early Childhood Education MEd & CAS Comprehensive Data Analysis Report (DAR) Summary 2011-2013 AY11: 1. Have the change(s) in response to data that you documented last year had the desired effect on your program? Please provide specifics referencing prior changes that you submitted in AY 2009-2010. In last year’s report, there were four new actions planned in response to the data, as well as the continuation of several efforts described in the previous year. This discussion addresses the effects of on-going changes as well as those made in 2009-2010. Acknowledging that substantive change requires a commitment over time, as opposed to “quick fixes,” the following discussion is offered. Continuation of items noted in the fall 2010 report: Web-based program information bas become the norm with admitted students now regularly using TU email and taking advantage of online documents that are updated in a timely manner. Off campus growth has occurred substantially in enrollments at USG and SMHEC. As there are now program completers from those locations, the effectiveness the actions taken to create strong programs at our satellite campuses has been demonstrated in candidate performance on the Graduate Professional Portfolio. The newly revised advanced technology course, with its new course number ECED 616, has been demonstrably effective (through portfolio assessment) in candidate learning and in creating positive learning in early childhood classrooms. The course is now offered yearly on campus and has also been offered off campus. An increasing number of full-time Early Childhood Department faculty and CAS candidates in the Teacher Educator Area of Focus have delivered courses in their areas of expertise at on campus and off-campus sites. Effectiveness of this action has been evidenced by student evaluations and Graduate Professional Portfolio presentations. In addition to the continuation of efforts mentioned in the previous section, the faculty has discussed the following actions described in the Fall 2010 report: To assist with the “grad student learning curve,” there is a plan to at least pilot an orientation seminar for students in the beginning of their graduate program. Not to add another course, the plan would be to require a number of seminar meetings during the first semester of the program to focus the student on the mission and goals of the program, to help them build on their own Goals Statement, to situate them within the profession and to introduce them to the core threads of the program (caring, ethics and social justice, critical pedagogy and practice.) The desired effects of this specific effort are yet to be determined. Making what would be a change in program requirements is more than a simple action and is now in progress in the Department. What has been done to work toward the desired effect has been the intentional conversations that have taken place with candidates in a number of the required and elective courses (see ECED 665 below) to address more intentionally the core threads of the program. To the extent that candidates in these courses have been among program completers, the faculty has seen positive effects in Portfolio assessment. To further these themes, a revisioning or re-emphasis of ECED 665 will take place in the now ECED-only sections to include reading and discussion in support of what was introduced in the orientation seminar. This action has been taken, with ECED-only sections of ECED 665 Curriculum Theory and Development now offered in both the fall and spring semesters on campus. ECED-only sections have been offered in our school-system cohort and at SMHEC and USG. (At HEAT, ECED-only sections are offered but students may still choose a ECED/ELED 665/SCED741 section.) Reading and discussion have been revised to address topics intended for the proposed program orientation seminar. Student evaluations and data from Assessment 8 and the Portfolio (Assessment 4) provide evidence that the ECE-only approach as had the desired effect. The APA manual will be required in the first semester of program course work. As with the addition of orientation seminar, taking this step has required procedural changes that are currently in progress. This effort is under way in concert with increased attention to instruction in the use of APA style among undergraduate Early Childhood students. Our assessment data show that APA proficiency grows among candidates as they progress through the program but is at times scored as “Below Expectations” on rubrics for assessments early in the program. We will work at our distance technology capability, through Webex and other tools in order to accommodate the increasing numbers of off campus students, to create a sense of community across all locations, to offer more course options off campus (and on campus) and to continue to support our current commitment to cross-location program integrity. This effort has begun and will continue to develop with more hybrid and online course. In spring 2011, Webex and use of the extended Blackboard tools were used in ECED 773 Seminar to bring together three HEAT Center candidates with eleven candidates at SMHEC to effectively complete this capstone course for the degree. Student evaluations and portfolio assessment data provide evidence of the desired effects. Hybrid course offerings on campus and at USG during 2010-2011 provided more schedule options for candidates, making it logistically feasible for candidates to take courses further from home and work. 2. What significant findings emerge from your examination of these data? What we have found in our examination of the data are as follows, beginning with overall findings: Aware of the emphasis on the positive impact on children’s learning in the current national P-12 education reform efforts, we are gratified with the effectiveness of our Graduate Professional Portfolio (Assessment 4) as an assessment in this regard and with the strength of the candidate data from this assessment. Most of the other assessments (Assessments 1, 3, 5, 6, 7, 8) also provide evidence of our candidates’ effects on children’s learning and environments for learning. The Graduate Professional Portfolio, however, as the culminating assessment addressing all NAEYC Advanced Standards and the candidate growth in the M.Ed., is the most comprehensive. Because having a positive impact on the children in their own classrooms is a personally held goal of our candidates, the motivation is present and the implication is thus that the responsibility falls to the faculty to provide opportunities for candidate learning. Assessment data show candidate ratings that are, overall, consistently “Expectation met” or “Expectations exceeded.” However, we find that the assessment and scoring rubrics are rigorous and meaningful, yield valid indications of performance and not “inflated” scoring data. We have found that, with enrollment growth in the program, there has been greater variance in scores seen in the assessment data. To a degree, this is to be expected statistically but we are continuing to critically examine where the lower scores are occurring, in terms of components if the assessments, in the courses where those assessments take place, and the campus locations where the courses are offered. We have noted location-specific issues in candidate performance and are, as above, questioning the context and expectations in off-campus cohorts and campuses, as well as the diversity among on campus candidates and the prior academic experience they bring to the M.Ed. Concerns about insuring consistent instruction and reliable assessment among the multiple sections of courses is an ongoing discussion but the current data suggest that variations in scores across sections by the same instructor suggest that variation in candidate performance are not likely to be “instructor effects.” Graduate Professional Portfolio: Data from this assessment have provided strong evidence of candidate performance and program effectiveness across program locations, as well as offering insight into the effects of data-driven changes that have been made. Three assessments (Assessments 1, 6, and 7) from ECED 609 Growth and Development of Young Children give us data to better understand our candidates’ strengths and needs as they begin, and respond to, the degree program. We have seen that the few students with markedly lower scores in these assessments have found that graduates study is not a good fit for them, at least in this point in their lives. In some cases, we have also seen gratifying growth in the candidates, based on their assessment scores, within the semester. These assessments address critical content and dispositions related to the profession. Data support the continuing proposal for the orientation seminar. Assessment 2 from ECED 611 Teacher as Researcher provides perhaps the most rigorous assessment of our candidates’ performance as graduate students. Also, taken early in the program, the course offers insight to faculty of the academic, as well as professional, potential (realized or not yet realized) of our candidates. We have concluded that the scores reflect the rigor of the course and of the assessment. Date provide powerful information for faculty to work throughout the program to support candidate performance. Data support the continuing proposal for the orientation seminar. In ECED 619 Assessment, Observation and Evaluation, Assessment 3 provides strong evidence of our candidates’ proficiency and commitment to appropriate and effective use of assessment of children’s learning. Similarly, from ECED 607 Learner Diversity and Inclusion, data from Assessment 5 provide evidence of our candidates’ commitment to each child and to all children and families. Consistent with the Dispositions data, candidate growth in the awareness of self, understanding of others and commitment to culturally responsive teaching and learning is evident in the data. In ECED 665 Curriculum Theory and Development, data from Assessment 8 in 2010-2011 suggests that in the ECED-only sections, instructors are using the assessment and scoring rubric consistently and with rigor. Data reinforce the continuing proposal for the orientation seminar to support the candidates scoring “Below expectation.” 3. How have you involved faculty in your identification of the implications of these data? The full-time faculty in the department of Early Childhood Education discussed these findings at the December 2011 Department meeting. Because there are increasing numbers of full-time faculty teaching graduate courses, on and off campus, it was important to have the discussion during a Department meeting in order to have all voices heard. In addition, each semester, as formative assessment, interim reviews of data from required assessments have taken place among course instructors, both on and off campus, and the program director. Assessment data are now posted on the departmental O: drive, facilitating discussion among faculty at any time. In addition, faculty members serving on Graduate Portfolio review teams during fall, sprung and summer, identify implications of the Portfolio assessment data. The Portfolio data provide a strong source of program evaluation information as well as candidate performance. 4. What specific actions will you take in response to these data? (REQUIRED response to NCATE AFI) Specific actions in response to the data include a continued and strengthened sense of purpose in creating the graduate student orientation to be required during the first semester in the program, as described in Item 1. The program director, Department Chair, and senior graduate faculty in the Department will work on the process of adopting the new program requirement as well as its design (content and delivery.) The strengthening of ECED 665 as ECED-only, that was initiated last year, will continue to support the program’s core commitments. A related action from the previous year is the requirement for the APA Manual among beginning M.Ed. students. The discussion has been related to the idea of including the APA learning requirement in the orientation seminar. The faculty will plan ways to address this action in the interim while the orientation seminar development proceeds. Assessment data show that rubric components related to writing and mechanics are the ones where most of the “Below expectations” candidate performance occurs. A renewed sense of commitment to effective online instruction has come from student evaluation and assessment data, notably the Graduate Professional Portfolio. Proposals have been submitted for the development of two online courses for summer 2011, for the advanced technology course ECED 616 and for a new course on working with dual language learners and their families. An examination of the assessment system itself has led to a planned action to revise the scoring rubric for Assessment 2 Teacher Action Research Proposal to include a component on information literacy and technology. While proactively seeking ways to make a strong program even stronger, the most compelling theme among the faculty was how to better support the “outliers” among candidates, those scoring “Below expectations.” The specific actions include those described above, along with an increased commitment to timely counseling of these candidates. One action to take place is the strategy of having assessment data on the O: drive to alert the program director to begin a conversation with the course instructor and subsequently with candidates. AY12: 1. Have the change(s) in response to data that you documented last year had the desired effect on your program? Please provide specifics referencing prior changes that you submitted in AY 2010-2011. As noted in the discussion below, actions related to each of the changes in response to the data from 2011-2012 were taken. Effects have been seen, to some degree, immediately, while others will be observed over time as the current graduate students progress to completion of the program. Changes in response to 2010-2011 data leading to specific included “a continued and strengthened sense of purpose in creating the graduate student orientation to be required during the first semester in the program.” This new program requirement was designed in detail during Spring 2012 and implemented with the first of the originally planned sessions held on campus on October 9 for students in ECED 609 and ECED 611, the first two courses in the program. The second session is scheduled for November. The response from students at the first session was so positive that we accelerated our plan to expand the orientation session to our largest satellite campus location and a session is now planned for that location for December 5, 2012. The immediate response from students and their course instructors has been strong but the ultimate effects will be seen as these students progress through the entire program. An item for action from the 2010-2011 report was additional support for graduate students to master APA style. This item has been addressed in two ways: Rather than requiring the purchase of the APA Manual for beginning M.Ed. students in ECED 609 and ECED 611, we have worked with Claire Holmes, Cook Library, to create links and video resources about APA on the Course Gateways for all M.Ed. ECE courses. Since the inception of the Course Gateways in fall 2011, instructors in all courses have emphasized APA and guided students to this resource. Evidence of the effectiveness of this action is demonstrated in stronger candidate performance on all assessments in this report, with specific rubric components in Assessments 5, 6, and 8. Furthermore, as projected, discussion of the APA learning requirement is part of the orientation seminar. Cited in 2010-2011 was “a renewed sense of commitment to effective online instruction.” During 2011-2012. Proposals were approved and for two courses that were effectively taught in summer 2012: ECED 610 Learning Environments: Curriculum and Technology and ECED 670 Working with Dual Language Learners and Families. Additionally, the Digital Media Classroom was used to provide videos for the ECED 611 Course Gateway. Students in the course at off campus locations could view Claire Holmes’ Cook Library orientation session for ECED 611 and two classes on statistics. As planned, the scoring rubric for Assessment 2 Teacher Action Research Proposal was revised to include a component on information literacy and technology. Assessment data have been included in this report. 2. What significant findings emerge from your examination of these data? Assessments throughout the program provide opportunities for candidates to demonstrate the positive impact on children’s learning that is critical to the current national P-12 education reform effort. Assessments 1, 3, 4, 5, 7, and 8 have direct child or curriculum planning or evaluation components, and Assessments 2 and 6 engage candidates in research advocacy designed to lead to direct or indirect positive impacts on children. Our overall candidate strength in these assessments offers important evidence while providing an opportunity for further program improvement. Of all the assessments, we are most gratified with the effectiveness of our Graduate Professional Portfolio (Assessment 4) as evidence of our candidates’ positive impact on children. Consistently strong data were reported from this assessment with on campus candidates in fall 2011 and spring 2012 and with the first cohort to complete the program in Howard County in spring. As the culminating assessment addressing all NAEYC Advanced Standards and the candidate growth in the M.Ed., the Graduate Professional Portfolio is our most comprehensive assessment. Because having a positive impact on the children in their own classrooms is a personally held goal of our candidates, the motivation is present to demonstrate that effectiveness and, therefore, the implication is that the responsibility falls to the faculty to provide opportunities for candidate learning. Assessment data show candidate ratings that are, overall, consistently “Expectation met” or “Expectations exceeded.” However, we find that the assessment and scoring rubrics are rigorous and meaningful, yield valid indications of performance and not “inflated” scoring data, as evidenced by the reporting of the albeit few scores in “Met with Limitations” or “Below Expectations.” We have found that, with enrollment growth in the program, there has been greater variance in scores seen in the assessment data. To a degree, this is to be expected statistically but we are continuing to critically examine trends where the lower scores are occurring: components of the assessments, courses where those assessments take place, and campus locations where the courses are offered. We have examined with care our location-specific data and have found increasing consistency in candidate performance among those on campus and those at satellite campuses and in schoolsystem cohorts. We have made continued progress and will work to maintain this consistent high quality of graduate study at our off-campus locations. Solid assessment data from the rapidly growing USG program and the strong data from the first Howard County cohort completers offers compelling evidence. (Please see Section IV Data Tables, disaggregated by location.) Concerns about insuring consistent instruction and reliable assessment among the multiple sections of courses has been an ongoing discussion but the current data suggest that more uniformly strong instruction is offered across sections and locations. The one course in which this was not the case has been improved in terms of instructor and needed updating and sharing of a common syllabus. By spring 2012, and in place for fall 2012, we are seeing a trend toward our goal of “consistent instruction and reliable assessment.” Graduate Professional Portfolio: Data from this assessment (N=66, four sections) have provided strong evidence of candidate performance and program effectiveness across program locations, as well as offering insight into the effects of data-driven changes that have been made. The strength of the Howard program completers offered compelling evidence of the strength of this latest TLN initiative. Assessments 1, 6, and 7, all from ECED 609 Growth and Development of Young Children, have given us data to better understand our candidates’ strengths and needs as they begin, and respond to, the degree program. There was evidence of strong performance among all candidates on the three assessments (N=63, four sections) with the exception of two candidates who failed to complete Assessment 1. These assessments address critical content and dispositions related to the profession. Assessment 2 from ECED 611 Teacher as Researcher provides perhaps the most rigorous assessment of our candidates’ performance as graduate students. Also, taken early in the program, the course offers insight to faculty of the academic, as well as professional, potential (realized or not yet realized) of our candidates. We have concluded that the scores reflect the rigor of the course and of the assessment. Although the 2011-2012 should be considered strong, with 3 of 80 candidates (3.8%) across five sections scoring “Below Expectations,” faculty continue to work throughout the program to support each candidate’s performance. Assessment 3, in ECED 619 Assessment, Observation and Evaluation, (N=69, three sections) provided strong evidence in 2011-2012 of our candidates’ proficiency and commitment to appropriate and effective use of assessment of children’s learning. Assessment 5 data comes from ECED 607 Learner Diversity and Inclusion, and, as Assessment 3, are strong (N=70, five sections) and have provided evidence of our candidates’ commitment to each child and to all children and families. Consistent with the Dispositions data, candidate growth in the awareness of self, understanding of others and commitment to culturally responsive teaching and learning is evident in the data. Assessment 8, provides data for 36 candidates in four sections of ECED 665 Curriculum Theory and Development in 2011-2012. The ECED-only sections continue to be an effective delivery of this course, although there were some “instructor effects” during the academic year, with one off campus instructor failing to submit student scores. A concerted effort for consistency resulted in the appointment of a full-time faculty member as instructor in the spring semester, also to serve as mentor for others teaching the course, to insure that all are using the assessment and scoring rubric consistently and with rigor. Data reinforce the need for the newly implemented orientation seminar to support the candidates scoring “Below expectations.” 3. How have you involved faculty in your identification of the implications of these data? The full-time faculty in the department of Early Childhood Education discussed these findings during fall 2012 Department meeting. In addition, faculty members serving on Graduate Portfolio review teams during fall, spring and summer, at both on-campus and off-campus locations, have identified implications of the Portfolio assessment data. The Portfolio data provide a strong source of program evaluation information as well as candidate performance and have guided aspects of program improvement. Further involvement occurs as formative assessment, in the form of interim reviews of data from required assessments that have taken place among course instructors, both on and off campus, and the program director. Assessment data are posted on the departmental O: drive, facilitating discussion among faculty at any time. 4. What specific actions will you take in response to these data? (REQUIRED response to NCATE AFI) Specific actions in direct response to the assessment data in this report address needs identified in the 2011-2012. Actions will (1) support candidates to become successful as graduate students, developing their identity as Early Childhood professionals and “masters” in their field, and (2) provide effective course experiences with strong instructors and consistent syllabi, insuring the integrity of the Towson M.Ed. in Early Childhood Education in all locations. The following will detail actions in place, and yet to come, for 2012-2013. Graduate Orienting Seminar Sessions: These sessions will be offered every semester on campus and at least once a year at USG. Topics and discussion of the Orienting Seminar will be addressed with each cohort in AACPS and Howard. Using the Digital Media Classroom to record the on campus seminars will make the content available for candidates at all locations. To add to orienting seminar and online program document, a document of the eight assessments current at the time of entry will be provided to candidates, with the caveat of possible revision or change. Expanded course offerings and established course rotations at growing off campus locations: USG will have four courses per semester/summer and an established course rotation; program course plans will continue to be established at the beginning of each new cohort in AACPS and Howard Counties; a program course plan will be in place for the current cohort at SMHEC; a course rotation will be developed for HEAT/Northeast MDHEC. This plan will not only support students but will help with regular staffing of courses. A marketing campaign targeted for the HEAT Center has begun for 2012-2013 with Jesse Trahan. More on-line courses: Added to ECED 610, on-line as of summer 2012, and ECED 670 Dual Language Learners, piloted in summer 2012 to become approved course in 2012-2013, other courses to begin the on-line development process are ECED 665 and ECED 619. The on-line format supports graduate students at all locations and also helps to insure the consistent instruction and assessment needed across locations. Mentorship in teaching: Adding to the mentorship in ECED 665, faculty members will be identified as mentors in each of the seven required courses, for the four reading electives, and other electives as can be found. To insure high quality instruction in the many course sections offered each semester/summer (24 total for spring 2013), regular part-time instructors who are demonstrated to be effective in courses they teach will be recommended for associate graduate faculty status. AY13: 1. Have the change(s) in response to data that you documented last year had the desired effect on your program? Please provide specifics referencing prior changes that you submitted in Fall 2012, covering AY 2011-2012. 4 areas were identified for 2011-2012: Graduate Orienting Seminar, expanded course offerings and established course rotations, additional courses offered on-line, and mentorship in teaching. Graduate Orienting Seminar The expectation for 2011-2012 was to offer the Graduate Orienting Seminar each semester on campus and at least once a year at the Universities at Shady Grove (USG). In addition, the seminar was to be recorded and offered to all students, regardless of location, via a link on the M.Ed. home page (http://grad.towson.edu/program/master/eced-med/). Neither of these goals was fully achieved. A Graduate Orienting Seminar was held in fall 2012, on campus, in conjunction with one section (TU) of ECED 609. Students from other courses were invited to attend. Attendance was mandatory for students from other sections of ECED 609 (TU, 2nd section). Most students from all sections of ECED 609 attended, however some students were absent. Three instructors facilitated the discussion for the graduate seminar. Student feedback from the Graduate Orienting Seminar was received and reviewed. Student response to the Seminar indicated a need to provide additional details on course selection, scheduling, and portfolio organization. From this feedback, changes to the process, content, and possibly the time of the seminar were addressed for 2012-2013. Expanded Course Offerings and Established Course Rotations A fixed course rotation was established for USG, and external cohorts in Anne Arundel and Howard County. At USG, two required courses, ECED 609 Growth and Development of Young Children and ECED 619 Assessment, Observation and Evaluation in Early Childhood, are now offered each spring with the addition of two elective courses. Summer courses have been added and include ECED 607 Learner Diversity and Inclusion in Early Childhood Education (required), ECED 610 Learning Environments: Curriculum and Technology (required) and two electives. ECED 611 Teacher as Researcher and ECED 665 Curriculum Development in Early Childhood Education, both required courses, are offered in the fall. Two electives are offered as well. The capstone course for the program, ECED 773 Seminar in Early Childhood Education, is also offered in the fall. For external cohorts, a course sequence was established for fall, spring and summer: fall, one course; spring, 1 course the first year; summer, 2 courses; fall, 1 course; spring, 2 courses with an early start date in January for the first course and a March start date for the second course; summer, 2 courses; fall, one course; spring, capstone course. The course rotation for SMHEC was also altered to a cohort structure, with some courses offered in the executive format. SMHEC cohort participants now reach several counties as well as members of the Maryland NEAYC chapter. Enrollment in courses held at USG increased and continues to increase. The demand for courses beyond the specified course matrix is evident. Students are completing courses at both USG and TU. Anne Arundel Cohorts continue to flourish with the expectation of a new cohort to begin in 2014. No marketing has taken place for the promotion of the HEAT Center at this time. Enrollment has decreased drastically. A course rotation has not yet been established for the HEAT Center however with a course rotation in place, it is expected that enrollment at the HEAT Center will rebound. An interest session was held in Howard County for a new cohort to begin fall 2013. Applications are forthcoming. On-Line Course Offerings ECED 610 continues to be offered on-line in both summer and winter sessions. Enrollment reaches full course capacity on a consistent basis. The process for ECED 670 Dual Language Learners becoming an approved course is still underway. The expectation is this will take another year to complete (2013-2014 academic year). ECED 665 was approved and is now an on-line course. The process for developing ECED 619 as an on-line course is continuing. Mentorship in Teaching Faculty members were to be identified as mentors in each of the seven required courses, for the four reading electives, and other electives as can be found. Faculty members were identified for ECED 665 (DePetris); and ECED 619 (Steele). An effort to identify faculty members for the remaining courses is underway. To insure high quality instruction in the many course sections offered each semester/summer, regular part-time instructors who demonstrated to be effective in courses they teach would be recommended for associate graduate faculty status. No decisions or progress has been made on associate graduate faculty as university policies for this distinction have not yet been determined. 2. What significant findings emerge from your examination of these data? What we have found in our examination of the data are as follows: The overwhelming majority of candidates in the program are scoring at meeting or exceeding expectations across all locations with a median of 94.6%. Overall scores in all assessments were in a range from 90% to 100%. Candidates were confident in their dispositions as early childhood educators and once again all candidates scored 100%. Assessments 1, 3, 4, 5, 7, and 8 have direct child or curriculum planning or evaluation components, and Assessments 2 and 6 engage candidates in research advocacy designed to lead to direct or indirect positive impacts on children. Our overall candidate strength in these assessments offers important evidence while providing an opportunity for further program improvement. The scores for each assessment are indicated below. Assessment Course Assignment Meets or Exceeds Expectations 1 ECED 609 Final Statement of 92.8% Understanding 2 ECED 611 Research Proposal 94.9% 3 ECED 619 Assessment Tool Kit 92.4% 4 Culminating Graduate Experience Portfolio 90.4% 5 ECED 607 Plan for Commitment and Action 6 ECED 609 Position Paper 95.5% 7 ECED 609 Child Study 94.6% 8 ECED 665 Curriculum Evaluation 93.0% 100% Meets Expectations with Limitations Below Expectations 7.2% 8 of 110 candidates 5.1% 4 of 78 candidates 7.6% 7 of 92 candidates 9.6% 5 of 52 candidates 4.5% 5 of 111 candidates 5.4% 6 of 112 candidates 7% 7 of 43 candidates ECED 609 sequence of assignments and data analysis ECED 609 Growth and Development is the first course in the program. In this course, three assessments are collected as evidence of candidate learning (Assessments 1, 6, 9). The first assignment completed is the child study. This assignment is the last in a series of observational assignments. Candidates have the opportunity to practice observation and recording skills prior to submitting this assignment. The majority of candidates (94.6%) met or exceeded expectations for this assignment. For those scoring below specified minimum requirements, most of the candidates demonstrated difficulty with all aspects of the assignment. In one section alone (TU-fall 2012, 21.2% of the class), seven students did not provide additional questions and two students neglected to submit field notes. Total N= 112 for ECED 609 when the child study was submitted. The second assignment in ECED 609 is the position statement. The majority of candidates (95.5%) completed the Position Statement in ECED 609 meeting or exceeding expectations. A total of 10 students, less than 5% of all students enrolled in ECED 609 scored below expectations. Two students (TU fall 2012) did not submit portions of the assignments and therefore received no credit for those sections. This increased the overall number students scoring below specified expectations. 4.5% of the students scored below expectations with many of those students displaying a lack of writing mechanics. Grammar, spelling and appropriate citations were not noted in position papers submitted by the students. This is becoming a noticeable trend within the M.Ed. and needs to be addressed. APA citations and correct APA format for references was also an issue for many students. Proper citation and reference formatting are needed within the course content. Total N= 111 for ECED 609 when the position paper was submitted. The last assignment in ECED is the Final Statement of Understanding. The majority of students (92.8%) enrolled in ECED 609 completed the Final Statement of Understanding at or beyond expectations. The limited number of students that did not meet specified expectations (7.2%) struggled with connecting course concepts to course content and assignments. Total N= 110 for ECED 609 when the Final Statement of Understanding was submitted. The total N for ECED 609 decreased as the semester progressed. Candidates withdrew from the course. We speculate that the few students with lower scores in these assessments have found that graduate study is not a good fit for them, at least in this point in their lives. For other students, a lack of writing skills is prohibiting their ability to articulate their knowledge on the assignments. Action Research Assessment 2 from ECED 611 Teacher as Researcher provides perhaps the most rigorous assessment of our candidates’ performance as graduate students. Also, taken early in the program, the course offers insight to faculty of the academic, as well as professional, potential (realized or not yet realized) of our candidates. The majority of the students (94.9%) completed the research proposal with expectations met or beyond expectations. 2.6% of the students demonstrated difficulty articulating the statement of the problem and defining the methodology for the research. The remaining scoring leading to a below expectations were due incomplete information provided for budget (5.1%) and timeline (2.6%), and in some cases neglecting to include an appendix (9.0%). Identification and use of appropriate assessments Assessment 3 is derived from data collected from students’ compilation of a variety of assessments designed to provide information in various developmental domains. Students are expected to identify an assessment, the use for that assessment, recognize differentiation strategies in needed for implementation, and articulating how to communicate the results of the assessments with colleagues, professionals and families. The assessment tool kit represents a range of assessments. In ECED 619 Assessment, Observation and Evaluation, Assessment 3 provides strong evidence of our candidates’ proficiency and commitment to appropriate and effective use of assessment of children’s learning. All students met expectations for the tool kit assignment. The majority of students (92.4%) completed the assessment tool kit with expectations clearly met or beyond expectations with only 7.6% of students demonstrating limitations in meeting expectations. Diversity Similarly, from ECED 607 Learner Diversity and Inclusion, data from Assessment 5 provide evidence of our candidates’ commitment to each child and to all children and families. Consistent with the Dispositions data, candidate growth in the awareness of self, understanding of others and commitment to culturally responsive teaching and learning is evident in the data. All students scored wither proficient or distinguished on the Plan for Commitment and Action, with the majority exceeding expectations (95.4%). Of the 4.6% scoring in the proficient range (24-27), all students scored 27 points. Curriculum Assessment 8 provides data regarding the analysis of curricula authentic to the students. Students are expected to critically examine, indicating additional criteria from which to analyze, a specific curriculum, and offer recommendations. Students met the expectations for the curriculum evaluation project in ECED 665. The majority of students (93%) across all sections of ECED 665 clearly met or exceeded expectations. A total of 6 students (7%) completed the assignment with expectations met with limitations. Of these students, lower scores on additional criteria and appropriate citations and references were indicated. The lack of knowledge on proper APA citation has been seen across other courses and assignments. Data support continuing APA citation seminars in ECED 609 to establish proper procedures for referencing and citing resources. Culminating experience – Graduate Professional Portfolio The Graduate Professional Portfolio, as the culminating assessment addressing all NAEYC Advanced Standards and the candidate growth in the M.Ed., is the most comprehensive. Traditionally, data from this assessment have provided strong evidence of candidate performance and program effectiveness across program locations, as well as offering insight into the effects of data-driven changes that have been made. In 2011-2012, 13.6% of candidates scored at the proficient level; 89.9% at the distinguished level. The data from 2012-2013 follows suit with 9.6% at a proficient level and the majority of students (90.4%) at the distinguished level. However at the presentation of their graduate professional portfolio, many candidates indicated they did not consider the connection between coursework, content, assignments, and professional practice until the end of the program. The foundation of the M.Ed. program is based on theory, collaboration, authenticity, application, advocacy, and an ethic of care. The expectation for all students in the M.Ed. is to understand and apply the foundations aligning with the NAEYC Standards for Preparation in Advanced Programs. The lack of consideration of students during the program is a concern. Through informal data collection (inquiries during Seminar, various points in the program, and at portfolio presentations), students indicated a need for more information on the process and content of the graduate professional portfolio. Data supports the continuing of the orientation seminar. Rigor across sections and locations Concerns about insuring consistent instruction and reliable assessment among the multiple sections of courses has been an ongoing discussion but the current data suggest that more uniformly strong instruction is offered across sections and locations. (TU = 15; External Locations = 11) 3. How have you involved faculty in your identification of the implications of these data? Communication, Collaboration, and Documentation The full-time faculty in the department of Early Childhood Education discussed these findings during fall 2013 Department meeting. In addition, faculty members serving on Graduate Portfolio review teams during fall, spring and summer, at both on-campus and off-campus locations have identified implications of the Portfolio assessment data. The Portfolio data provide a strong source of program evaluation information as well as candidate performance and have guided aspects of program improvement. Further involvement occurs as formative assessment, in the form of interim reviews of data from required assessments that have taken place among course instructors, both on and off campus, and the program director. Assessment data are posted on the departmental O: drive, facilitating discussion among faculty at any time. 4. What specific actions will you take in response to these data? (REQUIRED response to NCATE AFI) Exploration of items from 2012-2013 will continue with a plan of action along with newly indicated problems of practice. Graduate Orienting Seminar Plan of Action 2013-2014: Revision of the agenda for the Orientating Seminar to include course progression or sequence, scheduling, portfolio clarification in addition to topics already discussed (philosophy, foundation of program). Orienting Seminar is to be offered each fall and spring on campus. Seminar will be held in conjunction with ECED 609, with an invitation to all students. A graduate representative (Graduate Program Director or Full time faculty member) will attend USG Open House in either fall or spring. Recording of the Seminar will occur fall 2014 or spring 2015 after data analysis of seminars in 2013-2014. Expanded Course Offerings and Established Course Rotations Plan of Action 2013-2014: Fixed course rotations will be monitored for all locations (USG, external cohorts, HEAT, SMHEC). Student feedback on the executive model at SMHEC will also be considered. A new Howard County cohort will begin fall 2013 with ECED 609. On-Line Course Offerings Plan of Action 2013-2014: The process has formally begun to include ECED 670 Dual Language Learners as an approved course in the M.Ed. The process for developing ECED 619 as an on-line course is continuing. Mentorship in Teaching Plan of Action 2013-2014: Identification of faculty for courses continues. In addition, responsibilities for mentorship in these courses are to be outlined. Newly indicated problems of practice Lack of graduate quality writing There has been a greater trend among current and incoming graduate students demonstrating a lack of writing skills. An issue with grammar and spelling has been consistent across assignments and courses. There is consideration to require an essay response as part of the application process. Plan of Action 2013-2014: Informal data collection regarding student quality writing will occur for the 2013-14 academic year. If data is collected supporting this trend, the official process will begin to change program admission requirements. Support is offered to current students through the promotion of the writing center. The Writing Center provides individual writing support to all members of the Towson community, including undergraduate and graduate students as well as faculty and staff. We work with writers at any stage of the writing process from brainstorming to polishing the final draft. We help writers develop and organize their thoughts, sharpen their focus, and communicate their ideas more clearly and precisely. We support writers with any type of writing project, whether that is a PowerPoint presentation for a sociology class, a lab report for biology, or a resume for a summer internship. http://www.towson.edu/writingcenter/index.asp Identifying Additional Issues within the graduate program With a change in position of graduate program director, it is advised that for the academic year 2013-14, limited changes will take place until new graduate program directors have become familiar with and mastered all current procedures in the Master’s program. Plan of Action for 2013-2014: Concerns and issues will be noted (students, courses, schedules, assignments, faculty, procedures, etc) but action plans will not be formalized until 2014-15.