Science, Technology and Engineering Curricula Review Kindergarten to Grade Twelve Natick Public Schools Summary Report Natick Public Schools Science, Technology, and Engineering Curricula Review Team Dr. Karen Leacu LeDuc, Assistant Superintendent, Curriculum, Instruction, and Assessment, Natick Public Schools Mr. Paul Power, 5-8 Science Curriculum Leader – Kennedy Middle School Ms. Jill Pirrera, 5-8 Science Curriculum Leader – Wilson Middle School Ms. Kathi Browne, 9-12 Science Department Head – Natick High School Summary prepared by Karen Leacu LeDuc, PhD Science, Technology and Engineering, K-12, Curricula Review Report Winter 2009 Introduction At the start of the 2008-2009 school year, the Natick Public Schools was charged with conducting a science, technology and engineering curricula review of Kindergarten through grade twelve. The Science, Technology and Engineering Curricula Review Team undertook this task as a vehicle to highlight student learning and as a reflective process to review the science, technology and engineering learning environment for our students. This report contains an historical outline of the implementation of Natick Public Schools K-12 standards-based science, technology and engineering curricula, describes the evaluation process, indicates findings, and makes recommendations for the future. Historical background During the 2003-2004 school year, the Natick Public Schools began the task of reviewing the science, technology and engineering curricula. Under the direction of Ms. Kathi Browne, Natick High School Science Department Head, the district used a “backwards planning” approach to implement the standards as outlined in the Massachusetts Department of Elementary and Secondary Education (MA DESE) Science, Technology and Engineering (STE) framework. Ms. Browne and her team of teachers at Natick High School assessed the learning needs of high school students and determined appropriate content for each of the grade levels at Natick High School and then looked “backwards” to determine science, technology and engineering needs at the middle school and the elementary school. Concurrently, the Natick Public Schools included a curriculum leader position for STE at both middle schools, an important aspect of continued curriculum leadership, grades 5-12. This position oversees the curriculum, instruction and assessment of STE but does not supervise/evaluate teachers at this level. The district used a reflective approach to determining the content and programs offered to K-12 students to engage in deep analytical thinking within a context of stated STE concepts and skills – to support the STE literate student. Beginning in the fall of 2004, a gradual implementation of the Physic First curriculum for freshman began, with full implementation Physics First completed in the fall of 2004. Subsequently, a pathway for science was determined – Chemistry for sophomores, Biology for juniors and an STE elective for seniors. At this same time, the middle school was undergoing some change: Grade 8 Science was devoted to Earth Science, Grade 7 Physical, Grade 6 - Life and Grade 5 - a synopsis of earth, physical and life science. From 2005-2008, under the guidance of Ms. Kathi Browne, teams of teachers at the Kindergarten through Grade 4 level were brought together to review the standards by grade level and to determine what grade level content would be taught at each elementary grade level. Curricula Review Process During the fall of 2008, a Kindergarten to grade twelve STE curricula review was conducted. The review was multi-faceted and informed by the National Study of School Evaluation guidelines: Indicators of Schools of Quality Program Evaluation Series. The Natick Public Schools K-8 Mathematics Curricula Review – Fall 2006 1 district reviewed the K-12 curricula by examining the current Natick Public Schools standards-based curriculum guides with respect to student achievement, in conjunction with instructional systems and organizational systems that are currently in place to support student learning. To do this work, the district convened a STE curricula team comprised of: the two grades five through eight middle school STE curriculum leaders, the nine through twelve STE department head, and the Assistant Superintendent, whose charge was to develop the evaluation process, protocols, and subsequent action steps. Evaluation Process The Indicators of Schools of Quality (see below) were used to frame the evaluation process, which consisted of surveys and a curriculum review. To best gain the perspective of all constituencies, a survey was developed and conducted for all teachers, parents, administrators, and fourth, eighth and eleventh grade students. Note survey respondents: teacher survey, n=119; parent survey, n=168 (58 elementary, 80 middle, and 30 high school); administrator survey, n= 10; and student survey, n= 355 (69 grade 4 students, 229 grade 8 students, and 55 grade 11 students) Additionally, grade level teachers and special educators, with curriculum leaders and department heads, comprised the curricula review team, n=30. Their charge was to review curriculum, instruction, and assessment documents. Additionally, the STE team analyzed results of the Massachusetts Comprehensive Assessment System (MCAS) and common assessments as data points for indicators of the quality of the student work. These multiple evaluation tools, which were used to triangulate the data points, were developed to gain information on the following: Evaluation components - Overview, Analysis, Action Steps (Based on National Study of School Evaluation guidelines, Indicators of Schools of Quality: Program Evaluation Series) Indicators of Schools of Quality (National Study of School Evaluation, 2000) Instructional systems, specifically curriculum, instruction, and assessment o To what extent is an organized, articulated, up-to-date curriculum in place? o To what extent are research-based, best instructional practices being implemented? o To what extent are assessments that reflect student learning goals in place, being implemented, and used to inform instruction? Organizational systems, specifically leadership, professional development and culture of continuous improvement o To what extent is there leadership in place that ensures skillful management of the program, operations, and resources that promote an effective learning environment? o To what extent is there a focus on improving teacher skills and capacity to implement the articulated curriculum? Quality of the work of the students o To what extent do students meet or exceed benchmark expectations of curriculum essentials in the subject under investigation? Natick Public Schools K-8 Mathematics Curricula Review – Fall 2006 2 Multiple sources of data were used to respond to the indicators, as noted below. Teacher Profile Distribution of the years of experience among our K-12 school faculty who responded to our survey: Years Experience 1-5 6-10 11-15 16-20 >20 n=119/133 Gr.K-4: n=83 Teaching 36.4% 23.7% 14.4% 5.1% 20.3% Gr.5-8 : n=26 Teaching in Natick 49.6% 22.2% 12.0% 2.6% 13.7% Gr.9-11: n=15 Special Educators: n= 9 Analysis At least half of our staff is new to teaching and one quarter of the staff has taught in Natick for a minimum of sixteen years. These data points prompted the question: What are the constructs needed to effectively prepare all teachers to teach STE? Additionally, approximately 70% of the teacher respondents are Kindergarten through grade four teachers – what format and type of professional development is needed to support the elementary generalists who, unlike their grades five through twelve peers, do not have a degree/certification in science? What format and type of professional development is needed for our grades Kindergarten through twelve teachers to support their instructional and assessment knowledge? Summary – Teacher Profile Professional development offerings need to be crafted for all teachers, and new-to-thedistrict teachers, to review the STE curricula and resources and to assure teachers have the content understanding for teaching a standards-based program. All teachers in Natick need a refresher of the nuances of the STE curricula to provide consistency across grade level and schools. Additionally, a review of common instructional and assessment strategies would also be helpful. Action Steps Develop and conduct content professional development opportunities for K-4 generalist teachers and 5-12 content area teachers Continue to support the district mentoring and induction program for all new teachers INSTRUCTIONAL SYSTEMS CURRICULUM To what extent is an organized, articulated, up-to-date curriculum in place? o Indicators curricula aligned with frameworks vertical and horizontal alignment Natick Public Schools K-8 Mathematics Curricula Review – Fall 2006 3 curricula documents accessible, used and current curricula materials current and representative of articulated curriculum Overview Since 2003 the district has used a “backwards design” process to delineate curriculum standards for STE. This process looked at the STE standards as outlined by the MA DESE, determined Natick Public Schools curriculum benchmarks, starting with grades nine through twelve, and concluding in 2007, with completed standards for grade eight backwards to Kindergarten. As these benchmarks were written, curriculum resources, instructional strategies, and common assessments were developed. The building and department leadership used staff and department meeting time, coupled with professional development days to familiarize teachers with these documents and to take time to reflect on them. The consistency to which these documents are implemented by classroom teachers supports the students’ successful acquisition of these skills and concepts. In concert with understanding the validity of the curricula documents, for the purposes of this study, the evaluation team sought to understand teachers’ implementation and familiarity with the documents at their grade level and how teachers supported the articulated curriculum in their classroom. Analysis Teacher surveys and open response comments indicated that: 86% of teachers considered themselves to be strong STE teachers 78.6% expose and encourage the use of emerging technologies for STE 75% agree/strongly agree that the STE curriculum is clearly articulated and executable 85.3% feel confident using the district STE curriculum 68.8% have sufficient materials to teach STE Some open response comments from teachers who responded indicated: Need time to fit in science in the elementary curriculum My challenge is finding time to teach science and integrate technology into the daily or weekly schedule. I worry that teachers have yet to “buy in” to the expanded science and engineering curriculum largely because we have so little time devoted to science in our schedules I feel I have to teach myself science in order to teach the children. . . it still requires effort on the part of generalists like myself to become well informed about the science topics Did not feel that we have enough resources to address technology Technology is too new and not yet used It is hard to incorporate technology Natick Public Schools K-8 Mathematics Curricula Review – Fall 2006 4 There is so much we can do with technology . . . district has a young staff, we don’t need to be convinced to use technology. . . it just needs to be made accessible, reliable and easy to use (elementary) The district recently dedicated time and money to training us for the engineering and technology strand, I appreciate that. . . . letting us work each summer on organizing and enhancing the science curriculum so that all teachers in [elementary grade] have the resources for all the science units Lack of time built in the school day is a real problem when it comes to teaching science Engineering unit that the second grade used last year was fun and engaging for children and they learned a great deal I filled out this survey thinking about science and engineering. I really haven’t been using technology in my teaching since we lost our computer lab classroom that had a teacher to support teaching and learning Technology at the elementary level has not been a focus of science instruction. . . My students are currently engaged in an investigative research project which highlights the use of technology and supports the inquiry based research method, but I can only work with 3-4 students at a time. The science curriculum has grown by leaps and bounds . . .thanks to Kathy. I think Kathi Browne has done a tremendous job collaborating with teachers to align our science and engineering units (elementary.) We desperately need a science coordinator [elementary] The STE Curricula Review team reviewed the curricula documents which consisted of pacing guides, curricula grids that outlined standards, curricula resources and assessments. This curricula review was more comprehensive review of STE than what the teacher survey reported. Curriculum teams indicated: 92.3% indicated that the curriculum was aligned to MA DESE grade level standards 76.9% felt that the curriculum was designed to develop students’ understandings and skills 69.2% indicated that the curriculum was clearly articulated and enabled students an understanding of the standards 69.2% indicated that the curriculum was organized into large units of student with a focus on depth of conceptual development and specific end products Curriculum teams open responses: 1 and 2 level physics classes are aligned in assessment and coverage, differentiated by skill level only. All physics levels are closely matched to curriculum frameworks. . prepare the students for the MCAS despite less class time (no labs) than all other sciences. Curriculum is clear and organized…. Leads kindergarteners to observe, collect, and record information... various instructional strategies are used Natick Public Schools K-8 Mathematics Curricula Review – Fall 2006 5 Curriculum is broad and rich, developmentally appropriate and aligned to MA Curriculum frameworks (gr. 3, 4) Teacher friendly lessons. . . organized in a binder . . . directly aligned to MA state frameworks, (gr. 1) Teachers actively seek out support from outside programs to enrich the curriculum (for example, BC Educational Seismology Project, Project ASTRO, Earth Science by Design, LIFT 2 program, Museum of Science) gr. 8 The curriculum lends itself to real world examples, cross-curricula applications, and learning through inquiry (gr. 8) Time allotted to science/sense of priority varies from school to school (elementary) Need to prioritize the lessons in the science binders as either anchor lessons/experiences or additional activities Need a well communicated timeline for administrators and teachers to ensure common experiences for children in science (elementary) There is no syllabus or timeline for how long to spend on units to teach each one (elementary) Administrator surveys indicated that 85% felt that there was a process to evaluate the effectiveness of tools, text, materials, and technology used to deliver the program(s), 60% agreed that there was an open resource planning process that considers the resource allocation needs of STE improvement efforts, while only 30% agreed/strongly agreed that school budgets provide adequate resources for STE instructional materials, professional development, and equipment with 50% agreeing that students and teachers have access to reliable technologies for data analysis, research, and communication. Administrator Open responses noted that: Resources for science have been supplemented by numerous grants. Without these the science department would not have the tools needed to run a number of laboratory experiences necessary in a good science program. The structure of the school day is limited in the opportunities it allows for elementary student to encounter an inquiry based science program consistently. While there is adequate process, time, etc. for review and consideration of needs relative to allocation of resources, the resources available are not adequate to address the science/tech needs - - especially for design and engineering, authentic lab equipment, technology like Vernier probes, etc. Analysis of parent surveys indicated: 78.9% understand the STE content their child knows and is able to do 65% are familiar with the STE program(s) 72% assist their child in learning STE at home 57% agree/strongly agree that the STE curriculum meets their child’s needs Student survey responses indicated: 85.8% think their science work is appropriate for them Natick Public Schools K-8 Mathematics Curricula Review – Fall 2006 6 79.1% understand and use the scientific method in solving problems 77.7% liked learning STE 75.9% think learning STE is important to them When asked what their favorite part of STE was, one third of the respondents indicated earth, physical or life science, with 20% indicating engineering. Parent respondents understand the content but expressed a need to know more about the programs and sequence of science topics. When asked how we can better communicate with you about STE program(s) parent open responses indicated: Have a monthly newsletter summarizing what is going on in the classroom Website explaining curriculum – including how it fits into the middle/high school sequence. Also include educational links used to guide lessons and determine school standards and learning objectives Teacher website or email that is informative about the curriculum, about this unit newsletter, weekly summarizes of main lessons, . . email what is currently being taught so that . . I am able to enhance the learning experience for my child by sharing and discussing Useful to have some “advanced ideas” made available to kids and parents who wanted to invest the time at home challenging their kids and themselves to go farther. It would be helpful if curriculum, topics, and schedule was available online Have a STE display in the building that parents can observe Don’t think enough science is taught in school. Science often alternates with social studies or history. It should be emphasized more In considering communication with families, teacher surveys indicated: 86.2% are comfortable communicating district STE benchmarks with parents with 85% are comfortable communicating with parents about STE program(s) 35.4% usually provide parents with strategies to support the STE learning of their child 53.9% felt that the current communication with parents accurately reflects what students know and are able to do Summary – Curriculum To what extent is an organized, articulated, up-to-date curriculum in place? All constituents articulated that there is a STE curriculum that is aligned to the MA DESE standards in place. Parents and teachers clearly articulated a need to improve communication to students and families regarding STE curriculum, specifically what students should know and be able to do and how they know it. Teachers noted that they use emerging technology, but specifically noted the need to infuse computers in the classroom. Administrators saw a need for more funding for science resources. Natick Public Schools K-8 Mathematics Curricula Review – Fall 2006 7 Action steps Build STE content knowledge of K-4 teachers Provide format to follow the pacing guide as outlined in the curriculum guide Develop consistent usage of curricula resources, inclusive of the STE programs and additional resources Review the amount of time spent on STE at the elementary level Educate families regarding STE programs and standards– all parents, especially parents new to Kindergarten and grade 1 and new grade 5 Increase parent communication – inclusive of school newsletters, teacher and district website, email blast Update website for relevant information to assist teachers, parents and students in gaining an understanding of the programs and STE content Increase support for teacher development and familiarity with the curricula documents and resources - coach, courses, model lessons, lesson sharing, peer observation Improve the use of technology integrated into the curriculum INSTRUCTION To what extent are research-based, best instructional practices being implemented? o Indicators Instruction aligned with curriculum Instruction employs data-driven decision making Instruction engages student learning Instructional support available for all students Varied instructional strategies employed Instruction promotes self-directed learning Overview The K-12 curricula resources provide guidance for meeting the needs of all learners; outlines instructional supports for STE, concepts and skills; and provides opportunities for students gain access to the STE standards. The successful implementation of these resources is key to the use of these best instructional practices. As was articulated in the curriculum summary, the implementation of these resources needed review. Of note is an articulated district goal to differentiate lessons for all learners. Analysis Teacher surveys indicated that 95.5 % generally enjoy teaching STE. With regard to instructional practices: 96.5% use varied instructional practices in their classroom 85.6 % provide flexible grouping for students as part of STE instruction 84.4% have a clear understanding of individual student’s conceptual understanding of STE 80.7% are confident differentiating STE instruction for students needing additional support, while 66.7% are confident differentiating STE instruction for students who need more challenging work Natick Public Schools K-8 Mathematics Curricula Review – Fall 2006 8 77.8% indicated that the design of the curriculum “somewhat” reflected an understanding of the range of ways that diverse students learn 69.7% indicated that they provide students with consistent review and practice to develop skills in STE 46.6% use technology to support STE instruction 33.4% felt that sufficient time is allocated for STE instruction 31.8% felt that there are sufficient support systems available for students who have difficulty learning STE Teacher open response comments indicated: The half days where we meet with Kennedy are very useful, and I feel we do not get enough time . . . we work very well together. Not all grade levels meet with their curriculum leader at the 2 curriculum meetings At the elementary level, it feels as though more emphasis is placed on literacy and math than science and social studies The inquiry process needs to be developed and cultured at a young level in order for students to maintain and advance their curiosity and fascination of science at an older level. This cultivation required hands on learning experiences and time, which are rarely devoted due to the priorities of Literacy and Math I am confident that the reason shy students with special needs are successful in Science is because of the hands-on opportunities provided by teachers. Additionally, teachers are incredibly talented at differentiating their instruction to meet the needs of the learners in front of them, including those excelling in Science. The Curricula Review Team noted: 100% agreed that varied instructional strategies are used in planning curriculum 92.3% felt that the curriculum promotes rich science discourse through learning activities that integrate more than one strategy 91.7% agreed that the curriculum calls for problem formation, problem solving and scientific reasoning 84.6% agreed that the curriculum stimulates students to make connections and develop a coherent framework for scientific ideas 84.6% felt that the STE curriculum design reflects an understanding of the range of ways that diverse students learn 100% indicated yes or somewhat to the prompt that the curriculum reflects sensitivity to, and draws on, students’ diverse background, experiences, and dispositions 69.2% indicated “somewhat” that the curriculum is organized into large units of study with a focus on rich connections, depth of conceptual development, and specific end products (data studies, investigations, design challenges) 53.9% indicated that differentiation is documented in the curriculum guides to meet the needs of diverse learners Natick Public Schools K-8 Mathematics Curricula Review – Fall 2006 9 53.8% responded “somewhat” and 38.5% “no” that the curriculum promotes technology integration across the curriculum to support, reinforce and extend the learning of scientific concepts. Open responses indicated: No time for re-teaching, inquiry based and constructivist experiences (elementary) We need more diverse methods and inquiry-based (elementary) Time allotted to science varies across the district (grade 4) We know our students well (capabilities, weaknesses, IEPs) grade 6 We use a variety of teaching methods to reach many types of learners and diversify these strategies depending on the topic being taught and the students in front of us, curriculum is differentiated (middle school) Inequity in the availability of technology between schools (middle school), but do use technology where applicable There is flexibility and room for teachers to enrich the curriculum and draw from a larger pool of resources, which enhances student learning and enjoyment of the curriculum (grade 8) Only fifty percent of the administrators surveyed agreed that the time allocated STE instruction matches the needs for the content, instructional methods, and student population. One open response indicated that the [s]tructure of the school day is limited in the opportunities it allows for elementary students to encounter an inquiry-based science program consistently.. . I would like to find a way to make science more of a presence in the K-4 classrooms Parent surveys indicated that 60.6 % believe their child is being sufficiently challenged in STE. Over 79 percent of the student respondents agreed or strongly agreed that they feel confident trying different strategies to help them understand with 85.8% indicating that their science work is appropriate for them. 80.1% feel confident asking questions in class. Summary – Instruction To what extent are research-based, best instructional practices being implemented? By definition the STE curricula programs used in the Natick Public Schools are researchbased and incorporate best instructional practices, as was noted in the teacher and curriculum team responses. As was indicated in the curriculum review above, the degree to which the programs and instructional practices outlined in the curricula guides are implemented district-wide is not clear. Leadership will need to take a proactive role in assuring the consistency of the use of these curricula documents and resources, but it needs to be noted that there is no formal leadership for STE at the elementary level. More professional development and colleague collaboration to share ideas and best practices is warranted, as are opportunities for teachers to analyze the data of student learning. Opportunities to provide learning experiences for all students within a differentiated environment were also an articulated need, specifically challenging all learners. Teachers are differentiating lessons, but the curriculum guides do not necessarily reflect these Natick Public Schools K-8 Mathematics Curricula Review – Fall 2006 10 differentiation strategies. Technology use was also an articulated need from parents and teachers Action steps Provide teachers with data-driven decision making opportunities o to gain access to the data points, o to use analysis tools to determine areas of strength and weakness, o to analyze teacher-created assessments to inform instruction Increased opportunities to allow all students to be appropriately challenged Increased time for teachers to meet with curriculum leaders to talk about STE teaching and learning Increased opportunities to use varied instructional strategies to meet the needs of all students Increased teacher training to use existing technologies in STE coupling instructional practices with current best practices ASSESSMENT To what extent are assessments that reflect student learning goals in place, being implemented, and used to inform instruction? Overview During the 2003-2008 school years, district goals have outlined the process to develop common assessments. While this process has been slow, every content area has at least two teacher-created common assessments, which teachers use to inform instruction. The district curriculum, instruction, and assessment goals will continue to include these important assessments as a vehicle to assess student learning of stated standards. During the 2008-2009 school year, each grade level, five through twelve, will implement a system to collect this data by class/grade/school/district in order to review trends across the schools and to assure consistency in implementation of the state curriculum objectives. Additionally, the Massachusetts Comprehensive Assessment System (MCSAS) is administered in science for grades five, eight and high school assessments for physics, chemistry, and biology. These assessments informed our look at the Quality of the work of the students (the next indicator of school quality.) Analysis Teacher survey respondents indicated that: 93.6% use data from assessments to inform instruction 91.3% take student’s prior understanding into account when planning curriculum and instruction 90.9% provide students with a variety of opportunities to show their understanding of STE 80.2% feel that they develop students’ conceptual understanding of STE 73.4% engage in looking at student work with their colleagues 79.6% consistently use rubrics to evaluate student work Natick Public Schools K-8 Mathematics Curricula Review – Fall 2006 11 The Curricula Review Team reported: 92.3% indicated “yes” or “somewhat” that assessment is conducted on a continuous basis and feedback is used as a source of information to improve teaching and learning 83.3% agree that assessments promote equity by expecting that all students, including those with special needs or talents, reach high level of accomplishment. Each student is given opportunities to reach those levels and the necessary support to do so 75% indicated that decisions concerning students’ learning are made as a result of analysis of a variety of sources, inclusive of MCAS, mid- and end-of-year assessments and common assessments. 76.9% responded yes to the prompt that assessments are conducted as an open process by informing students about what they need to know, how they will be expected to demonstrate that knowledge, and what the consequences of the assessment will be – as articulated in the “no secrets” classroom. 69.3% responded yes to the prompt that assessment is conducted on a continuous basis and feedback is used as a source of information to improve teaching and learning 69.3% responded “yes” or somewhat” to the ideas that teachers describe and comment on samples of student work using the Looking at Student Work protocol 61.6% indicated that models and exemplars of formative and summative assessments assist students in planning for learning 58.4% indicated that the data provides a comprehensive and accurate reflection of the overall student performance 53.8% indicated yes that appropriate opportunities are provided for students’ revision of their work 46.2% felt there was a systematic process for collecting and managing student performance data 46.2% felt that all pertinent areas of student achievement data had been collected Open responses indicated: Need to align all assessments directly to the framework Lack of quantity of common assessments and time to construct more – gr. 7 Pre and post unit assessments are available for most units – gr. 4 Assessments vary from school to school. . . there are different expectations for science learning between the buildings (elementary) There is currently no criteria. . . no rubric for end projects or assessments (elementary) Time constraints limit the current analysis of student work to common multiple choice questions. Currently, common questions are used at each level of biology (0, 1, 2). In addition, on the mid-term and final exams, 20 questions are common on ALL exams, regardless of level Using common assessments and data analysis allows improvement in both curriculum and assessment instruments Natick Public Schools K-8 Mathematics Curricula Review – Fall 2006 12 Teacher survey prompt responses are noted below: 35.4% usually provide parents with strategies to support the STE learning of their child 53.9% felt that the current communication with parents accurately reflects what students know and are able to do When asked “I use data from assessments to inform instruction”, 73% responded “usually.” Which assessment practices do you use? Usually Pre-assessment 53.2 Informal 80.0 (formative assessment) MCAS data 28.4 End- or mid-year 43.0 assessments Lab reports 23.6 Tests 43.9 Projects 61.1 Teacher-created 70.0 assessments (recorded in percent) Sometimes 34.9 17.3 Rarely 9.2 0.9 Never 2.8 1.8 12.8 14.0 13.8 5.6 45.0 37.4 17.9 17.8 32.4 23.6 13.2 12.1 1.9 3.6 45.3 26.2 4.6 2.7 The results indicate that most teachers usually pre assess their students to determine prior knowledge, use informal assessments – ticket to leave, summary – use projects and teacher-created assessments coupled with end- or mid-year assessments to determine student learning. Only 28.4% “usually” use MCAS data, in part, because 70% of the respondents are K-4 teachers, with only grades 3 and 4 reviewing this information. Additionally, lab reports are usually not used at the elementary level, thus the high percentage of respondents indicating that choice. Parent surveys indicated that 71.3% of the respondents have a good idea of their child’s progress in STE but only 66.7% receive accurate reports of their child’s progress in STE. Student survey respondents indicated that 87.3% agree that their STE work is appropriate for them and 67.8% indicated that the amount of STE homework they received was just right. Summary – Assessment To what extent are assessments that reflect student learning goals in place, being implemented, and used to inform instruction? Many teachers and students indicated that the assessments gave them valid information about the STE learning, but there needs to be a more consistent approach to administration of the assessments and collection of the data to inform instruction. Additionally, more assessments need to be created to assure that all standards are being addressed. Natick Public Schools K-8 Mathematics Curricula Review – Fall 2006 13 Action steps Develop and analyze teacher-created common assessments, by standard, grade level Develop a formal process for collecting data on assessments, to inform instruction Administer assessment(s) more consistently across the school/district Continue the use of the Looking at Student Work and Planning protocol to assure consistency in administration and interpretation of the assessments Use the data from assessments to inform instruction and progress toward student learning Use the results of the assessments to assist students and parents in understanding student attainment of stated standards QUALITY OF THE WORK OF THE STUDENTS To what extent do students meet or exceed benchmark expectations of curriculum essentials in the subject are under investigation? Overview All aspects of the curricula review process - a clear and articulated curriculum, instructional practices, formal and informal assessments, leadership, communication and professional development are all integral structures to support student learning. In order to accurately assess student progress towards stated standards, a data review of the formative and summative assessments used by teachers is warranted. The criterionreferenced assessments, coupled with teacher-created common assessments afford the district the opportunity to assess student learning. Analysis Longitudinal analysis of MCAS scores over the past four years indicates that students moved towards proficiency – to a greater degree than the state. Additionally, cohort data for students, by year of graduation, indicates that students in 2010 class who scored Proficient or Advanced increased from 2006 to 2008 by 23%. Additionally, grades five and eight students are assessed on life, earth, and physical science, and technology and engineering, content that is learned over the grades three to five years and six through eight years. Teachers have begun to share common learning experiences over these years to review content taught over the previous year(s). Cohort data YOG 2009 Science Grade/Date A , P , NI, W District State Grade 8 Grade 8 (2005) (2005) 8, 38, 39, 16 4, 29, 41, 26 Natick Public Schools K-8 Mathematics Curricula Review – Fall 2006 14 . Cohort Data, continued YOG 2010 Science Grade/Date A , P , NI, W District State Grade 10 (2008) 24, 39, 33, 4 Grade 10(2008) 14, 43, 31, 12 Grade 8 (2006) 3, 37, 45, 15 Grade 8 (2006) 4, 28, 43, 25 Grade 5 (2003) 31, 33, 29, 8 Grade 5 (2003) 19, 33, 34, 14 YOG 2011 Science Grade/Date A , P , NI, W District State Grade 8 (2007) 6, 40, 41, 14 Grade 5 (2004) 30, 41, 24, 5 Grade 8 (2007) 3, 30, 44, 24 Grade 5 (2004) 20, 35, 33, 13 YOG 2012 Science Grade/Date A , P , NI, W District State Grade 8 (2008) 6, 56, 32, 6 Grade 5 (2005) 28, 41, 26, 5 Grade 8 (2008) 3, 36, 39, 22 Grade 5 (2005) 16, 35, 38, 12 Overall analysis of MCAS Science MCAS, grade 5, Proficient/Advanced % only Grade 5 Science Prof/Adv District Kennedy Wilson 2003 2004 2005 2006 2007 2008 64% 66% 60% 70% 67% 73% 69% 61% 74% 67% 63% 74% 65`% 61% 70% 66% 67% 67% Natick Public Schools K-8 Mathematics Curricula Review – Fall 2006 15 Subject Area Subscores on Standard Test, total points attained, percent, all students Gr. 5 MCAS Earth Life Physical Tech/Eng 2003 68% 70% 73% 81% 2004 69% 74% 78% 77% 2005 72% 77% 74% 78% 2006 69% 68% 74% 79% 2007 61% 74% 73% 74% 2008 73% 73% 80% 72% Mult Choice Open Response 78% 62% 78% 67% 81% 65% 80% 60% 79% 56% 81% 64% A review of the content strands served to gain an understanding of student progress towards stated standards/benchmarks. Over the six years of administration, students have improved in their understanding of earth and physical science, and remained stable in the areas of life and technology and engineering. Science MCAS, grade 8, Proficient/Advanced % only Grade 8 Science Prof/Adv District Kennedy Wilson 2003 2004 2005 2006 2007 2008 36% 36% 36% 45% 48% 43% 46% 35% 53% 40% 41% 39% 46% 44% 48% 62% 66% 63% The district has seen a steady increase in students who score in advanced/proficient, with the largest gain of 16% between 2007 and 2008. Subject Area Subscores on Standard Test, total points attained, percent, all students Gr. 8 MCAS Earth Life Physical Tech/Eng Mult Choice Open Response 2003 62% 58% 57% 63% 71% 42% 2004 67% 60% 64% 71% 73% 53% 2005 68% 60% 60% 73% 72% 53% 2006 82% 62% 59% 71% 77% 54% 2007 70% 61% 56% 74% 72% 55% 2008 73% 71% 73% 67% 73% 68% A review of the content strands served to gain an understanding of student progress towards stated standards/benchmarks. Over the six years of administration, students have improved in their understanding of life, physical sciences and remained stable in their understanding of earth science and a experienced a slight decrease in technology and engineering. Science MCAS, Introductory Physics, grade 9, Proficient/Advanced % only Grade 9 Science Prof/Adv District 2007 2008 62% 73% First administration was in the 2007 school year, where the district received school-based results. To note, all ninth graders at Natick High School took this assessment, with an Natick Public Schools K-8 Mathematics Curricula Review – Fall 2006 16 increase of 11% reaching proficient/advanced for the 2008 school year. Passage of this assessment, which includes students who score “need improvement”, is a requirement for the class of 2010. Mid- and end-of-year benchmark assessments Since 2005, teams of teachers from grades five through twelve have developed at least two common assessments that are administered across the district. These assessments have been piloted and refined over the years and data collected at the classroom and grade level. During the 2008-2009 administration of the common assessments, trends in student data will be reported at the district level for grades five through twelve. During these intervening years, grade level teams have analyzed the assessments for question validity and assessment of the stated standards and revised as needed. Summary – Quality of the Work of the Students During the 2009 school year, data collection will include grade level common assessments, which will serve to identify areas for improvement based on student learning of the NPS STE curriculum, and this data will be compared to the last administration of the MCAS to determine strengths and areas for improvement. Action steps - Quality of the Work of the Students Provide more opportunities for teacher use of longitudinal analysis of MCAS and common assessments by content strand to inform instructional practices Use of LASW protocol for consistency in grading benchmark assessments Develop “study guide” materials to ensure that students have a review of the 4 content subgroups for STE in grades five and eight ORGANIZATIONAL SYSTEMS LEADERSHIP To what extent is there leadership in place that ensures skillful management of the program, operations, and resources that promote an effective learning environment? o Indicators monitors progress promotes continuous reflection on practice and student achievement actively supports teaching and learning promotes and plans for continuous improvement in student achievement Overview Leadership is key to the successful implementation of any standards-based curricula. Building administrators are responsible for the supervision and evaluation of the science learning in their schools. In 2003, a curriculum leader, 5-8, was hired for each middle school to support the science program. This work included the development of the Natick Public Schools K-8 Mathematics Curricula Review – Fall 2006 17 curricula documents and assessments and facilitation of collaborative, collegial conversations during department meetings. A high school science department head has been in place for many years, with this person doing the same work as the curriculum leaders, coupled with supervision and evaluation. There is no formal support for science at the Kindergarten to grade four levels; however, the high school department head has assumed oversight of the curriculum review for these grade levels. Analysis Teacher surveys indicated that 65.7% of teachers felt that leadership encourages and supports STE content and teaching practices and 47.7% receive useful feedback on their instructional practices from their supervisor. Administrator surveys indicated that 49% respondents felt that there is strong STE leadership at the site, 60% felt that there is a supervisor who is responsible for coaching and/or evaluation of teachers, 80% supported implementation of state and national trends in STE, with 70% agreeing that teachers share leadership through a variety of activities (e.g., planning teams, peer review.)80% felt that leadership provides time for teachers to implement STE teaching Summary - Leadership There is a disparity in curriculum leadership K-4, 5-8, and 9-12. There is no formal content leadership structure for grades Kindergarten to four. In grades 5-8, there are curriculum leaders who oversee content during monthly department meetings, and at the nine through twelve level, there is a Science Department Head, who has an abbreviated teaching load and does supervise and evaluate staff. Action steps Assure that Kindergarten through grade twelve leaders are supervising teachers in implementing the articulated curricula and using data to inform student acquisition of learning standards PROFESSIONAL DEVELOPMENT To what extent is there a focus on improving teacher skills and capacity to implement the articulated curriculum? o Indicators Teachers have content and pedagogical knowledge to implement the curriculum Teachers participate in professional development offerings Professional development insures teachers have content knowledge and pedagogical skills Professional development provides conditions that support productive change and continuous improvement Overview – Professional Development Teacher training for content knowledge and understanding of the curricula materials is a very important aspect of the STE instruction in our schools. Since the fall of 2003, several opportunities for teacher training in these areas have been offered – Fulcrum Natick Public Schools K-8 Mathematics Curricula Review – Fall 2006 18 Institute, BC collaboration, district professional development days, after school districtsponsored graduate courses, summer workshops. Analysis – Professional Development Percentage of responses to the following prompt(s): Please provide us with some information about your professional development experiences and needs with respect to STE and the teaching of STE. Rate the following support structures the system provides for teaching STE. (recorded in percent) Very helpful Somewhat helpful Helpful Not helpful District early release 23.4 35.5 18.7 22.4 day School early release 23.8 36.2 21.9 18.1 day School-based grade 46.6 28.2 17.5 7.8 level meetings 25.3 13.7 12.6 Classroom 48.4 demonstrations Courses and 23.0 35.0 21.0 21.0 workshops offered by the district 7.3 22.9 20.8 49.0 Individual meetings with the principal Individual meetings 27.7 28.7 18.8 24.8 with curriculum leader/department chair Grade level meetings 38.5 30.8 19.2 11.5 with curriculum leaders to support STE instruction and assessment Data indicates that there are support structures within the Natick Public Schools that support teachers in their professional development, specifically district and school early release days and grade level meeting. As was stated previously, there is no formal STE curriculum, instruction and assessment support at the elementary level. Considering all of the STE professional development you have participated in during the last 5 years, how much was each of the following emphasized: Learning how to: Not at all Little Some To great extent Teach units or 24.3 18.4 39.8 17.5 chapters Use data from 18.4 34.0 35.9 11.7 assessments to inform instruction Understand the STE 1.9 16.2 43.8 38.1 content that I am responsible for teaching Use 10.5 14.3 39.0 36.2 inquiry/investigation oriented teaching strategies to gain an understanding of student’s thinking Use technology in 35.6 18.3 36.5 9.6 mathematics instruction Use engineering in 24.3 23.3 34.0 18.4 science instruction Assess student 11.7 23.3 45.6 19.4 learning Teach STE in a class 37.5 26.0 28.8 7.7 that includes students with special needs Natick Public Schools K-8 Mathematics Curricula Review – Fall 2006 19 Professional development offerings in teaching units or chapters, understanding the STE content, using inquiry/investigation oriented teaching strategies, and assessing student learning have been emphasized over the last five years. More professional development is needed for using technology and teaching STE in a class that includes students with special needs. What is the total amount of time you have spent on professional development in mathematics or the teaching of STE over the past five years? (Answer this regardless of whether or not you were teaching in Natick during all those 5 years.) None 3.6% Less than 6 hours 21.8% 6 to 15 hours 20.0% 16-35 hours 21.8% More than 35 hours 32.7% One third of the teacher respondents indicated that over the past five years, they have participated in more than 35 hours of professional development and 21.8% indicated 1635 hours of professional development. The following information will assist in creating professional development offerings: I am interested in taking a STE content course in: Life Science 61.2% Physical Science 62.9% Earth Science 56.3% Engineering 58.5% Technology 79.2% Inquiry-based teaching strategies 80.2% Using technology in the content area 88.9% Summary – Professional Development Clear, focused professional development with the curricula leader was articulated as the most preferred mode for this work. Teachers indicated a need for more content-focused courses coupled with instructional strategies to meet the needs of all learners. Action Steps – Professional Development Continue to offer STE content courses (e.g., District after-school courses, Annenberg courses, study groups, summer workshops) Use the district early release professional development time to support STE Develop new teacher orientation to the STE curricula and resources Summary While the review of the indicators of school quality provided an opportunity for the Natick Public Schools to reflect on the teaching and learning of STE for our students, it also provided a unique opportunity to highlight next steps to assure a consistent, comprehensive approach to STE for the district, schools, and teachers. Those indicators – an organized, articulated, and executed curriculum; research-based and implemented best instructional practices; formative and summative assessments that reflect student learning goals; organizational systems that support these aspects of student learning; and professional development opportunities that work in concert to assure teacher Natick Public Schools K-8 Mathematics Curricula Review – Fall 2006 20 understanding and implementation of these stated indicators will serve to support substantive student learning. A team of teachers, curricula coordinators, and building administrators will develop action plans associated with each of the action steps noted above. These action plans will take into account a three-year span for implementation. Evaluations will be conducted each year to assess successful implementation. Natick Public Schools K-8 Mathematics Curricula Review – Fall 2006 21