Theme: Numeracy, Classroom organisation, Self evaluation Page 1 Associations between students’ perceptions of classroom environment and academic efficacy in Australian and British secondary schools Dorman, J. and Adams, J., Anglia Polytechnic University, UK. Westminster Studies in Education, Vol. 27, No. 1, April 2004 http://taylorandfrancis.metapress.com/link.asp?id=7w6yyum92v9pgaqf Do particular elements of classroom environment help students develop a “can-do” attitude in mathematics? There has been increasing interest in the field of classroom environment recently. Many readers will be aware of the Hay McBer website ‘Transforming Learning’, which offers an interactive tool that teachers can use to measure and improve the climate in their own classrooms. This study of the links between classroom environment and students’ beliefs in their ability to succeed is therefore topical for many schools. Both the environment of the classroom and student beliefs about their capacity to achieve their academic goals (academic efficacy) have been found to have an effect on student learning. The researchers in this study set out to explore relationships between the two fields and to determine what specific aspects of classroom environment had the strongest effect on student academic efficacy in mathematics. They showed that equity, task orientation and teacher support were all linked to students’ confidence that they could learn well (academic efficacy) in mathematics. The researchers used statistical analysis to compare measurements of student academic efficacy in mathematics with their perceptions about various aspects of their classroom environment. They investigated attitudes to mathematics held by over 2,600 students aged 12 to 18 in British and Australian schools and compared their belief in their mathematics ability with their perceptions of classroom climate. The digest provides further information about how different classroom environments seem to be linked to student academic efficacy. Keywords: United Kingdom; Australia; Key Stage 3; Secondary schools; Pupils; Mathematics; Classroom organisation; Classroom environment; Beliefs; Attitudes; Teacher-pupil relationship; Self evaluation Page 2 Contents What does it mean to gather evidence about classroom environment? Page 3 What did the study find out about the relationship between classroom environment and student self-belief? ............................................. Page 4 What did the researchers conclude from the findings? ................ The study aims and design ............................................................. What are the implications for head teachers and teachers? ......... Where can I find out more? ............................................................. Page 5 Page 6 Page 7 Page 8 Page 3 What does it mean to gather evidence about classroom environment? The study aims were three-fold. The first was to investigate the relationship between classroom environment and academic efficacy. The second and third aims related to the nature of the measuring instruments used to assess classroom environment. The researchers wanted firstly, to validate scales from two different questionnaires and secondly, to determine how much scores derived from each of the two measuring instruments contributed to differences in academic efficacy. Researching learning and teaching is always complex because of the dynamic nature of the interactions. Much research therefore focuses on interactions between individuals. But classroom environment research needs to attend to the interactions across all the individuals involved. This requires a sensitive tool to ensure that interactions are recorded and measured consistently. This is why the researchers used and compared measures through two different instruments. The first comes from a well established instrument called “What Is Happening In This Classroom?” (WIHIC). This aimed to measure the following factors: WIHIC scale items and their descriptions Scale Name Scale description Co-operation The extent to which students co-operate rather than compete with one another on learning tasks. Equity The extent to which students are treated equally by the teacher. Investigation The extent to which skills and processes of inquiry and their use in problem solving and investigation are emphasised. Involvement The extent to which students have attentive interest, participate in discussions, do additional work and enjoy the class. Student The extent to which students know, help and are supportive of one cohesiveness another. Task orientation The extent to which it is important to complete activities planned and to stay on the subject matter. Teacher support The extent to which the teacher helps, befriends, trusts and is interested in students. Whilst the WIHIC scale is comprehensive, it is not designed to study constructivism in classrooms. (A constructivist approach is one in which meaningful learning is seen as a cognitive process in which students make sense of the world in relation to the knowledge they have already gathered. Learners link new ideas to current knowledge and to understandings they have constructed, often clarifying their thinking through talking about it with others.) In order to measure factors more characteristic of this type of environment, the researchers’ questionnaire included three additional scales chosen from an instrument called “The Constructivist Learning Environment Survey” (CLES). These were: CLES scale items and their descriptions Scale Name Scale description Personal The extent to which school mathematics connects with students’ out of relevance school experiences. Shared control The extent to which students are invited to share with the teacher control of the learning environment. Student The extent to which opportunities exist for students to explain and negotiation justify to other students their newly developing ideas. The study found evidence to validate the measuring instruments used. They also found that the WIHIC scales accounted for a much greater proportion of group variance than the CLES scales. The findings are discussed further on the next page. Page 4 What did the study find out about the relationship between classroom environment and student self-belief? Students reported a range of views about how far they felt able to achieve their goals in mathematics. School year groups of students in the study were significantly more likely to have high levels of confidence in their ability to understand and tackle mathematics tasks or have a “can do” attitude if they perceived their classroom environment to be: task orientated - it is important to complete activities planned and to stay on the subject matter; equitable - students are treated equally by the teacher; co-operative - students co-operate rather than compete with one another on learning tasks; cohesive - students know, help and are supportive of one another; and supportive – the teacher helps, befriends, trusts and is interested in students. The study analysed the results at both an individual and a group level. The group results are reported above and can be summarised as: fair, supportive, task-orientated working environments appear to promote a “can-do” attitude in students. For individuals, the relative importance of particular aspects of classroom environment differed from the group analysis, as shown below. Table showing the factors most highly correlated with academic efficacy for each type of analysis. (The figures are simple correlation coefficients – i.e. the closer the number is to 1, the more closely one factor is linked to another; in this case, the relationship between each factor near the top of the table and academic efficacy is stronger than the link between those at the bottom and academic efficacy.) Individual analysis Year group analysis task orientation involvement investigation equity student negotiation teacher support co-operation personal relevance shared control student cohesiveness .37 *** .31 *** .29 *** .24 *** .23 *** .20 *** .16 *** .15 *** .15 *** .14 *** equity task orientation cooperation teacher support student cohesiveness involvement student negotiation investigation personal relevance shared control .52 *** .50 *** .33 ** .28 ** .28 ** .22 * .17 .10 .07 - .12 *** Significant: p<.001 – the result is 100 times that which could be expected by chance alone. ** Significant: p<.01 * Significant: p<.05 No star: not significant The authors noted that, although analysis at an individual level led to significant associations with student self-efficacy in mathematics, these correlations were small. They also pointed out that “using the individual as the unit of analysis can provide spurious results because an unjustifiably small estimate of the sampling error is employed in tests of significance.” They therefore concentrated discussion of their findings on the group results. Nonetheless, they noted in passing that some factors emerge as important when the analysis is carried out at the level of the individual that did not emerge as important when carried out at the level of the year group. These were: involvement - student attention, interest, participation and enjoyment; investigation – how much students used problem solving and investigation skills; and, to a lesser extent, student negotiation – the extent to which opportunities existed for students to explain and justify their newly developing ideas to other students. Which measures helped to explain increase in efficacy best? The authors were interested in the ability of the two different measuring scales to account for differences in student efficacy. They found that the three CLES scales contributed very little to differences between student efficacy scores. More of the differences (38%) in student efficacy were explained by the seven WIHIC scales. So, in this study, the instrument designed to measure constructivist aspects of the classroom contributed little to explaining student differences in self-belief. The authors also used statistical analysis to check the validity of the scales. The results showed that the scales were valid measuring instruments. Page 5 What did the researchers conclude from the findings? The researchers concluded that teachers need to ensure their classrooms are high quality teaching and learning environments. Student confidence was likely to be raised in classrooms characterised by high levels of co-operation, harmony, genuine teacher support, student cohesiveness, task orientation and equity. Teachers who dwelt on student failures rather than helping them to build progression and who created an environment characterised by competition and conflict did not improve levels of student confidence. Two particular concepts have been found in other research to have a positive effect on student learning. The first is constructivism, in which students make sense of the world by linking new ideas to understandings they have already built up. The second is pupil dialogue, which proposes that pupils develop their understanding through discussion. There is a broadly accepted view that constructivist learning environments support academic efficacy. So the researchers were surprised that their results showed little variation in student academic efficacy that could be accounted for by the CLES scales specifically intended to look at constructivist classrooms. One possible explanation, proposed by the researchers, is that constructivism is concerned with critical thinking and higher order learning, whereas academic efficacy concerns one’s ability to perform specific academic tasks. They suggest that it is feasible that constructivism engenders a degree of uncertainty which, in a traditional school system which values certainty, could create a loss of confidence in students. The researchers extended research on classroom environment by linking it to student academic efficacy. They suggest that there is a close practical relationship between the two and that people interested in classroom environment should also be interested in academic efficacy. They state that a substantial body of research has indicated that both classroom environment and efficacy are strong predictors of student success (Dorman, 2002; Bandura, 1997). The researchers suggest that future research should try to unravel the relationship between the three. In particular, they ask to what extent either of the following questions would help to identify the most effective way forward. Does classroom environment have an effect on academic efficacy, which in turn affects student learning? Or, do student perceptions of how able they are to make progress in a given academic field shape their perceptions of their classroom environment in that subject? Page 6 The study aims and design The study aimed to explore links between classroom environment and self-efficacy: specifically, how students perceived the learning environment of their mathematics classrooms and how this related to their own perceptions about their level of competence in the subject. They reviewed other research in the fields of academic efficacy and classroom environment and undertook empirical research to investigate whether specific aspects of classroom environment were linked to measures of student academic efficacy. 2651 mathematics students in Years 8,10 and 12 from nine Australian and sixteen British secondary schools took part. They were asked to complete two questionnaires during a mathematics lesson. Both questionnaires required students to respond on a five-point scale ranging from ‘almost never’ to ‘almost always’. One questionnaire set out to measure academic efficacy in mathematics and included seven items, such as: “I can do almost all the maths class work if I don’t give up” and “Even if the maths is hard, I can learn it.” The other questionnaire consisted of 60 questions intended to provide a comprehensive assessment of the classroom environment. This questionnaire was composed of 42 items on seven scales taken from the What Is Happening In This Classroom? (WIHIC) instrument and 18 items on three scales derived from The Constructivist Learning Environment Survey (CLES). The latter was included to see whether constructivist environments had any specific effects on efficacy. The table below explains the ten measures of classroom environment used for the study. The researchers analysed student responses using a range of statistical methods in order to discover any correlations between different aspects of classroom environment and students’ academic efficacy. The results were analysed at the level of the year group in order to minimise the impact of individual bias. Page 7 What are the implications for head teachers and teachers? In completing this digest, the authors began to ask the following questions about implications for head teachers: The researchers gave most emphasis to the results of analysis at the level of the year group. What features do you analyse at whole school, year group, class and individual levels? Would it be useful to examine whether different trends emerge when results are analysed at different levels? What tools and measures do you use to measure school climate and/or student views on their ability to achieve their goals? Would any of the measures used to conduct this research be of use to your school? What whole-school strategies do you have in place to promote a positive school climate and especially, to promote fairness and a focus on work? How can you support staff to focus on measures which are likely to raise student academic efficacy? The digest authors also began to ask the following questions about implications for teachers: To what extent do you think your own classroom promotes the supportive ethos described in the research? Would you want it to do so? What further aspects of your practice would promote co-operation and student perceptions of fairness and support? The importance of student focus on the task is unsurprising, but the study noted variation in student perception of how important it was for them to complete activities and stay on task. How do you encourage students’ belief that it is important to finish tasks and stay focused? Do any of your colleagues achieve this in different ways? Is this something that would benefit from collective reflection with colleagues? Teachers who advocate a constructivist approach to teaching may find it helpful to see the extent to which the open-endedness (and consequent uncertainties) of their approach is balanced by more supportive (and more definite) measures in other parts of their work. Page 8 Where can I find out more? Bandura, A. (1997) Self-efficacy: the exercise of control. New York: Freeman. Dorman, J.P. (2002) Classroom environment research: progress and possibilities, Queensland Journal of Educational Research, 18, 112-140. Fraser, B. J. (1986) Classroom environment. London: Croom Helm. Fraser, B. J. (1994) Research on classroom and school climate. In: D. L. Gabel (Ed.) Handbook of research on science teaching. New York: Macmillan. A four year study on teachers’ work lives and their effects on pupils: www.nottingham.ac.uk/education/centres/crtsd/vitae/ (Newsletter 6 includes survey results from pupils about their learning.)