2. Goals of the study and research questions

advertisement
Swantje Lahm, University of Bielefeld
Towards Writing Enriched Curricula at Bielefeld University, Germany: An Educational
Design Research Study
Content:
Proposal Summary ........................................................................................................................................ 1
A few words before ........................................................................................................................................ 1
Roadmap to the text: ..................................................................................................................................... 2
1. POINT OF DEPARTURE AND THEORETICAL BACKGROUND ......................................................... 3
1.1 German Higher Education in transition: context and reason for the study ............................................ 3
1.2 Theoretical ankers................................................................................................................................... 5
1.3 „Decoding the Disciplines“ and other approaches toward curriculum reform and the integration of
writing into the curriculum ......................................................................................................................... 14
2. GOALS OF THE STUDY AND RESEARCH QUESTIONS ..................................................................... 15
2.1. Goals .................................................................................................................................................... 15
2.1 Research questions ................................................................................................................................ 16
3. METHODOLOGY AND RESEARCH PLAN ............................................................................................. 17
3.1 Methodology.......................................................................................................................................... 17
3.2 Research Plan ....................................................................................................................................... 19
4. LITERATURE ................................................................................................................................................ 22
5. APPENDIX ..................................................................................................................................................... 27
5.1 Institutional Description ....................................................................................................................... 27
5.2 Key theorists and frames ....................................................................................................................... 29
5.3 Glossary ................................................................................................................................................ 30
swantje.lahm@uni-bielefeld.de [12/15/2014]
Proposal Summary
The goal of my study is the development, carrying out and testing of a special format for
faculty development, a Curriculum Design Program. The context is the Bielefeld University
(Germany), more specifically departments which participate in a curriculum design process.
Practical experience at Bielefeld University and recent literature about curriculum
development in Higher Education in Germany have shown that efforts to change contentbased into competence-based curricula often fail. It can be argued that this failure is the
result of a lack of an adequate conceptualization of the curriculum design process which
involves faculty both as disciplinary experts in their field and as teachers. In order to address
this problem my study seeks to develop a Curriculum Design Program which is intended to
initiate a bottom-up departmental process. In this Program faculties reflect upon their
disciplinary ways of knowing, doing and writing as researchers and develop ideas for
curriculum change based on this. It is anticipated that this approach will help to overcome the
resistance of faculty and departments to previous top-down efforts to change curricula. It is
also expected that this approach will help to better integrate writing as fundamental mode of
disciplinary learning into curricula. The study comprises two parts. In the first part of the
study the Curriculum Design Program (CuDesign) will be conceptualized based on literature
and qualitative inquiries. In the second part CuDesign will be tested and the results be
described within a case study framework.
A few words before
The following text is my first attempt to think through a new project. My goal is to develop a
Curriculum Design Program (CuDesign) which will interest and engage departments at the
university of Bielefeld (Germany) in collaborative thinking and planning about how writing
could be meaningfully integrated into the curriculum. Based on theoretical and empirical
research I want to develop an approach which is context-specific and takes departments,
disciplines, and individual teaching beliefs as major variables of influence on the curriculum
design process into account. My overall perspective on the problem is shaped by systemic
thinking, which means that I distance myself from simplistic notions of change which assume
that change in a department can be realized by top-down leadership. Instead I assume that
change processes are „contingent and contextualized“ (Knight/Trowler 2000: 69). It is
therefore crucial to choose a course of action both for the research and the design which is
dialogic, iterative (factors in new information as they emerge) and involves participants.
Educational Design Research (EDR) is a framework which takes account of these
requirements.
As my thinking evolves in the writing process, the text will be lengthy at times and
sometimes the relevance of some sections (especially in the theory part) may not come
through clearly. I nevertheless dare to let my readers struggle with this, because I hope that
feedback will help me to understand connections better myself. Right now I am in the process
of trying to understand what happens in a curriculum design process and to deduce design
principles for CuDesign from that.
1
swantje.lahm@uni-bielefeld.de [12/15/2014]
Roadmap to the text:
In 1.1. „German Higher Education in transition: context and reason for the study“ I explain
the larger context for my study and try to show the relevance and need for this project.
Section 1.2 „Theoretical ankers“ is quite long, because I am in the process of trying to
understand how curriculum design processes can be analytically grasped. I detected a huge
body of literature and I am in the process of finding my way through.
In section 1.3 I list some universities in the US which have involved faculty in curriculum
design processes, most of them are aiming at a meaningful integration of writing. This
section is very rough, because I still need to look at the various models and approaches more
closely. I do describe a little bit of the Decoding approach by David Pace and Joan
Middendorf, because already use it with great benefit at Bielefeld University. I also highly
value it for giving faculty the opportunity to develop their own language for talking about
student learning outcomes.
In part 2 I try to define my goals and research questions. Readers do need a lot of patience
until I arrive at this point and may want to jump forward in between and read this part prior to
reading through all theoretical ankers. I nevertheless placed goals and research questions after
the theory section, because the theory very much helps me to refine my questions.
Part 3 tries to develop a research methodology. My home discipline is history and I am
familiar with interpreting qualitative data, but not familiar with methodological approaches
for doing so. I would greatly appreciate advice in this respect.
2
swantje.lahm@uni-bielefeld.de [12/15/2014]
1. Point of Departure and theoretical background
In order to argue for the relevance of my study, I will first describe the specific situation of
German Higher Education as it is right now (1.1). I will then point out why addressing
faculty as teachers without considering their role as disciplinary experts and their position in
a department is a serious impediment to curricular change (1.2) Based on the assumption that
discipline matters, I will present in 1.3 approaches to curriculum design which focus on
disciplinary ways of knowing, doing and writing.
1.1 German Higher Education in transition: context and reason for the
study
German Higher Education is in a fundamental process of restructuring and renewal. Together
with other European countries Germany decided in 1999 to become part of a joint Higher
Education System with comparable degrees and structures. This process is usually referred to
as the „Bologna process“.1 As a consequence Germany switched from Diploma and Magister
degrees (6 years of study) to Bachelor’s (3 years) and Master’s degrees (2 years) and new
curricula were designed. New programs had to become accredited. A major criterium for
accreditation was the inclusion of key competencies (German: „Schlüsselkompetenzen“) as
an explicit part of the curriculum. But the shift from content-based to outcomes-oriented,
competency-based curricula proved to be very difficult. Many universities added courses for
key competences as extra-curricular courses and hired staff from outside the disciplines to
teach problem-solving, communications skills and other so called key competencies. The
disciplinary curricula often remained content-oriented and in regular courses key
competencies continued to be taught mostly implicitly.
This overall practice of teaching key competences as generic skills in non subject specific,
extra curricular courses also affected the role of writing in German Higher Education in the
post Bologna educational landscape. Generally, explicit teaching of writing has no tradition
in German universities. In contrast to the US no first year composition exists and the first
initatives for writing instruction at the university came into being only in the 1990s. Their
focus is to provide extra-curricular service and support students who address the writing
center with questions about how to manage the writing process. With the beginning of the
Bologna process writing projects began to thrive, but they remained mostly separate from the
disciplines.
Only in the last years some places have become interested in Writing Across the Curriculum.
But this interest so far had only little influence on the systematic integration of the teaching
of writing into disciplinary curricula. A discourse about writing as being a generic key
competence which does not fall into the domain of disciplinary teaching dominates.
From the perspective of disciplinary learning this is a serious shortcoming. Especially in the
US the effectiveness of writing-intensive instruction for deep disciplinary learning has been
1
with reference to the Italian town Bologna where European ministers of Education met in 1999.
3
swantje.lahm@uni-bielefeld.de [12/15/2014]
demonstrated by well-designed small-scale, quasi-experimental studies (Carter, Ferzli, Wiebe
2004) and by several large-scale studies (Astin 1992, Light 2001, Anderson et al. 2009, Arum
and Roksa 2011).
Despite the broad evidence, the potential of well-designed courses which use writing as a
medium for disciplinary learning is not widely acknowledged in Germany. This has several
reasons:
Firstly, the German culture of teaching and learning is highly influenced by 19th century
notions of academic freedom and the learning „in the mode of research“ (Humboldt 1810),
which means that teaching is regarded as socializing students into a discipline and explicit
teaching of procedural disciplinary knowledge is not necessary. Secondly the notion of key
competencies, seen as generic competencies, did contribute to the fact that writing was not
integrated into curricula. Jones’ research on generic skills and attributes and their enactment
in teaching practices shows that in Australian universities faculty rejected the teaching of
generic skills, although they clearly could understand and explain the relevance of these skills
for their disciplinary context when they were asked. Jones interprets this as „consequence of
the top down imposition of statements of generic attributes onto subject outlines. Because
these are not framed as part of the disciplinary content, but are seen as extraneous they are
resisted.“ (Jones 2009: 181). Similarly in Germany, the notion of writing as being a generic
skill, has precluded its integration into curricula. This is a problem, both in terms of learning
to write and writing to learn the discipline.
Research on Writing in Higher Education for a long time has shown the futility of trying to
teach writing as a generic skill (Russell 2002; Beaufort 2007). The notion of writing as a
generic skill oversimplifies the reality of writing as a highly complex activity, which has been
conceptualized as a form of social action within disciplinary contexts (Bazerman 2014;
Gruber 2014). According to Russell the idea of writing as a generic skill corresponds with a
„myth of transiency“, which refers to the idea that writing can be taught in one spot at the
curriculum and students problems will be solved once and forever. Those who stress the
situated nature of writing on the contrary emphasize that it has to be taught and learned
within the disciplinary context and practiced throughout the whole study program. This
notion of writing as disciplinary action has led many WAC initiatives in the US towards
advocating the systematic integration of writing into curricula. Universities like North
Carolina University or the University of Minnesota (Wagner et al. 2014; Anson et al. 2012,
Carter 2002) for example, let departments define learning outcomes for graduates of their
programs both with respect to writing and subject matter learning. Curricula are then
systematically revised and respective writing assignments are included.
The University of Bielefeld aims to integrate writing as a mode of disciplinary learning into
curricula. Hosting the first writing center of a German university (founded in 1994) it has
slowly built a culture which acknowledges the importance of writing as a mode of
disciplinary learning. But for the reasons I have outlined the design of writing enriched
curricula is still a highly ambitious and difficult project. As in other universities writing is
still perceived as a generic skill by many faculty and this difficulty is elevated by the fact that
4
swantje.lahm@uni-bielefeld.de [12/15/2014]
traditionally in Germany teaching is regarded as an individual activity and a matter of
freedom of research and teaching. Departments do lack a culture of collaboratively working
on teaching problems.
Until now research on program design and organizational development in Higher Education
has little to offer to guide practical efforts in creating writing enriched curricula in a German
context. My research aims to make a contribution in this respect. In order to address both the
misconception of writing as a generic competency and the lack of collaborative commitment
to designing writing enriched curricula my study employs an Educational Design Research
(EDR) approach (McKenney, Reeves 2012; Plomp, Nieveen (2010). In EDR the design of an
educational intervention and research merge with the aim to both contribute to practical
problem solving and contributing to theories about teaching and learning in specific contexts.
Based on existing research inquiry into local knowledge the problem is defined and the
designer-researcher develops an intervention, the prototype. The prototype is tried out and in
several iterations refined and re-designed until it represents an adequate solution to the
problem. In this process formative evaluation plays an important role. Design and research,
understood as systematic information gathering and reflecting outcomes, complement each
other. Examining the impact of the well-designed and tested intervention can and should lead
to the formulation of research based principles and practices which have relevance not only
in the local context, but in other contexts, too.
For the purpose of this study I intend to develop and test a Curriculum Design Program
(CuDesign) for departments in Bielefeld who work collaboratively on designing a writing
enriched curriculum.
1.2 Theoretical ankers
Before describing the goals of the study in more detail, I will point out some of the
theoretical ankers which are helpful for refining my assumptions, frame my research
questions which I will present in section 2 and help design the Curriculum Design Program.
Systemic perspective on curricular change
In everyday life we often think in linear and causal fashion (“if I will do X, Z will happen“).
This can be an adequate strategy for putting a nail into a wall, but usually fails when we think
about interventions into what Willke calls “non-trivial social systems” (Willke 2005).
Examples for non trivial social systems are individuals, a department, a classroom.
“Individuals and even more so social systems are non-trivial systems in the sense that they
react in quite a complex and usually perplexing way to external stimuli. These units even
define internally what they want to accept as a stimulus.” (Willke 1987: 23). From the
perspective of modern systems theory developed by Helmut Willke any intervention geared
towards changing a curriculum has to part with the idea that it can be changed by a top down
transfer of previously successful models into a new context. For the purpose of my study I
will look at a department or more precisely a group of faculty within one department as a
social system, which means that interactions within this systems are defined by rules, shared
5
swantje.lahm@uni-bielefeld.de [12/15/2014]
norms and values. The system is autonomous in the sense it selects and codes information
from the environment in a way to guarantee it’s own survival. This means that even
“seemingly ‘pathological’ behavior of an indicated client or system is precisely functional for
this very system, which means that it serves the survival and operational continuity of this
system (Willke 1987: 24). In my role as a faculty developer I sometimes get frustrated by a
lack of engagement and interest of faculty in matters of teaching and curriculum. In terms of
systems theory lack of interest as a reaction towards external stimuli is a foreseeable reaction.
According to Jay Forrester social systems share four characteristics (Forrester 1972: 200):
1. They are insensitive to most policies or interventions that people select in order to alter the
behavior of the system.
2. Systems resist change.
3. All complex systems seem to have a few “influence points”. If interventions succeed in
pushing these buttons, the system’s way of operating can be changed.
4. Their behavior is influenced by the fact that because of their complexity they develop a
dynamic balance of various and contradicting forces.
For curriculum reform in Higher Education this means that findings which stress that even in
the US “despite long-established traditions in continuous quality development of study
programs, initiatives often fail to permeate the practices of students and faculty” (Jenert
2014: 2) do not come as a surprise. From a systems theory perspective it is to be expected
that both faculty and students do not welcome innovations which come from an external
environment.
From a systems theory perspective it is important to notice that the intervening system cannot
change the focal system, all it can do is to try to support and initiate processes of selftransformation. This is why I chose Educational Design Research (EDR) as an approach for
developing an intervention geared towards change of the curriculum. EDR helps to provide
information which is the basis for departments to make decisions. Faculty are addressed as
and participate as key stakeholders in the research and the design process. They decide
whether to embark on a curriculum design process, what kind of key learning outcomes for
graduates to include, etc. Systems theory also helps to take into account that any external idea
about what might “help” or support the system are hypotheses in the sense that only the
reactions will show what is adequate. For the designer-researcher it is important to be aware
of his/her own constructions in order to be able to revise them if necessary.
My role as a designer-researcher is not to give recommendations in the first place, but to
provide information which will support the system in autonomous decision making. A key
research interest in the process of production of relevant information will be to find out what
is relevant according to the “discriminatory rules of the system” (Willke 1987: 32) and design
the intervention accordingly. Willke characterizes this approach to inducing change in a
social system as guidance. “Guidance may be characterized as the art of intervening in a
complex system in a way which results in patterned reactions and controlled structural
change of that system.” (Willke 1987: 26). Educational Design Research can be understood
6
swantje.lahm@uni-bielefeld.de [12/15/2014]
as a form of guidance in the sense that “interventions aim at shaping specific contextual
patterns which facilitate the derivation of new information for a target system.” (ibid. X)
Königswieser/Exner differentiate between intervention at two levels, which they call
„interventions architecture“ and „interventions design“ (Königswiesner/Exner 2006: 45ff).
Interventions architecture refers to the the whole set-up of a change process, which is
intended to secure a smooth flow of information. The architecture has to consider that change
needs extra spacial and social spaces in order to happen. Time is also an important
dimension. Key questions are: What is the goal of the change process? Who will participate?
What social formats (one-on-one meetings, group trainings etc.) are adequate? The
interventions design is the interior architecture of of the different components of the change
process. Here the designer has to decide which methods will be use for working together how
existing resources (again: time, space) can be used best.
The development of CuDesign will factor in both the need of an interventions architecture
and an interventions design. But the general principles formulated by Königswiesner/Exner
to not yet take into account the specific context in which my intervention is going to happen.
To better understand the context and formulate hypotheses for what is relevant for a group of
faculty within a department who are confronted with the idea of a writing enriched
curriculum I can draw on three bodies of literature: curriculum theory, research about filters
which influence teaching conceptions and teaching behavior, literature on the discipline
specificity of teaching, studies about the impact of teaching beliefs and work on faculty as
learners.
Curriculum Theory
In the broadest sense of the term a curriculum is a ‚plan for learning‘ (Taba, 1962 cited by
van den Akker 2010: 37). For the purpose of my study I borrow from the definition by
Huball/Gold, who define the curriculum as „a coherent program of study (such as a four year
B.Sc.) that is responsive to the needs and circumstances of the pedagogical context and is
carefully design to develop students’ knowledge, abilities and skills through multiple
integrated and progressively challenging course learning experiences“(Huball/Gold 2006:7).
But I do replace the end of their definition with through meaningful, multiple integrated and
progressively challenging writing experiences in order to highlight my focus on writing as a
fundamental mode of disciplinary learning.
A curriculum design process is a highly complex process, because various components of a
curriculum such as the rational, objectives, learning activities, location, time, assessment etc.
have to adjusted and brought into balance. Moreover, the design process is challenged by the
many stakeholders involved in the process: legislators, administrators, faculty, students,
central units, grant giver etc. „To sketch curriculum development as a problematic domain is
actually an understatement. From a socio-political stance, it seems often more appropriate to
describe it as a war zone, full of conflict and battlefields between stakeholders with different
values and interests. Problems manifest themselves in the (sometimes spectacular and
persistent gaps between intended curriculum (as expressed in policy rhetoric), the
7
swantje.lahm@uni-bielefeld.de [12/15/2014]
implemented curriculum (real life in school and classroom practices), and the attained
curriculum (as manifested in learner experiences and outcomes).“ (van den Akker 2010: 42).
Typology of curriculum representations by van den Akker 2010: 38
Van den Akker’s differentiation between the intended, the implemented and the attained
curriculum (van den Akker 2010: 38) applies to all levels of curriculum design: the macro
level (e.g. national syllabi or core objectives), the meso level (e.g. school-specific
curriculum), the micro level (e.g. textbooks, instructional material) and the nano level (e.g.
individual ideas about teaching) (ibid. 37f.). The focus of this study is the meso level, in this
case the curriculum as is it perceived by a group of faculty of a department for a degree
program. I will not look at the way the curriculum is enacted in the classroom, but inquire
into the meaning and values faculty attach to a curriculum and the generation of a joint
framework of understanding for individual teaching as the result of CuDesign. I am
interested in the curriculum in teachers’ minds.
As Oliver and Hyun point out „curriculum design is a matter of shared governance which
requires mutual respect and submission, effective communication, and the recognition of the
corporate responsibility for curriculum. Curriculum is a corporate responsibility that must be
shared by the collective faculty of the educational institution.” (Oliver/Hyun: 2011: 5). This
is easily voiced as a norm, but hard to realize in practice. I am interested in finding out about
the characteristics of a Curriculum Design Program that will help to bring about cooperation
and collaboration among faculty at the departmental level as a precondition for any
curriculum change in the specific context of Bielefeld university.
Addressing the question of how curriculum change comes into being several authors stress
the importance of involving actors at the meso and the micro level. Instead of assuming that
curricular prescriptions from external sources will be followed, an “’enactment perspective”
has become predominant, meaning that “teachers and learners together create their own
curriculum realities” (van den Akker 2010: 44). Oliver and Hyun call this the postmodern
curriculum: “Curriculum development is not seen as permanent but as creative and fluid.
Postmodern curriculum development does not focus on specific steps in curriculum
development but instead on the relationships of people involved in the process of creating the
curriculum.” (Oliver/Hyun 2011: 1). The Educational Design Research Approach
acknowledges the important role faculty play in the process by letting them actively
participate both in the research and the design process.
8
swantje.lahm@uni-bielefeld.de [12/15/2014]
To engage faculty in a curriculum design process has to consider that faculty enter this
process not as a blank page. Their context, their academic socialization as members of a
discipline and their trajectory of becoming a member in the communities of practice in a
department influence they way in which they conceptualize and approach teaching, writing
and curriculum design. To find out more about the „discriminatory rules of the system“ (see
section „systems theory“; Willke 1987: 32) and formulate hypotheses about what the
characteristics of an intervention are, which will help to overcome misconceptions of writing
as a generic competence and lack of collaborative commitment to curriculum design I will
differentiate between the department and the discipline as „filters to practice“ (Fanghanel
2007). Fanghanel uses the term filter „to emphasise the subtle impact on practice, the range
of possibilities, and the notion that a degree of choice can be exerted in emphasising on filter
or another.“ (ibid. 2). Fanghanel’s study is based on semi-structured interviews with lecturers
in fifteen disciplines. She investigated university lecturers’ pedagogical practice with
reference to the context in which this practice takes place and identified seven filters to
practice, which include the pedagogical beliefs at the micro level, the discipline and the
departments at the meso level and four filters at the macro level (the institution, external
factors, academic labour and the research-teaching nexus).
Filters to teaching practice
Departments can be both seen as a specific mode of organization and as a culture. Looking at
departments as an organization the system of rules which bring about the curriculum comes
into view: the module handbook, the examination office, the legal framework, rules for
exams, teaching loads, hierarchies, status and the logistics of teaching (rooms, time,
resources). Looking at departments as cultures brings the tacit knowledge surrounding
curriculum design and teaching into view. “This tacit knowledge includes norms, discourse
and value sets associated with assessment, teaching practices and research culture as well as
our daily work practices.” (Norton 2009: 9). For an outside observer it can be hard to
understand this system of norms and values, but it is important to acknowledge it as a major
determinant of faculty behavior. Knight and Trowler argue that tacit knowledge is acquired
informally through discussion, observing colleagues and through professional practice, and
that this is more powerful than any ‘formal mechanism’ such as a mentor, induction
programmes and so on. (Knight and Trowler 2002). I will get back to this point in the section
on faculty as learners.
Next to the department, the discipline might even be a stronger filter in trying to understand
how faculty perceive the teaching of writing and curriculum development. Jenert argues that
this is especially true for “German-speaking countries where universities do not tend to have
strong organizational identities” (Jenert 2014: 5). Although the departments defines the
framework in which teaching takes place, faculty do have a high degree of freedom when it
comes to designing, implementing and enacting a curriculum. Within boundaries set by the
department as an organization and a culture deep-seated convictions about what needs to be
taught stem from faculties own socialization into the norms and values of a discipline. Jenert
stresses that “[a]s a result of their strong disciplinary affiliation, university faculty tend to
conceptualize teaching from the perspective of their own research discipline.” (Ibid.). This
9
swantje.lahm@uni-bielefeld.de [12/15/2014]
might be true for most research universities, especially in German Higher Education. In a
discourse which heavily relies upon the the ideas of Wilhelm von Humboldt, the founder of
the modern German university, the university is conceptualized as a pedagogy-free space,
which means that students learn by being socialized into the discipline. The Bologna reform
challenged this conception, when departments and faculty were asked to define competencies
and student learning outcomes at the graduate level. The reactions were mostly negative,
because departments and faculty did perceive learning outcomes as something extraneous,
being imposed on them from outside. Even when they were asked to define their own
discipline-specific learning outcomes, the idea of transmitting content was so prevalent, that
many efforts to implement competency-based curricula failed (see Jenert 2014). From my
perspective the implementation of competency-oriented curricula failed, because faculty are
accustomed to think and speak of their discipline in terms of subject content (Carter 2007).
The procedural knowledge, the ways of thinking and writing in a discipline, are usually
implicit, because faculty as themselves have been socialized into their discipline mostly
without any instructional metadiscourse about the specific specific disciplinary operations
and competencies in their field. Any intervention which aims at curricular change which
integrates writing as a disciplinary practice has to find a method to support faculty in making
their disciplinary ways of knowing, thinking and writing explicit. In section 3.2 I will present
the „Decoding the Disciplines“ approach by David Pace and Joan Middendorf as an approach
which addresses this problem.
Discipline specificity of teaching
Discipline-specific approaches to teaching and their implications for learning within the
discipline, have been areas of inquiry and research for several decades (Andresen 2000,
Shulman 2005, Kreber 2009, Fanghanel 2007). This research helps to conceptualize that what
is usually referred to as “content” of a curriculum is a complex way of knowing which is
based on knowledge on the subject matter, general pedagogical strategies, but also – in terms
of Shulmann (1987, 2004) pedagocial content knowledge (PCK), the specific way subject
matter is taught.
Berthiaume’s research on disciplinary pedagocial knowledge (DPK) draws on Shulman’s
notion of pedagocial context knowledge and presents a new model which was constructed
and validated with the help of a multi-case study of four university professors from four
disciplines (Berthiaume 2007). His model of discipline-specific pedagogical knowledge
(DPK) for university teaching identifies:
1. goals, knowledge, and beliefs related to teaching
2. disciplinary specificity in terms both of teaching, learning, knowing and practizing the
discipline and it’s epistemological structure
3. personal epistemology of faculty which includes beliefs about knowledge and knowing,
knowledge construction and the evaluation of knowledge.
10
swantje.lahm@uni-bielefeld.de [12/15/2014]
Berthiaume’s model suggests that each professors teaching is influenced by a specific
combination of these three elements. In contrast do Shulman he explicitly incorporates the
personal epistemology of faculty.
Fanghanel also identifies personal pedagogical beliefs as an important filter for teaching
practice and stresses the interrelatedness with other filters, like the discipline or the
department.
For my study this means that the development of an Curriculum Design Program has to be
based on a systematic inquiry into the filters which inform faculties’ choices about a
curriculum. Approaches which have worked well in other contexts have to be critically
scrutinized for their underlying conceptions about teaching and learning and the departmental
and disciplinary contexts in which they have been used. Elon University (USA), for example,
has started a „Writing Excellence Initiative“ in 2012 and eight departments agreed to
systematically revise their curricula. My hypothesis is that faculty from Elon would have a
very different DPK (discipline-specific pedagogical knowledge) profile than faculty from
Bielefeld. Elon is a college with high appreciation for teaching, Bielefeld is a research
university and teaching is not a priority. This might show at all levels of Berthiaumes model:
in the goals of teaching, in the conceptions of what it means to teach a discipline and beliefs
about student learning, motivation, intelligence etc.
In terms of the development of a Curriculum Design Program the discipline, the department
and individual pedagogical beliefs are also especially important, because they are identified
by Fanghanel as the „levels of practice where individuals/groups have scope for agency“
(Fanghanel 2007: 15). This means that a Curriculum Design Program can have an impact on
these three levels.
Teachers Beliefs and Practices
According to Anderson et al. an increasing evidence suggests „that teachers entering beliefs
about the nature of the subject matter and how it is learned influence the extent to which
teachers value and use new curricula and instructional models“ (Anderson et al. 1991: 2).
Their study examined the classroom practice of 15 teachers who had all participated in the
same staff development activity and learned to work with an approach called „Cognitive
Strategy Instruction in Writing“ (CSIW). Noticeable about their findings is the wide range of
congruence (from very low to very high) of the actual teaching with the principles of CSIW.
In depth interviews showed that teachers beliefs had changed little and adhered to CSIW
principles only when they were was consistent with the teachers’ original thinking.
Beliefs are crucial for understanding the practice of faculty but they are difficult to
operationalize for empirical research and the design of professional development programs.
Swan has taken an important step in this direction in a design-based research study into the
professional development of 24 numeracy teachers. His study very consciously takes beliefs
as the starting point for professional development. He proposes a model which depicts the
relationship between beliefs and practice (Swan 2006: 177). His model suggests „that within
11
swantje.lahm@uni-bielefeld.de [12/15/2014]
every teacher’s mental structure there are deeply held beliefs about mathematics, teaching
and learning. There is also a further, broader set of beliefs about the environment one works
in, the reactions of students, one’s self image, and so on. These broader beliefs act as filters
that modify the implementation of the beliefs about mathematics, teaching and learning and
also influence the interpretation of the observed outcomes.“ (Swan 2006: 175/176). In the
professional development program he provides opportunities for reflection about the deeply
held beliefs about mathematics, teaching and learning.
For my study the theoretical model as well as the tools for reflection provided by Swan are
highly relevant. If deeply held beliefs about the discipline, writing, learning and teaching are
not made explicit, the creation of a joint framework for teaching in a department is likely to
fail. As I pointed out before, my intervention mainly addresses the perceived curricuum, the
curriculum in the minds of faculty. For this purpose making the examination of beliefs part of
CuDesign will be a major design principle.
Faculty as Learners
From a cognitive and psychological perspective faculty as learners share characteristics with
other learners. Svinicki points out similarities of student and faculty learners with respect to
diversity in learning styles, motivation („Motivation to learn derives from the learner’s
estimates of the usefulness of the task and the probability of success“), progression of
learning in steps and preconditions for learning like trustful relationships and a safe contexts
(Svinicki 1996).
For the development of a Curriculum Design Program it is important to take into account the
needs of faculty as individual learners. But this is not enough. To engage faculty in a
curriculum design process has to consider that faculty enter this process not as a blank page.
Their context, their academic socialization as members of a discipline and their trajectory of
becoming a member in the communities of practice in a department influence they way in
which they conceptualize and approach teaching, writing and curriculum design. But this is
not enough. Recent studies have criticized that the focus on the individual does neglect the
influence of the context in which faculty learn (Fanghanel & Trowler 2008). For my study
the work of Jawitz (2007, 2008, 2009a, 2009b) is of special interest. He examined how new
academics learn to assess student performance in their departments. His study involved three
case studies in academic departments with significant differences in the teaching, research
and professional dimensions of academic life. Jawitz uses situated learning theory (Lave &
Wenger 1991; Lave 1996; Wenger 1998) which describes „learning as a process of
understanding through participation with others in ongoing activitiy, and knowledge as being
distributed amongst the participants in an activity“ (Jawitz 2007: 186). Jawitz delineates what
kind of communities of practice (CoP) in a department shape the experience of new
academics and differentiates between the Research CoP and the Teaching CoP. In the three
departments studied various constellations exist: In the Social Science department, junior and
middle academics, postgrads and part-time staff form an undergraduate teaching Cop which
has only small overlap with the research CoP, because advanced researchers don’t teach
12
swantje.lahm@uni-bielefeld.de [12/15/2014]
undergraduate courses. In the Natural Science department the Teaching CoP is a subgroup
within the Research CoP, teaching is done by research staff only. In the Design Department
additionally to the Research CoP and the Teaching CoP a Professional CoP exists, which is
highly influential in setting standards on how to evaluate student work. Based on the outline
of configurations of communities of practice in the three departments Jawitz traces how
newcomers learn to assess and how their experiences of assessment influence their
trajectories towards memberships in the communities of practice. Faculty in the social
science department for example face a situation of unconnectedness of the Undergraduate
Teaching CoP and the Research CoP. One faculty aspired full membership in the Research
Cop and therefore did see the Undergraduate Teaching CoP only as a transition stage and did
not invest in efforts to reform assessment practice. Another faculty decided that that both
communities were central for her academic identity and found ways to negotiate tensions
between the demands of the teaching and the research community. She very much engaged in
making assessment an explicit topic of discussion in the Teaching CoP.
For my study the research of Jawitz is fundamental, because it provides a theoretical basis for
analyzing the social dynamics in departments which in turn determine spaces of agency for
engaging in curriculum reform. Especially in the first part of the study in which data will be
collected as a basis for the development of CuDesign, his analytical framework will help to
analyze the „social structure“ of change in departments with questions like: What
communities of practice exist in a department? Who teaches? Who does research? What kind
of trajectories for membership in the CoPs exist? How do they affect the possibility for
engaging in reform efforts? Understanding how newcomers learn to assess is crucial in my
study, too, because the curriculum design process will be based on learning outcomes which
are developed in a process of assessing students written papers (see 2.3). It is therefore
important to understand, what the social dynamics of assessment in a department are. Jawitz
for example shows that in the Natural Science department in his study basically only one
trajectory for membership exists and this involves assessment as an highly individualized
activity which functions as a proof of the research qualities of the assessing person (in the
sense that who knows how to do research, also knows how to assess student research papers).
Here the social structure of learning how to assess does leave very little room for agency.
Challenging established practice would mean to risk negative career consequences for
becoming a researcher (Jawitz 2009b: 613). For Jawitz the pratical impact of his study is that
faculty development should focus on „creating learning communities [in departments] rather
than simply providing opportunities for individuals to learn.“ (Jawitz 2008: 1017).
In the section on systems theory I have highlighted that systems strive for balance and that
guidance as a form of intervening into a system should therefore beware of the level of
uncertainty it introduces. If we think about the conditions in which faculty learn, this also
means to acknowledge the larger context, especially academic labour. This is filter that in
which little room for agency exists, but is highly influential. Fanghanel and Trowler point out
that in the UK recent measures of quality management with respect to teaching have
contributed to „sense of disempowerment for academics who iterate between teaching,
research, and quality agendas in which they perceive misrepresent the nature of their work,
13
swantje.lahm@uni-bielefeld.de [12/15/2014]
and control their practice in managerial ways.“ (Fanghanel & Trowler 2008: 43). In Germany
and in Bielefeld this is especially true for non tenure-track faculty members who in some
departments do most of the undergraduate teaching. This means that any request for change
runs the risk to destabilize both personal and social systems. For the development of
CuDesign this is a serious issue and the question is whether any intervention can provide
enough stabilization and support for making temporary de-stabilization (which is a
precondition for change) possible.
1.3 „Decoding the Disciplines“ and other approaches toward curriculum
reform and the integration of writing into the curriculum
Since writing enriched curricula at the program level have never been implemented at a
German University before and consequently no prior research about the process of
implementation exists, my study will chart into unknown territory. As part of the first phase
of the EDR process, the problem identification and context analysis, a benchmarking will be
done with interventions developed and implemented at universities in the US. Major points of
reference are:
•
NC State University: Campus Writing and Speaking Program (Chris Anson and
Michael Carter) (Carter 2002)
•
Elon University: Writing Excellence Initiative (Paul Anderson)
•
Seattle University (John Bean) (Bean 2005)
•
University of Minnesota: Writing-Enriched Curriculum Project (Pamela Flash)
(Wagner et al. 2014)
•
Indiana University: Decoding the Disciplines Project (Joan Middendorf, David
Pace) (Pace/Middendorf 2004)
Decoding
The “Decoding the Disciplines” approach (Pace/Middendorf 2004) is a 7-step-cycle for (re-)
designing courses. Faculty start with a clarifying-process that helps them to make
disciplinary ways of thinking and doing explicit. Starting points are so called ‚bottlenecks‘:
points in a course where a majority of students experience difficulties in mastering basic
material. The underlying idea is that faculty are experts in the disciplinary ways of thinking
and doing but are not always in a good position to making these discipline-specific acts
explicit and help others to acquire them. To be able to do this faculty first have to develop a
language to talk about what they do themselves. Accordingly they need help to find a way for
putting these unconscious acts into such words so students can understand and act upon.
The process of reflection starts with an interview in which basically faculty are asked one
question again and again: How do you do this? (Decoding Interview, see 3.2 Methods)
14
swantje.lahm@uni-bielefeld.de [12/15/2014]
My assumption is that using this approach could be a button, one of the major influence
points, which according to Jay Forrester (see 1.2) have to be pushed to change a systems way
of operating. Since the discipline seems to be of utmost concern for departments and faculty
when it comes to designing curricula, any reform effort should start with a deep conversation
about how faculty frame learning outcomes in terms of the disciplinary operations they want
students to be able to master.
2. Goals of the study and research questions
2.1. Goals
I would like to find out whether a professional development program for faculty which is
specifically designed to enable faculty to make decisions about teaching and learning in terms
of their disciplinary expertise does:
A. help to initiate a collaborative curriculum design effort in a department in which faculty
are involved who do actual teaching.
B. improve the integration of writing as a key competence and disciplinary mode of learning
into the curriculum
The professional development program, CuDesign, has to be constructed. Based on the
theories and literature which I have incorporated so far, I tentatively formulate that it should
be based on the following principles. CuDesign has to factor in that:
1. Faculty and departments are experts for determining the content and structure of a writing
enriched curriculum at the program level.
2. This expertise is grounded in the fact that faculty are members of disciplinary and
departmental communities of practice and share values and knowledge which are most of the
time not part of the formal, explicit and written curriculum, but crucial for the perceived and
informally implemented curriculum.
3. An intervention aiming at creating a collaborative commitment towards a purposeful
curriculum design process has to find ways to help faculty to make core practices of teaching
and learning in a discipline explicit.
4. Beliefs about the discipline, writing, teaching and learning are fundamental for the
perceived as well as the enacted curriculum. CuDesign therefore has to „[e]stablish an
informal candid culture in which existing beliefs are recognised, made explicit and are
worked on in a reflective non-judgmental atmosphere“ (Swan 2006: 178).
5. In order to match with the informal culture of learning in a department communities of
practice have to be identified before the beginning of the training and the social structure for
change has to be mapped.
15
swantje.lahm@uni-bielefeld.de [12/15/2014]
2.1 Research questions
The object of my study is the development and test of CuDesign, an approach to curriculum
design which supports faculty in making the shift from a content-based to a competencebased curriculum. As the fundamental competence to be integrated into the curriculum
writing was chosen, because of the broad evidence for the impact on disciplinary learning.
The study consists of two parts: the development (part 1) and the test (part 2)
Research questions part 1:
1. How can we initiate a curriculum design process in a department which addresses the
learning outcomes of graduates and the role of writing in achieving these learning outcomes?
What design principles can we infer from theoretical and empirical studies?
2. What conceptual tools facilitate the creation of a collaborative culture for a curriculum
design process in a department?
Research questions part 2:
3. What are the effects of applying the aforementioned design principles on faculties’ ways of
thinking and talking about the curriculum and their beliefs about their discipline, writing,
teaching and learning?
4. What is the contribution of the Curriculum Design Program to enhancing motivation and
capability for the collaborative design of a Writing Enriched Curriculum?
5. How can we design long-term professional development to best impact teacher practice
with respect to teaching with writing?
16
swantje.lahm@uni-bielefeld.de [12/15/2014]
3. Methodology and Research Plan
3.1 Methodology
My study will be based on qualitative data. I will use a mixed methods approach for
generating knowledge about an intervention that will create collaborative commitment for the
design of a writing enriched curriculum at the program level in a department at Bielefeld
University. Educational design research is not a methodology. It is common practice for EDR
to use mixed methods, which is seen as a special value in order to be able to triangulate data
from different sources (McKenney/Reeves 2012).
Part 1 of the study, the development of CuDesign will be based on problem-centered
interviews (Witzel 2000) with major stakeholders for the curriculum department who also
should be highly appreciated researchers (for details about the interview see 1.3 and below).
After the interview a questionnaire which will be send to all members of a department. This
questionnaire inquires into the courses faculty teach, their teaching experience (How long?
Successes? Challenges?), whether an how they integrate writing into their courses and how
they learn about teaching (from their own socialization, their colleagues, books, professional
development programs etc.). It also announces that the questionnaire is send out as part of a
planned curriculum design process and asks about what would make them want to participate
in this process.
As someone from outside the department, but a staff member of the Center for Teaching and
Learning at the University Bielefeld I will also collect information through informal
discussions, from departmental documents and and reports, and from field notes made during
and after visits to the departments.
Departments and faculty will be involved in a iterative design-research process in which
decisions will be made jointly. The interview, for example, has several functions: it generates
information about graduate learning outcomes framed in the language of the discipline which
can be used as a starting point for discussion. The learning outcomes in combination with the
questionnaire will also be the the basis for a first preliminary mapping of the curriculum in
order to find out, where students are actually taught what they are meant to know after they
graduate. On the basis of this information the department has to make a decision whether to
embark on a curriculum design process or not. The participation is strictly voluntary, but the
decision to participate will include a commitment to fully engage in the process.
One of the departments who commit will be the object of further study. For the work with a
selected group of faculty from the department I will issue a workbook containing a range of
tasks, questionnaires and activities. This workbook will be modeled on the workbook by
Swan (2007) which includes questions about priorities and purposes of teaching, inquiry into
teaching methods as well as opportunities for reflecting beliefs about teaching and learning. I
intend to revise and adapt this workbook for my purposes and also include questions and
activities for reflecting the place of writing in the curriculum and the formulation of learning
17
swantje.lahm@uni-bielefeld.de [12/15/2014]
outcomes for the curriculum. The workbook is a practical tool in the professional
development program, but also a primary source of data for the research.
Part 2 of the study, the evaluation of CuDesign will be based on the material (workbook)
faculty have developed in CuDesign (comparing material generated before the beginning of
CuDesign, during and after) and (maybe?)focus group interviews with members of the
department.
In both part 1 and part 2 I will use a case study methodology to interpret data and present the
results.
As an additional method I would like to use autoethnography in order to counterbalance
specific role problems that might occur in the process. „Autoethnography is an approach to
research and writing that seeks to describe and systematically analyze personal experience in
order to understand cultural experience“ (Ellis, Adams & Bochner 2011). It is a general
dilemma of EDR that researchers are not only researchers, but designers of the intervention,
too (see Educational Design Research 130). This is valuable in formative evaluation, but may
also produce tensions, for example when participants and the designer-researcher disagree. In
my situation I take even more roles than the researcher and designer, because I also have an
institutional role, being the Director of the Writing in the Disciplines program which is
situated in the Center for Teaching and Learning. My institutional mandate is to facilitate
change within departments and some faculty perceive this mandate as an intrusion into their
very personal affair of teaching. By using autoethnography I will analyze tensions that arise
in my multiple roles as information about the cultural context in which the design happens.
Since I’ve been working at Bielefeld University for more than ten years and also graduated
there, I consciously chose this method (being an enthnographer of my own present and past
experiences) because my past experiences at the institution shape they way I think about an
intervention and how I react to faculty in the departments. Rather than pretending to be an
objective observer, autoethnography will help to carefully consider my role in influencing
and shaping the phenomena I study.
18
swantje.lahm@uni-bielefeld.de [12/15/2014]
3.2 Research Plan
Phases in the
EDR process
Time and Working Steps
Winter
2015/16

Summer
2016

Winter
Implementation 2016/17


Test CuDesign
Evaluate on the basis of material from faculty
and focus group interviews
Winter
2017/18

Analyze and interpret data with respect to
research questions for part 2
If necessary: plan Redesign of CuDesign
Write Report
Publish Articles
Part 1
Exploration
Part 2
Enactment
Dissemination






Development of first prototype of CuDesign
based on existing research
Composition of interview guidelines
Interviewing and collection of other data
Data analysis and interpretation with respect to
research questions for part 1
Redesign of CuDesign based on qualitative data
and feedback from members of departments and
expert review
Exploration:
Based on existing theoretical and empirical studies as well a benchmarking with existing
curricuum design models I will formulate design principles for CuDesign. The theoretical and
practical knowledge will also inform the composition of Guidelines for the problem-centered
interview. „Guidelines are a supportive device to reinforce the interviewer’s memory on the
topics of research and provide a framework of orientation to ensure comparability of
interviews. In addition, some ideas for lead questions into individual topics and
preformulated questions to start the discussion are included.“ (Witzel 2000: 3). The problemcentered interview seeks to combine inductive and deductive theorizing. Ideas for questions
are generated on the basis of existing (theoretical knowledge), but at the same time narration
strategies in the interview are used, to determine what is relevant from the subjects
perspective. The problem-centered interview is a useful methodological framework for the
„Decoding interview“ which has been developed by David Pace and Joan Middendorf. Using
the problem-centered interview will enable me to start with some matter questions about prior
curriculum design efforts in the department, the relevance of writing for teaching and general
problems that occur with respect to student writing and learning. In the open-ended narrative
19
swantje.lahm@uni-bielefeld.de [12/15/2014]
section of the interview I will then start with the Decoding process, which aims at uncovering
the disciplinary operations that students are meant to learn in a department. On the basis of
two bachelor’s theses, chosen by the interviewee as an example for an excellent and a
deficient piece of work, I will ask the interview to analyze the differences of the two papers
and determine an attribute, a kind of thinking, doing or writing, which any graduate of the
program should master as a result of studying this discipline. Starting with this attribute, I
will ask the interviewee how he/she accomplishes this task. Joan Middendorf points out that
first answers usually provide superficial responses, which become more specific as the
consequence of repeated asking „How do you do that?“ and summaries and probing. The
interview will be videotaped and transcribed. My reason for videotaping instead of just
recording it, is that I plan to use the interview in CuDesign as a model for other faculty in the
department who will be asked to do Decoding with a different method.
For analysis of the transcribed interviews as well as the date generated later by faculty
particpating in CuDesign I will use the qualitative content analysis by Mayring (Mayring
2000). XXX
As one outcome of the interview analysis I anticipate to have discipline-specific writing
expectations, one two three major learning outcomes for writing as a major in the field and
the basic mental operations which are required to master writing expectations in the
discipline.
Based on the results of the interview a short questionnaire will be designed and send to
faculty in the departments asking where and how they prepare students for the writing
expectations defined in the interview. The results of the questionnaire will be put into a map
of the curriculum which shows where and how students are supported in reaching the
learning outcomes for writing. This curriculum map will be send back to the interview
partner and on this basis, the department has to decide whether it wants to embark on a
curriculum design process, how the process will be facilitated and who will participate in it.
The preliminary study with interviews will take as long as at least one department commits
to a curriculum design process. This does not mean that the outcomes as defined in the one
interview will be the basis for the design process, the idea is to take an important learning
outcome defined by a well-respected member of a department as a starting point for
discussion. The defining of learning outcomes for the actual design process will happen
collaboratively amongst members of the departments in a curriculum design
Enactment:
The prototype of intervention will be a Curriculum Design Program (CuDesign) which will
involve members of one department. The prototype will be modeled on a Curriculum Design
Program conducted at Indiana University which has been successfully used for external
review by three department and in which currently 46 departments within the College of Arts
and Sciences are involved (Rehrey, Metzler, Kurz 2014). The model encompasses fours
sessions (3 hours each) in which faculty define program goals, define student learning
outcomes for the program goals, map a curriculum for their program, determine forms of
20
swantje.lahm@uni-bielefeld.de [12/15/2014]
assessment for student learning by using evidence and define next steps for the departmental
process of implementing the curriculum. Backward Design (Wiggins 1998 and McTighe &
Seif 2003) and the Decoding the Disciplines approach are the methodological and theoretical
basis for the curriculum design process.
Based on the findings from the exploration phase the Indiana University model will be
revised and adapted to fit the needs of our context. It will then be evaluated by the involved
department in order to meet the criteria of relevance and practicality.
The prototype will also be reviewed by external experts for curriculum design and specialists
in writing pedagogy in order to meet the criteria of effectiveness and consistency.
Implementation
In the implementation phase I will conduct CuDesign for a department which commits itself
to participate in the process. Formative evaluation will take place on the basis of participants’
workbooks which include written materials (student learning outcomes, curriculum maps
etc.) developed by the participants. Observations from my participation in CuDesign will be
included as well as records of one-on-one conversations.
Dissemination
The overall outcomes evaluation will take place in the form of a case-study which portrays
how a departments participates in CuDesign and evaluates the outcome of the intervention.
The steps taken by participating department after the Program will be described and if
necessary a focus group interviews will be taken in order to delineate strengths and
weaknesses of the intervention and formulate suggestions for improvement.
21
swantje.lahm@uni-bielefeld.de [12/15/2014]
4. Literature
Anderson, Linda M.; Raphael, Taffy E.; Englert, Carol Sue; Stevens, Dannelle D. (1991):
Teaching Writing with a New Instructional Model: Variations in Teachers’ Beliefs,
Instructional Practice and and their Students’ Performance. Paper presented at the annual
meeting of the American Educational Research Association, in Chicago, April 1991 [pdf
retrieved 07.09.2014].
Anderson, P.; Andson, C.; Gonyea, B.; Paine C. (2009): Using results from the Consortium
for the Study of Writing in College. Webinar handout. National Survey of Student
Engagement, 2009. [pdf retrieved 21.12.2012].
Andresen, L.W. (2000): A useable, trans-disciplinary conception of scholarship. In: Higher
Education Research and Development 19 (2), 137-154.
Anson, C. M.; Dannels, Deanna P.; Flash, P.; Gaffney, A. (2012): Big Rubrics and Weird
Genres: The Futility of Using Generic Assessment Tools Across Diverse Instructional
Contexts. In: The Journal of Writing Assessment 5(1) [online:
journalofwritingassessment.org].
Arum, R.; Roksa, J. (2011): Academically adrift: Limited learning on college campuses.
Chiago: University of Chicago Press.
Astin, A. W. (1992): What really matters in general education: Provocative findings from a
national study of student outcomes. In: Perspectives 22(1), 23-46.
Bazerman, C. (2013): A Rhetoric of Literate Action: Literate Action Volume 1. Perspectives
on Writing. Fort Collins, Colorado: The WAC Clearinghouse and Parlor Press.
Bean, J.; Carrithers, D.; Earenfight, T. (20059: Transforming WAC through a DiscourseBased Approach to University Outcomes Assessment. In: The WAC Journal 16, 5-21.
Beaufort, A. (2007): College writing and beyond. A new framework for university writing
instruction. Logan, UT: Utah University Press.
Berthiaume, D. (2007): Teaching in the disciplines in higher education. In: Ketteridge S.;
Marshall S.; and Fry, H. (Eds): The effective academic: a handbook for enhanced academic
practice. London, Kogan Page, 215-225).
Berthiaume, D. (2007): What is the nature of university professors’ discipline-specific
pedagogical knowledge? A descriptive multicase study (unpublished Ph.D. Dissertation).
Montreal: Mc Gill University.
Carter, M. (2002): A process for establishing outcomes-based assessment plans for writing
and speaking in the disciplines. In: Language and Learning Across the Disciplines 6(1), 4-29.
Carter, M. (2007): Ways of knowing, doing and writing in the disciplines. In: CCC 58(3),
385-418.
22
swantje.lahm@uni-bielefeld.de [12/15/2014]
Carter, M. (2007): Ways of knowing, doing and writing in the disciplines. In: College
Composition and Communication 58(3), 385-418.
Carter, M.; Ferzli, M.; Wiebe, E. (2004): Teaching genre to English first-language adults: A
study of the laboratory report. In: Research in the Teaching of English 38(4), 395-419.
Ellis, C.; Adams, T.; Bochner, A. (2011): Autoethnography: An Overview. In: Forum
Qualitative Social Research 12(1) [retrieved 14.11.2014].
Fanghanel, J. (2007): Investigating university lecturers’ pedagogical constructs in the
working context, The Higher Education Academy [pdf retrieved 19.11.2014].
Fanghanel, J.; Trowler, P. (2008): Exploring Academic Identities and Practices in a
Competitive Enhancement Context: a UK-based case study. In: European Journal of
Education 43 (3), 301-313.
Forrester, J. (1972): Understanding the counterintuitive behavior of social Systems. In:
Beishon, J.; Peters, G. (Eds): System behavior. London/New York: Harper & Row, 2002017.
Fussangel, K. (2008): Subjektive Theorien von Lehrkräften zur Kooperation. Eine Analyse
der Zusammenarbeit von Lehrerinnen und Lehrern in Lerngemeinschaften (Unveröffentlichte
Dissertation), Universität Wuppertal.
Huball, H.; Gold, N. (2006): The Scholarship of Curriculum Practice and Undergraduate
Program Reform: Integrating Theory into Practice. In: P. Wolfe & J. Christensen Hughes
(Eds.): Curriculum Evolution in Higher Education: Faculty-Driven Processes & Practices.
New Directions for Teaching and Learning. San-Francisco: Joessey-Bass Publishers, 5-14.
Huemer, B.; Rheindorf, M.; Gruber, H. (2013): „Writing a.i.D.“ - Ein neuer Ansatz für die
Schreibforschung und ihre Didaktisierung. In: Doleschal, U.; Mertlitsch, C.; Rheindorf M. &
Wetchanow, K. (Eds): Writing across the Curriculum at Work: Theorie, Praxis und Analyse.
Wien: LIT Verlag, 15-39.
Humboldt, Wilhelm von (1810): Über die innere und äußere Organisation der höheren
wissenschaftlichen Anstalten in Berlin. In: Werke 4, 255-266.
Jawitz, J. (2007): New academics negotiating communities of practice: learning to swim with
the big fish. In: Teaching in Higher Education 12(2), 185-197.
Jawitz, J. (2008): Learning to assess in the academic workplace: Case study in the Natural
Sciences. In: South African Journal of Higher Education 22(5), 106-118.
Jawitz, J. (2009a): Academic identities and communities of practice in a professional
discipline. In: Teaching in Higher Education 14(3), 241-251.
Jawitz, J. (2009b): Learning in the academic workplace: the harmonization of the collective
and individual habitus. In: Studies in Higher Education 34(6), 601-614.
23
swantje.lahm@uni-bielefeld.de [12/15/2014]
Jenert, T. (2014): Implementing Outcome-Oriented Study Programmes at University: The
Challenge of Academic Culture. In: Zeitschrift für Hochschulentwicklung 9(2), 1-12.
Jones, A. (2009): Generic Attributes as espoused theory: the importance of context. In: High
Educ 58, 175-191.
Knight, P.T.; Trowler, P.R. (2000): Department-level cultures and the improvement of
learning and teaching. In: Studies in Higher Education 25(1), 69-83.
Königswiesner/Exner (2006): Systemische Intervention: Architekturen und Designs für
Berater und Veränderungsmanager. Stuttgart. Klett-Cotta
Kreber, C. (ed.) (2008): Teaching and learning within and beyond disciplinary boundaries.
London: Routledge.
Light, R. J. (2001): Making the most of college. Students speak their minds. Cambridge, MA:
Harvard.
McKenney, S.; Reeves, C. (2012): Conducting Educational Design Research. London/New
York: Routledge.
McTighe, J. & Seif, E. (2003): A summary of underlying theory and research base for
understanding by design. Retrieved March 14, 2012, from
http://assets.pearsonschool.com/asset_mgr/current/201032/ubd_myworld_research.pdf
Middendorf, J. (2014): Decoding the disciplines interview. What does the expert do?.
Unpublished Draft.
Middendorf, J.; Pace, D. (2004): Decoding the disciplines: A model for helping students learn
disciplinary ways of thinking. In: D. Pace & J. Middendorf (Eds.): Decoding the Disciplines.
Helping Students Learn Disciplinary Ways of Thinking. New Directions for Teaching and
Learning 98, San Francisco: Jossey-Bass Publishers, 1-12.
Norton, L.S. (2009): Action Research in Teaching and Learning. A Practical Guide to
Conducting Pedagogical Research in Universities. Abingdon: Routledge.
Oliver, S.L.; Hyun, E. (2011): Comprehensive curriculum reform in higher education:
collaborative engagement of faculty and administrators. In: Journal of Case Studies in
Eduation 2 [pdf retrieved 21.11.2014].
Plomp, T.; Nieveen, N. (Eds.) (2010): An Introduction to Educational Design Research. SLO
Netherlands institute for curriculum development.
Plomp, T. (2010): Educational Design Research: an Introduction. In: Plomp, T.; Nieveen, N.
(Eds.): An Introduction to Educational Design Research. SLO Netherlands institute for
curriculum development, 9-35.
Rehrey, G; Metzler, E.; Kurz, Lisa (2014): Closing the Loop: Curriculum Mapping as a
Method for Conducting Meaningful Program Review. Paper presented as part of „Making
24
swantje.lahm@uni-bielefeld.de [12/15/2014]
program assessment meaningful: The faculty developer’s role“. POD Conference, 2014.
Dallas, Texas.
Russell, David (2002): Writing in the Academic Disciplines: A Curricular History.
Carbondale (2nd ed.). Carbondale, IL: Southern Illinois University Press.
Shulman, L. (2005): Signature pedagogies in the disciplines. In: Daedalus 134, 52-59.
Shulman, L.S. (2004): How and what teachers learn: s shifting perspectiv. In: Journal of
Curriculum Studies 36, 257-271.
Shulmann, L. S. (1987): Knowledge and teaching: Foundations of the new reform. In:
Harvard Ecudational Review 57(1), 1-22.
Svinicki, M. D. (1996): When Teachers Become Learners. In: The National Teaching and
Learning Forum 5(3), 1-2.
Swan, M. (2006): Collaborative learning in mathematics: A challenge to our beliefs and
practices. London: National Institute for Advanced and Continuing Education (NIACE), for
the National Research and Development Centre for adult literacy and numeracy (NRDC).
Swan, M. (2010): The impact of a professional development programme on the practices and
beliefs of numeracy teachers. In: Journal of Further and Higher Education 34(2), 165-177.
Tingerthal, J.S. (2013): Applying the Decoding the Disciplines Process to teaching structural
mechanics. An authoethnographic case study (unpublished Ph.D. Dissertation). Northern
Arizona University.
van den Akker (2010): Curriculum Design Research. In: T. Plomp & N. Nieveen (Eds.): An
Introduction to Educational Design Research. SLO Netherlands institute for curriculum
development, 37-52.
Wagner, H.E.; Hilger, P.A.; Flash, P. (2014): Improving Writing Skills of Construction
Management Underaduates: Developing Tools for Empirical Analysis of Writing to Create
Writing-Enriched Construction Management Curriculum. In: International Journal of
Construction Education and Research 10(2): 111-125.
Wiggins, G. P.; McTighe, J. (2005): Understanding by design (Expanded 2nd Edition).
Alexandria, VA: Association for Supervision and Curriculum Development.
Willke, H. (1987): Observation, Diagnosis, Guidance: A Systems Theoretical View on
Intervention. In: K. Hurrelmann; F. X. Kaufmann; F. Lösel (Eds.): Social intervention:
potential and constraints. Berlin, 21-35.
Willke, H. (2005): Systemtheorie 2. Interventionstheorie: Grundzüge einer Theorie in
komplexe Systeme (3rd revised ed.). Stuttgart: Lucius & Lucius.
Witzel, A. (2000): The problem-centered interview. In: Forum: Qualitative Social Research
1(1) [pdf retrieved 9.12.2014].
25
swantje.lahm@uni-bielefeld.de [12/15/2014]
26
swantje.lahm@uni-bielefeld.de [12/15/2014]
5. Appendix
5.1 Institutional Description
In the last years teaching with writing has become a topic of interest in Germany. The
Bologna reform spurred a huge process of reconstructing curricula in Higher Education. But
the envisionend redesign from content-based to competency-based curricula proved to be
very difficult. Many universities, departments and faculty perceived competencies as
something extra that had to bee added to the curriculum. As a response at Bielefeld
University the Writing Center (which is located within the Center for Teaching and Learning)
developed an approach to teaching with writing in which writing is seen as an integral part of
disciplinary learning. When in 2012 the government started an initiative for reforms in
teaching in Higher Education the University of Bielefeld decided to work on a better
integration of writing as a mode of disciplinary learning into courses, mostly introductory
courses. For this purpose ten departments received money to hire so called LitKom experts
(Litkom is the acronym for „literacy competencies“). The Litkom experts are faculty
members who received special training in teaching with writing. They design and teach
introductory courses where writing is integrated as a fundamental mode of learning the
discipline. At the broadest level the LitKom project seeks to persuade faculty to alter the
ways they teach and show them how to make that change. The LitKom project seeks to create
this transformation through the work of the LitKom experts, who as a group, advocate, teach,
and model the best practices in writing instruction, assignments, and feedback. The Litkom
project is coordinated by two specialists in writing pedagogy, one of these is my colleague
Svenja Kaduk and one is me. We both work at the Center of Teaching and Learning (CTL) at
Bielefeld University and I direct the Writing in the Disciplines program, which is part of the
CTL.
From the very beginning formative evaluation was meant to play an important role in the
project, the focus being to generate evidence that the best practices developed by the faculty
experts increase first-year students master of course material and enhance their writing
abilities.
The project started in July 2012 and is now in the middle of the overall 4 year funding time.
It has been successful in the sense that the LitKom experts found their role within the
departments, they all developed material for teaching with writing in the disciplines and
continually revise and improve this material. A major success of the Litkom experts is that
they generated a „social infrastructure for change“ (Lahm/Kaduk, article submitted). In
Germany, typically, teaching is an individual activity, ideals of autonomy and freedom date
back to the founding of the modern university by Wilhelm von Humboldt. Formal written
curricula exist, but the way they are implemented (for a typology of curriculum
representations see section II below) is mostly a matter of choice of individual faculty. When
the LitKom project started in most departments no institutionalized space for talking about
the place of writing in the curricula existed beyond the level of the formal curriculum and
informal door-to-door talk. The LitKom experts created these spaces and they host events
27
swantje.lahm@uni-bielefeld.de [12/15/2014]
where faculty meet to discuss writing assignments, grading, rubrics, feedback practices and
other issues.
In designing and implementing courses that integrate writing the LitKom project so far has
focused on introductory courses, because this was part of a larger university effort to support
students in becoming successful learners in their discipline. Guidelines for courses that use
writing as a tool for learning disciplinary ways of doing, knowing and writing were
developed and each instructor used these guidlines to develop student learning outcomes
(SLO’s) at the course level and tried to bring these outcomes and the activities in the course
in alignment with the formal written curriculum of the study program. To change the written
(intended) curriculum as formalized in the descriptions of the study program proved to be
extremely difficult. At the same time it became evident, that in order to work sustainably the
LitKom experts need a larger framework for designing their courses, in the sense that the
overall learning and writing outcomes for a study program should be determined so that they
can lay the foundation for a systematically designed curriculum. My study seeks to provide
that framework with the development of a Curriculum Desing Program (CuDesign).
In contrast to the Angloamerican context, mostly the United States, Writing Across the
Curriculum (WAC) and Writing in the Disciplines (WID) is not a widespread reform effort at
German universities. Bielefeld University is the first university which seeks to systematically
integrate writing into the curricula. Our work is inspired by research and pedagogical
literature mainly from the United States. The effectiveness of writing-intensive instruction for
deep disciplinary learning has been demonstrated by well-designed small-scale, quasiexperimental studies (e.g., Carter) and by several large-scale studies in the US (Astin1992,
Light 2001, Anderson et al. 2009, Arum and Roksa 2011).
The Anderson study is particularly relevant for reform efforts at Bielefeld. A project of the
National Survey of Student Engagement (NSSE) and the Council of Writing Program
Administrators (CWPA), this survey of over 70,000 first-year and senior students at 80 U.S.
universities not only demonstrated that writing-intensive instruction is associated with greater
self-reported gains in learning and development, but also identified several features that
distinguish more effective writing-intensive instruction from less effective versions of it. The
evidence-based best practices identified in this study form the basis of the LitKom project.
We also profit from practical advice from a U.S. expert for implementing a university-wide
writing program. All this is helpful, but at the same time we do experience that interventions
cannot be easily transfered from one context to another. As a result we learned a lot about the
structures our educational system and the specifics of our context. What we learned is:
1. The term „Writing“ often provokes misunderstanding. In an educational culture where the
teaching of writing was not an issue for universities until 1993 when the first writing center
was founded at Bielefeld University, faculty and departments often hear that the LitKom
project wants to fix students writing problems and that the projects is about additional
courses for students who can’t ‚write‘. As Russell shows, this has been the case in the US,
28
swantje.lahm@uni-bielefeld.de [12/15/2014]
too, but the WAC movement started much earlier in the 70’s and the many initiatives at U.S.
universities is an indicator for the fact, that a much broader understanding of writing as a
mode of disciplinary learning has become a shared notion of a large community of faculty,
administrators and writing specialists (Russell)
2. The structure of curricula differ. German universities have no general education at the
beginning, students start studying by choosing one or two majors. General Composition does
not exist. The usual course structure is a lecture (90 min) followed by a tutorial (90 min) or a
seminar (90 min) taking place once a week.
3. Forms of assessment differ. For a long time the „seminar research paper“ was the most
important form of assessment, especially in the humanities and the social sciences. Students
started to write „seminar research papers“ of 15-20 pages from the very first semester. The
papers were written when the course was finished and students autonomously designed their
writing and research process, which usually took about 4 to 6 weeks. In the meantime the
repertoire of assignments is more variable, but the seminar research paper still plays a major
role. With respect to disciplinary conventions it is usually an ill-defined task and - as other
genres, too, students write mostly when the course is finished and regular feedback is not
available. Writing in sessions and in between sessions is not a common practice.
4. Systems of evaluation differ. Although the practice to evaluate teaching is gaining
importance in Germany right now, students do not rate or evaluate courses on a regular basis.
Course evaluations do not matter in the reward system for faculty
In a sum: Although practice and research in the US have generated a useful set of principles
for integrating writing into curricula, we have to find ways which fit our special educational
context. Until now the LitKom experts were able to demonstrate the need for integrating
writing into core courses which they teach themselves. Colleagues are happy and willing to
take their material and learning from them as long as they can see the benefit for themselves,
the promise of saving time is a main incentive for adopting LitKom strategies. Initiatives
which demand collaborative effort, like for example getting together with a group of faculty
in the department and define learning outcomes for writing introductory courses and design
rubrics accordingly, are happening only very slowly and only in some departments. Although
the social infrastructure of change develops, decisions for change are still made individually
and are not a matter of a collaborative effort or a departmental decision. This is not only on
obstacle for the ongoing formative evaluation, but the long run the lack of collaborative
commitment in departments is likely to become a major obstacle for further efforts of the
project to integrate writing into curricula. This is why my study seeks to develop CuDesign
which is meant to foster a collaborative process of curriculum design.
5.2 Key theorists and frames
My approach is characterized by a systemic perspective on curricular change and based on
interventions theory by Helmut Willke. This means that I think of curricular change as an
29
swantje.lahm@uni-bielefeld.de [12/15/2014]
open-ended, contingent process which very carefully has to take the context of the
intervention into account.
A body of literature about the role of departments, disciplines and individual teaching beliefs
helps to analyze this context and design faculty development programs accordingly. This
body of literature includes theories of situated learning (Laver/Wenger) and implicit,
procedural knowledge of faculty as experts in their discipline (Pace/Middendorf).
My understanding of writing is shaped by the literature about writing as social action
(Bazerman). This is the theoretical foundation for most WAC programs and Curriculum
Design Efforts in the US. In the last years many Writing Across the Curriculum (WAC)
efforts in the US have started to focus on integrating writing into curricula. In this process
key writing assignments are identified and/or designed which allow faculty to assess
students’ capability to meet outcomes which were define beforehand. The departmental
assessment is based on a review of students work based on collaboratively developed rubrics.
The results of the review of student work are the basis for continual improvement. For WAC
proponents this “discourse based approach to assessment” (Bean; Carithers; Earenfight 2005)
is a way to show “that a rigorous program in writing in the disciplines may be the best way to
produce students who know their disciplines’ concepts and procedures but who can also use
this knowledge in complex rhetorical environments” (ibid. 20). The basic underlying
assumption is that at an advanced level students’ work in the form of written text is not an
indicator for writing competency only, but also a proof of deep disciplinary learning. At the
level of graduation writing means to perform the discipline, writing is disciplinary action.
5.3 Glossary
Wordle of most frechently used words in the proposal
30
swantje.lahm@uni-bielefeld.de [12/15/2014]
Autoethnography
A genre of writing and research that transcends mere narration of self and "displays multiple
layers of consciousness, connecting the personal to the cultural.“ (Tingerthal 2013:14)
Backward Design
„The backwards desgin model centers on the idea that the design process [of courses or
curricula, S.L.] should begin with identifying the desired result and then „work backwards“
to develop instruction rather than the traditional approach which is to define what topics need
to be covered. (Source: http://pixel.fhda.edu/id/six_facets.html, retrieved: 13.12.2014).
Bottleneck
A „bottleneck“ is an essential concept or skill in a discipline which is crucial for students to
succeed in their disciplinary studies, but which they consistently fail to grasp.
Curriculum:
„a coherent program of study (such as a four year B.Sc.) that is responsive to the needs and
circumstances of the pedagogical context and is carefully design to develop students’
knowledge, abilities and skills through multiple integrated and progressively challenging
course learning experiences“ (Huball/Gold 2006:7)
For the purpose of my study it is important to keep in mind that this definition of the
curriculum highlights only one level of possible understandings of the curriculum, the formal
level. I am interested in the perceived curriculum, the mental framework which influences
teaching practice in a department.
Decoding the Disciplines
A seven step framework „within which teachers can develop strategies for introducing
students to the culture of thinking in a specific discipline and, in the process, level the playing
field for those students who do not come to college ‚preeducated‘ “ (Tingerthal 2013: 15)
Educational Design Research
Educational Design Research (EDR) is a „research approach suitable to address complex problems in
educational practice for which no clear guidelines for solutions are available.“ (Plomp 2007: 9). EDR
has been used in subject areas like learning sciences, instructional design, curriculum development
and teacher professional development (McKenney & Reeves 2012). Design research has been gaining
momentum in recent years and it’s major goal is to increase the relevance of research for educational
policy and practice (see „Educational Design Research“). The starting point for research is a complex
31
swantje.lahm@uni-bielefeld.de [12/15/2014]
problem, the output is an intervention which has been systematically designed, developed and
evaluated. In the course of the research the intervention is tried out in and formatively evaluated with
the participation of the stakeholders involved in the intervention. Using the results of formative
evaluation the intervention is carefully revised and adapted in several cycles of iteration until it
addresses the complex problem formulated in the beginning in a satisfactory manner. Four main
criteria for the evaluation of an intervention are: relevance, consistency, practicality, effectiveness
(Table from: Plomp 2010: 26).
Learning
My study is based on a systemic-constructivist notion of learning which stresses the
experiential aspect of learning: learning happens when a subject acts and is confronted with
its environment. For learning to happen the confrontation with the environment has to result
in a productive irritation. An irritation is productive when the experiences which disrupt
previous conceptions of understanding and acting, lead to an understanding of the situation
which is subjectively meaningful for the learner and adequate for the context. Prior
experiences and knowledge play an important role and can foster or hinder learning. Striving
for an equilibrium and continuity in the subjective understanding of the world and the
individual experience is an important motivation for learning.
Subjective Theories
In the German discussion the term „subjective theories“ is often used interchangeably with
„belief“, but the term is better defined than „beliefs“ in the Angloamerican discussion:
Dann (1990, 1994) define subjective theories as having the following five characteristics:
- Subjective theories represent relatively stable cognitions, but can be change through
experience.
- Subjective theories are mostly implicit, but can be made conscious when a person gets help
in articulating his/her cognitions.
32
swantje.lahm@uni-bielefeld.de [12/15/2014]
- Subjective theories have a structure similar to scientific theories, which means that they
contain if-then relations and can be use expain and forecast situations. They fulfill the
functions to
a. Define a situation; b. explain events which occurred; c. predict future events and d.
generate plans or recommendations for action.
Teachers’ Beliefs
„Beliefs are a psychologocial concept, which describes the views and propositions of a
person about the world who accepts these as true. These propositions do not have to be
logical, they are arranged by what a an individual sees as relevant and can conflict with each
other. For the actions of a person beliefs haven an informational and action generating
function.“ (Fussangel 2008: 71f; translation S.L.)
Writing
The WEC (Writing-enriched Curriculum) project at the University of Minnesota formulates
an understanding of writing which is foundational for my study:
1. Writing can be flexibly defined as an articulation of thinking, an act of choosing among an
array of modes or forms, only some of which involve words.
2. Writing ability is continually developed rather than mastered.
3. Because writing is instrumental to learning, it follows that writing instruction is the shared
responsibility of content experts in all academic disciplines.
4. The incorporation of writing into content instruction can be most meaningfully achieved
when those who teach are provided multiple opportunities to articulate, interrogate, and
communicate their assumptions and expectations.
5. Those who infuse writing instruction into their teaching require support.
(Source: WEC Home Page wec.umn.edu; retrieved 13.12.2014)
Writing Enriched Curriculum (WEC) Project
„A three-phase, recursive process in which academic units develop, implement, and assess
discipline-specific Undergraduate Writing Plans. These plans articulate discipline-specific
writing expectations, and plans for curricular integration of writing instruction, writing
assessment, and instructional support. At the center of this process are multiple faculty
dialogues that will allow departmental faculty groups to think collaboratively with specialists
in writing pedagogy and assessment about the effective integration of writing into their
undergraduate curricula.“ (Source: WEC Home Page wec.umn.edu; retrieved 13.12.2014)
33
swantje.lahm@uni-bielefeld.de [12/15/2014]
34
Download