Title: Key words Summary

advertisement
1
Title: Mentoring for Skills for Life subject specialist trainees
Key words
Skills for Life diplomas; e-mentoring; online support for mentors; distance learning
Summary
Focus: To establish the needs of mentors who are supporting trainees undertaking a subject
specialist diploma in literacy, numeracy or English for Speakers of Other Languages (ESOL)
and to evaluate the effectiveness of e-mentoring. The courses are a combination of taught
days and distance learning and have recently been extended to include a generic teaching
qualification.
Main strategies: online questionnaires and telephone interviews were used to carry out the
research.
Outcomes: Support for mentors will include the creation of a dedicated web page, stronger
links between course tutors and mentors and a better understanding of the role of the
mentor. Trainees are not always well-supported by their mentors; course tutors will check
this during tutorials. The results of the research indicated that mentors should be subject
specialists. If that is difficult for trainees, they should be allocated a Skills for Life specialist
e-mentor.
Context
The Essential Skills Resource Centre (part of the Centre for Lifelong Learning, the University
of Warwick) has been delivering one year Skills for Life qualifications for teachers over the
four years. The Additional Subject Specialist Diplomas are offered in literacy, numeracy and
ESOL. Trainees with an existing generic teaching qualification work towards the Additional
Diplomas. Trainees without a generic teaching qualification have embarked on a two year,
partially integrated model. At the end of two years, trainees will have achieved a Subject
Specialist Diploma in addition to a Diploma in Teaching in the Lifelong Learning Sector
(DTLLS). Delivering the DTLLS programme is a new venture for the staff at the Essential
Skills Centre. Diplomas are delivered by flexible study. Trainees attend 7 sessions: 1 day a
month over an 8 month period and they are required to complete distance study tasks
between the taught days. The course is managed through a website with monthly tasks and
e-learning activities. Trainees have their own blog to store course work and reflections.
Essential Skills Resource Centre: Mentoring for subject specialist trainees
2
Because of the flexible delivery of the courses, some trainees travel some distances to
attend the courses.
In the past, the Centre staff only delivered the subject specialist diplomas and although
mentors were used, it was not essential. The Centre staff will be offering the DTLLS
programme from September, 2009 and there is a requirement for all trainees to have a
mentor.
There are currently 46 trainees on the diploma courses: 27 on the two year partially
integrated programmes and 19 on the additional diploma courses.
The team consists of 2 full time staff and 3 part time staff. The e-mentor offered support to
14 trainees.
Aims and Objectives
As it will be a requirement for all trainees on the DTLLS programme to have a mentor, it was
decided that current mentors should be asked whether they felt well-supported and, if not,
how improvements could be made. A further aim was to evaluate the effectiveness of ementoring provided to trainees with no suitable mentors within their organisations.
There were a number of issues that could potentially affect the quality of the mentoring
process: last year, 14 trainees reported to the Centre manager that they were finding it
difficult to identify subject specialist mentors; there was no funding for mentors and incidental
comments from trainees suggested that there was a general lack of understanding about the
structure of flexible/distance learning model and there was a lack of understanding as to
what to expect of a subject specialist mentor.
Mentoring arrangements were not a requirement for the Additional Diplomas. The
development of the two year partially integrated Subject Specialist Diplomas with the DTLLS
focused the attention on the mentoring arrangements as they are a requirement of the
course.
Initially, all trainees were asked to provide the name of a mentor. For those for whom that
would be difficult, an e-mentor was allocated.
Although the staff at the Centre sent out information to the mentors, they had little contact
with them and no mentors replied to emails.
It was hoped that by strengthening the links with mentors and by discovering what they
would find the most helpful, appropriate support could be offered by the Centre. To gain a
Essential Skills Resource Centre: Mentoring for subject specialist trainees
3
balanced overview of the system, it was necessary to consider the views and experiences of
the trainees. It was hoped that the role of the mentor could be better defined and the
mentoring process improved.
Through the research project, funding was available for mentors to both engage with the
research and undertake their role more effectively. A one-off payment was offered to 12
mentors to contribute to their time spent mentoring the trainees and as an incentive and
payment for taking part in this research.
There was also the second strand of this research to consider: this year, the Centre
appointed an e-mentor to support those trainees who did not have a suitable person in their
organisation. In most cases, these were trainees who were working in isolated
circumstances. For example, one trainee assessed National Vocational Qualifications
(NVQs) in a logistics organisation and has developed literacy support for the workforce;
there is no one in this organisation with the necessary area of expertise to support her.
Through this research, it was hoped to gauge the effectiveness of this remote support to
inform future mentoring plans.
Strategies
The two main people involved at the planning stage were the manager of the Essential Skills
Resource Centre and the Project Manager. Together they decided what data to gather.
They decided to identify the following information: the level of contact between trainees and
mentors; the method used to make contact; the nature of the support required; how the role
of the mentor could have been enhanced; how that support should be made available and
any other suggestions.
To conduct this research, there were three main stages in the process: letters to inform
mentors and mentees of the research, data collection by questionnaires and semi-structured
interviews.
The first part of the process was to write to all involved: mentors and trainees. The letter to
the trainees was to inform them of the research and to alert them to the fact they would be
receiving a questionnaire. The letter to the mentors was inviting them to take part in the
research. (Appendix 1) The number taking part was limited as funding would be allocated to
those taking part; there were insufficient funds for all mentors.
Initially there was a poor response from the mentors with only 3 out of 46 replying. The
Centre manager contacted a mentor with whom she had previous contact. This mentor was
able to offer make some excellent suggestions for improving the letter. She felt that the
Essential Skills Resource Centre: Mentoring for subject specialist trainees
4
letter was rather wordy and there was no ‘reply by’ date. She particularly thought that the
wordiness of the letter would not encourage busy professionals to read it immediately. A
further letter was produced. (Appendix 2) It was far more explicit and bullet points helped to
make it easier to read and to understand. The omission of a ‘reply by’ date was an oversight
when compiling the first letter and was included in the second version. The result was a far
better response with 14 replies; two of those respondents had to be placed on a waiting list.
The improved response was likely to be due to the improved second version. However, it
may also have been due to the fact that this was the second mailing and could have served
as a reminder. It should be noted that the mentors self-selected themselves to take part in
this research and that may have affected the responses.
Whilst letters were being sent out and responses recorded, the questionnaires were being
devised. Although containing similar themes, a separate questionnaire was devised for the
three main groups: mentors, mentees and e-mentees. (Appendices 3, 4 and 5)
Questionnaires were sent to: 12 mentors, 32 mentees and 14 e-mentees. As the quantity of
questionnaires was small (below 50), it was felt that it was possible to collect qualitative data
so it was possible for respondents to add their own comments. The result was that the
questionnaire was made up of both quantitative and qualitative data.
The on-line questionnaires were developed using FormsBuilder. This is on add-on tool to
the University of Warwick’s web-building software, SiteBuilder. Although the questionnaires
could be sent out to individuals, the returns were anonymous. The facility for collating the
results was better for quantitative data than for qualitative.
A pilot questionnaire was sent out to three mentors. Their feedback was useful and small
changes were made. A pilot was not carried out for the mentees questionnaire. There were
two reasons for this: firstly, the Project Manager was aware that the course that the trainees
were undertaking was very demanding and did not want to add to people’s workload and
secondly, some of the improvements suggested for the mentors’ questionnaire could be
applied to the mentees’ questionnaire.
Questionnaires were then sent out to those mentors volunteering to take part and to the
trainees. Mentors also received a consent form to sign and return. (Appendix 6)
Once the ‘return by’ date had passed, the Project Manager started to analyse the results and
considered what questions to ask during the telephone interviews (Appendix 7). The most
frequent issues were selected for further discussion. As the sample was small (12), openended questions were asked therefore qualitative data was collected. This method was
selected to enable the interviewer to elicit more detail and to seek clarification when
Essential Skills Resource Centre: Mentoring for subject specialist trainees
5
necessary. For example, the mentors were asked if they would have appreciated more
detail about the course. During the interview, it was possible to discuss the amount of
information required. Some mentors would have preferred as much information as possible;
whereas others felt they would only need an overview.
The Project Manager arranged a timetable of telephone interviews. All mentors were
emailed and were given dates and times when telephone interviews could take place. The
times suggested were from before the beginning of the working day until after the end of the
working day. Only two mentors had to rearrange an alternative time. The interviewer
ensured that the mentors were telephoned at the agreed time and did not take any longer
than the suggested fifteen minutes. This part of the data gathering process was extremely
effective. Mentors appreciated the punctuality of the interviewer. In all cases, the mentors
were immediately available for the interview and some had arranged to take the calls in
quieter places. During the telephone interviews, notes were made by the interviewer.
Two main methods of data collection have been used during this project: questionnaires
with both closed and open-ended questions and semi-structured interviews. Both these
methods gave rise to some useful information to help future mentors and trainees. Although
a little cumbersome, the results of the semi-structured interviews was enormously helpful for
identifying the amount of detail required by mentors. It was anticipated that, had this project
had a longer life, semi-structured interviews with the trainees would have provided further
helpful information.
There were a number of success aspects of these strategies. The shorter, more specific
letter was successful in attracting sufficient mentors to take part in the project. Piloting the
questionnaire helped to improve the questions. The well-scheduled telephone interviews
gave rise to some very helpful information resulting in some mentors making suggestions
that had not been previously considered. Using the questionnaire software was extremely
efficient as the results could be checked as they arrived. As stated previously, this was an
excellent way of gathering quantitative data.
The less successful aspect of these strategies was the first letter not being sufficiently
explicit. The qualitative responses to the questionnaires were more time-consuming to
collate. This would have been more problematic had the sample size been greater. The
responses from the e-mentees lacked some detail. The Project Manager and Centre’s
manager considered conducting telephone interviews. This was problematic as the majority
of the trainees were teaching full time and of course, were taking part in a demanding
flexible distance study course. It was decided that the e-mentor would collate the frequency
and nature of the contact between her and the e-mentees.
Essential Skills Resource Centre: Mentoring for subject specialist trainees
6
An additional and unexpected feature of this project was the success of the seminars with
other managers of similar projects. These occasions provided excellent opportunities to
share experiences and ideas. This was so effective that it should be considered to be an
additional strategy. At each of the three seminars, peers asked questions and made
comments that added value to the research at its different stages. More importantly,
listening to peers describing mentoring in their situations, issues were raised for this
research that had not previously been considered. Some of the many points raised will be
considered in the plans that go beyond the life of this research project.
Outcomes and Impact
To elicit the required information, the questions asked were related to: the nature of the
contact between mentors and mentees; the effectiveness of the current mentoring process
and the details of support requested by mentors. At the onset, as previously stated,
mentoring for Skills for Life trainees was not essential and therefore occasionally
inconsistent. Trainees identified a mentor of their choice and an e-mentor was allocated to
those without suitable mentors. Although guidance was sent out to mentors, there was little
or no further contact between the teacher trainers and the mentors.
Mentors and mentees were asked about the nature of the support i.e. was it related to the
following: generic teaching, the subject specialism, assignments, the structure of the course
or ‘other’? Figure 1 below shows that the majority of issues were related to the subject
specialism and assignments. Although the sample was small, there were significant
differences that could inform future plans. During the seminars, interesting debates took
place around the issue of whether or not the mentor should have the specialist subject
knowledge. In this situation, it is the subject knowledge that it being developed as much as
the generic teaching skills, therefore, it may be suggested that trainees should be matched
with subject specialist mentors.
Essential Skills Resource Centre: Mentoring for subject specialist trainees
7
Figure 1: Nature of support
Mentors, mentees and e-mentees were asked how effective they found the mentoring
process (see Figure 2 below). Acknowledging the fact that small samples were collected,
there were some significant differences in the results. 11% of mentors found mentoring to
be effective and 82% found mentoring to be mostly effective. The results for mentees did
not reflect the same level of satisfaction. Another significant difference was the
effectiveness of the system for those with an e-mentor. The reasons for this were not
established in this current research.
Figure 2: Effectiveness of current mentoring process
Essential Skills Resource Centre: Mentoring for subject specialist trainees
8
One of the main outcomes of the research was to establish what support mentors required.
Figure 3 below gives as overview of the results. The main request from mentors was for a
dedicated web page (10 requests). The next most frequent request was for clarification of
the role of the mentor (8 requests) followed by the need for telephone contact with Centre
staff (7 requests). Mentors requested information that was related to the course itself.
Information related to the course content and structure was requested by 6 and 5 mentors
respectively and observation support by 4 mentors. Some mentors requested
communication with the Centre staff: 5 staff requested telephone communication whilst 3
requested communication using email.
Figure 3: Requests from mentors
Comments were collected from open-ended questions in the questionnaires. These
comments formed the basis of the semi-structured interviews carried out with the mentors.
The results can be seen in Figure 4 below. Whilst accepting that small samples of
questionnaires have limitations, the detail that was gained from the telephone interviews
proved to be excellent when considering the content of the dedicated web pages.
Essential Skills Resource Centre: Mentoring for subject specialist trainees
9
Figure 4: Results of semi-structured telephone interviews carried out with 12 mentors
Point for discussion
Course structure
Role of mentor
Observation
Payment – does it
make a difference?
How should this
information be made
available?
Contact with other
mentors and course
tutors
Other suggestions
Responses with number of those in agreement
Overview of the course 12
Timeline of assignments and tasks 12
Detail 1
Guidance 12 (include how much help)
Make process more formal 4 (perhaps choose – it may be added
pressure) describe different scenarios about how relationship
works
Guidelines 12
Can observations be linked to college observations
A model lesson observation would be v helpful
No 10
Yes 2
Web 12
Paper based 5
Face to face meeting at the beginning 6
(mentors could have option of attending for an hour over lunch
possibly)
Knowing who to contact (course tutors) 12
Email once a month from course tutors 2
Forum for mentors 2
Distributing email contacts of mentors (with permission) 2
Collate FAQ
Recruit ex-trainees as mentors
The research has highlighted a number of key factors. Firstly, mentors have requested that
there should be stronger links with the Centre staff. Mentors will be given the contact details
of the appropriate members of staff. Some mentors suggested attending the induction day
to meet staff face to face. Secondly, mentors have requested more information about the
course content, course structure, observations and the role of the mentor. This information
can be made available on a dedicated web page for mentors. Finally, some aspects of the
mentoring process need to be considered. The choice of mentor is crucial. The research
suggested that the support received was not always appropriate: some mentees reported
that their mentors were too busy to offer support whilst others had identified their line
managers to be mentors; a decision they had later regretted. To provide trainees with
subject specialist mentors, the Centre manager may recruit mentors from previous cohorts of
trainees. For trainees unable to identify a suitable mentor, the e-mentoring should be
continued. It will be necessary to debate the level of formality required. A suggestion from
Essential Skills Resource Centre: Mentoring for subject specialist trainees
10
the final seminar was to introduce a three-way agreement between mentor, mentee and
teacher educator.
Learning points
In respect of the research methods, it is clear that with small groups, quantitative
data is limited and with hindsight, evidence should have been gathered from
telephone interviews and perhaps face to face structured discussions with trainees.
It is clear from the results of the research that even though once trainees have
mentors, there should not be an assumption that all is well.
Next steps
The first action will be to present the results of this research to the team of subject specialist
course tutors. This can be done at a team meeting. Once the team has had chance to
discuss the issues raised, the actions below can be implemented and embedded into the
course procedures.
A dedicated web page for mentors has been started. Suggestions as a result of the
research will be included on the web page. This information will also be available in
a paper-based pack. The use of the web page needs to be monitored.
An e-mentor should be allocated to those who do not have access to a Skills for Life
specialist. Further research into the effectiveness may be useful.
In most cases, trainees should have a subject specialist mentor.
It is essential that all parties understand the role of the mentors. This includes the
mentors, trainees and tutors. The current guidance will need to be circulated to all
involved. There needs to be flexibility within the role to accommodate the varying
levels of experience of the trainees. The role of the mentor could be discussed at the
next teacher trainers’ meeting.
The Centre manager could consider recruiting mentors from previous cohorts of
trainees.
The issue around whether the mentoring process should be formalised or not could
be explored further. A suggestion from the final seminar was to introduce a 3-way
agreement between mentor, mentee and teacher trainer.
Mentees should be asked during their tutorials if they are satisfied with the mentoring
system. A question should be added to the tutorial forms.
Mentors will be able to access the contact details of appropriate Centre staff. The
Centre manager may consider contacting the mentors, perhaps twice during the
Essential Skills Resource Centre: Mentoring for subject specialist trainees
11
course, to identify any issues. Some mentors suggested they attend part of the first
day to meet teacher trainers.
Contact details: Anne.Schofield@warwick.ac.uk
Essential Skills Resource Centre: Mentoring for subject specialist trainees
12
Supporting documents:
Appendices 1-7
Essential Skills Resource Centre: Mentoring for subject specialist trainees
13
Appendix 1
Dear ___________
Firstly, I would like to thank you for supporting ___________________ whilst he/she is attends the
Subject Specialist Diploma.
We have realised that mentors have agreed to take on this role and then received little in the way of
support. One of the reasons for this is that trainees live and work a long way from the university and
the opportunity to meet with mentors is impossible. We are now in the fortunate position of having
some funding to complete some action research. We are hoping to find out what support is
required to improve the experience of both mentors and mentees. Of course, we don’t know the
outcomes of the project but it is expected that the end result may be a webpage or ‘toolkit’
dedicated to mentors and possibly a system that allows regular contact with a course tutor.
We intend to complete the research with the mentors and mentees mainly through confidential and
anonymous questionnaires and telephone interviews. Some of the funding received will be used to
make a one-off payment to mentors who agree to take part in the action research.
Please let me know if you would be interested in taking part in this project that we hope will add the
quality of our provision.
If you have any further queries, please do not hesitate to contact Anne Schofield:
anne.schofield@warwick.ac.uk
Essential Skills Resource Centre: Mentoring for subject specialist trainees
14
Appendix 2
Dear ___________
RE: Action Research into the effectiveness of support for mentors
We have written recently giving details of the above project. We have had a small response but
would like to be working with a larger sample. Therefore, I have included some additional
information about the project:
You will be sent an online questionnaire. This will take about 20 minutes to complete.
We will arrange to conduct a semi-structured interview over the telephone. This will take
about 15 minutes.
Your organisation will receive a payment between £250 and £300 to acknowledge the time
spent. (We acknowledge that working with your finance departments many be problematic.
You can take part in the project and not receive the payment.)
We understand that some mentees request very little support. Please do not let this put
you off taking part. All feedback will be helpful.
Questionnaires and interviews will be completed by 07/03/09
Please let me know if you are able to take part in this project by 16/02/09
Responses and queries to: anne.schofield@warwick.ac.uk
Essential Skills Resource Centre: Mentoring for subject specialist trainees
15
Appendix 3
WMCETT (West Midlands Centre for Excellence in Teacher
Training) Mentoring Project
Mentor’s questionnaire
Thank you for agreeing to take part in this project.
The system that we use ensures that your questionnaires remain anonymous.
If you require any clarification when completing the questionnaire, please contact
anne.schofield@warwick.ac.uk
In your role of mentor, on how many occasions have you had contact with
your mentee?
Please tick one.
0
1
2
3
More
than 3
State
number
if
possible
What type of contact was used?
Tick those that are appropriate.
Face to face
Email
Telephone
There are a number of aspects to the course. In which aspects does your
mentee require support?
Tick those that are appropriate.
Issues around generic teaching
Issues around the teaching of the specialist subject i.e. literacy, numeracy,
ESOL
Issues around assignments/tasks
Issues around the structure of the course
Any other issues or comments.
Essential Skills Resource Centre: Mentoring for subject specialist trainees
16
Would your role of mentor been enhanced by any of the following:
More information about the course content
More information about the course structure
More information about the tasks and
assignments
More support for observations
More support for the completion of the
observation forms
More information about the role of mentors
Email contact with Centre staff before the
start of the course
Email contact with Centre staff at intervals
during the course
Telephone contact with Centre staff before
the start of the course
Telephone contact with Centre staff at
intervals during the course
A web page dedicated to mentors including:
useful details of the course, the role of the
mentor, observation information.
A paper-based pack including: useful details
of the course, the role of the mentor,
observation information.
Any other suggestions:
As a mentor, do you face any difficulties? Please comment.
How would you rate the effectiveness of the mentor/mentee relationship?
Ineffective
Mostly ineffective
Mostly effective
Effective
Any other comments about the role of mentor or the processes involved?
Once again, I would like to thank you for taking part in this project.
The next stage of the research will be to conduct semi-structured interviews over the
telephone.
Anne Schofield
Essential Skills Resource Centre: Mentoring for subject specialist trainees
17
anne.schofield@warwick.ac.uk
Essential Skills Resource Centre: Mentoring for subject specialist trainees
18
Appendix 4
WMCETT (West Midlands Centre for Excellence in Teacher
Training) Mentoring Project
Questionnaire for mentees
As you will know, we are conducting some research into the effectiveness of the mentoring
process. Your comments will form an in
The system we use ensures that all questionnaires remain anonymous.
If you require any clarification when completing the questionnaire, please contact
anne.schofield@warwick.ac.uk
As a mentee, on how many occasions have you had contact with your mentor?
Please tick one.
0
1
2
3
More
than 3
State
number
if
possible
What type of contact was used?
Tick those that are appropriate.
Face to face
Email
Telephone
There are a number of aspects to the course. In which aspects have you
required support?
Tick those that are appropriate.
Issues around generic teaching
Issues around the teaching of the specialist subject i.e. literacy, numeracy,
ESOL
Issues around assignments/tasks
Issues around the structure of the course
Any other issues or comments.
Essential Skills Resource Centre: Mentoring for subject specialist trainees
19
Do you feel that your mentor would have benefited from any of the following:
More information about the course content
More information about the course structure
More information about the tasks and
assignments
More support for observations
More support for the completion of the
observation forms
More information about the role of mentors
Email contact with Centre staff before the
start of the course
Email contact with Centre staff at intervals
during the course
Telephone contact with Centre staff before
the start of the course
Telephone contact with Centre staff at
intervals during the course
A web page dedicated to mentors including:
useful details of the course, the role of the
mentor, observation information.
A paper-based pack including: useful details
of the course, the role of the mentor,
observation information.
Any other suggestions:
How well informed do you consider your mentor to be?
Uninformed
Mostly uninformed
Mostly informed
Informed
Do you face any difficulties with the mentoring process? Please comment.
How would you rate the effectiveness of the mentor/mentee relationship?
Ineffective
mostly ineffective
mostly effective
Effective
Any other comments about the role of your mentor or the processes involved?
Once again, I would like to thank you for taking part in this project.
Anne Schofield
anne.schofield@warwick.ac.uk
Essential Skills Resource Centre: Mentoring for subject specialist trainees
20
Appendix 5
WMCETT (West Midlands Centre for Excellence in Teacher
Training) Mentoring Project
Questionnaire for e-mentees
As you will know, we are conducting some research into the effectiveness of the mentoring
process. Your comments will form an in
The system we use ensures that all questionnaires remain anonymous.
If you require any clarification when completing the questionnaire, please contact
anne.schofield@warwick.ac.uk
How many times have you contacted your e-mentor?
There are a number of aspects to the course. In which aspects have you
required support?
Tick those that are appropriate.
Issues around generic teaching
Issues around the teaching of the specialist subject i.e. literacy, numeracy,
ESOL
Issues around assignments/tasks
Issues around the structure of the course
Any other issues or comments.
None
How effective has your e-mentor been?
effective
Mostly effective
Mostly ineffective
ineffective
Do you have any further comments about the e-mentoring process?
How could the e-mentoring system be improved?
Essential Skills Resource Centre: Mentoring for subject specialist trainees
21
Appendix 6
Project: Mentoring Subject Specific trainees
Material gathered during this research will be treated as confidential and securely
stored. Please answer each statement concerning the collection and use of the
research data.
I have been given the opportunity to ask questions about the
study
I have had my questions answered satisfactorily
yes
no
yes
no
I understand that I can withdraw from the study at any time
without having to give an explanation
I agree to being identified in this interview and in any
subsequent publications or use.
I would like my name acknowledged in the report and on the
project web site (without linking it to content or quotation)
yes
no
yes
no
yes
no
Name (printed) ______________________________________________
Signature _______________________________ Date_______________
Feel free to contact me if you have any further questions.
The name of the main investigator, along with telephone and email contact details is:
Anne Schofield
Tel:
02476574558
Email: anne.schofield@warwick.ac.uk
Essential Skills Resource Centre: Mentoring for subject specialist trainees
22
Appendix 7
Topics for telephone interviews
Course structure
Role
Observations
Payment
Specialist knowledge
What would be the best way of communicating any information?
What support would you like from the university?
Essential Skills Resource Centre: Mentoring for subject specialist trainees
Download