e1 Survey March 2013 Introduction On the 26th of March all schools were invited to take part in an online survey (see Appendix I for full survey). The purpose of the survey was to ascertain users’ views on the support they receive from the Schools’ MIS Team and from the Pearson helpdesk; to assess training requirements; determine awareness and usage of the MIS blog; and gauge user perception of e1. The online survey was open to all teaching and non-teaching staff using e1 and closed on Friday 29th of March. In total there were 120 responses from 35 schools (7 secondary, 26 primary and 2 special schools), the breakdown of responses by school is given in Figure 1 and a breakdown by respondents’ staff position is given in Figure 2. Figure 1 e1 Survey: Respondents by School Abbotsw ell School Bucksburn Primary School Charleston School Cordyce School Culter School Cults Academy Cults Primary School Danestone School Dyce Academy Dyce Primary School Fernielea School Forehill School Gilcomstoun School Glashieburn School Harlaw Academy Hazlehead Academy Hazlehead Primary School Heathryburn School Holy Family RC School Kincorth Academy Kingsw ells School Kirkhill School Mile End School Milltimber School New hills Primary School Northfield Academy Scotstow n Primary St Joseph's RC School St Peter's RC School Stoneyw ood School Sunnybank School The Pupil Support Service Torry Academy Tullos School Unknow n Woodside School 0 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 No of Respondents 1 24 25 Figure 2 e1 Survey: Respondents by Position 70 66 60 No of Respondents 50 40 30 22 20 12 14 10 4 2 0 Unknow n Teaching School Support Assistant School Senior School Management Administrator Other non teaching Analysis Support from Pearson Of the 120 respondents only 19 had directly logged a call with Pearson; of these 6 were neither satisfied nor dissatisfied, 9 were satisfied and 4 were very satisfied with the response to their call(s). There were 2 responses to Question 5 despite no Dissatisfied or Very Dissatisfied responses to Question 4. 1 was a complaint relating to not being able to save staff letters in e1 and the other response was, “To be honest, I’m not entirely sure what you mean by ‘Pearson’ and ‘MIS’”. Support from Schools’ MIS Team Of the respondents answering Question 6, How satisfied were are you with the level of support you receive from the MIS team in Aberdeen: 2 were very dissatisfied, 1 was dissatisfied, 45 were neither satisfied nor dissatisfied, 26 were satisfied and 36 were very satisfied. When prompted to explain why they were dissatisfied or very dissatisfied (Question 7) few of the responses related to the question. 9 answered this question despite only 3 very dissatisfied/dissatisfied respondents. 2 respondents did not know what MIS stood for or what the MIS team was, 2 respondents made positive comments about the team, 3 of the respondents have never had to contact the team, 1 said they have had no support, 1 questioned, “what support?” There were 26 responses to Q8, ‘if there are any specific items you would like to see covered in this documentation, please list them’ (see Appendix II) 2 Training From the responses to Question 9, Do you require more training in e1?, 54 said no and 62 said yes. The areas respondents would like training on are given in Figure 3. Figure 3 e1 Training Requirement Monitoring SQA Attendance Reports Marksheets Administration General overview 0 5 10 15 20 25 30 35 40 Responses Respondents were asked in Question 11 how they wanted training delivered; the responses are given in Figure 4. Figure 4 e1 Training Delivery Preference All day sessions any of the above Inservice Day Morning/afternoon sessions Twilight sessions user guide/paper based instructions 0 5 10 15 20 25 30 35 40 45 No of Respondents 3 MIS Blog From the responses to Question 12, Have you accessed the MIS Blog? 97 said no, 18 said yes and 5 did not respond. Of those that have accessed the blog 15 said they found it useful and 2 said they did not. Asked why respondents did not find the MIS blog useful 3 said they did not access it or had heard of it and 1 said it was, “not in a language I particularly understand”. There was only 1 response to Question 15, If there are any items you would like to see included on the blog, to which the respondent inferred they did not have time to read the blog as they were to busy. e1 Assessment 48 of the respondents to Question 16, Would you like to see any changes or additions to e1?, said no, 57 respondents said yes and there was no response from 15. There were 60 suggestions given for Question 17, Would you like to see any changes or additions to e1? (See Appendix III) Conclusions and Next Steps The number of responses were adequate considering the survey was available to staff for less than a week. Responses came from staff in Secondary, Primary and Special schools. Proportionately the biggest number of responses came from secondary schools (60%) with 52% of responses from four secondary schools: Cults Academy, Hazlehead Academy, Kincorth Academy and Northfield Academy. The biggest number of responses by staff position came from teaching staff (55%). Whilst the number of respondents indicating they had logged a call with Pearson was low, none of those who logged a call were dissatisfied with the response to their call(s). 3 respondents said they were dissatisfied or very dissatisfied with the support received from the MIS team but this may be due to a lack of awareness of what MIS stands for. This was certainly backed up by the comments made by respondents. There is evidently a training requirement for e1 users across a number of areas and for there to be flexibility in how this training is delivered. The number of respondents who have accessed the blog was very low and indicates that work needs to be done to raise staff awareness, although, the majority of respondents who have accessed it have found it useful. It is clear from the survey that the MIS team need to convey to e1 users what MIS stands for, as a result future correspondence from the MIS Team will make it clear that MIS stands for Management Information System. The Schools’ MIS Co-ordinator will work with Pearson to identify training in the appropriate areas and to offer a variety of training options so that as many staff as possible in schools can access the training they require. The MIS team will continue to raise awareness about the blog and encourage all e1 users to access it and ideally sign up for email alerts and/or register for the site. The Schools’ MIS Co-ordinator has scheduled time to work on documentation for administering e1 and it is intended that this will be finished prior to the start of the 13/14 academic term. Feedback from the survey will be 4 used as part of this work. Suggestions made by respondents on any changes or additions they would like to be made to e1 will be forwarded onto Pearson. 5 Appendix I – Online Survey 1. School Name: answered question 120 skipped question 2 Response Count 120 2. Your position at the school answered question 120 skipped question 2 Response Percent Response Count School administrator 19.2% 23 School support assistant 10.0% 12 Other non teaching 3.3% 4 Teaching 55.0% 66 School senior management 12.5% 15 3. Have you logged any helpdesk call(s) directly with Pearson in the last 12 months? answered question 121 skipped question 1 Response Percent Response Count Yes 16.5% 20 No (If No, please go to Q6 on the next page) 83.5% 101 4. If Yes, in general how satisfied were you with their response to your call(s)? answered question 21 skipped question 101 Response Percent Response Count Very Satisfied 23.8% 5 Satisfied 42.9% 9 Neither Satisfied nor Dissatisfied 33.3% 7 Dissatisfied 0 0.0% 6 Very Dissatisfied 0.0% 0 5. If you were either 'Dissatisfied' or 'Very Dissatisfied' with their response, please explain why. answered question 3 skipped question 119 Response Count 3 6. In general, how satisfied are you with the level of support you receive from the MIS team in Aberdeen? answered question 112 skipped question 10 Response Percent Response Count Very Satisfied 33.0% 37 Satisfied 24.1% 27 Neither Satisfied nor Dissatisfied 40.2% 45 Dissatisfied 0.9% 1 Very Dissatisfied 1.8% 2 7. If you are either 'Dissatisfied' or 'Very Dissatisfied' with the support you receive, please explain why. answered question 9 skipped question 113 Response Count 9 8. The MIS team are planning to give schools more detailed documentation on administering e1. If there are any specific items you would like to see covered in this documentation, please list them here. answered question 28 skipped question 94 Response Count 7 28 9. Do you require more training in e1? Answered question 118 skipped question 4 Response Percent Response Count Yes 54.2% 64 No (If No, please go to Q12 on the next page) 45.8% 54 10. If Yes, please indicate the area(s) you require training on (tick all that apply). answered question 63 skipped question 59 Response Percent General overview Response Count 33.3% 21 Administration, i.e. setting up users, 33.3% etc. 21 Marksheets 60.3% 38 Reports 63.5% 40 Attendance 15.9% 10 SQA 25.4% 16 Monitoring 47.6% 30 11. How would you like the training to be delivered? (Please tick all that apply) answered question 64 skipped question 58 Response Percent Response Count Morning/afternoon sessions 64.1% 41 All day sessions 21.9% 14 Twilight sessions 40.6% 26 Drop in sessions 21.9% 14 9.4% 6 Other (please specify) 8 12. Have you accessed the MIS blog? answered question 117 skipped question 5 Response Percent Response Count Yes 17.1% 20 No (If No, please go to Q16 on the next page) 82.9% 97 13. If Yes, did you find it useful? answered question 19 skipped question 103 Response Percent Response Count Yes 84.2% 16 No 15.8% 3 14. If you did not find the MIS blog useful, please explain why. answered question 5 skipped question 117 Response Count 5 15. If there are any items you would like to see included on the blog, please list them here. answered question 2 skipped question 120 Response Count 2 9 16. Would you like to see any changes or additions to e1? answered question 107 skipped question 15 Response Percent Response Count Yes 55.1% 59 No 44.9% 48 17. If Yes, please provide your suggestions here. answered question 62 skipped question 60 Response Count 62 10 Appendix II Q8 The MIS team are planning to give schools more detailed documentation on administering e1. If there are any specific items you would like to see covered in this documentation, please list them Can't think of any offhand Developing the use of marksheets and how this could be incorporated into the annual reports. Doctor's Look up Tables - Facility to edit - At present a lock on. how to access percentages re absences How to print out class grids with pupil names How to export reports eg. class lists to WORD ,excel etc. How to generate reports and how to extract information about general attendance for the school day with tel no's of parents/careres. I would like to know how to prepare a report by class on absences or a list of parent names per class. I would like to know how to see a whole class's results on the marksheet onscreen and how to print out that information (like we used to do with Phoenix.) This would be very handy for reportwriting. I'd like training on how I can easily produce csv files of class lists to import into my library management system. Instructions for creating marksheets and pulling information from exisiting sheets (e.g. SQA data, midyis data, prelim data). Just keen to use the system more fully although do appreciate that will take a joint approach to agreeing authority approaches, a great opportunity to smarten our systems. Paper support not online help please. Specific assistance in in-putting timetables, from roll forward to finished product e.g. Where do you start? What is step 1,2, 3 etc.? What else can e1 do? an overview of what it can be used for. Pupil tracking Recording discipline referrals (paper free system) Interim Reports Reminder to teachers about letting other staff use log ins Overview of what could be possible Report writing - how to make more specific reports Tracking - so far only teachers have received training - I'm often asked and have no idea what is input in tracking. Reporting/Tracking pupil progress. Short cuts. Some things on E1 take ages to do because you have to go through about 12 clicks of the mouse to get there. Some way to make the experience of using e1 less clunky. I'm not sure documentation is the answer, more training is needed. Class teachers got NO direct training in using e1. System does not flag up truancy, Does not flag up period truancy, Does not carry attendance over from P1 to P2 etc The reports section - how to access reports, create customised reports, delete reports created by staff who are no longer working here Unfortuately with e1 there is a certain amount of "you don't know - what your don't know" The course running regarding timetabling etc are helping address some training issues and gaps in knowledge. The MIS team in Aberdeen are a very valuable resource Use of Standard Letters ATT1 etc What is the MIS team What reports are available and instructions on how to print these out Where is the time coming from? Yes, how to uncomlicate the system. 11 Appendix III Q17 If Yes to Q16(Would you like to see any changes or additions to e1?), please provide your suggestions here. A facility to allow teaching staff (or at least Faculty Heads) to develop individual marksheets and reports without all other school staff 'seeing' these and avoiding an overly complicated set of marksheets and reports being presented to all staff. Ability to create marksheets etc for departmental/personal use Ability to flag up truancies - day or period by period Ability to track performance Ability to record exam data in an easily accessible way Ability to have pupil chronologies on e1 would be useful Ability to see reports as the pupil will see them - easier to check if whole pupil report can be viewed. Way too many clicks are needed in general. When a pupil brings in a note for being absent it seems to take ages to log the reason - very cumbersom Alphabeticla lists for entering NABS etc. Facility to print of class lists rather than whole year for logging grades etc. an awful lot of clicking to get anywhere, not intuitive, ability to cut/paste to/from excel would be very useful Appearance of Reports are very small and not easy to read. I would like appearance improved. When you change the size of your screen sometimes some of the Report is missing. Auto-Logout time is too short for our periods. Be able to access period by period registration for individual pupils, pupil names to be highlighted if missing from classes when attended earlier classes, Could you make the p3 server login screen slightly different to the standard server login screen so that I can tell which one I am looking at. Could you change our spell check to English-UK. Cross-referencing on period registration to alert class teachers if a pupil who was present in a previous class is now absent, or vice versa. This will assist in more quickly identifying truancy/missing students, allowing us to more quickly respond and Easier tracking as the version we are using appears not to do this. GIRFEC chronologies, assessment and plans and an agreed authority approach to recording behaviours I don't find E1 easy to use. When I am inputing childrens attainment data I find it awkward and slow. It is not easy to get an overall picture of my classes levels or predictions using e1 and I find creating my own spreasheets much easier, although this I find it surprising that it does not keep a "running total" of pupils in school - when P1 input attendance (or not) this should show up in P2 and so on. It should also flag up persistent lates/absences - Guidance tell me it doesn't. I would like it to be clearer and more user friendly. I would like to be able to amend the Doctors to surgeries only as most people never see the same doctor all the time. I would like to be able to see what was registered in the previous class for attendance so I can see where anomolies are appearing with pupils registration. I would like to see more discussion with school on exactly what we need and greater willingness from E1 not the authority to put it in place. I would love to be able to work on different screens at the same time ie, have edit pupil open and be able to minimise that screen to work on edit personnel, or run a report if asked - obviously I've no idea if this is possible, but it would be very handy Interest Group: be able to print an individual sheet each time a payment is made instead of printing the whole class each time one or two further payments are made. Pearson still working on this one? It can sometimes still be rather confusing looking for things and feel that it can have a long winded approach to getting information or adding information- i.e PLPs and reports. It could be much more streamlined and user friendly. It takes far too many clicks to get to the information that I need and to input data. It is not exactly intuitive to do electronic registers for classes that are not on your own timetable. It would be helpful to be able to copy a class list and have in a larger font on a Word document. It seems to take a lot of clicks to get anywhere. The system also freezes alot It would be very useful to have the problems with the solos/siblings report sorted out as this causes a lot of time delay to rectify. Also one per family labels when you only want the child's name would be useful. It's not very user-friendly, given how you have to constantly scroll across and back when inputting data on the marksheet. Also see previous comment about how to see a whole class's data at once e.g. literacy levels, or an individual child's results acros It's very annoying to have to key in numerous passwords/codes everytime I need to get into E1 Less "clicks" to submit information. Be able to run run more than one copy of pages at one time e.g. timetables of two pupils at the same time for comparison. Be able to select multiple pupils from different 12 groups at one time (not per class or teaching Like to see authority use e1 - e.g. staff appraisals - new system with HR but could be on e1, Monitoring staff attendance Marksheets which work out levels. Paperwork to support new Nat 4/5 qualifications. More intuitive More user friendly. Especially using the right button on the mouse to give access to drop down menus for example - rather than coming in and out of sheets to enter information. MORE USER FRIENDLY. BE ABLE TO BRING UP A FAMILY AND THEN MOVE BETWEEN FAMILY MEMBERS. THE SAME WHEN GOING THROUGH A CLASS. Perhaps a twilight session could be used to share examples of how schools/colleagues are using e1 effectively. Perhaps the process of entering data into the marksheet could be easier and less steps needed to return to specific curricular areas. Previous lesson attendance on attendance entry page not hidden in side bar. Previously suggested the facility to give Teaching Staff credence for "Please Takes" durnign Exam Invigilation. Also during a three/four day week due to holidays etc the amount of frees available is adjusted, even although I believe the !"Unions" advise Recording staff absence would be really helpful Printing off reports, especially attendance for previous years - perhaps you can do this? Reporting through E1. Room availabiltity - previously available on Pheonix Gold Room booking system Screen easier to read. Larger font. More obvious colour blocking. Set up so I don't have to keep logging out and in to do period by period registration. Set upso default registration is "present". Should be easier to search for a timetable for a teacher or for a room in the same way that you would a pupil. Should be easier to view/correct a pupil's attendance history. If a pupil is registered absent (unknown, medical, etc) at registration, this Sorting of pupil monitoring logs by teacher. Default 'subject' 'PT' for class teachers (who miss out this information). Space for In/Out of Zone as we had in Phoenix Names beginning with Mc and Mac to come up together when searching. Stop it opening in several new pages. The "Home Tel Num" for pupils is often wrong as the number of the Parents changes. Showing "home" number of Parent at same address as Pupil would highlight the error in maintaining a childs home tel. The ability to link E1 to Novell email so that I could email a pupil's teachers without having to input all the subject teachers' addresses. The ability to merge and print more than on class at a time eg with vertical registration all years are mixed in all classes. I would like to merge the S1s in all registration classes and print all at the same time rather than searching for S1s and printi the applicatin of F.S.M to be more consistent because their is not set guideline as how to complete the F.S.M information and everyone is doing it different, aslo a guide how to take of report's regarding F.S.M The Mark sheets for tracking pupil attainment are confusing. The headings need to be simplified. It says result where you have tp put in a prediction. This has confused many of our staff. If this simple fix was done I think teachers would feem much mo The pupil's attendance should be carried over from the previous period - eg. pupil turns up P1, marked as present, pupil turns up P2 there should be no need to remark them as present. Double periods should be handled properly - i shouldn't have to com To have reports easily available as they were in Phoenix Gold To make it possible to see pupils' attainment in all curricular areas on one page. Unable to answer Q16 fully because do not feel I am experienced enough with e1 as it is... We used to be able to print off a list with all contact details ie mum, dad (with mobiles and work numbers) also emergency contacts - find this is not easy to provide now - have tried to set up various ways. One report will take info of parents while othe WHETHER PUPIL IS IN OR OUT OF ZONE would like to be able to have corporate headed paper for letters. 13