Quality Enhancement in Engineering Education (QEEE) Program Concept & Phase I Overview July 16, 2014, New Delhi Indian Education: Quantity, Equity, Quality • Rapid expansion in number of schools / colleges / technical education • RTE, Affirmative action, accessibility – near equal opportunities to all across demographics • What about Quality? What about Quality?? Rapid growth in numbers not matched by quality Infrastructure Quality faculty Lack of quality has led to: Less equipped graduates who are not employable Students aspiring to study further go abroad – ‘Brain Drain’ Can ICT be leveraged in making in improving quality in education available to all and bridge the gap between demand and supply? Quality Enhancement in Engineering Education(QEEE) • MHRD Committee set up in February 2013 under the chairmanship of Prof Ashok Jhunjhunwala • Broadbased committee consisting of members from government, academia and industry • Objective - suggest comprehensive reforms to improve quality of engineering education being delivered to students across the country • Proposed intervention across 3 areas: • Direct – to – Student • Teacher training: Comprehensive ten year plan for teacher training (pedagogy Designed and implemented and subject) and certification at IIT Madras • Policy changes focusing on governance, transparency, autonomy, accreditation • ASHOK@IITM.AC.IN Design of D2S recognizes Global eLearning Trends Advantages of ICT in education have been recognized globally: • Taking limited resources – teachers, quality learning material etc. to many • Enabling different pedagogical methods – video, animation, 2D/3D viewing, games, simulations… • Enabling individualized any-time, any-where learning • Interactive and two-way learning process QEEE’s D2S designed to incorporate all the above advantages but aims at supplementing and empowering the local resources / teachers, rather than replacing them D2S Methodology Designed as distinct modules to cover all aspects of engineering education LIVE CLASSES 15 lectures (1/3rd of a course) delivered live from IIT Studio to 100 classrooms simultaneously Faculty can use teaching aides like video, screen share, whiteboard; or simply use the blackboard 2-way interaction made possible by suitable hardware / software Institute Server NKN Central Server at IITM Institute Server Institute Server Students& Local Faculty D2S Methodology Live Classes - Delivery IGNOU At the college DTH Live Class from IIT Recording Institute Server Set top box Moderator Laptop Central server hosted at IIT Madras Classroom at Engg. college with two screens D2S Methodology TUTORIALS Remote tutor or local tutor can conduct private sessions for a batch of 30 students Synced with Live Class – Problem solving emphasized In case of remote tutor, software and infra communication used for conducting online sessions Broadband Institute Server Remote Tutor Students& Local Faculty D2S Methodology LABS Simulation based / remote trigger labs implemented at multiple colleges simultaneously by remote tutors Remote tutor logs in to facilitate labs in the participating college Broadband Institute Server Remote Tutor College: 2 College: 3 College 1: Students& Local Faculty D2S Methodology MOOC Similar to MOOC offered by MIT, Coursera Live intervention through 3 to 4 live sessions Proctored exams and grading BRIDGE COURSES Training on noncurriculum courses Make students industry ready / employable D2S Methodology Delivery through infrastructure specially designed and setup LOAL COLLEGE IITM HARDWARE SOFTWARE Redundant heavy duty servers with adequate bandwidth on NKN Live class delivery in partnership with AVIEW, Amrita Monitoring and Management Server with requird bandwidth to connect to IITM server, classroom with 2 projectors, screens, AV/ recording devices Dedicated computer / headphones per student for labs / tutorials Web based interface for delivering moduls developed at IITM Software for video interaction, quiz etc. developed at IITM Pilot implementation of D2S undertaken Jan – Apr 2014 12 Live Courses 1. 2. 3. 4. 5. 6. 7. 8. 9. 10. 11. 12. Comp Arch and Org EM Fields Probability and Statistics Linear Algebra Comp Methods in TFE Engg ThermoD Geotech Analysis Engg Mech Engg Flu Mech Operating Sys Heat Transfer Wireless Comm 2 Virtual Labs 1. Digital Signal Processing Lab (IITM) 2. Virtual Smart Structures Lab (IITD) 1 Tutorial 1. Computer Arch & Org 1 MOOCS Algorithms (MSR, India) Pilot Planning and Implementation • 100 colleges identified based on response to questionnaire • Website created to serve as link between IITM and local colleges • Timetable and infrastructure requirements put up • Various stakeholders – head, local teachers, system admin, IIT teachers, tutors etc. orientated at specially designed workshops • Program Management and Technical support teams put in place during implementation • Qualitative and Quantitative feedback collected from all stakeholders Pilot Launched on Jan 27 2014 Total # of Colleges Registered # actively participated Total # registered in all courses # completing 105 73 603 527 • Colleges not ready with required infrastructure • Alignment with semester start date • Syllabus mismatch • Colleges had made it voluntary for students • Mismatch with exam timetable / vacation • Syllabus mismatch • Content mismatch with level Overall Feedback Stakeholders Exceeds Below # of # of av #/ Neutral expectations expectations respons college course (score 3) (scores 4 or 5) (scores 1 or 2) QEEE Coordinator 70 70 53% 22% 26% System Admin 57 57 55% 27% 17% Local Teachers 56 16 4.3 63% 21% 16% 4570 26 326.4 40% 35% 24% Students Detailed Analysis of feedback Feedback considered stakeholder wise, student wise, course wise and college wise… Exceeds expectation Below Expectation • Live classes very well received by colleges • Core concepts taught by IIT faculty helped students in GATE preparation and placement interviews • Tutorial module provided handson and problem solving approach to understanding concepts • Need the program to offer more number of courses across semesters • Syllabus mismatch – Local faculty be involved in finalizing course content • Start at 9:00 AM instead of 8:00 AM • Suggested whiteboard /QEEE software tools be used for lectures rather than blackboard for better clarity • Need for uninterrupted network connectivity for the smooth functioning of the program Early conclusions from Pilot The D2S modules delivered involved active participation and engagement. This eLearning model appears to be well received Colleges can easily absorb an engagement based model into their offering as it involves “active” involvement MHRD Committee gave Mandate to continue for 2 years and collect, measure and analyse feedback in a more comprehensive manner over a slightly longer time frame Areas for improvement have been identified for Phase II (July 2014) …. Learnings from Phase I • Implementation issues to be addressed • 8:00 am too early for start of live lectures • Mid term break to be introduced for colleges to adjust their internal teaching schedule and exams • Strengthen technology • Platform to be upgraded to enable continued access to content • Issues with audio / video, connectivity to be addressed - Colleges to be tested comprehensively for readiness and ratings provided for the same • Local faculty involvement to be strengthened • Local faculty to be involved in curriculum planning for the 15 QEEE sessions • Increase interaction between local and IIT faculty • Issues of “standard”, curriculum mismatch can be addressed Learnings from Phase I cont. • Ensure commitment from colleges • Introduce attendance • Introduce exams based on QEEE coursework • Ensure Grading from QEEE test are integrated with overall grade • Rating of colleges on infrastructure setup / extent of participation • Periodic reviews and college participation reports • Observers at colleges to assess program acceptance / compliance • Address specific issues related to difficulty in English based education Screenshots from phase I classes Live Class using White Board Live Class using Black/Physical Board Tutorial Session in progress Phase II Program & Expectations Phase II implementation • Designed as a 2 year program • Will aim to be a comprehensive and high quality learning program • Enhance basket of offerings to give the student multiple and varied learning options • IIT faculty and program implementation team to “include” colleges / faculty as collaborators in program design • Addresses issues from Phase I as well as focus on continuous improvements based on feedback Program modified based on Phase I feedback… • Live Classes to start at 9:00 am • Program to be designed to have a “Mid term break” between the 15 lectures. This is in order for the colleges to make adjustments to their teaching and exam schedules. • Labs and tutorial to be synchronized and offered along with a select set of live class courses • Unlike phase I, tutorials to be handled by local faculty with support from IIT faculty on content and delivery Increased emphasis on accountability and compliance • Student attendance to be made compulsory. • Local faculty to enter student-wise attendance details at the start of every class • Observers to be sent to colleges to gauge program “acceptance” and to evaluate the technical quality of the program received. • Review meetings to be organized regularly with participant colleges • College report cards and rating on college participation, interaction, quality of infra set-up, local faculty involvement, student grades, observer reports • Overall program feedback as well as course-specific feedback to be made compulsory. Feedback to be collected across all stakeholders at college. • QEEE certificates to be awarded to students based on participation and performance Increased involvement of colleges in course design and delivery … • QEEE live class courses decided based on polling of colleges – most wanted courses offered • Local faculty to provide inputs to collaboratively decide the coursework with the IIT faculty for 15 sessions • Tutorials to be conducted by local faculty with support from IIT faculty on content. • Continuous interaction between local /IIT faculty through forum / video sessions to be enabled • Local faculty to be involved in grading/assessment of QEEE related mid-term and end-term exams Program Specific Enhancements – Exams and Grading Proctored Exams to be introduced as part of every live class Mid-term exam (after 8 lectures) to consist of objective type questions. Evaluation will be system automated. End-term exam (After 15 lectures) to be a mix of objective and subjective questions. Answers to subjective questions to be scanned and uploaded question wise at the college To be evaluated by randomly chosen local faculty from other participating institutes answer key and grading strategy provided by the IIT faculty Grades from QEEE mid-term and end-term exams to reflect in final grade of student Technology upgraded… Satellite link to be added for video broadcast in addition to broadband Comprehensive testing to ensure colleges are “ready” to receive the program Software platform to host a course page for each course. - Lecture notes, recorded video, assignments, quizzes and forum to be part of the course page New modules introduced – Bridge Programs Two bridge programs being offered 1. Learning Python (In vernacular language) 9 week long program delivered as 3 hour sessions each on Saturdays Offered in 6 Indian languages (Tamil, Telugu, Kannada, Oriya, Bengali and Hindi) Sessions to have a dedicated remote tutor logged in to interact with students from each college through the QEEE software Students to also perform exercises on their own in the lab post interactive sessions Quizzes to be conducted as par of course and certificate to be provided based on performance New modules introduced – Bridge Programs cont.. 2. Spoken English 10 week long program delivered as 4 hour sessions each on Saturdays First 2 hours to be interactive with a remote expert delivering the session similar to the live class model followed by students performing exercises on their own in class In addition to the weekly practice sessions, there will be a preassessment, mid-term and an end-term assessment which will be a mix of objective and spoken exercises Local faculty to be involved in evaluation of spoken exercises Based on above assessments certificate to be provided CII- QEEE program Industry Bridge – Technology Trends in Industry • 15-18 sessions to be delivered by senior industry persons from a variety of industry sectors including Aerospace, IT, Electronics, Telecom, Auto, Chemical, Utilities, Consumer durables etc. • hosted companies including TCS, CTS, Siemens, Flextronics, Ford, Hyundai, Saint Gobain, Rolls Royce, Kirloskar, BPCL, ONGC, Cavinkare, etc. and others like Microsoft • 2 hour sessions to include a video on technology, talk by the industry person, panel discussions and extensive interaction with students • Aimed at exposing students to these industry sectors • Ideal for 4th-5th and 6th-7th semester students MOOC+ module New modules introduced – Course Pack Digital collection of Learning material - text, video, animations, ppt Evaluation components - quiz, assignments, Interactive components - forum, chat, Embedded with dictionary and bookmark support. organized chapter-wise / topic wise The learning material and evaluation components for a course are sourced from the IIT Faculty delivering the live class Offerings for term starting Aug 1 LIVE CLASS 1. 2. 3. 4. 5. 6. 7. 8. 9. 10. 11. 12. 13. 14. 15. Math I (Tut) Math III (Tut) Physics (Tut) Transportation & Traffic Engg Analog Circuits Intro to DB Mass Transfer Indus Engg & OR (Tut) DSP Machine Design (Tut) Data Struc & Algo Chemical Reaction Engg (Tut) Smart Struc (Tut) Software Engg Fibre Optic Comm (Tut) LABS 1. 2. 3. DSP Smart Structures Lab Physics Lab MOOCs 1. Basic Electric Circuits, IITM 2. Theoretical Computer Science, MSR BRIDGE & INDUSTRY BRIDGE 1. Spoken English 2. Learning Python 3. Industry Bridge sessions from CII Break up of colleges Total : 146 Participants from Phase I: 80 New colleges: 66 Teqip:78 Non – Teqip: 68 Geographical distribution Roles & Responsibilities of stakeholders at the college Coordinators are ambassadors of the program at the college… • Single point of contact for all program related communication • • Ensure that all the colleges are “ready” and “tested” to receive the program Register college for courses offered • Integrate the QEEE timetable/schedule into the college’s schedule, to ensure that there is minimum disruption to students and local faculty’s academic calendar • Identify at least one local faculty for each live class, labs, MOOCs and bridge program that the college is enrolled for • Work towards providing weightage for the student’s QEEE grade in the final grade • Host the QEEE “observer” who will be assigned for 2-3 days at the college for collecting feedback • Ensure that all reports, feedback and other requirements (attendance, grading, testing etc..) are complied with in a timely manner • Take necessary action as indicated by the college report cards and periodic reviews System Administrators ensure effective running of the program • Ensure that the hardware / classroom / connectivity and QEEE software interface is set up as specified • ensure that testing for each QEEE module (h/w & s/w) in conjunction with the QEEE-IITM team is done well before start of the classes • Enrol local faculty, students for the courses opted for • Ensure testing, software upgrades and sync with cloud is done whenever indicated • Train all the users on the QEEE problems, as well as be the single point contact for any issues related to hardware and software Local faculty deliver QEEE at the college • Work in collaboration with IIT faculty to finalize content for 15 live classes • Integrate the 15 sessions into the overall course as typically offered by the college • Conduct the quizzes as specified, as well as participate in the randomized grading methodology being adopted • Enter and manage digital attendance records, quiz scores and compliance on assignment submission, providing feedback etc. • Integrate Live class marks with grading for the course • Be the interface between the students and IIT faculty both during the live class, as well as offline on the forum • To cover course topics in sync with the Live Class course topics (handling topics between lectures, covering missed out topics, replaying recorded videos of unattended live class sessions etc) Additional responsibility for tutorial, lab faculty • Participate in video sessions with IIT faculty before each lab / tutorial • Be familiar with the tutorial/ lab experiments, and ensure students are ready for the class • Teach the tutorial class, using inputs provided by the IIT faculty • Ensure students comply with the requirements of the tutorial / lab as regards submission of problem sets, lab records etc. • Provide support and guidance to students during the lab sessions Additional responsibility for faculty for other modules Spoken English • Participate as evaluators for pre, mid and end term spoken language assessment of students from the college • Participate in Workshops on assessment methodology and guidelines to be conducted by bridge program provider • moderate the sessions and ensure student participation. Learning Python / Industry-Bridge Sessions • Facilitate the sessions locally and ensure student attendance and participation MOOCs • Guide students through the program and monitor progress Contact Us Website: www.pilot.edureform.iitm.ac.in Program related quries: pilot_program_mgmt@edureform.iitm.ac.in Web App Support queries: webappsupport@edureform.iitm.ac.in Sys Admin related queries: qeeesysadmin@edureform.iitm.ac.in ------------------------------------------------------------------------Program related quries : 08939266567 Web App Support queries: 08939260084, 08939260065 Sys Admin related queries: 07299006887