To: From: Shawna Arroyo, Manager Student Relations Dr. Susan Bussmann, Distance Education, OCIP Director Sandra Johnson, Distance Education, OCIP Coordinator Subject: OCIP Year 4 Report Date: July 30, 2013 Distance Education respectfully submits the following Year Four Report for the Online Course Improvement Program (OCIP) and the One Year Plus (1Y+) Fellowship Professional Development Program. 1. What events were provided by the Online Course Improvement Program? From September 2012 to May 2013, 45 events were provided as follows: Type Number Percentage Let’s Talk Online Teaching Hybrid Workshops 7 20 15.5 44.5 Webinars Open Labs 4 9 9 20 Presentations Distance Education Speakers Total Events 2 3 45 4.5 6.5 100% Thirteen events were hosted in conjunction with the Teaching Academy such as Let’s Talk Online Teaching and guest speakers. Eight of events were hosted in partnership with the Canvas Support team. Forty-two of the events directly supported Quality Matters (QM) Standards. OCIP has organized the professional development workshops and presentations as well as the online professional development training course thematically around the eight research-based Quality Matters Rubric and Standards to ensure quality in blended/online course design. For more detailed information on events provided by the OCIP team, see Appendix A. 2. What resources did they used to have before versus now (book rental, online materials only, etc)? This information is collected in the 1Y+ Fellows application form. Plus, they agree to work on reducing the cost of the supplies and materials for the course. Some examples of changes in the cost of course supplies and materials were reported by the 1Y+ Fellows such as, offering materials in digital format, use of etextbooks including information on renting books, use of video, audio, and recordings for lessons and assignments that are offered online. See Appendix B for faculty comments on reduction in material costs. 3. Did any of the faculty receive feedback from students on the difference/what feedback have you received from the faculty? As of April 29, 2013, 51 course evaluations have been submitted for the following Cohort IV courses. (Please note-most courses are scheduled to be taught Fall/Spring 2013-2014). See Appendix C for student comments. Course Title Number of Reponses ASTRO 308 Into the Final Frontier 0 BIOL 154 Essentials of Anatomy & Physiology 0 BUS 203 Business & Professional Communication 2 CEP 110 Human Growth and Development 0 CJ 432 Issues in Criminal Justice 0 ENGL 203 Business & Professional Communication 26 ENGL 218 Technical & Scientific Communications 0 HIST 302V/538 Science in Modern Society 0 HNDS 449/549 Diet Therapy II 0 HRMT 412 Beverage Management 0 MGT 309 Organizational Behaviors 0 MUS 101 Classical Music Appreciation 1 OECS 235 SQL 0 SOC 353 Social Research: Analysis 0 STAT 251 Statistics 8 W S 403/503 Gender and Horror 12 Another course not listed 2 Total Responses 51 4. How many students were enrolled in the classes that participated in program? The student enrollment data is based on the available data for the 1 Y+ Fellows' courses for Cohort IV In terms of primary impact, the estimated number of students enrolled in the 22 courses under revision is 1,430. In terms of secondary impact, the estimated number of students enrolled in the online courses taught by the 1 Y+ Fellows is ~2,600. Secondary impact means students taking the other 2 online courses that 1Y+ Fellows will improve due to what they have learned about online course design and the Quality Matters Rubric. First Ali Chet Last Name Ahmed Barney College DACC BUS Role Professor Adjunct Department Math/ STAT 251 Management/MGT309 Organizational Behaviors Ann Bock ACES Professor Nutrition/HNDS 449/549 Diet Therapy *Nathan Brooks A&S Associate History/HIST302V/538 Prof Science in Modern Society Kurt Depner DACC Assistant General Studies/ENG203 Prof Business & Professional Communications Patricia Hoffmann A&S Associate Sociology/SOC 353 Social Prof Research: Analysis Andrea Joseph A&S Associate Criminal Justice/CJ 432 Prof Issues in Criminal Justice Keith Mandabach ACES Associate Restaurant, Hotel, Prof Tourism/HRMT 412 Beverage Management Gerri McCulloh A&S Grad English/203G Business & Assistant Professional Communication Bernard McNamara A&S Professor Astronomy/AST308 Into the Final Frontier *Nikki Mott A&S Adjunct English/ENGL218: Technical and Scientific Communications Hiranya Rowchodhur DACC Associate Health/BIOL 154 Essentials y Prof of Anatomy & Physiology James Shearer A&S Professor Music/MUS101 Classical Music Appreciation Rajaa Shindi DACC Instructor Computers/OECS235 SQL *Enedin Vasquez EDUC Professor CEP 110 Human Growth & a Development Laura Williams A&S Assistant Women's Studies/WS Prof. 403/503 Gender & Horror *Participants noted in blue are in progress for completion. No. Students 120 85 90 Not Reported 130 110 75 75 Not Reported 75 120 120 120 Not Reported 75 75 5. What faculty applied for the Fall 2012 Semester? (Fall 2012) Recruitment for Cohort 4 of 1 Year + Fellows ran from July 17–August 30, 2012. Thirty five applications were submitted. Twenty-two applicants were accepted. Two applicants dropped the program within the first two months. Thirteen applicants completed the online course and course revision requirements by April, 2013 from Cohort 4. One intends to complete the program by the June 15th deadline; two will complete 3 half the program by the June 15th deadline, and have requested to continue the program and complete it next year; four 1Y+ Fellows stated that they wanted to complete the program but have not yet fully participated. For a full list of OCIP cohorts since 2006 including represented colleges and departments, see Appendix D. 6. Who are your partners for this program (e.g. Teaching Academy)? The partners for the Online Course Improvement Program include the Distance Education, the Student Technology Advisory Committee, Associated Students of New Mexico State University, Instructional Innovation and Quality Unit, Teaching Academy, NMSU Library, and Information Communication Technologies. OCIP/1Y+ faculty participants also provided peer support for the program and each other. 7. What were some things that you learned this year that you would like to improve on for next year? See Appendix E for participant feedback. ● ● ● ● ● ● ● ● 1Y+ Fellows had great feedback on the content within the online course. Revisions will be make that will include more mentor support and less peer-to-peer expectation since this requirement was hard for them to meet. Increase integration of professional development activities & efforts of OCIP, Teaching Academy, and Instructional Innovation and Quality units. Continue to build a process to leverage the expertise of the 1Y+ Fellows to build a peer-topeer network of mentors and engage them in informal and formal course reviews using the Quality Matters Rubric. See Appendix D for QM Peer Review process for NMSU. Continue to develop an internal framework to recognize course quality and brand courses with Quality Matters seal of quality. Continue to align the OCIP professional development events around monthly themes that align with the 1 Y+ professional development course and the Quality Matters Rubric standards. Improve OCIP outreach efforts to the main campus departments through flyers, meetings with DE directors, HotLine, Faculty Listserv, and Canvas Listserv. Support faculty teaching online and blended courses by establishing a professional development opportunity “Summer Technology Camp” to be held June 11-13, 2013. Provide support for faculty wanting to transition to blended or online, as in from face-to-face to some online, or blended to online. 8. Long term goals if funding is matched with STAC as well if funds are not matched. The long-term goal is to grow OCIP and the 1 Y+ Fellowship Program. Progress has been made in securing stable funding. A one-year commitment of $225K to OCIP from the Course Delivery Fees has been secured. The College Deans supported it and the University Budget Committee (UBC) approved it. Since STAC continues to co-fund the program, requests for support will be submitted each year since a multi-year OCIP funding commitment cannot be supported by STAC. A request for continued professional development funding will be made to Deans and the UBC for FY15. Ensuring quality for all courses regardless of method of delivery is the primary mission of the 4 OCIP/1Y+ Fellowship under Distance Education, Teaching Academy, and the Instructional Innovation and Quality Unit. 9. Additional Activities Peer Review of Online Courses Program The Online Course Improvement Program is using Quality Matters (https://www.qualitymatters.org) as the foundation for improving online courses. Quality Matters (QM) is a faculty-centered, peer review process that is designed to certify the quality of online and blended courses using the QM Rubric. Quality Matters program standards guide quality assurance for online education. OCIP's goals were to conduct 2 formal QM online course reviews for national QM recognition as well as having 5 Las Cruces faculty getting QM certified as peer reviewers. Goals for the 2013-2014 year are to increase these numbers to 5 formal QM course reviews and having 16 certified peer reviewers for the QM program at NMSU. See Appendix F for OCIP's brochure on Peer Review of Online Courses. The following activity occurred for the Peer Review of Online Courses Program: CEL 580/EDLT575 ENGL 203 Formal QM Online Course Reviews Tools and Techniques for Online Teaching and Learning Business and Professional Communication Certified QM Peer Reviewers (Faculty) Stephen Anderson, HSS Krista Kozel, DACC Betsy Stringham, ACES Sandra Johnson, IIQ Kourtney Vaillancourt, FCS Theresa Westbrock, Library Susan Wilson, HSS Certified Facilitator Trainers (Support) Sharon Lalla, Teaching Academy 2012/2013 Costs Activity Formal QM Course Reviewers Cost $150 Qty. 3 Total $450 Formal QM Course Reviewers* QM Peer Reviewer Certification QM Facilitator Trainer Certification 0 $350 $500 3 6 2 0 $2100 $1000 $3300 1 $3300 QM License *Conducted by Support Staff Summer Technology Conference The Summer Technology Conference was a three-day conference June 11-13 consisting of a cohort of twenty-five faculty. Over fifty applicants applied for the cohort and 25 were selected based on their responses to the application. See Appendix F for evaluation and feedback. Goals for the summer conference included providing workshops on Canvas, Quality Matters, and Web 2.0 tools; offering twenty hours of professional development to all participants; and provide conference 5 opportunities to any faculty not included in the cohort to attend the conference through open registration. See Appendix G for participant feedback and evaluation of the technology conference. Workshops iPad Basics Canvas Tools Using your iPad in Canvas Your Course Map: Course Goals and Learning Objectives Meeting QM Standards: Communicating your Online Course Web 2.0 Tools iPad Apps for Faculty The following faculty attended this year’s Summer Technology Conference: Participants Elsa Arroyos, EDUC Timothy Barnett-Queen, Mary Benanti, A&S HSS Carmen Boje, ETSE Melinda Chavez, FCS Ruth Burkhart, HSS Joseph Gladstone, HSS Zhen Chai, EDUC Cecilia Hernandez, EDUC Andrea Joseph, A&S Loana Mason, EDUC Amal Mostafa, A&S Patricia MacGregorMendoza, A&S Jesse Munoz, A&S Donald Pepion, A&S Deborah Rhein, EDUC Kris Robinson, HSS Cristobal Rodriguez, EDUC Naomi Schmidt, BUS John Scarbrough, HSS Lois Stanford, A&S Christina Schaub, ENGR Elizabeth Stringham, ACES Cynthia Murrell, A&S Ann Bock** **No costs incurred since this faculty member had her own iPad The following costs were incurred during this year’s Summer Technology Conference: Item iPads Refreshments Lunches Qty. 24 3 3 Cost $479-499 $100 per day $260 per day Total $11,536 $300 $780 Other* $355 Approx. Total $12,971 *stylus, iPad covers, bags, cleaning kits 6 Other Conference Scholarships Scholarships were offered for OCIP fellows to attend national conferences concerning online and/or blended learning. Through an application process, six fellows were chosen to attend five different national conferences. One fellow was unable to attend and declined their offer. The scholarship paid for the attendee's conference Early Bird registration, travel, hotel, food, transport, parking, and other miscellaneous expenses. A total of up to $1800 (except for Galveston which was $1400), for travel, per diem (hotel & food), registration, and other expenses was supported. As part of the opportunity to attend the conference of their choice, OCIP fellows agree to "give back" to the university community in the form of a presentation, workshop, or as a guest speaker. First Name Last Name College Name of Conference Ali Ahmad DACC Texas Distance Learning Conference Galveston, TX Margaret Ann Bock ACES Blended Learning Conference (Sloan C) Milwaukee, WI Chris Cramer ACES Distance Learning Conference Madison, WI Kurt Depner Dona Ana Community College Emerging Technology Conference (Sloan C) Las Vegas, NV NMSU - Main US Distance Learning Association Conference St Louis, MO Niki Mott 7 10. What is your budget for this OCIP year? OCIP Y4 STAC Budget Master ICT Budget 2012-2013 Percentage Amount Salaries Instructional Consultant Lead (.62 FTE) $35,368 Instructional Consultant Intermediate (.21 FTE) $10,555 12 Faculty Stipends $24,000 Subtotal $69,923 Benefits Instructional Consultant Lead 32% $11,318 Instructional Consultant Intermediate 32% $3,368 OCIP Faculty Supplemental Compensation 19% $4,560 Subtotal $19,246 Purchased Services Food $81 Total OCIP Y4 CEL Matching Budget Master CEL Budget Salaries Percentage $89,250 Amount Cost Program Administrator (.30 FTE) Program Support (.50 FTE) $17,400 $40,000 1 Faculty Stipend $2,000 $59,400 Subtotal Benefits Program Administrator Project Coordinators 32% 32% $5,568 $12,800 1 Faculty Stipend 19% Subtotal $380 $18,748 Subtotal $78,148 Services Quality Matters Subscription Upgrade $1,650 QM Training and Course Review Expenses Consultant Fees $3,550 $5,902 $11,102 Subtotal Total $89,250 8 Appendix A OCIP Workshops or Hybrid Presentations Communications Interaction and Engagement Online Communications in Canvas Using Canvas for Collaboration and Group Work Collaboration and Group Work OCIP Teaching Academy Events Interaction and Engagement Communications in Canvas Student Groups Graphic Syllabus Assignments Assignments in Canvas Using Canvas for Collaboration and Groupwork Interaction and Engagement Online Interaction and Engagement Assessment in Online Learning Learning Objectives Assessment in Online Ed Learning Objectives Student Groups Design Beginning Design in Canvas Graphic Syllabus The Online Syllabus Additional Resources SoftChalk Hybrid and Face to Face Workshops Course Technology and Canvas (Video, Podcasting) Course Technology and Canvas Other Accessibility Getting Started Module Open Educational Resources Jossey Bass WebinarsEngaging the Online Learner Getting and Keeping Students Engaged Learner Support in Canvas MOOCS Learner Support MOOCS Quality Matters Canvas Open Labs Quality Matters Summer Technology Conference 9 Appendix B Faculty Comments - Reduction in Materials and Textbook Costs I led the conversation on implementing a new textbook for our Tech Writing class (ENGL218). What we did was get together in a small cohort to determine which text was preferable and then choose to eliminate about half of the chapters that are either not used or whose material can be found easily (and freely) elsewhere. As a result, we created a custom text w/ a bundled etext that cost about $40 less than the original. I created my workbooks with Kendall/Hunt Publishing Co. in an effort to reduce student costs. Something that has proven even more successful with the changes we made during the OCIP process is that we now offer Rhapsody access for the listening component of the class. It does not reduce the cost a great deal, but it offers much more value to the student, as they now have access to everything on the extensive Rhapsody website rather than being tied to the 70-100 tracks we had available on the old listening CD sets we created. I still use my textbook but am now providing all my resources online. Students no longer have to purchase extra components outside of the text. The textbooks that I use for Ast110, Ast308 and Hon 308 are now entirely on-line. They are free. This decreased the text book cost for Ast110, Ast308, and Hon 308 from $100 per course to $0. Total enrollment in these courses is approximately 120 students. The student textbook saving is, therefore, $12,000 per course set offering. I offered the option of using online texts and provided links to three alternate sources for books. I also reduced the course book requirement to only one and provided supplementary materials free of charge. The main way I reduce cost with the online statistics class is that since I am able to use Canvas for so many learning assignments, there is no need for the students to purchase a study guide- it is online and they are able to purchase the older edition of the textbook and that saves them close to $100 each. So with 25 students in each online statistics class that comes to $5,000 a year total. But they do have to still purchase the textbook and the student version of SPSS. I have reduced textbook costs for my students as suggested by the OCIP group by allowing students to use previous editions and providing supplemental material from the web that allows students to individually research the topics that were added to the text in the newer edition. I also have added videos to replace additional texts for my classes. I am supplementing my online and face to face classes with online resources that are free. This is steadily reducing reliance on hardcopy textbooks. It is not easy to teach anatomy and physiology without a textbook since students have come to rely on texts quite heavily. However, my classroom method is shifting steadily towards problem-based learning, and I am confident that in another year or two I can completely eliminate textbooks and rely on free resources. 10 Appendix C Samples of Student Feedback Learning new formats and their abilities. That is was online so classroom talk did not hinder the teacher performance and thoughts of progress. It was easily accessible. I really enjoyed the discussions because it allowed me to understand the movie from other people's views and it pointed out stuff I may have missed. Also, I enjoyed the choosing of movies to view. The online course was without difficulties or issues. Was able to maneuver through it with no problems. It was easy to find the assignments and what was required each week. I liked that there was a discussion almost every week and the expectation was always discussion due on Monday and the responses due on Wednesday. I really enjoyed the aspect of submitting every assignment as a discussion. The additional academic readings. The content, movies, and papers. I liked that we got to practice communicating professionally with our peers and I got to prepare for the work environment. I did enjoyed the structure the class had The instructor's feedback and the readings. Regular coursework deadlines and expectations. Instructor knowledge and enthusiasm. My professor gave very comprehensive feedback that included follow-up questions. This contributed greatly to my comprehension of the course material. That everything was online :) I like the way the instructor taught and communicated Collaborating with other students and getting through assignments as a group. How everything was online. There were lots of interactions between classmates. This was due to the professor creating opportunities for this type of participation. 11 Appendix D Full List of 1Yr+ Fellowship Participants Applicants Totals A&S ACES BUS EDUC ENG HSS Other Qualify Cohort 1 (2009) 25 4 6 2 5 0 0 8 17 Cohort 2 (2010) 19 2 8 3 4 1 1 0 19 Cohort 3 (2011) 22 9 0 0 3 5 3 2 20 Cohort 4 (2012) 34 10 3 4 3 1 0 13 30 100 25 17 9 15 7 4 23 86 Accept A&S ACES BUS EDUC ENG HSS Cohort 1 14 2 1 2 3 0 0 8 Cohort 2 15 2 5 2 3 0 0 12 80% Cohort 3 15 6 0 0 2 2 2 12 80% 60% 62% Totals Grads. 57% 13 Cohort 4 Totals 22 10 2 5 1 1 1 (As of 7/28/13) 66 20 8 9 9 3 3 45 Grads. Participated Totals A&S ACES BUS EDUC Prof. 11 6 2 1 1 Assoc. Prof. 22 5 3 5 5 Asst. Prof. 12 6 1 2 Coll. Prof 1 1 Coll. Asst. Prof. 6 2 1 Coll. Inst. 5 2 1 Adjunct 6 3 1 Grad. Assistant 1 Totals 64 25 7 ENG (As of 7/28/13) 6 13.3% 2 2 17 37.7% 2 1 10 22.2% 2 4.4 % 2 4 8.8% 1 1 2.2% 1 3 6.6% 1 2 4.4% 1 8 (as of 7/28/13) 1 1 1 HSS 11 4 7 45 12 Appendix E Participant Feedback from Midpoint Focus Group OCIP Cohort 4 Highlights of Professional Development Course Evaluations from 1 Y+ Fellows My experience with the OCIP program was more than positive. I have learned new methods to engage my students in the discussions, learned how to organize learning modules to fit students, use learning objectives to measure learning, etc. The OCIP team was very helpful and answered all questions quickly. I appreciate that. I found the program to be a critical part of my development as an online instructor. This program should be required for anyone wanting to teach an online course at NMSU. The OCIP program exposed me to the state-of-the-art requirements for the online teaching & learning. My participation in OCIP helped me critically re-think my approaches to delivering hybrid or online courses. It was extremely informative and applied. I have made some important changes during the course of the program and I continue the work on improving my courses. I hope to see a significant payoff in terms of increase in my students learning. The program gave me new insight in how students learn and how to make their learning experience less stressful and more organized. I just wish this could be an on-going effort for each of us teaching at the university. Every person who teaches online can benefit from this program! The OCIP Fellowship has taught me the value of organization of an online course by forcing me to visualize a new course from a student's perspective. I was forced to reexamine the way I structure online classes, not with respect to technology, but rather with access to and organization of content and the various ways to foster student interaction and engagement. I got a much stronger sense of students' needs from an online course. I found the OCIP staff absolutely available, knowledgeable, and helpful. I also learned how to streamline some of the busywork, esp grading. I think my class is so much better organized; it’s easier to navigate for the students. They know what to do from the very beginning. I feel as if, because of this program, I will be a better online teacher. And having professionals help us out certain helps me feel more… it encourages me to try things that sound like maybe it will work, maybe it won’t but you can turn to somebody if it doesn’t work. Actually the role of review is very important. Because we all come from educational grounds, and a lot of the information we were provided was for a particular context that some of us were not familiar with. So, having someone come in and say, well, this is what it actually means, makes it a lot easier to incorporate. We are getting that feedback to help us relate to the material. I feel like it has helped me become a better organizer, it’s helped me to match what I am doing in my classroom with proven techniques with the rubric, and that’s really a matter of 13 contrasting and comparing at every level. And that’s that reflective, you know, here it is, here is the standard, am I actually implementing that in my classroom. And I think it has helped me think through what that actually means. The webinars are very good, the first Soft Chalk I did was a webinar and then I created an assignment page that has all sorts of little links to the helps I wanted to give them, so the webinars are very good. Everything about my teaching has changed because of what I have learned in here. I think that the aligning of learning objectives and creating of learning objectives at a module level is important. I’ve used it in my face to face class. In fact, on a slightly different subject, I’ve made all my face to face classes hybrid now OCIP gave me that handle on how to actually use that blending. So it helped, like I said in face to face classes, that I am using the same technique and the same principals but now that I have those in front of me, I am using this in my face to face class, the blending of it the two. I think in my case my students actually find my courses more organized I’m working harder on communication with my students; I’m clearly thinking more about course design from the students’ point of view; and in new class construction, I’m starting by building with the tools I’m learning in this program 14 Appendix F QM Brochure 15 16 Appendix G Summer Technology Conference Evaluation This is a great opportunity to learn, practice, and understand the value of 21st century technology for learning." It will make your teaching and communication with students more fun and effective! Of course we earned iPads, which is really cool, but I have come to see that the very fact of developing comfort with this technology will help me connect better with my students. Great interaction with instructors and other participants! We were encouraged to immediately apply what we were learning and ask questions. Very collaborative and focused on directly relevant and helpful knowledge and skills. 17