Survey of Methods Winter Quarter 2003 Documentation Overview of the Survey This survey asked instructors questions about the following areas with regard to each of their courses: 1. Teaching methods 2. Assessment methods 3. Native American content 4. Writing content 5. Technology content Population Surveyed Courses offered in Winter 2003 quarter only at Northwest Indian College (i.e., courses that were not canceled) All instructors (part-time and full-time) of 100 level plus courses [including sites and learning contracts (LC)] 175 courses total were offered Winter 2003 quarter: 79 courses at Lummi Campus (45% of total # of courses offered) 36 courses at Extension Sites (21% of total # of courses offered) 59 Learning Contracts (34% of total # of courses offered) 1 On line courses (0.6% of total # of courses offered) The number of credits per course was recorded, but was not taken into account in the analysis Method The survey was created by Anne Marie Karlberg and the Assessment Committee (Shelley Macy, Susan Given-Seymour, Tiffany Roosa, Misty Fuller) Anne Marie created a database in Access called “C:\amk\Assessment Committee\Survey of Methods (of Faculty Teaching and Assessment Methods)\Survey of Methods--with data.mdb Data from the surveys was entered into the database by Dan Woods in May/June 2003 Anne Marie analyzed the surveys Distribution Lummi Campus: One survey for each course that fit the criteria was put in the instructor’s mailbox Extension Sites: Susan Given-Seymour (Extension Services), Misty Fuller and Angel helped to mail the survey to instructors at sites All surveys were returned to Anne Marie Karlberg Updated 2/17/2016 D:\106740504.doc Page 1 of 13 Response Rate 118/179 courses (66% overall response rate) - Lummi Campus: 77% response rate (64/83) - Extension sites: 44% response rate (16/36) - Learning Contracts: 64% response rate (38/59) - On Line: 0% response rate (0/1) High response rate from Lummi Campus instructors Low response from courses with no instructor listed (2/13=15%) Of those who responded, 80 were not learning contract courses and 38 were learning contract courses # of Total Courses Offered Lummi Campus Sites Learning Contracts On-Line Total # of Response Responses Rate (%) 83 64 77% 36 16 44% 59 38 64% 1 0 0% 179 118 66% Analysis Was performed by Anne Marie Karlberg in Excel and Access in June 2003 Main Documents Used (see CD in pocket of binder) C:\amk\Assessment Committee\Survey of Methods (of Faculty Teaching and Assessment Methods)\Survey of Methods.xls C:\amk\Assessment Committee\Survey of Methods (of Faculty Teaching and Assessment Methods)\Survey of Methods--with data.mdb C:\amk\Assessment Committee\Survey of Methods (of Faculty Teaching and Assessment Methods)\Documentation for Survey of Methods.doc Updated 2/17/2016 D:\106740504.doc Page 2 of 13 Summary of Findings 1. Teaching Methods in Courses at NWIC A. Non-Learning Contract Courses Teaching Method Lecture Seminar/Discussion Textbook (i.e, in-class) Independent Projects Tutoring / One-on-One Experiential Learning / Field Studies Lab Group Projects / Cooperative Learning Demonstrations Computer / Internet /Email Shop / Studio Other Teaching Methods (i.e., journal writing) Role Plays Videos % of Course Time 20% 13% 12% 9% 9% 8% 7% 6% 5% 4% 4% 2% 1% 0.5% Teaching Methods at NWIC (Non-Learning Contract Courses) Winter 2003 25% 20% 15% 10% 5% 0% 20% 13% 12% 9% 8% 7% 6% 5% 4% 4% 1% tb oo k O th er Te ac hi ng % Te x Pl ay s e Ro l je ct s tP ro in g de pe nd en In tiv eL ea rn tra tio 0.5% G ro up Pr ie nt oj ec ts / ia lL ea rn Co op er a in g D em on s /F ie ld /S St tu ns ud ie s di o n sio Sh op D isc us in ar / r/ In te rn t /E La b m ai l g /A dv isi n Co m pu te Se m Ex pe r Tu t or in g /O ne -o nO ne Le ct ur e 1% V id eo s 9% % of Class Time Updated 2/17/2016 D:\106740504.doc Page 3 of 13 B. Learning Contract Courses Teaching Method Textbook Independent Projects Tutoring / One-on-One Other Teaching Methods (i.e., journals, self-reflection) Experiential Learning / Field Studies Computer / Internet /Email Lab Demonstrations Role Plays Videos Group Projects / Cooperative Learning Seminar Discussion % of Course Time 53% 10% 9% 9% 8% 7% 1% 1% 1% 0.3% 0.3% 0.3% Teaching Methods at NWIC (Learning Contract Courses) Winter 2003 60% 53% 50% 40% 30% 20% 9% 10% 1% 0% 10% 8% 7% 0.3% 1% 0% 9% 1% 0.3% 0.3% eo s V id % ng tb oo k er Te ac hi O th Te x la ys Ro le P tP ro je ct s in g de pe nd en G ro up Pr oj ie nt ec ts In tiv eL ea rn tra tio on s D em in g ia lL ea rn /C oo pe ra tu /F ie ld /S op Sh ns St ud ie s di o n sio D isc us La b in ar / ai l /E m te rn t In /A dv isi ng r/ Co m pu te Se m Ex pe r Tu t or in g /O ne -o nO ne Le ct u re 0% % of Course Time Updated 2/17/2016 D:\106740504.doc Page 4 of 13 C. Non-LC and LC Courses Teaching Method Textbook Lecture Independent Projects Tutoring / One-on-One Seminar/Discussion Experiential Learning / Field Studies Lab Computer / Internet /Email Group Projects / Cooperative Learning Demonstrations Other Teaching Methods (i.e., journals, selfreflection) Shop / Studio Role Plays Videos % of Course Time 25% 13% 10% 9% 9% 8% 5% 5% 4% 4% 4% 3% 1% 0.5% Teaching Methods at NWIC (Non LC and LC Courses) Winter 2003 30% 25% 20% 15% 10% 5% 0% 25% 13% 9% 4% 4% eo s V id % ng tb oo k er Te ac hi O th Te x la ys In Ro le P tra tio 0% G ro up Pr oj ec ts /C oo pe ra t on s D em in g ie nt ia lL ea rn ea rn in de g pe nd en tP ro je ct s ns s ud ie /F ie ld /S St tu sio Sh op 4% 1% di o n 3% D isc us La b in ar / Se m 10% 8% 5% Ex pe r Tu to rin g /O Le ne ct ur -o e nO ne Co /A m dv pu isi te ng r/ In te rn t/ Em ai l 5% iv eL 9% % of Course Time Updated 2/17/2016 D:\106740504.doc Page 5 of 13 2. Assessment Methods in Courses at NWIC A. Non-Learning Contract Courses Assessment Method Attendance / Participation Other Written Assignments Projects Problem-Solving (Test/Exam/Quiz/Homework) Short Answer (Test/Exam/Quiz/Homework) Multiple Choice (Test/Exam/Quiz/Homework) Demonstration Portfolios Fill-in-the-Blank (Test/Exam/Quiz/Homework) Presentations Other Assessment* Observation Essay (Test/Exam/Quiz/Homework) Self-Evaluation % of Grade 21% 15% 12% 8% 8% 7% 7% 6% 4% 3% 3% 2% 2% 2% Assessment Methods at NWIC (Non-Learning Contract Courses) Winter 2003 25% 21% 20% 15% 15% 12% 10% 8% 8% 7% 5% 7% 6% 4% 3% 2% 2% 2% 2% 1% t2 % t% en sm sm ss es O th e rA rA th e O te n rit O th e rW en en ss es ss ig A Pa e/ nc da tte n nm at ip rti c lu va lfe Se A Updated 2/17/2016 D:\106740504.doc ts io n n at io n tio s2 bs er va O s str at io n D em on rtf o lio ts Po ec s io n ta t Pr oj ng lv i -S o m le Pr es en Es sa y Pr ob w er or tA ns Sh -th Fi llin M ul tip le C ho eBl an ic e k 0% Page 6 of 13 B. Learning Contract Courses Assessment Method Other Written Assignments Projects Essay (Test/Exam/Quiz/Homework) Short Answer (Test/Exam/Quiz/Homework) Multiple Choice (Test/Exam/Quiz/Homework) Portfolios Other Assessment* Problem-Solving (Test/Exam/Quiz/Homework) Self-Evaluation Observation Demonstration Fill-in-the-Blank (Test/Exam/Quiz/Homework) Attendance / Participation % of Grade 39% 13% 9% 8% 8% 7% 5% 4% 2% 2% 1% 1% 1% Assessment Methods at NWIC (Learning Contract Courses) Winter 2003 45% 40% 35% 30% 25% 20% 15% 10% 5% 0% 39% 13% 9% 7% Updated 2/17/2016 D:\106740504.doc 1% io te n er W rit O th A ss ig ci p at at Pa rti O th ce / 0% nm en ts er A ss es sm O th en er t% A ss es sm en t2 % n n io n ev al u A tte nd an tra tio va tio ns 2 s io on s ec ts rtf ol D em Po oj ta tio Pr ns ng es en Pr -S ol vi ay Es s ob le m Sh or t A ns w er 0% Pr Fi ll- in - th Ch oi ce eBl an k 1% 5% 2% 2% 1% Se lf- 4% O bs er 8% pl e ul ti M 8% Page 7 of 13 C. Learning and Non-Learning Contract Courses Assessment Method % of Grade Other Written Assignments 22% Attendance / Participation 14% Projects 13% Short Answer (Test/Exam/Quiz/Homework) 8% Problem-Solving (Test/Exam/Quiz/Homework) 7% Multiple Choice (Test/Exam/Quiz/Homework) 7% Portfolios 6% Demonstration 5% Essay (Test/Exam/Quiz/Homework) 4% Other Assessment* 4% Fill-in-the-Blank (Test/Exam/Quiz/Homework) 3% Observation 2% Presentations 2% Self-Evaluation 2% “Other Assessment” includes: memorization, advisor meetings, elder interview, encouraging others to participate, research, safety, workbook Assessment Methods at NWIC (Non-LC and LC Courses) Winter 2003 25% 22% 20% 15% 10% 14% 13% 8% 7% 3% 5% 7% 6% 4% 2% 5% 2% 2% 3% 1% rtf ol io D s em on str at io ns 2 O bs er va tio n Se lfev A tte al ua nd tio an n ce /P O a rti th ci er pa W tio rit n te n A ss ig nm O en th ts er A ss es sm O en th t% er A ss es sm en t2 % Po ec ts Pr oj ng ta tio ns Pr es en -S ol vi em k Es sa y Pr ob l Sh eBl an ce -th ho i Fi llin pl eC M ul ti Updated 2/17/2016 D:\106740504.doc or tA ns w er 0% Page 8 of 13 3 (i) Are courses at NWIC culturally enriched with Native American materials? 60% of courses at NWIC report being culturally enriched with either “some Native American material” or “primarily Native American material”. 5% of learning contract courses report being enriched with “primarily Native American material”, whereas 20% of non-LC courses report that level of cultural enrichment. % Culturally Enriched Level of Cultural EnrichmentNon-LC Courses LC Courses Overall No Response 5% 8% 6% Minimal / No NA Material 30% 42% 34% Some NA Material 45% 45% 45% Primarily NA Material 20% 5% 15% Totals 100% 100% 100% % of Courses that are Culturally Enriched with Native American Materials NWIC Winter 2003 100% 90% 80% 70% 60% 50% 40% 30% 20% 10% 0% 42% 100% 100% Non-LC Courses 45% 45% LC Courses 30% 20% 5% 8% No Response 5% Minimal / No NA Material Some NA Material Primarily NA Material Totals Level of Cultural Enrichment Updated 2/17/2016 D:\106740504.doc Page 9 of 13 3 (ii) How are courses customized to meet the needs of Native American Students at NWIC? 16/118 courses report including Native American speakers 56/118 courses report meeting the needs of students in the following other ways: o NA text o “My style” o Use NA perspective o NA films o NA-specific assignments o Adjusted content o NA writers o NA web sites o NA music o Address different learning styles o Work in NA work place o NA art o Self-paced course o Personal reflections Updated 2/17/2016 D:\106740504.doc Page 10 of 13 4. Does the NWIC Catalog designate this course as a writing enriched course? 29% of respondents (34/118) did not know whether or not their course was writing enriched (and of those 34 courses, 2 of them are actually designated as writing enriched in the catalog) 9 instructors thought their course was designated as writing enriched (and of those 9 courses, only 1 of them is actually designated as writing enriched in the catalog) Of the 75 instructors who thought their course was not writing enriched, 1 of these courses is actually designated as writing enriched in the catalog Actual # of Courses Writing Enriched (according to instructor) Writing Enriched (according to the catalog) No Response No Yes Total No 32 74 8 114 Yes 2 1 1 4 Totals 34 75 9 118 % of Courses Writing Enriched (according to instructor) Writing Enriched (according to the catalog) No Response No Yes Total No Yes Totals 27% 2% 29% 63% 1% 64% % of Writing Enriched Courses at NWIC (According to the Instructor vs According to the Catalog) Winter 2003 97% 100% 80% Not Writing Enriched (according to the catalog) 63% 60% 40% 27% 20% 2% 1% 7% 1% 3% 0% No Response No Yes Writing Enriched (according to the catalog) Total Writing Enriched (According to the Instructor) Updated 2/17/2016 D:\106740504.doc Page 11 of 13 7% 97% 1% 3% 8% 100% 5. How is technology incorporated into courses at NWIC? Learning Contracts: 55% of courses incorporate Word 39% of courses incorporate the Internet 61% of courses incorporate Email Non-Learning Contracts: 46% of courses incorporate Word 49% of courses incorporate the Internet 36% of courses incorporate Email 24% of courses incorporate other technologies (Excel, typing, computerized accounting, La Taupe Interactive Computer Learning System, Photo Shop, tool technology, LangMaster Records, graphic arts, PowerPoint) Actual # of Courses Word Internet Email Other Not Applicable Total # of Courses Learning Contract Courses Non Learning Contract Courses Total 21 37 15 39 23 29 0 19 12 20 38 80 58 54 52 19 32 118 % of Courses Incorporating Each of the Following MS Word Internet Email Other Not Applicable Updated 2/17/2016 D:\106740504.doc LC and Non-LC Learning Contract Courses Non Learning Contract Courses Courses 55% 46% 49% 39% 49% 46% 61% 36% 44% 0% 24% 16% 32% 25% 27% Page 12 of 13 Technology Used in Courses at NWIC (Learning Contract vs Non Learning Contract) Winter 2003 70% 61% 60% 55% 49% 50% 46% Learning Contract Courses 39% 40% 36% 32% Non Learning Contract Courses 30% 25% 24% 20% 10% 0% 0% MS Word Updated 2/17/2016 D:\106740504.doc Internet Email Other Not Applicable Page 13 of 13