The Evolution of Distance Science Lab Options and Current Practices Peter Jeschofnig, Ph.D. Colorado Mountain College April 2007 CMC - Glenwood Springs Colorado Community Colleges Online CCCOnline’s History Began in the mid-1990s Consortium of 13 Colorado Community Colleges and 2 Universities Growth initially ~30% annually 5,000+ students/semester 5 semester terms/year 300+ courses CCCOnline’s Science Courses Introductory Science = ~ 22% of Total Enrollments SCIENCE = 18 courses - HEALTH SCIENCE = 4 courses Began with hybrid and simulations Almost all courses now use AHS kits for lab First lab kit used = micro-scale Chemistry in 2000 Now also use Biology, Physics, Microbiology. Geology, A&P Per Academic Dean: CCC-Online’s Commitment to providing excellent and accredited hands-on lab experiences greatly contributed to growth of its science courses and programs Purpose of Science Labs? Why do we teach laboratory experimentation in science classes? What are students supposed to learn in the laboratory? How can these objectives be met at a distance? Learning Objectives for Undergraduate Teaching Laboratories per Rice University Laboratory Coordinators for Natural Sciences and Engineering Learn to observe, measure, record, convert, and analyze data Learn lab safety, recognize potential hazards, and act appropriately Acquire Basic Laboratory Skills Acquire Communication and Recording Skills Learn to keep timely, comprehensive lab notes for work replication Improve effective writing, research, and presentation skills Gain Maturity and Responsibility Learn advanced preparation and organization skills Work independently and learn the value of mistakes Laboratory Objectives … cont. Understand the Context of Science Recognize the relevance of data gathering and measurement Learn and appreciate the processes of the scientific method Relate lab results and experiences to the real world Appreciate the major consequences of minor oversights Integrate Knowledge/Experience Appreciate and apply critical thinking skills in other work Apply math, science, and logical processes to other work Recognize when conclusions do and do not make sense Science Labs Consensus Science Educators universally agree that… Laboratory Experimentation MUST Be Part of All Science Classes Labs Have Been the Weak Link of Distance Learning Science Classes Quotes of Interest …. “During the next decade, the United States demand for scientists and engineers is expected to increase at more than double the rate for all other occupations.” Michigan Dept. of Education "Learning science is something that students do, not something that is done to them. In learning science students describe objects and events, ask questions, acquire knowledge, construct explanations of natural phenomena, test those explanations in many different ways, and communicate their ideas to others" National Science Education Standards, NRC 1996, 20). Philosophical Differences Simulations vs. Hands-On Labs Kits i.e. Seeing vs. Doing College Level vs. Basic Concepts i.e. Kitchen Chemistry String and Sticky Tape Distance Lab Options Hybrid - Campus-based labs Simulations – Virtual Labs Remote-Access Labs Kitchen Labs Lab Kits Instructor Assembled Student Assembled Commercially Assembled Evaluation of Hybrid Labs: Pro: Provide Traditional on-campus labs Once-a-month all-day lab sessions at local college or H.S. Several-day long lab workshops Combination: Online and On-campus Con: Defeat the Purpose of Distance Learning Mind-numbing long sessions for students Loss of distance enrollment for Institution Students Like Simulations Because they are: Easy Similar Low to computer games cost But do they learn from them? Textbook CD-ROMs Houghton Mifflin (Ebbing) Model Science Software http://modelscience.com/ Virtual ChemLab - BYU Remote Controlled Lab: Diffraction of electrons Aviation Simulator Analogy 1 Caveat ! Increasing numbers of 4-year colleges and universities (incl. California) are refusing to accept transfer credits for simulation-based labs University of Colorado – School of Engineering is the latest college refusing to accept simulation-based lab credits Believe students with no hands-on labs experiences are unsafe, and don’t know what they are doing. No Test Tubes? Debate on Virtual Science Classes Quotes from the NY Times October 2006 article by Sam Dillon: Members of the College Board insist that college-level laboratory science courses not be labeled ‘A.P.’ without a physical lab Dr. Fleck, provost at Hampden-Sydney College, Virginia, said students worldwide found the virtual dissection useful. But he called it “markedly inferior” to performing a real dissection. He said “You don’t get the look and the feel and the smell,” Summing Up: Simulations PROS: relatively cheap, readily available, fulfill some lab objectives, will probably get better & more challenging; useful as part of lab program CONS: Passive, don’t meet as many lab objectives as kits; tactile experience missing; feel of “doing science” is missing; may not be adequate for “majors” level course; potential problems for transfer students Kitchen Chemistry Labs Pro: Provide genuine hands on science activities Relate science to the student’s real world Cheap - assumably Con: Limit sophistication of lab experience Students don’t respect it as serious science Require extra time for acquiring supplies and constructing equipment Lab quality varies from very creative to inadequate Exceptional Kitchen Chemistry Courses Elmhurst College UC Denver and Univ. of N.Carolina - FIPSE Grant: “Anytime Anywhere Chemistry Experience” Anytime Anywhere Chemistry Experience Instructor/Student Assembled Kits Usually consists of instructor checking out glassware and equipment and students procuring supplies, then returning equipment at the end of the semester Pro: Cheap - Assumably Student get a hands-on, wet-lab experience Con: Student complaints about finding materials Instructor relegated to “stock boy” chores Disputes over inevitably lost/broken equipment History of Commercial Lab Kits Began in the early 1970’s with the Open University in the UK Initially assembled and checked out to students a very large trunk-sized science kit. The initial cost was over a million pounds for (~$2 million) for 8000 students or ~$250/student plus warehousing, replacement parts, etc Open U subsequently developed a smaller kit that students purchase and is non-returnable Commercial Kit History … continued 1980’s Monash University, Australia Physics kit checked out to students Video instructions Students enrolled from as far away as Singapore Kits returned as much as 6 months late Success - High retention rate Eventually moved to selling students nonreturnable kits. At Home Science Kit Development 1993 Leadville Colorado First kit = chemistry for a one-semester Intro to Chemistry course at CMC Based on small-scale / micro-scale and green chemistry techniques About Micro-Scale Techniques Micro-scale refers to the process of conducting traditional science experiments on a much smaller and safer scale. First introduced in late 50’s by chemistry professor Dr. Hubert Alyea (1903-1996) at Princeton University. Today used on campus labs around the world Primary objectives To greatly reduce safety risk of experimentation and To reduce environmental and chemical disposal problems While still engaging students in traditional science experimentation and fostering inquiry-based problem solving abilities. Small-scale Science Equipment Centrifuge Tubes - 24-Well and 96-Well Plates - Thin Stem Pipet How Chemicals are Packaged Single-use wet chemicals: Packaged in thin-stem micro-pipets which deliver consistent sized drops for experimentation. Multi-use wet chemicals: Packaged in ¼, ½ and 1 ounce dropper bottles. Dry chemicals: Packaged in micro vials and mini zip-lock baggies. ChemKits Lab Kit Issues How safe are at-home lab experiments? What are legal issues for conducting labs in an unsupervised environment? Are important experiments eliminated because of safety or cost? Compliance with proper waste disposal? Home Labs: Solutions Home science kits designed with safety and safety-education in mind Liability waivers & safety contracts Kits designed and produced by professionals Ample insurance and legal backing 14 year 100% safety record Summing Up: AHS Lab Kits Equivalent experience to campus labs Meet ALL lab objectives Offer tactile experiences Give the “feel” of doing science No transfer problems Easy transition to upper-level on-campus lab setting High level of student satisfaction and learning Advantages of hands-on Labs National Science Teachers’ Association: The inquisitive spirit of science is assimilated by students who participate in meaningful laboratory activities. The laboratory is a vital environment in which science is experienced. … Laboratory experience is so integral to the nature of science that it must be included in every science program for every student. http://www.nsta.org/positionstatement&psid=16 , NSTA Teacher Resources, retrieved 1/1/07 Assessment Comparison On-Campus Labs vs. At Home Science Lab Kits - from “We Teach, but are They Learning:….” Sloan-C Conference November 2006 Assessment Comparison On-campus vs. “Home Labs” Objective of this Study To quantitatively assess and compare the performance of my chemistry students In a face-to-face (F2F) chemistry course with an on-campus laboratory and In an online chemistry (DL) course with a home-based laboratory kit - from “We Teach, but are They Learning:….” Sloan-C 11/06 Assessment Comparison On-campus vs. “Home Labs” Process of Assessing Outcomes Administer and Compare Results for Campus-Based CHE-111 Students and Online CHE-111 Students: 1. American Chemical Society Standardized Exam Pre-test at the beginning of the semester and Post-test at the end of the course 2. Traditional homework, quiz, and exam grades 3. Laboratory reports graded via a specific rubric - from “We Teach, but are They Learning:….” Sloan-C 11/06 Final Exam vs ACS Exam Final Exam vs ACS Exam Final Exam Score 120 100 80 Series1 60 Linear (Series1) 40 y = 0.5233x + 49.372 R2 = 0.3756 20 0 0 20 40 60 ACS Score 80 100 CHE 111– ACS Exam Results Exam Scores ACS Score Comparison 90 80 70 60 50 40 30 20 10 0 Raw Score % DL-PreTest F2F-PreTest DL-Post- F2F-PostTest Test ACS National DL Final Exam F2F-Final Exa, Assessment Comparison On-campus vs. “Home Labs” Summary of Findings DL and F2F exam scores were basically equivalent DL, F2F, and national ACS exam scores were basically equivalent DL lab grades averaged 5% and course grades 1% higher than F2F Institution exams were as effective as ACS exams for assessment - from “We Teach, but are They Learning:….” Sloan-C 11/06 Assessment Comparison On-campus vs. “Home Labs” Conclusions: “Student learning in DL science courses with home based lab kits is at least equivalent to and usually a little better than in face-to-face courses with a campus based lab.” “Valid assessment can be achieved via institution exams.” - from “We Teach, but are They Learning:….” Sloan-C 11/06 Effectiveness of a Web-Based Laboratory Course in Biology Jennifer Herzog, Herkimer County Community College, N.Y Retention Rate Median Lab Grade Avg Class % Scoring B or Better Avg On 89.4 Campus C 75.8 75.8 43 Online A 82.5 87.5 62 64.4 Lab Kits: Student Satisfaction Survey Feb 2007 Marge Vorndam, CCCO CCCOnline Science/Health Science Courses 124 surveys returned from current users 29% 19% had also previously used lab kits had on-campus lab and home lab kit experience Student Survey Preference What were the most POSITIVE aspects of using a home lab kit? Convenience Flexibility Challenge / self-learning Hands-on Lab in a DE course Similar to on-campus lab Fun Student Survey Preference What were the most POSITIVE aspects of using a home lab kit? Easy to use, good instructions Could share the lab experience with others Kit is self-contained Re-enforces textbook reading Sense of Accomplishment No pressure Student Survey Preference What were the most NEGATIVE aspects of using a home lab kit? Expense Lack of immediate instructor feedback Lack of immediate peer communication Confusion over instructions or outcomes Requires more time than expected for lab and reports Student Survey Preference If you have taken courses with labs that were offered on campus and with a home lab kit, which would you prefer: home lab or on-campus lab? 59% Home Lab 9% Either 23% Campus Peter Jeschofnig pjeschofnig@coloradomtn.edu Margaret E. Vorndam cccbiology@ghvalley.net Colorado Community Colleges Online http://www.ccconline.org At Home Science http://www.athomescience.com The Role of Home Lab Kits in Online College Science Courses Presented at the ITC e-Learning Conference in Albuquerque, NM 02/18/07 by Professor Margaret E. Vorndam, M.S., CCC-OnLine Student Survey Comments I have definitely gained more practical knowledge from the at-home lab kits than I ever did from on-campus labs. I feel that I do the labs more thoroughly at home when I don’t have a time constraint. I have also gained research and problem solving skills from the online classes. Student Survey Comments The home lab kits really help to further demonstrate the text in which we are studying. It makes the class more exciting by offering hands on. I really like the idea of a lab accompanying a course. Student Survey Comments I was quite impressed with the amount of materials included in my home lab kit. I feel that it more than adequately covers the labs that I need to perform. Also I feel that some of the materials, such as the scale, thermometer, magnifying glass, etc can be reused for other classes and in my personal life. Student Survey Comments I have been impressed with the home lab kits for both BIO105 and GEY111 and feel that they are providing a lab experience that is comparable to one I would obtain in an on-campus lab. Student Survey Comments I think the home lab kits make it fun to do the labs. I like the variety of labs they have in there and all the materials are available at all times. Also at the beginning of the labs, they explain the lab and aspects of the lab very well. Student Survey Comments Having taken several science courses both online and at school, I feel online courses are more difficult in that they require a higher level of organization. The at home labs have been more involved as well, but I’ve really learned a lot. Student Survey Comments The science courses I have taken at ***** on-campus did not require labs to be written up. Usually, there was a short answer or fill-in-the-blank few pages to turn in. I have only written formal labs with my online chemistry, physics, and biology courses. Student Survey Comments One thing that’s nice about the home lab kit is that my son can also participate in the learning experience. *************************************************************** The flexibility of home labs most certainly give more students the opportunity to take classes, so it is a very good thing. Student Survey Comments I have really enjoyed the at home labs that I have done. Some highlights are: burning pieces of food to count calories, swinging a rope around my living room, and carrying an egg around in a jar of karo syrup, all loads of fun and helpful to learn if it makes sense too. Student Survey Comments I enjoy the opportunity to take labs at home since I am a working parent. It provides a hands on experience at any time that is convenient in my schedule. I do not have to worry about daycare or gas money to get to school. Student Survey Comments I enjoy being able to have the home lab kit and be able to complete experiments right in my own kitchen. ******************************************************** Home lab kits appear to be a great way to give students options in their education. Student Survey Comments At home labs are much better because each student is required to do the work not just a group where 1 person does the work. ********************************************* I do enjoy the flexibility of online labs and am glad CCConline provides the option. Student Survey Comments As a first time user of an at home lab kit, I find it very convenient and simple to use. ************************************* I have really enjoyed both forms, but since my recent surgery, the home lab has been the most effective. Student Survey Comments I think the kits are well put together and I like the fact that I can do the course at home, because I wouldn’t be able to otherwise. **************************************************************** I’m enjoying doing the work at home. There’s no experiment or dissection that I’m missing out on. Student Survey Comments I prefer the home lab primarily because I have the flexibility to take as long as necessary in one sitting to complete the lab. Also the quality and level of experiments is comparable to campus labs. Re: At Home Science Lab Kits “These kits provide students with much of the same hands-on experience they would receive in an on-campus lab. Why should students with families and jobs and the need for schedule flexibility be locked out of the joy of science because of a stodgy, dated approach to teaching in the laboratory?” Dr. Paul Vorndam Science Division Chair CCCOnline