City College of San Francisco Department of Library Information Technology Student Learning Outcomes, History and Development Summarized 2006-2012 July 13, 2012 Update: 1.08.2013; 6.18.2013; 7.17.2013; 8/20/13; 9/4/13; 11/18/13; 6/17/14; 9/4/14; 5/28/15 May 28, 2015 The department is reorganizing its CTE Advisory Board and should meet once in June 2015. It is also submitting new forms to the Office of Instruction on Certificate/Degree Sequencing for Completion – two semesters for the Certificate, likewise for the degree major (less general education requirements). All of the courses are evaluating a course level SLO this Spring using the new tool, Curricunet. One Program Level Student Learning Outcome has been evaluated using this tool this semester – a brief copy of that report is appended as a note to the document titled “PSLO.lit.mission.outcomes.6.15” and found under the link “Department SLO Assessment Process.” An additional Program Outcome (i.e. administrative) will be assessed similarly in the coming days. Results on that will be reported here, and in the above named document. September 4, 2014 One course ran in the summer, LIBR 58A Legal Resources. The class was very small and thus offered the instructor a unique opportunity for assessment based on direct and personal observation and classroom contact. A decision was made to report assessment for this course along with those for the Fall of 2014. June 17, 2014 Courses ran in the Spring Semester informed by teaching students about expected learning outcomes, and posting outcomes along with other course objectives and expectations on the course syllabus. Instructors for Library 51, 55A, 55B, and 58C were provided newer, recently completed course outlines, bearing from 3 to five outcomes each. Instructors, who have been a part of their development, were reminded that both the outline and the outcomes posted on it are to be viewed as products of process, thus not fixed, perhaps even somewhat tentative. For this semester, one or at most two of the outcomes were addressed with the object of developing the tools for assessment more so than the assessment itself. This sort of development continues to be problematic in trying to find a mechanism for reporting evidence that fits well with the college’s system of reporting. There continue to be barriers to understanding what the college’s system is asking, exactly, of the reporter, and the sense that there are some redundant and repetitive loops in the scheme. Still, at the end of the day the most important facts are that the faculty are updating their teaching techniques, staying abreast of changes in their discipline, incorporating these changes in their classroom contact. They are regularly measuring student learning outcomes for distinctly different purposes than grade assignment, i.e. to measure the effectiveness of their teaching, the appropriateness of the content, and the quality of the course and its instruction through the vehicle of student learning. November 18, 2013 All course outlines have been revised with the sole exception of Library 58B, which we intend to complete yet this fall, so that it can be reviewed in the Spring of 2014 and offered in the Fall. Our learning outcomes continue to be gathered for the Fall, with numerous discussions on them rounding out the approach to continuous evaluation and assessment. The department chair will be serving in an administrative capacity during the late Fall and Spring (as Interim Associate Dean for Instructional Support/Library), and thus will be appointing a replacement for departmental operation as well as replacements for instruction. The new instructors are aware that there are many outcomes mentioned on the current course outline, that certainly they cannot evaluate all at once; but that their work too should be in distilling the most important, the “major” outcomes for further course outline revision in the future. Program Review drafts have been completed for Library Technology, and the key points of achievement noticed on this review are: o Completion of the LSSC Certification with the ALA-APA o Utilizing the learning experience from the LSSC and from SLO assessment to build collegiality in the department and to evaluate the program, its place in the college, and its utility for the community o Completing the task of revising course outlines and eliminating courses no longer supported o Evaluating the continuing need of instruction for library support staff in light of smaller student populations and changing demographics In general, the department operates efficiently, but further economies can be realized if necessary without great sacrifice to the community. September 4, 2013 Preparing course outlines for revision in accord with findings from initial assessements. Have submitted revisions for 51, 53, 55B – which were passed tentatively with stipulations last Spring. Have sent through Libr 58A and 55A for Technical Review, both moved forward; and 58C, 56 and 59 pending. Libr 58B is still under preparation, but will be submitted early in October. August 30, 2013 Ran late submitting the program learning outcomes – came in three days before deadline. Had done work in June, but thought had submitted with all the course outcomes at that time. One reason for this is the rather excessively complex, arcane, and reduplicative system set in place for reporting by the college. We understand their haste to build a system which they believe will satisfy the accreditors, and admire the effort and achievement thus far, but such systems will naturally have problems which take time to iron out. How long? This depends on the complexity of the system and the expectations for it. Chou En Lai, when reputedly asked by Kissenger what he thought the outcome of the French Revolution was, replied, “Too soon to tell.” We are in the midst of revising course outcomes as we revise course outlines. This too leads to very real systemic problems, not least, that the culture of assessment and revision happens at locomotive speed, but the mechanisms are neither rapid, nor forgiving, and thus the refrain, “We can’t approve this course outline because the outcomes don’t match those previously given.” Well, no kidding folks! Summer 2013 Summer courses are not ordinarily offered by this department. However, the college sought to expand summer offerings, thus the only course in the department which the chair thought educationally productive in the short, six week, term was LIBR 58A, Legal Resources – a one unit class that thus could meet three hours each week for a total of 18 hours. The class met and the instructor considered outcomes which she had developed in the prior year. These will be reported upon in conjunction with the Fall offerings. Fall offerings will be LIBR 51, 53, 56, 58B and 59. All have had outcomes assessments in the prior academic year – 51 and 59 both in fall and in spring. This fall, LIBR 53 will initiate life as one of the core required courses, as a product of having our curriculum more effectively match the competencies for the Library Support Staff Certificate Program of the ALA-APA. Spring 2013 Some preliminary assessment work will be conducted along with midterm examination and grading for LIBR 51, 55B and 59. Email went out to instructors for LIBR 55A, 57 and 58c to recommend similar consideration of assessments at this time, and not wait until the end of the semester to consider whether students are learning effectively. All courses held assessments on one or two Outcomes for the Spring. The Program Assessments were done by two surveys, one on paper and conducted in class; another a first attempt at using Survey Monkey. In the surveys, student self-assessment demonstrated competence with disciplinary and industry vocabulary and concepts, PSLO 1-3. In addition, students in work experience classes asserted skills development which match proposed PSLO 3-5. For LIBR 51, assessments can be conducted reflecting the fundamental technologies which constitute the first 1/3 of the course. LIBR 55b can be assessed for the conveyance of information on service ethics, service issues and the vocabulary of employment. For LIBR 59, the issues remain effective conduct and qualities of successful employment. The ALA Support Staff Certification Program was approved effective March 1, 2013. A press release was issued by the ALA-APA, a copy of which resides on the department SLO pages below. Midterrm assessments are being conducted using surveys for LIBR 51, 55B and 59. 1.Assessment of Student Learning Outcomes for each class offered, Fall 2012 2.ALA-APA Library Support Staff Certification Program 1.Assessment of Student Learning Outcomes for each class offered, Fall 2012 The department chair was on Sabbatical in Europe during the entire semester, Fall 2012. Nevertheless, the chair continued to monitor developments at City College generally, and in particular communicate with faculty teaching in the department during the Fall 2012 semester. Communication developed assessment plans for LIBR 51, 53, 56, 57 and 59 with each of the four instructors teaching. It was decided that each would assess three Student Learning Outcomes derived from proposed revisions to Course Outlines which are to be submitted to the college curriculum committee in the Spring of 2013. It was decided that courses taught in the Spring will be similarly assessed at that time. Assessments were based on a combination of exam questions, final projects and instructor observations. The assessments were to be drafted into a tabular form with the Student Learning Outcome desired in the columns, and numbers representing each student in rows. Instructors were warned that in no way do these assessments impact on student grading. Indeed, these are intended to be assessments of US, not the students, and of our effectiveness in identifying and presenting significant issues for learning. As such, the identities of the students were to remain anonymous, thus, students appear as numbered rows. For the record, instructors did identify each student with initials in their internal documents, however the department chair, in his digest and reconciliation, has stripped all vestiges of student identification from these documents. RESULTS: In general, it was found that that students do effectively learn what the department sets out to teach, with one significant exception occurring during the fall semester. We considered a 70% pass rate for each outcome a measure of success, however, in LIBR 53, outcome A, concerning an understanding of primary Intellectual Freedom documents, the pass rate was but 60%. Since these documents are fundamental to the practice of librarianship in the United States, and since no library employee should be ignorant of them, it is not the desire to diminish their importance as a result of this outcome. Indeed, and instead, this informs us that the instructor must work more effectively to view, transmit, analyze, and present these documents in a fashion that nearly universal comprehension is the result. We have already begun a departmental dialogue to this end. The tables reflecting this data can be linked from the department website, and from the website hosting this discussion, in a “bullet point” link below to “Fall 2012 SLO assessment tables”. Tables for all classes will be held here in a single document. The discussion of this matter will be carried on vis-à-vis departmental email communication. 2.ALA-APA Library Support Staff Certification Program The department continued in its work to seek approval of its curriculum under the Library Support Staff Certification Program of the American Library Association – Allied Professional Association. As of December a complete portfolio of course mappings were submitted, and as of January 2013 the evaluator has forwarded a recommendation for approval to the ALA-APA. We await final notification of approval. The course mappings can be viewed by returning to the previous web page, then following the link to “ALA-APA Support Staff Certification Documents”. CKox, Chair, 1/8/13 Student Learning Outcomes Development The consideration and development of Student Learning Outcomes, and their assessment, has played a major role in departmental direction over the past several years. The reasons for this are obvious: To justify disciplinary instruction To maintain currency in disciplinary instruction To assure outside stakeholders of quality instruction To guide students making vocational choices To certify ethical standards of teaching and learning All library work is service oriented. As such, the standards for service are ethical, and relatively timeless even in a vocational environment. One can teach, and assess, the narrow techniques of today – soon obsolete – or one can teach and assess the foundations of a service oriented discipline. Indeed, one of the most succinct, and almost cryptic, statements of philosophy is Ranganathan’s “five laws” first published in 1931. To a large measure, the learning processes for library support staff are those which inculcate a culture of ethics and responsibility, and the standards defining library service – yet always within the community and institutional context. To this end, the primary documents that inform the discipline are: ALA Code of Ethics http://www.ala.org/advocacy/proethics/codeofethics/codeethics Library Bill of Rights (and Office of Intellectual Freedom) http://www.ala.org/advocacy/intfreedom/librarybill/ http://www.ala.org/advocacy/intfreedom Library Customer Bill of Rights (a typical example, from Haverhill, MA) http://www.haverhillpl.org/about/policies/library-customer-bill-of-rights/ United States Constitution and Bill of Rights Amendments (US Archives, typical) http://www.archives.gov/exhibits/charters/constitution_transcript.html Ranganathan’s Five Laws of Library Science http://en.wikipedia.org/wiki/Five_laws_of_library_science City College of San Francisco Mission http://www.ccsf.edu/NEW/en/about-city-college/mission-and-vision.html The term Library Information Technology has long ante-dated the concept of “information technology” as used today and generally designates the work of library support staff, assistants or paraprofessionals. This, and other terms for library support staff (pages, clerks, associate specialists etc.) are fairly uniform and are understood to mean the application of library practice, process and service rather than developmental or administrative functions. To this end, the structure of the military, with commissioned and non-commissioned officers, serves as the best analogy. Technical assistants are the NCOs of the library world. To choose library assisting is to choose a career, not a job. Often, “techs” have worked their way up through the ranks (having entered with a high-school diploma) and now command a great deal of authority in the trenches. Our long-term expectation is that we are fostering career building, i.e. teaching those who are willing, patient and devoted enough to hold a succession of jobs that lead eventually to the supervisory level. Those who teach and those who study should be reasonably well versed in job titles, tasks and basic qualifications. To this end, there are very good government and organizational resources which describe and summarize tasks, tools, knowledge, skills and the abilities needed and rewarded in the workplace. In the process of outcomes analysis some of the resources we have consulted include O*NET and the Occupational Outlook Handbook (both online from the U.S. Department of Labor), the American Library Association (ALA) Support Staff Resource Center, the ALA-Allied Professional Association web-sites, and the Council on Library/Media Technicians (COLT). ONET http://www.onetonline.org/find/quick?s=library+technicians Occupational Outlook http://www.bls.gov/ooh/education-training-and-library/library-technicians-andassistants.htm ALA – Support Staff Resource Center http://www.ala.org/offices/hrdr/librarysupportstaff/overview_of_library_support_staff ALA-APA http://ala-apa.org/ ALA – Library Support Staff Interests Round Table http://www.ala.org/lssirt/ COLT http://colt.ucr.edu/ In addition, numerous “job-sites” serve the department well in alerting us to current standards and employer expectations. These include sites at the ALA, Higher Education Jobs, BayNet Libraries, California Library Association to name a few. (We typically refer students to the list of “Job and Career Networking Resources” posted by the Diablo Valley College Library Technology program: http://www.dvc.edu/org/departments/library/lit/jobs-network.htm). Department Meetings, Flex Days, 2008-2011 The department is small, 1.25 FTE faculty, and adjuncts from a variety of professional settings are employed for one-half of all instruction. The employment of adjuncts is preferred to assigning librarians from City College because they bring to us specialized knowledge and valued external contacts. The down side to this being that there is precious little time to meet as a unit. Although the college holds four annual “Flex Days” they do not necessarily fall on their scheduled teaching days. Still, voluntary participation in department meetings has been productive and this has provided an opportunity to discuss assessment along with the usual matters of discipline. These limits on communication are alleviated somewhat by personal meetings, prior to class time, email and telephone. Nevertheless, conversations on curriculum and accountability have been fruitful given the constraint of time, especially as two of our adjuncts (Kobayashi and Dear) are involved with similar matters at other institutions. Incorporating Expertise from Other Colleges and Organizations A good share of learning outcomes techniques, and outcomes used by other programs teaching library technology, or library science, has been located by searching and visiting the websites of programs that have published them. These have likewise been supported by the study of accountability measures, and by specific examination of the literature of learning outcomes. An entire industry has emerged around this, thus, the literature is too numerous to summarize here, though a good clearinghouse is the National Institute for Learning Outcomes Assessment at the University of Illinois. To this end too, and perhaps more importantly, we have been coordinating with the ALA Library Support Staff Certification program to map our courses against the norms and standards for support staff certification. To be clear, the ALA venture does not assume that library staff seeking certification attended college or vocational school. Indeed, ALA-LSSC emerged from the desire to formally recognize the career commitment of library support staff learning through experience. Nevertheless, formal schooling is seen as an avenue to obtain certification, in whole or in part, and programs such as City College’s can serve the broader library community through acknowledged parallel curricula. Where we are now and where we are going As we move forward to examine, promote, and evaluate student learning outcomes, and to measure our delivery though finding means to fairly assess them, we do note that we have posted learning outcomes, by broad themes, and assigned them to courses on our departmental web page: http://www.ccsf.edu/NEW/en/educational-programs/school-and-departments/libintech.html. A study of the learning outcomes as posted on our website should read familiarly to any library professional and most current support staff. They are derivative of the values embodied in the above mentioned codes of Library Ethics, and standards of service, no less than the legal environment in which we operate which acknowledges the rights or copyholders no less than access to information and a free press in the US Constitution and Bill of Rights. We have used learning outcomes on our syllabi for the past academic year, and we consider them in advising for study, degree or certificate completion and career goals (see Appendix I, below). We are currently submitting a statement into the college catalog to direct readers to the department website for this discussion and enumeration. In addition, we are developing revisions of each course for designating outcomes and their measures. The department does maintain a list-serve for former students which was initially designed to distribute job notices and news on educational opportunities, but is being stretched to provide a means to inquire as to the whereabouts, employment and satisfaction of alumni. Student Learning Outcomes Assessment For the past year, the entry-level course has taken an initial survey of incoming students (see Appendix II, below). The intention of doing so has been to assess the goals and directions of each incoming class, for the purpose of effective advising and direction. A set of questions attempts to learn their age, previous level of schooling; their stated career goals; the level of prior library work experience; their exposure to, and use of technology. At the other end, a survey will be designed, in the form of an exit interview, which will be distributed through the previously mentioned list-serve, in an attempt to elicit information about long-term outcomes for alumni. Appendix I: Syllabus, Library 51, Fall 2012: Learning Outcomes LIBR 51, Fall 2012, Introduction to Libraries CRN 70342 (T/R 9 AM) & 70343 (W 4:30) Text: No text book required: Lectures and discussions ARE the primary text. Readings and assignments: Other course materials including readings and assignments will be distributed in class and/ emailed using the class list serve. Computers and Email: You are responsible for managing your official CCSF email account and your preferences. You are responsible for checking that account for occasional class missives and information. I will only use the official CCSF class list and the email addresses associated with it. If you do not know how to use email, or how to change your CCSF preferred address, then check with the Library Reference Department, 4th floor Rosenberg, for advice and direction. As for general computer skills, LIBR 51 expects that you already know how to start a computer, log on, use email and use the world-wideweb. You need not be an expert. To further develop your basic computer skills you may consult the Reference Librarians, take basic Library Skills Workshops that are offered by Library Services, take FREE non-credit division courses in word processing, keyboarding etc. and/or take credit division courses in the business department under MABS. The Library Technology department maintains a computer lab and library in Room 518 Annex. There are ten PCs set up, with student barcode access log-in. You may set passwords for your bar-code at the Reference Desk, 4th floor, or at the service kiosk, 5th floor outside room R521. For campus wireless pleas see: http://www.ccsf.edu/NEW/en/library/library-services/computers.html. Attendance, drops and grading: Rule 1: Show up in class. LIBR 51 is not offered for independent study. The instructor reserves the right to lower your grade for absences no matter how well you perform on exams. Rule 2: No matter how many absences you accrue, I will NOT drop you from the class. You are responsible to drop yourself. Pay careful attention to the CCSF drop deadlines. Rule 3: Homework will be examined for general worth with a check, check plus and check minus system. Homework will count toward your mid-term and your final grades to the extent that good and complete homework may elevate borderline grades. Rule 4: The mid-term exam serves to identify students who are in danger of failure. Your final grade will not necessarily be an average of mid-term and final exams. Learning Outcomes: At the end of the semester students should be able to: *Distinguish library employment for support staff and professionals in public and technical services. *Characterize library service ethics, institutional missions and goals. *Distinguish basic fields of information in the (surrogate) catalog or database record. *Identify the sources of catalog or database description *Translate thesauri into subject headings (descriptors) and cross references. *Perform simple database and catalog searches for known items. *Perform simple database and catalog searches by subject *Search and interpret library periodical and vended database holdings. *Search major shared resource databases. *Relate five to seven fundamental criteria for the critical evaluation or selection of resources. *Enumerate major types of reference materials. *Craft simple MLA style bibliographic reference citations for a books and periodicals. * Distinguish reference from footnote style citations. *Relate the most fundamental scholarly reasons for citation and documentation. Supplemental reading, Rosenberg Library Reserves: Wolf, Carolyn. Basic Library Skills, 5th ed. Jefferson, NC: McFarland 2006. Gates, Jean Key. Guide to the Use of Libraries …, 7th ed. New York: McGraw, 1994. Mann, Thomas. Oxford Guide to Library Research, 3rd ed.. New York: Oxford, 2005. Tentative schedule of broad topics (subject to change): Week 8/15-16 1 8/21-22-23 Administrative Notes: No Tuesday Class. Eve begins Wed, Day begins Thursday First Monday class 8/22. Topics* Orientation Weeks 1-12: general matters including history, ethics, bibliography, classification and cataloging, “shared resources”, thesauri & subject headings, alphabetization, periodical holdings and databases 2 8/28-29-30 8/31 last day for full refund drop 9/2 last day to add online No Monday class 9/8 Last day to drop without “w” or 50% nonresident refund 3 9/4-5-6 4 5 6 9/11-12-13 9/18-19-20 9/25-26-27 7 8 10/2-3-4 10/9-10-11 9 10 11 12 10/16-17-18 10/23-24-25 10/30-31-11/1 11/6-7-8 13 11/12-13-14 14 15 11/20-21-22 11/27-28-29 11/17 last day for leave of absence and for student or instructor withdrawals No class Thursday 11/24 Last day instructor Late Adds 11/28 16 17 18 12/4-5-6 12/11-12-13 12/18-19-20 FINAL EXAM T/R 12/15 FINAL EXAM M 12/19 9/29 last day to petition for degree or certificate No Monday class 10/10 MID TERM EXAM T/R 10/13 MID TERM EXAM M 10/17 Weeks 13-17: Reference sources, evaluation of resources, documentation, copyright, fair use and “plagiarism” Appendix II: Incoming Student Survey Survey Incoming Students, Library 51 This survey is ANONYMOUS. DO NOT PLACE YOUR NAME or any other information on this form. The purpose of my collecting this information is to inform advising for college and career goals, and to help establish bench-marks for students in the program. 1. What is the main reason for your taking this class? ___ Develop better library skills ___ Interested in library careers ___ Meet a distribution requirement in another department 2. What is your age range: ___ 20 or under ___ 31-40 years ___ 51 or over ___ 21-30 years ___ 41-50 years 3. Degrees earned: ___ high school diploma or GED ___ junior college certificate or degree ___ bachelor’s degree ___ master’s degree ___ doctor’s or post-bac professional degree 4. What desktop software applications have you used: ___ Word processing ___ Spread sheet ___ Small databases ___ Power point ___ graphic design/CAD ___ web design/construction 5. What net/web skills do you have: ___ browsing and email ___ social networking ___ other ___ Blogging ___ Skype/telephony 6. If you have a home computer, indicate type of service: ___ Cable ___ DSL ___ Satellite ___ Dialup 7. What mobile devices do you use? ___ Cell phone ___ Netbook/Ipad/tablet ___ Blackberry/Iphone/Droid etc. 8. Do you now use mobile for all your information needs (and let the computer collect dust)? 9. What types of news sources keep you informed? ___ Newspaper (print) ___ Television (broadcast/cable) ___ Radio ___ Newspaper online ___ Newsfeeds online ___ Radio/television online 10. Pick the three (3) most important purchases for the CCSF Library ___ general and reference books ___ magazines and journals ___ text books ___ databases ___ non-book media (cd/dvd/film/video) ___ computers and networking equipment ___ desktop software 11. Pick the three (3) most important services in the CCSF Library ___ a place to study ___ computers and wireless access ___ text books held on reserve ___ guidance, consultation and personal assistance (Reference) ___ instruction for library literacy ___ lectures and events ___ exhibits and displays 12. What is the following resource and what/who is it about? Ellen Lambeth, “Totally Weird Turtles,” Ranger Rick, August 2010: 30-35. 13. What is the following resource and what/who is it about? Kristine Setting Clark, Undefeated, Untied and Uninvited…the 1951 University of San Francisco Dons Football Team, Irvine, CA: Griffin, 2002. 14. What is the following resource and what/who is it about? http://en.wikipedia.org/wiki/Franklin_D._Roosevelt 15. These three labels appear on the spines of books. Place them in shelf order, numbered 1-3. G26 H4 G226 H4 G26 H39 ___ ___ ___