FAQs about the NSSE Consortium for the Study of Writing in College Q. What are the benefits of joining the CSWC? (move to main) Q. We need to persuade our administration that our school should participate in the CSWC. Any advice for how we should persuade them? (move to main) Q. Where can I go to get answers to specific questions? (separate link in right) Q. Will the CSWC writing questions continue to be available beyond the Spring 2009 administration? Our school is not scheduled to administer the survey until after 2009. Q. Our school is unusual, and we are concerned that there may not be other schools like ours with which we can compare ourselves. Can we wait to see who is in the consortium before deciding? Q. Can my institution add questions to the set? Q. I notice there are 27 questions in the CSWC question set, but the NSSE consortium guidelines specify that a maximum of 20 are allowed. Q. Will my school’s data be shared or made public? Q. My institution’s office of research/planning says they don’t have the resources or time to analyze the data gathered from the writing questions. They are concerned that we will have this data but will not be able to do anything with it. Should we still bother? Q. Can we analyze our results ourselves, without the help of our office of institutional research/planning? Q. Are there other resources for learning how to analyze our data and interpret our results? Q. What are consortia, “comparison groups,” and “systems,” and how do they differ? (move to main) ---move to main— Q: Our institution is already in a consortium or state system, can we participate in more than one consortium or system? Q. Why does NSSE restrict an institution to just one consortium? Q. What are the benefits of joining the CSWC? A. While colleges and universities have recognized the importance of writing throughout the curriculum, it has been difficult to understand how much and what kind of writing students are actually doing. The CSWC is designed to provide a snapshot the writing their undergraduates do. By participating in the consortium, schools can gather data about students' writing behaviors that would otherwise be impossible to acquire. Colleges and universities are increasingly dedicating new programs and resources that focus on student writing. These changes are led in part by the recognition offaculty, the public, and the professional world that writing ability is an essential skill for all college graduates. In addition, the research of Derek Bok, Richard Light, David Russell, and Marilyn Sternglass, among others, suggests also that writing activities increase students’ engagement and learning in any course. This movement is also driven by new concerns about students’ readiness to enter a global workforce with multifaceted, complex demands for communicative effectiveness. CSWC participants will receive a range of reports that idescribe students' responses to both the NSSE core survey and the additional question set about writing. Participants also receive the raw data, which they can use to answer their research questions about the role of writing at their institutions. For instance, institutions can examine the relationships between writing practices and the gains student report for a variety of other learnign outcomes. Benefits for first-year-writing programs and WAC/WID programs Paul/Chris For both first-year writing programs and WAC/WID programs, the CSWC question set asks questions that probably align with some or all of your program’s learning outcomes. Your NSSE results will provide an additional indirect measure of student learning, and could help you better understand what students are writing and how instructors are teaching writing, teaching disciplinary writing, or using writing to enhance learning. Benefits for departments, colleges, and other programs and units Individual departments and colleges can use the CSWC data to better understand the writing practices of their undergraduates. Individual departments, colleges, and other units can isolate the data for their students and examine their writing practices, and can even compare their students’ responses with students overall and from other units. If they request a special analysis from NSSE (which requires a fee), a unit could compare their students' responses wiht the responses of similar students from other institutions. For instance, a history department could compare their majors to the history majors from other institutions. Some units may choose to work with their offices of research/planning to analyze the data themselves Benefits for the institution Your institution’s office of research/planning is probably already aware that NSSE is a highly regarded and increasingly influential means for assessing student behavior and effective educational practice. If your institution is already administering the NSSE in Spring 2009, it can participate in the consortium for a very reasonable fee and gain an overall snapshot of students’ writing practice. These results, like all NSSE results, can be used for benchmarking: comparing an institution with other institutions or comparing your performance with pre-established goals. Institutions may be especially interested in using the CSWC survey results as part of their overall accreditation and accountability efforts. One of the most widely used assessment products for measuring value-added learning is the Collegiate Learning Assessment (CLA), which is designed to measure students reasoning and communication skills by assessing students’ written responses. Institutions that use the CLA may be especially interested in knowing what kinds of writing their students are doing. More Information about the CSWC Q. Where can I find more web-based information about the CSWC and NSSE in general? A. The clearinghouse site for information about the CSWC is at http://comppile.org/wpa+nsse. NSSE’s website includes several resources that can help you understand NSSE in general and consortia. NSSE webpage on consortia provides a general description of NSSE consortia, what they are, how they work, how to sign up, how much they cost, etc. Web tutorials about NSSE that you can listen to and watch are available at NSSE’s Webinar Archives. Q. Where can I go to get answers to specific questions? A. Email one of the following people with your questions. DOES ANYONE OBJECT TO HAVING THEIR EMAIL ADDRESS POSTED HERE? Chuck Paine, Coordinator of the Consortium, is an associate professor of English at the University of New Mexico. He’s the consortium factotum. Write to Chuck with general questions. If he can’t answer your question, he’ll direct you to the person who can. Paul Anderson, Consortium Collaborator, is Professor of English and Director of the Roger and Joyce Howe Center for Writing Excellence at Miami University (Ohio). Chris Anson, Consortium Collaborator, is University Distinguished Professor of English and Director of the Campus Writing and Speaking Program at North Carolina State University. Chris is a national leader in WAC/WID and assessment. Paul Chris Bob Gonyea, Associate Director of NSSE in the Center for Postsecondary Research, Indiana University-Bloomington, can can answer questions about Bob NSSE, data analysis, policy and procedures, and other stuff. , I think that actually we shouldn’t even list you here. I don’t think you want people calling you with data analysis questions, do we? Dan Bureau and Tony Ribera serve as managers for the consortium process. They can answer questions about consortium policies and registration. Dan/Tony Client Services Project Associates: Each institution is assigned two project associates who work as a client services team to provide support during your NSSE administration. You can view your institution’s project associates at http://nsse.iub.edu/html/staff.cfm. Client Services Manager Jennifer Brooks manages client services and can direct your question to the appropriate person at NSSE. Q. Will the CSWC writing questions continue to be available beyond the Spring 2009 administration? Our school is not scheduled to administer the survey until after 2009. A. There would need to be a consortium for the year you’re administering NSSE. The questions would not go away, but a single school could not use them alone; this is a NSSE rule. We can’t predict whether other schools would be interested in creating a consortium for 2010, but we think there’s a reasonable chance because many NSSE consortia continue across several years, because the CSWC has broad support from both the Council of Writing Program Administrators and NSSE. Q. Our school is unusual, and we are concerned that there may not be other schools like ours with which we can compare ourselves. Can we wait to see who is in the consortium before deciding? A. Yes. You can wait to enroll in the consortium until the closing date, October 5, 2008. If you write to Chuck Paine, he can we can tell you which institutions have told him they are enrolling. The CSWC Question Set Q. Where can I find the question set? A. You can get a PDF of the set of 27 questions at http://comppile.org/wpa+nsse/docs/27_Question_Supplement.pdf. Q. Can my institution add questions to the set? A. No. All member institutions of a consortium agree to use the identical question set. More questions could frustrate student survey takers and might lead to a drop in participation. Also, although your data will not be made public unless you choose to do so, all the data goes into an aggregate pool; if institutions added questions, the data would be rendered less commensurable. Q. How was the question set developed? A. It was developed through a multi-year collaboration between NSSE and the WPA. The WPA collaborators included more than 70 professors with expertise in writing program administration, writing across the curriculum, writing in the disciplines and writing-center theory and practice. Before and during the 2007 WPA Conference, these WPA collaborators created over 100 questions that were collapsed, refined, focus-grouped and finalized by a smaller team. More information about the development of the question set can be found on WPA/NSSE web pages (which are wrangled, designed, and maintained by Glenn Blalock at CompPile.org). Q. I notice there are 27 questions in the CSWC question set, but the NSSE consortium guidelines specify that a maximum of 20 are allowed. A. NSSE has given us permission to use the entire 27-question set. NSSE limits the number of questions because too many will frustrate student respondents and might cause some to give up on the survey. However, this question set appears to be relatively easy for students to complete. It was developed with the help of NSSE directors. Furthermore, the Spring 2008 experimental administration of the question set showed that students did not give up. Signing up to Participate: Costs, Dates, Procedures Q. How much does it cost to participate in the CSWC? A. The fee for consortia participation is based on overall undergraduate enrollment: Fewer than 4,000 $200 4,000 to 7,999 $300 8,000 to 12,000 $400 More than 12,000 $500 Q. What is the procedure for registering? A. Institutions will be sent an invitation to register in the consortium on or after September 5, 2008. Institutions must register by October 5. Q. When is the signup deadline? A. Institutions need to enroll by October 5, 2008. Data Analysis and Data Sharing Q. Will my school’s data be shared or made public? Bob A. , will you answer this? I answered for the person who asked but I’m sure you could do a better job. Q. My institution’s office of research/planning says they don’t have the resources or time to analyze the data gathered from the writing questions. They are concerned that we will have this data but will not be able to do anything with it. Should we still bother? Bob/Paul A. There may be good reasons to participate even if your research/planning office cannot complete an analysis of the data beyond what NSSE provides. Your office is right that you should consider what you want to do with this data. You will probably gain valuable information and insights from the analyses provided by NSSE (reports arrive in early August). But it is true, as your office suggests, that the most powerful results, conclusions, and insights can be gained when you match NSSE student responses with the kind of data that only your institution has access to, such as demographic data, student-success data (GPA, persistence, etc.), and data about programs and courses pursued by students. In short, matching institutional student data to survey data allows institutions to fine tune their analyses and discern with writing and other student experiences are leading to the learning, engagement, and success outcomes they are most interested in. Q. Can we analyze our results ourselves, without the help of our office of institutional research/planning? Paul A. : perhaps you could say briefly how an individual can do analysis themselves. You will need their help in getting access to the data, but you can do some analyses yourself, especially if you are assisted by a faculty member or graduate student with experience in social-science research. Q. Are there other resources for learning how to analyze our data and interpret our results? Bob A. : BOB you said you and Jillian were thinking about this. Have you been able to decide? Several helpful resources are available at NSSE’s Webinar Archives, especially “Getting Down to Basics: Working with your NSSE Data,” a twohour introduction to NSSE, its data, and uses. You could also read the 14-page PDF “Using NSSE Data.” Finally, if enough schools participate in the consortium, NSSE will conduct a webinar devoted to interpreting the CSWC survey results. The webinar will occur in October of 2009 (about three months after you will have receive your data from NSSE) and be produced and hosted by Associate Directors of NSSE Bog Gonyea and Jillian Kinzie. This will be a live and free webinar that you can participate in. It will also be available on the NSSE website for later viewing. General Information about NSSE Consortia Q. What exactly is a NSSE consortium? A. As NSSE explains on its website, “A NSSE consortium is a group of six or more colleges or universities participating in NSSE the same administration year that want to ask students additional questions that will follow the NSSE core survey.[…] You can see the diverse functions of NSSE consortia since the survey's inception in 2000.” Q. What are consortia, “comparison groups,” and “systems,” and how do they differ? A. Systems and consortia are kinds of comparison groups. Consortia ask additional questions; systems and ordinary comparison groups do not. Institutions register with systems and consortia in the fall before the NSSE administration; they select comparison groups in May, after the NSSE administration. Comparison group. Your institution can choose up to three comparison groups. Your survey results are compared to each of these three groups. As NSSE explains, “NSSE reports display results for each institution alongside three comparison group columns. Institutions have the option to customize each column or select a recommended default group of institutions. NSSE comparison groups may be customized in several ways. Contacts may identify specific institutions from the list of all current-year NSSE participants, create the list using institutional criteria, or begin with institutional criteria, then add or remove specific institutions to refine the comparison group.” Examples of comparison groups include institutions in your geographical area, in your Basic Carnegie Classification, CHE peers, and all other schools in the nation administering NSSE that year. System. One of your comparison groups can be a state or university system. Institutions can join a system at no additional charge. Systems do not ask additional questions; if they do choose to ask additional questions, they become by definition a consortium. Consortium. Up to one of your comparison groups can be a consortium. Institutions can join a consortium by paying an additional charge. Consortia ask additional questions. Q. Why does NSSE restrict an institution to just one consortium? A. This strict NSSE rule is designed to prevent "survey fatigue." Each consortium uses an additional question set. If students were asked to complete two additional question sets, many might feel overburdened or might give up. Q: Our institution is already in a consortium or state system, can we participate in more than one consortium or system? A: You can participate in only one consortium. You can participate in a consortium and state system only if the system is not asking additional questions. If you need clarification about a system, please contact Dan Bureau or Tony Ribera at consorti@indiana.edu i Q. Where can I find NSSE consortium general information? A. Visit this NSSE webpage on consortia. Convincing Your Institution to Participate in the CSWC Q. We need to persuade our administration that our school should participate in the CSWC. Any advice for how we should persuade them? A. Here are some ideas that might work. Choose those you believe will be compelling for your decision makers (upper-level administrators, directors of institutional research/planning, etc.). Perhaps most important, follow the principles of any good rhetorician and adapt your message to your specific audience and local situation. Explain how participation will benefit your school specifically. Connect the benefits of participation with specific initiatives and programs; connect to the specific local values and goals of your school, how it defines itself in its mission statement and similar documents; connect to the specific pressing needs and concerns your school faces. Connecting CSWC participation to the these typical ways that universities and colleges use NSSE core-survey results (from page 1 of NSSE’s “Using NSSE Data”): Assessment and improvement General education reform Benchmarking Alumni outreach Accountability Grant writing Institutional research Institutional advancement Accreditation & self-studies Faculty and staff development Retention Communication with students Institutional communication State system performance reviews Educate yourself about NSSE and the CSWC. Visit the WPA/NSSE website. Consult the first section of this document, “Benefits of Participating in the Consortium,” as an idea generator. Give yourself a crash-course tutorial about NSSE. View some of the webinars at NSSE’s Webinar Archives, especially “Getting Down to Basics: Working with your NSSE Data,” a two-hour introduction to NSSE, its data, and uses. It also provides numerous tips for talking with people in your college. You might also read the much shorter 14-page PDF “Using NSSE Data.” Also, scout around the NSSE website for information you think will be useful to you. Consider addressing how the CSWC might address these general highereducation issues: Assessment in general: the CSWC survey results may provide data about writing, which is a skill that those inside and outside higher education recognize as important; it would be difficult or impossible to gather this data in any other way. Accountability systems. If your school is participating in one of accountability systems (such as the Voluntary System of Accountability, which produces the College Portrait), participation and results could be reported there. Accreditation and self-studies for the institution. Accreditation and self-studies for departments and colleges. College deans and college directors of assessment can provide support. If your institution has a school of engineering, business/management, or education, those schools have professional accrediting agencies that have increasingly stressed the importance of writing skills. Accreditation and self-studies for other programs and units. Similarly, if you have a new or high-profile first-year-experience program that stresses writing instruction, enlist their involvement. Programs that might be especially interested in using CSWC results include: first-year experience, learning communities, WAC/WID programs, faculty development, various colleges that have professional accrediting agencies, administrators of large government and other grants, and others. National visibility by participating in a nationwide research project. Get written or oral support from deans, chairs, program directors, and other campus leaders. If you don’t have access to these campus leaders, speak with person in their unit who is in charge of assessment or of faculty development. Consider asking these campus leaders to demonstrate their support with money. You could ask them to commit to paying for a certain portion of the consortium fee. For instance, for the largest institutions, the consortium fee is $500, which could be split five ways. It would be a small but meaningful gesture of support. Ask these leaders to demonstrate their interest by indicating interest in oversampling their students. (NSSE’s “Oversampling Information” defines oversampling and explains why a school or unit would oversample.) Remind them that participation is relatively free of risk: the cost is very reasonable, and your school is free to do with the data as they wish, including keeping it to themselves.