Oct 2013 - University of Colorado Boulder

advertisement
AAUDE – NSSE caretaker update October 2013
1
10/29/13 Caretaker update
NSSE
Lou McClelland, Colorado
Reflects reviews by Wisconsin, Maryland, Illinois, and Ohio State. Kansas, Michigan
State and Stony Brook invited to review, did not comment.
Posted from http://www.colorado.edu/pba/surveys/nsse-aaude/index.htm
PBA ref: L:\IR\survey\NSSE\AAUDE\NSSECaretakerUpdate201310.docx






Spring 2013 was the first administration of NSSE 2.0. 9 AAUDE’s participated, 8
using the AAUDE questions (revised-for-2.0) and sharing data (Colorado, Iowa St,
Kansas, Michigan St, Nebraska, Ohio St, Washington, Tulane), one school
administering but doing neither (Carnegie Mellon). NSSE will send the responselevel aggregate data file in November. Colorado will make available (to those
sharing data 2010-14)

The v2.0 response-level data – probably without some AAUDE value-added
variables like CIP codes at the outset, because NSSE will create the maps but
hasn’t yet.

V1.0 response-level data, all years 2000-2012 but only items comparable to v2.0,
in format comparable to 2.0 (same varnames and response values). Initial
release with variables for questions; probably later release with converted
variables for majors, race/ethnic, other tricky conversions.

We have posted the plan for these datasets/conversions, and the caretaker
report, from http://www.colorado.edu/pba/surveys/nsse-aaude/index.htm
Spring 2014 registration has closed. Illinois, Maryland, Stony Brook, Wisconsin, and
Boston U are using AAUDE questions and sharing data. Georgia Tech and McGill
are sharing data but cannot use AAUDE questions because they’re in required
state/country consortia. Toronto sought approval for sharing data but VP’s there
denied the request. Buffalo is sharing data but not using AAUDE questions – I have
asked them to reconsider, citing the value of the comparative data and Colorado’s
approach 2013 of asking NSSE to sample and contact half of the eligible population,
with the other half “saved” for other surveys. Looks doubtful.
If Buffalo does not use AAUDE questions, 2014 will be the first time we’ll have fewer
than the 6 schools required by NSSE for a “consortium” = set of schools using their
own common questions. However, NSSE has said our having only five is OK at
least for this time.
AAUDE questions 2014 will be same as 2013.
Several schools that once used NSSE have explicitly or apparently stopped doing so
– all UC, FL, IA, MI, MN, NC, PennSt, Pitt, Purdue, TX, TXA&M, VA, Case, Emory,
and Rice. Many of these are doing SERU instead.
Schools typically do NSSE on 3 or 4 year cycles. The schools still in the game, and
sharing, total 22, all of which are publics except BU, Tulane, and Syracuse. A few of
these are doing both NSSE and SERU (In my records, Indiana, Oregon, and Rutgers
CU-Boulder PBA – LMcC Lou McClelland– Document1 – 2/10/2016 - Page 1
AAUDE – NSSE caretaker update October 2013




2
all said, once upon a time, that they’d do NSSE in 2015 but are also involved with
SERU.). A few cannot or do not use AAUDE questions (GA Tech, McGill, Indiana).
That leaves 18-19 real players, plenty enough to justify an item but perhaps not
enough to satisfy NSSE every year.

The low number per year heightens the value of the AAUDE comparative data,
which span years in a fashion NSSE itself does not do.
The AAU Survey on Undergraduate Student Objectives and Assessment (sent by
Josh Trapani 10/18/13) cited heavy use of national surveys including NSSE, SERU,
and COFHE. Basically there’s a 3-circle Venn of NSSE, SERU, and COFHE, with
little overlap except of purpose, and sharing within each circle (I presume) but not
across, and an AAUDE caretaker for one circle but not three!
NSSE has been a considerably less expensive option than SERU, with no
requirement to administer annually. SERU may or may not make comparative
response-level data available. Some NSSE schools have expressed surprise at the
number migrating to SERU, and at CIC interest in SERU.

Report from a CIC school: “Just talked to my Vice Provost for undergrad studies.
Administration of SERU has moved to Minnesota, although UCLA still has a role,
not sure what that is. The UG group discussed SERU as more appropriate for
CIC type schools, and not sure who said it, but it was said by someone that lots
of NSSE was irrelevant for our kinds of institutions. The Minnesota undergrad ed
person was going to see if they could work out special pricing for SERU for the
CIC schools. Apparently Indiana is now doing both and said that they were only
continuing with NSSE because it was located there.”
NSSE has changed considerably in the last few years, with

Routine sampling of the entire eligible population for no additional cost, if the
school so wishes. This generates enough respondents to characterize all but the
smallest majors, increasing value for school/college and department use. NSSE
does continue to define only seniors and new freshmen as the eligible
population.

In 2013, Colorado elected to sample half its eligible population, holding the
other half for other surveys. This may reduce concerns about over-surveying.

V2.0 questionnaire revision, first used in 2013, aimed at more utility for academic
planning and decisions

Vastly improved reporting and customized reporting, including comparative
reports for individual majors or groups of majors to simulate schools and
colleges. In Colorado we have broken long practice and posted many NSSEcreated reports (for 2013) straight out of the box. See
http://www.colorado.edu/pba/surveys/NSSE/13/. [The major field reports are not
yet posted.]
The AAUDE response-level comparative data make NSSE even more valuable.
AAUDE adds

Custom questions suited to big research universities; e.g., on class size
CU-Boulder PBA – LMcC Lou McClelland– Document1 – 2/10/2016 - Page 2
AAUDE – NSSE caretaker update October 2013


3
Availability of comparative response-level data identified by institution

Longitudinal data – NSSE does no reporting on change over time by institution

A collegial user group
Caretaker activity

I discussed transfer with GA Tech. That got delayed, then waylaid when we
learned that GA Tech hadn’t participated in 2013, couldn’t ever use AAUDE
questions, and was focused only on the datasets.

Most of the work is housekeeping – who’s participating, data sharing
agreements, working with the NSSE people on consortium and v1-v2, keeping up
email list, website, keeping everybody informed, question revisions, how to put
old and new data together. There’s been a lot of housekeeping lately. I also
reviewed all NSSE reporting formats and sent comments/suggestions to NSSE.

Things that should be done but haven’t: Revise user guide for v2.0 and new file
formats; update the website at Colorado and the exchange item page; develop
AAUDE reports, especially reports using more than one year of data.
CU-Boulder PBA – LMcC Lou McClelland– Document1 – 2/10/2016 - Page 3
Download