sense

advertisement
SENSE FAQs
Section ___________________________________________________________ Page
General Questions .......................................................................................................... 1
Course Schedule File (CSF) ........................................................................................... 2
Sampling Procedures ..................................................................................................... 5
Survey Administration ..................................................................................................... 6
Completed Survey Returns ............................................................................................. 8
General Questions
1. We have signed up to participate in SENSE. What happens next?
In May, a SENSE Liaison will be assigned to the college. The SENSE Liaison will work closely
with the Campus Contact to ensure a smooth administration process, including discussing with
the Campus Contact all of the steps involved in implementing SENSE. The SENSE Liaison will
also send the Campus Contact an electronic version of the SENSE Procedure Guide, which
includes the Survey Administration Timeline to assist in the coordination of SENSE at the
college.
2. Who designates the Campus Contact?
Typically, the college president designates the Campus Contact.
3. Who designates the Survey Administrators?
The Campus Contact designates the Survey Administrators.
4. If we have multiple campuses, should we have multiple Campus Contacts?
No. Colleges are allowed only one designated point of contact for SENSE.
5. If we have multiple campuses, should we have multiple Survey Administrators?
Yes. It can be very time consuming and inefficient to have one person administer the survey at
multiple campuses. Therefore, the Center strongly recommends that at least one Survey
Administrator be designated for each campus. Please see page 2 of the SENSE Procedure
Guide and review the Survey Administration Staffing Tips sheet on the SENSE Members Only
Website for suggestions on how to staff the survey administration.
6. When is the survey administered?
The survey is administered during the fourth and fifth class weeks of the fall academic term.
7. How is the survey administered?
SENSE is administered as a pencil-and-paper survey in randomly selected classes drawn from
a specific group of courses provided in the course schedule file (CSF).
8. Is it possible to administer SENSE on the Web?
No. While the Center is interested in pursuing this option, there are many factors that make this
a non-viable option. In addition, response rates with in-class surveys are significantly higher.
SENSE FAQs
9. How does this survey work if we are on a quarter rather than a semester system?
The survey should be administered during the fall academic term. Contact the SENSE Liaison,
and he or she will work with the Campus Contact to accommodate the abbreviated time frame.
Course Schedule File (CSF)
10. What is a course schedule file (CSF)?
The CSF is an electronic file containing information about the institution’s first college-level
English, first college-level math, and developmental courses. It is the responsibility of the
Campus Contact to ensure that all courses included in the CSF fall within the guidelines outlined
in the SENSE Procedure Guide and that all necessary variables are included for each course.
Following submission of the CSF, the Center randomly selects courses from this file to be
surveyed for SENSE. An Example Course Schedule File (CSF) is provided on the SENSE
Members Only Website.
11. How should the CSF be submitted?
The Campus Contact should submit the CSF to the SENSE Liaison via e-mail as an attachment.
An Excel file is preferred; however, most standard file formats will suffice, with the exception of
PDF or html files.
12. Our registrar informed me that we do not have all of the data elements the Center
requests for the CSF. What should I do?
The Center would prefer that all requested data elements outlined on page 5 of the SENSE
Procedure Guide be provided in the CSF, but the following are the data elements that MUST be
included: 1) start time; 2) end time; 3) start date; 4) end date; 5) section number; 6) course
number; 7) course name; 8) meet days; and 9) maximum/predicted enrollment. It should be kept
in mind that Survey Administrators may encounter problems if other requested data elements
are not included as this information is vital for locating and administering the survey in classes
selected as part of the sample. Additionally, including all requested data elements enables
Center researchers to identify cross-listed and team-taught courses. If all data elements are
included, these courses will be combined and enrollments summed so that course packets will
have sufficient surveys for all students in selected classes.
13. Could you give an example of what is meant by first college-level English and Math
courses?
First college-level English and Math courses are generally those offered to first-time collegeready students that did not place into developmental courses. Examples include Comp I and
Algebra I.
14. Can we include Student Success Courses/College Skills Courses or other courses
typically taken by first-time college students?
Student Success/College Skills courses should not be included in the CSF because these
courses are not offered at all institutions and course content often differs greatly across
institutions. The Center uses only developmental and first college-level English and Math
courses because these courses are offered across all participating institutions.
15. We run a 12-hour clock, not a 24-hour clock. Is this acceptable for the CSF?
All time fields must be formatted the same way. If the college runs a 12-hour clock, an AM/PM
indicator must be included in the file field (i.e., start and end times).
2
SENSE FAQs
16. Our system output separates department and course number, while your template
puts them together. What should we do?
The Center will combine the two fields as part of the data cleaning process.
17. Our system output combines building and room number, while your template
separates them. What should we do?
This isn’t a critical problem, but it will affect the way the course packets are labeled (e.g.,
information on course packets will contain both the building and room in the building field).
18. If we do not yet have an instructor of record listed for a course, should we go ahead
and send the CSF?
Yes. Leave the field blank or indicate “Staff” in the CSF.
19. If we have updated information for the CSF but have already submitted the file,
should we send it to you?
No. The Center cannot accept additional information after the CSF has been submitted.
20. Some of our courses meet at different times on different days. How should we report
this in the CSF?
Include only one start time, one end time and one meet day for the course, so that only one
listing of the course is included in the file.
21. We have some short-term courses that do not start at the beginning of the fall term
(like those that run for only four Saturdays); do we report those?
Yes. However, if a course ends before survey administration begins, it will be removed from the
sampling frame.
22. Should we include off-campus classes in the CSF?
All credit courses held at off-site locations should be included if they meet the described
parameters for SENSE and a Survey Administrator can administer the surveys at these
locations.
23. Should we include ITV (Interactive Television) courses in the CSF?
ITV courses are those in which multiple classrooms are connected via a satellite feed, with an
instructor in one location and groups of students in other locations. If Survey Administrators can
be at each course location at the same time and date, ITV courses should be included in the
CSF. Please collapse all sections of the course into one listing and sum the total student
enrollment, making a note that multiple sections for this course will be surveyed if the ITV
course is selected for the sample.
24. When the Center refers to distance learning classes, does this refer only to internetbased and ITV courses, or does this also include courses offered off-site?
The only classes that should be excluded as distance learning (online) courses are classes that
do not have a physical class meeting during the fourth or fifth class week of the fall term in
which the survey can be administered. Courses that meet off-campus should be included in the
sample as long as a Survey Administrator will be able to administer the survey to these courses
should they be selected as part of the sample.
3
SENSE FAQs
25. Should hybrid or blended courses be included in the CSF?
Hybrid or blended courses are those in which students meet both online and face-to-face.
These courses should be included in the CSF if they have a physical class meeting during the
fourth or fifth class week of the fall term in which the survey can be administered.
26. Should we include classes taught to incarcerated populations in the CSF?
No. Classes taught in incarcerated settings should not be included in the CSF as these students
are not exposed to the full breadth of the college experience.
27. Should we include combined lecture and lab classes in the CSF?
Yes. However, the Center requests that the CSF contain only ONE entry for the combination
and not two separate entries for the lecture and the related lab.
28. Should concurrent enrollment high college classes be included in the CSF?
No. Concurrent enrollment typically means that students can obtain both high college and
college credit for a course and these courses are often comprised entirely of high college
students. SENSE is not administered to classes comprised entirely of high college students.
29. How do we include cross-listed courses in the CSF?
Cross-listed and team-taught courses will be identified during the sampling process if all
variables outlined on page 5 of the SENSE Procedure Guide are included in the CSF. The
Center will combine these courses into one listing and sum enrollments so that course packets
will have sufficient surveys for all students in selected classes.
30. How do we include cohort courses in the CSF?
Cohort courses are those in which the same group of students is enrolled in more than one
course. If the college offers cohort courses, please include only one course for each cohort in
the CSF.
31. We have some self-paced classes in which there is an instructor, but the instructor
serves mainly as a tutor. Should this offering be included in the CSF?
As long as there is a set meeting time for the class and students are required to attend, selfpaced classes should be included in the CSF.
32. Should we include courses with small enrollments in the CSF?
Courses with at least three students should be included in the CSF.
33. What is a codebook?
A codebook is a data dictionary. It provides information on the structure, contents and layout of
the data file.
34. Do I have to have a codebook?
If the CSF conforms to the Example Course Schedule File (CSF) provided on the SENSE
Members Only Website, a codebook is not necessary.
35. What is a variable name?
A variable name indicates the name assigned to each column of data in the data file. In Excel
spreadsheets, it is typically the top row of the column.
4
SENSE FAQs
5
36. What are values and value labels?
Values are the codes assigned to variables (e.g., “DK” and “Y”), and value labels are the
definitions for the codes (e.g., ”Don’t Know,” “Yes”).
Sampling Procedures
37. Approximately how many classes will be included in our sample?
The table below provides the average number of classes sampled based on institution size.
Enrollment category
Fewer than 1,500
1,500–4,499
4,500–7,999
8,000–14,999
15,000–21,999
22,000 or more
Target sample size
TBD
600
800
1,000
1,200
1,500
200% of target
TBD
1,200
1,600
2,000
2,400
3,000
Average number of classes
TBD
52
75
82
119
129
38. If there is a problem with the sample you send us, can you pull a new one?
The Center will only re-pull the sample if a substantial number of courses in the CSF should
have been excluded in order to meet the Center’s specifications or if a substantial number of
courses was excluded from the CSF prior to submission that should have been included. Please
contact the SENSE Liaison for more information.
39. If instructors refuse to allow survey participation in their classroom, what should we
do?
The Center has accounted for non-participation in the sampling strategy. Each college is
provided with approximately 200% of the target sample size to account for such situations.
40. If instructors have multiple classes chosen, can we omit one of the classes from the
sample?
No. The sampling unit is the class that is composed of students, and the random selection of
students is the principle objective. The Center encourages colleges to explain to instructors that
they are not being sampled more than once, they just happen to be associated with more than
one group of students that is being sampled.
41. An instructor who wants to participate would like to substitute a class that was
canceled with another course. Can we do this?
No. Sampled courses are selected through a random process, and in order to preserve the
integrity of the sampling process, course substitutions are not permitted.
42. A class that was chosen for the sample has stopped meeting. What should we do?
It is not problematic if a course has ended prior to the survey administration. Each college is
provided with approximately 200% of the target sample size; not surveying this course should
not have a negative impact on the data.
43. When we reviewed our sample file, we came across additional courses that fall
outside the sampling frame. What should we do?
Because the Center provides colleges with approximately 200% of the target sample size,
omitting these courses should not have an overall negative impact on the targeted number of
respondents. Make a note of any problematic courses and remove these survey packets when
the shipment arrives from the Center. However, if a substantial number of courses that violate
SENSE FAQs
the exclusionary guidelines listed on page 5 of the SENSE Procedure Guide were included in
the CSF and selected in the sample, contact the SENSE Liaison as soon as possible to discuss
options for submitting a new CSF.
44. We would like to survey a sub-population of students for SENSE. Is it possible to
receive additional surveys?
Oversampling enables colleges to survey students not selected as part of the random sample.
The Center offers four oversample options. Details regarding oversample options and pricing
are available on the SENSE Registration Page under SENSE 2011 Membership Options and
Pricing.
Survey Administration
45. How long does it take to complete the survey?
The survey is designed to be completed in one 50-minute class period. Historically, the survey
has taken students up to 45 minutes to complete; however, it is possible the survey may take an
entire class period.
46. What do we do if students have not completed the survey when the class period
ends?
The Survey Administrator should collect all surveys at the end of the class period. All completed
responses will be included as part of the college’s dataset, even if the entire survey was not
completed.
47. Do we have to survey students during fourth and fifth weeks of class?
SENSE focuses on students’ initial college experiences, so it is important that students be
surveyed during the fourth and fifth class weeks. Additionally, since all participating colleges
survey their students at this time, it is important to survey students within this administration
frame.
48. We have a class that starts four weeks into the term; do we administer the survey to
these students during their first week of class?
SENSE should be administered during the fourth and fifth class weeks of each course. For latestart courses, the survey administration date ranges will vary so that surveys are administer
during the fourth or fifth class week following their late start.
49. What do we do when a class to be surveyed meets with another class that wasn’t
selected for survey administration due to cross-listing?
Because the Center runs a program that identifies cross-listed courses and combines them to
reflect their total enrollment, this situation should have been addressed prior to pulling the
sample if all requested data elements were included in the CSF. If this did not happen, use
supplemental surveys so that all students in the classroom can be surveyed.
50. What are the one hundred additional surveys for?
These surveys are intended to supplement course packets needing more surveys due to
enrollment discrepancies. They should not be used to survey any courses not selected as part
of the sample.
51. We did not receive enough pencils for every student. Can we get additional pencils?
The Center does not provide enough pencils for each survey sent. The number of pencils sent
is based on the college’s enrollment size. We suggest that pencils be collected and redistributed
6
SENSE FAQs
throughout survey administration in order to ensure there are enough pencils for students in
each surveyed course. However, if the college would like additional pencils, the cost is $20 per
box (144 pencils per box). Please contact the SENSE Liaison to order additional pencils.
52. Should students under the age of 18 be surveyed?
No. The Center’s Institutional Review Board (IRB) at the University of Texas at Austin requires
parental consent for students under age 18 to participate in SENSE. Any student indicating on
the survey instrument that they are “Under 18” is excluded from all analyses and reporting, and
those respondent data are not returned to the college. Students under 18 should still remain in
the classroom during survey administration, however, so that they do not miss any instruction
time following survey administration.
53. Do students have to complete the survey more than once?
No. If students completed the survey previously, they are welcome, but not required, to
complete the survey more than once. If a student elects not to participate again, the student is
asked to remain in the classroom during the survey administration period. The primary reason
for this is to prevent disruptions or students claiming to have taken the survey in order to leave
the classroom. Additionally, students should remain in the classroom during survey
administration so that they do not miss any instruction time following survey administration.
54. Do I have to let faculty choose the date of the in-class administration? It was very
difficult to accommodate the faculty requests and then find staff to administer the
surveys.
No. The Scheduling Letter, available on the SENSE Members Only Website, may be altered to
provide faculty with a choice of pre-determined dates for survey administration.
55. Can we let faculty administer the surveys themselves?
We recommend that faculty do not survey their own class as the survey is designed to capture
students’ experiences at the college as a whole—rather than the experiences in a particular
course. However, the Center does not object to faculty members administering surveys to their
own class if necessary. It is imperative that the faculty member read the Survey Administration
Script to the class prior to distributing surveys to students and stress that the survey is about the
entire college experience, not about a particular class.
56. On the Class Information Sheet, what circle should we fill in if the survey is
administered by a faculty member who does not teach the course?
“Survey Administrator” rather than “Faculty” should be indicated. The “Faculty” option is for
situations in which a faculty member is administering the survey to his or her own class.
57. What should we do to accommodate special needs students?
Appropriate accommodations for special needs students should be arranged in advance of
survey administration and in accordance with standard practices at the college.
58. Do we need to have students complete the student ID section?
While collection of student identifiers is optional, colleges may collect this information for other
institutional research efforts. By collecting student identifiers, it may be possible for colleges to
link SENSE data with other institutional initiatives at the college.
59. How should students enter their student IDs on the survey?
Students should enter the identifier information from left to right with no spaces, dashes, or
other extraneous marks.
7
SENSE FAQs
60. Can we stop the survey administration process once we reach our target?
The Center asks that the college continue the administration process even after reaching its
target sample size as a college's membership fee covers administration of the entire sample.
Further, the more data collected, the more likely an institution will be able to "drill down" into its
results (e.g., more responses when performing subgroup analyses).
Completed Survey Returns
61. I have survey packets that I did not use. What should I do with them?
Unused materials should be recycled. Please only send completed surveys, along with their
corresponding Class Information Sheet, in the original course envelopes in which they were
sent, back to the Center.
62. We have misplaced a Class Information Sheet. What should we do?
A PDF version of the Class Information Sheet is available on the SENSE Members Only
Website. Print the PDF, complete the course information section (available on the outside of the
course packet envelope), and have the Survey Administrator complete and sign the sheet
during in-class survey administration. If the surveys have already been administered, complete
the course information section and ask the Survey Administrator to sign the sheet indicating that
he or she read the Survey Administration Script to the class.
63. Our Survey Administrator did not sign the Class Information Sheet. What should we
do?
Since the signature verifies that the Survey Administration Script was read to survey
respondents, please make every effort to have the form signed by the Survey Administrator.
64. How do we return completed surveys to the Center?
Discard/recycle any unused pencils, surveys, Special-Focus Modules and Survey
Administration Scripts. Return completed surveys and Class Information Sheets to their original
corresponding course envelopes. If an envelope has been misplaced, please create a new
envelope and clearly write the appropriate course information on the outside of the envelope.
Pack the surveys carefully using packing material to fill any empty space not used by the
packets themselves. Do not use Styrofoam materials when packing completed surveys as
this creates static electricity that interferes with the scanning process. Affix one return
label and one neon address label to each box. Once the box is securely taped and ready to
ship, contact UPS (or DHL if shipping internationally) to schedule a pickup. Be sure to record
the tracking numbers from the return label and notify the SENSE Liaison when a box has been
shipped.
65. What should we do if we run out of UPS return labels?
Contact the SENSE Liaison, and he or she will provide more return labels via e-mail.
66. If envelopes are not already sealed, can we just leave them unsealed when we pack
them?
Yes.
67. What is the deadline for returning completed surveys to the Center?
Completed surveys must arrive at the Center by no later than Friday, November 11. Shipments
post-marked on November 11 will not be accepted. Surveys must be physically received by the
close of business on November 11.
8
SENSE FAQs
68. How are survey results presented to our college?
Institutional reports will be provided electronically via the SENSE online reporting system. The
college president will also receive multiple print copies of a customized Key Findings booklet.
9
Download