Queensborough Community College
DEPARTMENT:
Non-teaching Department
OIRA
July 2014
2013-2014 ACADEMIC YEAR
MISSION
The Office of Institutional Research and Assessment supports academic and institutional planning and
assessment, student affairs, sponsored programs, pedagogic research, strategic planning, and other
administrative functions of Queensborough Community College by providing information for decision
making and planning. The office conducts quantitative and qualitative research and evaluation studies for
assessing institutional effectiveness, student support initiatives and interventions, program evaluation, and
student learning outcomes. The office monitors the college-going needs, academic progress, and success
of students. The Institutional Research and Assessment Office also routinely gathers, analyzes, and
reports information required by the City University of New York, federal, state, and accrediting agencies.
The Institutional Research staff regularly collaborates with administrators, faculty, and staff about
research design, instrument development, data analysis, and other related research topics.
A. DEPARTMENT CORE ACTIVITIES AND PERFORMANCE
Core Activities
Key Performance Indicators
Indicators to Be Assessed
Briefly list the major activities
conducted or performed to
support the mission of the
department.
Briefly list the corresponding Key Performance
Indicators (KPIs) that measure the effectiveness of
the department’s activity. Key performance
indicators are not outcomes—for example, a KPI
might be “volume of service,” whereas an outcome
might be “increase volume of service by 5
percent”).
Yes or no. Indicators to be assessed should come from
the previous year’s report, part F, column 4.
Planning and
execution of the
Queensborough
Academies
Assessment Protocol
Freshmen Experience Survey
Assessment planning, execution, and
reports of all key performance
indicators in collaboration with the
strategic planning teams for the
Academies and the HIPs.
High Impact Practices (HIP)
Assessment
General Education Critical Courses
Analysis (Roadblock Analysis)
Participate in the Strategic Planning
of the Academies and the Academies
Assessment Protocol
Year-end comprehensive report of the
protocol findings
Starfish Early Alert
and Connect Reports
and Analyses
Participate in the planning and
execution of High Impact Practices
assessment as member of the HIP
Assessment Team
Provide usage reports and course
grades for the Academic Learning
Centers.
Work with the learning center, the
Starfish Team, and the Office of
Academic Affairs to agree on a standard
report to the Academic Learning
Centers on the Use of Starfish Retention
Solutions Connect data. Provide such
reports at the end of the academic year.
1
Queensborough Community College
Non-teaching Department
Academic impact analyses of Early
Alert on course pass rates, completion
rates, and withdrawal rates.
Evaluation of
academic programs
and interventions,
assist with Strategic
Planning
Attend Starfish Team meetings and
assist the team with reports as needed.
Program Review data packets and
assistance
July 2014
A standard report on the impact of Early
Alert on campus-wide course pass rates,
completion rates, and withdrawal rates.
Programs under review in 2014-15: CJAS, SF-AS, ME-AAS, EM-AAS, ENCERT
Report on remediation and remedial
needs and outcomes as needed
Assist with the assessment needs as
requested by VP for Academic Affairs
and the VP for Strategic Planning,
Assessment, and Institutional
Effectiveness
CUNY Justice Academy data report
Provide QCC specific data to enable the
collaboration of the CUNY Justice
Academy.
Assist in the strategic planning goals
and completion reports
Assist the College Advisory Planning
Committee and Dean Dr. Arthur
Corradetti in the strategic planning,
PMP, and completion report process
with data reports as needed.
Update incoming student data set and
predictive analytics for newer cohorts.
Monitoring of
retention and
graduation rates and
the analysis of
institutional
effectiveness in
general
Retention and graduation predictive
analytics
Assist the Retention Task Force with
analytical work as needed.
In-depth analysis of the drop-out survey
results, the academic performance or
readmits and probation students, and
assist with the reverse transfer project.
Measure the
outcomes of QCC
graduates
Annual recent graduate survey
Work on these assessment activities in
order to better understand the transfer
and career success and outcomes of
QCC graduates. Findings from one
assessment activity (e.g. the labor data)
may inform another assessment activity
(e.g. survey).
Transfer Out counts and reports
Senior College academic performance
analysis of recent transfers
Labor data analysis
Dissemination of
useful and current
information to the
college community
and the public.
Economic impact analysis of QCC
education
Internal reports on recent trends in
enrollment, retention, graduation, and
other institutional effectiveness
measures
Brief and timely reports for the college
community on recent trends based on
new fall 14 enrollment – small excerpts
of the larger Fact Book
2
Queensborough Community College
Publications,
presentations, and
external and internal
data reporting
Non-teaching Department
Fact Book and Fast Facts
Program Dashboards
Annual reports to MSCHE, Nursing,
Technology & Engineering, Business,
and Art accreditation agencies
July 2014
Ongoing effort to enable the College
and all constituencies (internal and
external) to understand the scope of
program specific and campus-wide
student enrollment, performance, and
outcomes.
Presentations at the Assessment
Institute
Support and services
for the departments,
faculty,
administrators, and
student services
Collaborate with AACU/Roadmap
school
Support enrollment management and
prediction
Assist the Veteran Affairs Office with
data reports for internal and external
reporting
Collaborate with the Office of the
Registrar, the Admissions Office, and
the Budget and Financial Services
Office during enrollment and reporting
periods.
Provide data reports, analytical work,
and service in all areas as needed.
Reports to the VP for Student Affairs,
Academies Advisement, and the
various Student Services Offices.
Institutional Review Board service for
QCC and CUNY- wide manuscript
submissions and IRB assistance on
campus
Support Sponsored
Programs
Large incoming requests and ad hoc
requests from departments, faculty,
and administrators.
Sponsored Program Office
application and reporting needs
Perkins grant reports and institutional
profile
Data reports in collaboration with the
Office of Sponsored Programs and the
PIs. Continue support by providing data
on students and programs related to
grant funded activities and grant
proposals.
Support faculty with individual grant
proposal and reports
Support CUNY wide
assessment efforts
including SAM
(Student
Achievement
Gates Foundation IPAS grant reports
Noel Levitz and Student Experience
Survey implementation and reporting
on campus
Enable the College to participate in
CUNY wide assessment efforts as
scheduled by CUNY.
Coordination of the Recent Graduate
Communicate to and collaborate with
3
Queensborough Community College
Measure)
Non-teaching Department
Survey
July 2014
CUNY central on QCC specific
reporting and assessment needs.
SAM (Student Achievement
Measure) participation
Stay current with
CUNY wide research
activities and
discussions
Stay informed about
topics in Higher
Education and issues
specifically important
to Community
Colleges nationwide
Increase the research
capacity of the office
B.
Attend all CUNY wide OIRA related
meetings and events when
appropriate.
Participate in IR Council, WIKI, and
list serve. Attend CUNY wide events
related to IR and education policy
research
Review literature, news, and attend
and participate in workshops and
conferences
Hire an additional full-time research
analyst
Continue to participate in IR Council,
WIKI, and list serve. Attend CUNY
wide events related to IR and education
policy research. Be an informed and
active participating IR office in CUNY
wide discussions, research, and policy
implementation.
Share literature reviews, news articles,
and participate in workshops and
conferences. Be aware of latest
developments in higher education
research and assessment.
Propose the creation of an additional
full-time senior research analyst for the
office. Meet the increased demand for
assessment and research especially with
surveys, statistical analyses, and
reporting on the outcomes of Early Alert
and other interventions.
DEPARTMENT-SPONSORED ACTIVITIES, 2013-2014
Type of Activity and Topic
Presentation at the Fall 2013 Assessment Institute
IR presentation at CETL: “Using institutional research
data to identify pedagogical trends, projects, and
questions”. Part of the CETL series: Campus based
partnerships in Pedagogical Research
Campus Conversation Event: Presented together with
Brian Kerr and Karen Steele on changes to the
Academies Assessment Protocol
Team presentations and workshops at Monroe
Community College together with Jane E Hindman,
Brian Kerr, Natalie Roopchand, Susan Madera, Gail
Patterson, Alex Tarasko.
Office of Institutional Research and Assessment
Presentation at the New Faculty Institute
HETS conference in Puerto Rico: Presented together
Organized,
Presented, or
Both
Presented
Date
Number
Attending
October 4th,
2013
October,
2013
EL, VF
Presented
October
23rd, 2013
VF
Presented and
conducted
workshops
November
10-11,
2013
VF
Presented
January 16,
2014
January
EL, VF
Presented
Presented
VF
EL
4
Queensborough Community College
Non-teaching Department
with Dr. Paul Marchese and Dr. Margot Edlin and
Research Analyst Hamadi Henderson on the Starfish
Early Alert intervention and outcomes analysis
Presentation at the Spring 2014 Assessment Institute
CUE Conference: Presented on the scaling up of the
High Impact Practices and the assessment efforts of
the High Impact Practices together with Mrs.
Josephine Pantaleo, Dr. Jane Hindman, Mrs. Arlene
Kemmerer, and Mrs. Cristina DiMeo
CUNY IR and Assessment Retreat Presentation on the
QCC Starfish Early Alert intervention and research
July 2014
2014
Presented
VF
Presented
March 7,
2014
May, 2014
Presented
June, 2013
EL
EL
C. INDIVIDUAL ACTIVITIES/ACHIEVEMENTS OF DEPARTMENT’S
ADMINISTRATIVE STAFF, 2013-2014
Name
Elisabeth Lackner
together with
Margot Edlin and
Jane Hindman
Elisabeth Lackner
together with
Michele Como, the
Academic Affairs
Office, Sponsored
Programs, and IT
Achievement type (from
menu)
CUNY Grant awarded
for the evaluation of the
QCC Student Support
Network
Citation
Semester
Grant work
continued
throughout
the AY
2013-2014
April 1,
2013 –
May 31,
2015
Bill and Melinda Gates
Grant awarded for the
Integrated Planning and
Advising Services with
Starfish
D. DEPARTMENT CHANGES, 2013-2014
Type (from
menu)
Description of
Change
Reason for Change
Date/Semester
Evaluation of
Change*
5
Queensborough Community College
Personnel
Search for a
Research Analyst
position was
conducted
Personnel
The College
Assistant Cynthia
Wach left the Office
of Institutional
Research and
Assessment with the
end of November
2013.
A search for a
College Assistant
(replacement for Ms.
Wach) was
conducted in Spring
2014
Personnel
Non-teaching Department
July 2014
The office has
May 2014
expanded research
activities and need
more research
personnel.
Mrs. Wenmey Ting
was chosen for the
position from a pool
of interviewed
candidates in May
2014. She had
previously held a
substitute position.
De facto the office
did not add an
additional line but the
office assistant line
was converted into an
aHEO Research
Analyst line.
Ms. Wach was
December
offered a full-time
2013
research analyst
position at Baruch
College.
NA
Mr. Patrick Wynne
was chosen from a
pool of interviewed
candidates and hired
on April 2nd 2014
NA
Spring
semester 2014
NA
6
Queensborough Community College
Services
The office is
conducting and
monitoring grant
funded research
activities
Non-teaching Department
The office was
actively involved in
proposing and
receiving grants to
analyze and monitor
the Early Alert
systems – both the
SSN and the Starfish
Retention Solution.
The Director
Elisabeth Lackner
was actively involved
in the research
activities and
supervised three parttime analysts that
were funded through
the grant money
through June 2014.
July 2014
Throughout the NA
Academic
Year 20132014
*Please note that, if change has been too recent to evaluate, you may indicate NA.
E. ASSESSMENT AND EVALUATION, 2013-2014
Key Performance
Indicator*
Target outcome(s)
for Key Performance
Indicator**
Actual outcome(s)
Recommended
action plan
Recommen
ded status
of Core
Activity
and KPI
(see menu)
Assist in the
evaluation and
assessment of
existing academic
initiatives and
programs and the
proposal of new
ones.
Assist the Academic
Affairs office and the
College
Administration in
making informed
decisions on existing
and new initiatives.
Collaborate closely
with the VP for
Academic Affairs and
the VP for Institutional
Effectiveness and
Assessment
AY 2013-2014: Assist
the Starfish Planning
Committee and the
College with Starfish
Early Alert reporting
and analysis.
Continue to work
with the Office of
Academic Affairs
and IT to generate
meaningful and
timely reports on
Starfish Early
Alert and Connect.
Develop yearly
Starfish Connect
reports to the
Academic
Learning Centers.
Streamline
reporting
on Starfish
activities in
a team with
OAA and
IT
CUNY Justice
Academy data
Coordinate
with the
February 2014: Power
Point presentation and
document for the
IPAS (Starfish Early
Alert Gates Grant)
related visit by PAR
Framework (Gates
Grant side visit)
February, 2014: Data
report and Power
7
Queensborough Community College
Non-teaching Department
July 2014
Point document on
the Justice Academy
programs at QCC for
the CUNY Justice
Academy Summit
reports will be
annually
OAA on
this annual
request.
Fall 2013 and Spring
2014: Assist the
department of Speech
Communication &
Theatre in their
efforts to acquire
accreditation for a
new Theatre degree
program.
Sub-plan data in
CUNYfirst is not
complete mostly
because students
were not mandated
to declare a subplan. Moving
forward the data
should be more
complete when
students are
required to declare
a sub-plan under
CUNY Pathways.
In the AY
2014-15 the
Music and
Dance
programs
will also
put forward
accreditatio
n requests
and will
need the
assistance
of OIRA.
Spring 2014: Online
course counts and
historical trends.
Spring 2014: Assist
with the PRR
specifically on the
historical description
of the Academies.
Spring 2014: Report
on Transfer Out
students to the Senior
Director of
Articulation, Transfer
& Educational
Partnerships
June 2014: Reported
to the President and
the Cabinet on recent
trends in the areas of
student progress and
institutional
effectiveness.
Provide
information to
program review
Enable program review
committees to
understand the
program specific
Summer 2013:
Created data
packets for the
following programs:
Transfer Out
reports of
graduates and
college drop-outs
are produced
annually.
Report included
findings for
several studies
conducted by the
OIRA in the areas
of Freshmen year,
persistence
through college,
and outcomes
such as transfer
and career
outcomes.
Data packets will
be modified for
2014-2015. Some
tables will be
Additional
analysis of
the senior
college
academic
performanc
e of
transfers to
senior
colleges
will be a
focus of the
OIRA work
in the AY
2014-2015.
Continue
8
Queensborough Community College
Non-teaching Department
committees that
will aid the review
process. Produce
the standard data
packets and
include chapters
that summarize the
information the
data presents. Be
available for
departmental
meetings.
student and faculty
demographics,
enrollment trends, and
program specific and
institutional
effectiveness measures
in order for the
committee to come to
informed conclusions
and recommendations
FA-AS, DA-AAS,
DD-AAS, AP-Cert,
AM-AS and TCAAS.
Fall 2013: Attended
review committee
meetings and assisted
with follow up
questions and
summary of data sets.
Continue the Fact
Book process.
Collaborate with
the Marketing
department to
develop a plan to
increase the
availability of
reports internally
(password
protected) and
information
highlights to the
public.
Update the OIRA
website.
Provide institutional
data for the entire
college community and
for the public.
Fact Book 2013-2014
was published.
A QCC Five Year
Trends in Enrollment,
Remedial Needs, and
Retention and
Graduation was
published and
distributed widely in
March 2014.
The OIRA website
was updated. It now
includes updated
documents under the
Assessment page on
the new Academies
Assessment Protocol,
the Transfer Out rates
of QCC graduates,
and the program
review data packets.
The OIRA website
now also includes
Starfish Reports,
updated program
dashboards, and past
Fact Books.
The OIRA assisted
with the development
of several Marketing
publications including
the Fast Facts,
Advancement
brochures and
economic impact
figures.
July 2014
removed to avoid
un-necessary
duplication.
Review
committees will
have additional
time moving
forward to review
the program and
will be encouraged
to ask for
customized data
reports as needed.
Continue to
Continue
collaborate with
the Marketing
department to
enhance OIRA
and college
publications.
A password
protected area has
not yet been
created.
Work with the
Office of
Academic Affairs
to distribute
relevant data to
departments and
centers either via a
password
protected area on
the OIRA website
or via interoffice
publications.
9
Queensborough Community College
Work closely with
Academic Affairs,
Student Affairs,
and CETL, to
administer and
refine the
assessment
protocol and to
assess the goals
established by the
Academies review
committee;
Increased
understanding of
the benefits of a
case load model of
advising (The
Academies) and
high impact
practices in
courses;
In collaboration
with the Retention
Management Task
Force develop a
data analyses plan
and an outreach
initiative (through
surveys or
Conduct the following
assessment:
- Freshman
Experience
Survey
- HIP Survey
- Assessment of
Starfish Early
Alert
- Critical Course
Analysis
Generated a
comprehensive report
of the results from the
assessment activities as
they relate to the
Academies outcomes.
Gather data and
information that will
aid the Task Force to
better understand
student attrition,
retention, persistence,
and graduation rates.
Non-teaching Department
Fall 2013: Both
surveys were
administered. Spring
2014: Results were
analyzed.
The assessment of the
Starfish Early Alert
intervention was an
ongoing year-round
project. Results of the
usage and
effectiveness of Early
Alert were included in
the Academies
Assessment Protocol
Report.
OIRA conducted a
comprehensive course
grade analysis and
reported on courses
with high failure
rates.
The Academies
Assessment Protocol
Report of Findings
2013-2014 was
written over the
summer 2014.
The following actions
were undertaken in
the AY 2013-2014:
Fall 2013: OIRA
assisted in the data
analysis of Academic
Alert
July 2014
All Academies
assessment
activities of the
OIRA office were
administered and
the results
communicated to
the VP for
Strategic
Planning,
Assessment, and
Institutional
Effectiveness.
Continue
The protocol will
be reviewed in the
coming year and
modification may
be made as the
VPs and
committee see fit.
The surveys found
that freshmen are
not as familiar
with their
Academy
Advisers as the
caseload model
might suggest. In
the survey
feedback, students
perceived the HIP
as beneficial for
communication
and learning
skills;
Early Alert in
combination with
tutoring benefits
students, in
particular those
who are at risk.
OIRA will
continue to assist
the Retention
Management Task
Force.
In early Fall 2014
the results from
the QCC Drop Out
Continue
10
Queensborough Community College
otherwise) to
students to better
understand
students’
motivations and
higher education
goals. Continue the
development of a
comprehensive
data set to aid
retention and
graduation
analyses.
The goal is an
increased
understanding of
student persistence
rates and
graduation rates.
In collaboration
with CUNY, the
Academic Affairs
office, and student
support offices
develop and
administer surveys
via paper surveys
or survey monkey.
Obtain feedback
from students,
faculty, and/or
staff on a variety
of initiatives and
programs as
needed.
Non-teaching Department
Fall 2013/Spring
2014: OIRA assisted
in the Reverse
Transfer Project
July 2014
survey and
additional
predictive
analytics will be
presented to the
Task Force.
Winter 2014: OIRA
conducted a student
success analysis of
readmitted students
Fall 2013: OIRA
developed a New
Student Dataset and
conducted predictive
analytics to predict
retention.
Obtain feedback as
needed for internal and
system-wide
evaluation
Fall 2013 and Spring
2014: OIRA
developed and ran a
QCC drop out survey.
The results of the
survey were presented
at the Task Force
meetings and are
analyst in summer
2014.
In the AY 2013-2014,
the following surveys
were administered by
the QCC OIRA:
QCC Drop Out
Survey, Spring 2014
Early Alert Faculty
Survey, Fall 2013
Early Alert Student
Survey Fall 2013,
Spring 2014
All surveys were
conducted to assist
in the evaluation
and assessment of
student
interventions and
institutional
effectiveness.
Survey activities
will continue to be
a core activity of
the OIRA.
Continue
Recent Graduate
Survey, Fall 2013
(CUNY wide and
QCC)
Freshman Experience
Survey, Fall 2013
11
Queensborough Community College
Non-teaching Department
July 2014
High Impact Practices
Student Survey, Fall
2013
CUNY also
conducted the Student
Experience Survey in
Spring 2014
In the AY 2013-2014
the OIRA assisted the
Sponsored Programs
Office and individual
faculty with the
following:
Data reports in
collaboration with
the Office of
Sponsored
Programs and the
PIs. Continue
support by
providing data on
students and
programs related
to grant funded
activities and grant
proposals.
Fall 2013: Teagle
Grant application
support
February, 2014: Title
II application
The Office of
Continue
Sponsored
Programs
underwent
personnel changes.
However,
supporting the
office with data
reports as needed
is still a core
activity of the
OIRA.
May 2014: NSF
STEP data report for
Prof. Paris Svoronos
May – June, 2014
Bridge Grant related
data reports for Prof.
Pat Schneider
Comply with
accreditation
requirements, Title
III and V
requirements.
Collaborate with
CUNY central and
other IR directors
to develop a
standard format of
reporting to the
Volunteer
Framework of
Accountability
(VFA) consortium.
QCC complies with all
mandatory external
data requests.
Perkins Grant data
reports
See above;
April 2014: Middle
States Commission on
Higher Education
(MSCHE)
Institutional Profile
Report;
The participation
with the Volunteer
Framework of
Accountability
(VFA) consortium
in the future is
unclear.
Continue
Perkins IV
Application
Institutional Profile
Report, May 2014;
Assist with the yearly
report to the
Accreditation
Commission for
12
Queensborough Community College
Non-teaching Department
July 2014
Education in Nursing;
Assist with the report
to ETAC of ABET;
Assist the Business
department with data;
Collaborate with
faculty and
department chairs
on data reports as
needed. Be open
for ad-hoc requests
that aid the support
of curricular
decisions.
Enable academic
departments to make
informed decisions.
CUNY Central did
not continue to pursue
participation in the
Volunteer Framework
of Accountability
(VFA) consortium in
the Academic Year
2013-14
Data reports for the
Mathematics and
Computer Science
department:
(MA 440 data; MA
120/119 data;
Biology 310 and
Math courses;
CJ majors in math
courses; data for Prof.
Michael Guy’s
research project;)
Continue
Report for ASAP on
ASAP students in MA
119 courses;
English department:
EN 101 performance
based on High School
scores, Regent scores,
and remedial needs
Academic Literacy
department:
Demographic data for
students in BE
courses;
Speech
Communication
Theatre department:
Language Spoken at
Home and Country of
Birth data for SP 211
13
Queensborough Community College
Non-teaching Department
July 2014
students;
Collaborate with
student services
and the student
affairs office on
data reports as
needed.
Communicate
findings relating to
student services
and advising as we
continue our
analyses of the
effects of Early
Alert and Starfish.
Enable the student
affairs office and
the student
services to make
informed
decisions.
Data report on the
Criminal Justice
program
January 2014: Data
on QCC Graduates
with a Certificate for
the Financial Aid
Office
Continue
Fall 2013: Assist Jean
Amaral with the
Library’s Tech and
Library Survey
Assist with the data
analysis of College
Discovery students
AY 2013-2014:
Learning Center
Starfish data reports:
Early Alert analysis
revealed that students
who received a
referral in addition or
instead of a flag alone
are more likely to
receive tutoring.
Tutoring has a
positive effect on
course grades.
Fall 2013: Alumni
Association Survey
Fall 2013: The
Freshman Experience
Survey informed
student services on
the following levels:
Student attendance at
orientations/events
and utilization of
student support
services, student
qualitative feedback
on their reasons for
non-attendance/
utilization, and
14
Queensborough Community College
Non-teaching Department
July 2014
student perspectives
on the helpfulness of
various student
support services
including the
Academic Advisers.
Continue the
CUNY grant
funded research as
outlined in the
grant documents.
Include additional
analyses of
Starfish data.
Understand the
impact and
benefits early
interventions and
case load model of
advising.
Conduct additional
qualitative and
quantitative research
on the use and
effectiveness of the
Early Alert system in
the AY 2013-2014 and
develop a
comprehensive report.
Continue to
participate in IR
Council, WIKI,
and list serve.
Attend CUNY
wide events related
to IR and
education policy
research.
Be an informed and
active participating IR
office in CUNY wide
discussions, research,
and policy
implementation.
Share literature
reviews, news
articles, and
Be aware of latest
developments in higher
education research and
AY 2013-2014: Assist
the Veteran Affairs
office with various
data reports on
veterans for internal
and external
reporting.
OIRA supervised
additional part-time
analysts hired with
the CUNY Student
Success Grant who
with the guidance of
Elisabeth Lackner
conducted data
analyses and surveys
throughout the AY
2013-2014. A
comprehensive report
was drafted
throughout the spring
2014 and is being
finalized throughout
the summer 2014.
Results from the
analyses are discussed
and recommendations
to the faculty and
administrators will be
forthcoming.
Elisabeth Lackner
participated in the IR
Council, WIKI and
list serve thorough the
year. She presented
on the QCC’s Early
Alert intervention at
the CUNY IR
Assessment Joint
Retreat in June 2014.
Elisabeth Lackner
attended and
presented at the CUE
The OIRA will
continue to
conduct analytical
data reports on the
Early Alert
intervention on a
smaller scale in
the AY 20142015.
IT will generate a
standard report to
the president on
the usage of the
Starfish Early
Alert and Connect
on a regular basis
as needed;
The OIRA will
generate yearly
reports to the
Academic
Learning Centers.
Continue
Elisabeth Lackner
and other
members of the
OIRA will
continue to
participate in
CUNY wide
events and IR
council activities
Continue
Elisabeth Lackner
and other
members of the
The OIRA
should
make it a
15
Queensborough Community College
Non-teaching Department
participate in
workshops and
conferences.
assessment.
conference 2014. She
reviewed literature in
connection to Early
Alert as well as
general education
assessment and the
assessment of High
Impact Practices.
Propose the
creation of a fulltime position for
the office to be
filled by a research
analyst. Meet the
increased demand
for assessment and
research especially
with surveys and
statistical analyses;
Enable high quality,
professional, and
timely work of the
Office of Institutional
Research and
Assessment.
A fourth full-time
position was not
allocated for the AY
2013-2014. However,
the office assistant
line was converted
into an aHEO
Research Analyst
position.
July 2014
office plan to
attend the fall
2014 NEAIR
conference.
priority to
set time
aside for
staff
developme
Time for the
nt and
review of news
review of
articles and
relevant
literature is limited new
due to an
developme
overwhelming
nts in the
amount of regular area of
and ad hoc
higher
analytical work
education.
and reports. The
work of the OIRA
has expanded even
more with the
enhanced
assessment efforts
through the
Academies
Assessment
Protocol,
additional HIP
assessment, and
the Starfish Early
Alert and Connect
activities.
For the AY 20142015 a new Senior
Director position
was created for
Institutional
Research,
Strategic Planning
and Market
Analysis;
The office also
needs an
additional fulltime senior
research analyst
position.
Notes:
*The items in this column correspond to “indicators to be assessed” in part A, column 3.
**To be more effective and meaningful, assessment efforts should focus on selected KPIs each academic year; over time, assessments should be
rotated through all the department’s KPIs.
16
Queensborough Community College
Non-teaching Department
July 2014
F. ASSESSMENT PLAN FOR NEW YEAR, 2014-2015
Core Activity
(New Year)
Key Performance
Indicator
(New Year)
Participate in the
planning and
carrying out of
the
Queensborough
Academies
Assessment
Protocol
Ensure that the
effects and outcomes
of the various
components of the
Queensborough
Academies are
monitored and
assessed.
Target
Outcome(s)*
Divisional
Head
Approval
Freshmen
Experience Survey
The Principle
Investigator of the
Academies, Dr.
High Impact
Victor Fichera will
Practices (HIP)
conduct the surveys
Assessment
and other
assessment activities
General Education
under the
Critical Courses
supervision of the
Analysis (Roadblock Director Elisabeth
Analysis)
Lackner and with
the input from the
Participate in the
Academies Strategic
Strategic Planning
Planning Committee
of the Academies
and the HIP
and the Academies
Assessment Team.
Assessment Protocol
Write a
comprehensive
report of the
protocol findings
Starfish Early
Alert and
Connect Reports
and Analyses
Plan for Achieving
Target Outcome
Participate in the
planning and
execution of High
Impact Practices
assessment as
member of the HIP
Assessment Team
Monitor and assess
Provide usage
the use and effects of reports and course
Starfish Early Alert
grades for the
and Connect.
Academic Learning
Analyze the impact
Centers.
on student
performance and
Dr. Fichera will
draft a
comprehensive
report of all findings
at the end of the AY
2014-15. The
Director Elisabeth
Lackner and the
Vice President Dr.
Karen Steele will
review and edit the
report as needed.
The Director
Elisabeth Lackner
and Dr. Victor
Fichera will
participate in the
HIP Assessment
Team as needed.
Coordinate and
collaborate with the
Office of Academic
Affairs, the
Academic Learning
Centers, the Starfish
Implementation
17
Queensborough Community College
Non-teaching Department
institutional
effectiveness
July 2014
Team, and with IT.
Agree on a standard
report year-end
report for all
learning centers.
Academic impact
analyses of Early
Alert on course pass
rates, completion
rates, and
withdrawal rates.
Evaluation of
academic
programs and
interventions,
assist with
Strategic
Planning
Assist in the
evaluation and
assessment of
existing and
proposed academic
programs and
College initiatives.
Assist the College in
making informed
decisions.
The Director
Elisabeth Lackner
will develop a plan
of regular analytical
reporting on
Starfish. Mr. Patrick
Wynne will assist in
Attend Starfish
the implementation
Team meetings and
of the analyses and
assist the team with
reports under the
reports as needed.
supervision of
Elisabeth Lackner.
Program Review
Under the
data packets and
supervision of the
assistance (Programs Director Elisabeth
under review in
Lackner the
2014-15: CJ-AS,
Research Analyst
SF-AS, ME-AAS,
Mrs. Wenmey Ting
EM-AAS, ENand the College
CERT
Assistant Patrick
Wynne will generate
program review data
packets over the
summer 2014.
Elisabeth Lackner
will meet with all
the review
committees and
discuss the data, and
offer additional
support as needed.
Report on
remediation and
remedial efforts as
needed
Reports and
analytics for
remediation and
remedial program
changes and effects
will be developed
and conducted
according to the
recommendations
from the VP of
Strategic Planning,
Assessment, and
Institutional
18
Queensborough Community College
Non-teaching Department
July 2014
Effectiveness
Monitoring of
retention and
graduation rates
and the analysis
of institutional
effectiveness in
general
Enable the College
to better understand
the trends of
retention,
graduation, and
other institutional
effectiveness
measures. Perform
predictive analytics
to better understand
reasons for attrition
CUNY Justice
Academy data report
Mrs. Wenmey Ting
will prepare the
annual data report
and presentation for
the CUNY Justice
transfer programs
under the
supervision of
Elisabeth Lackner
Assist in the
strategic planning
goals and
completion reports
The Office will
assist Dean Dr.
Arthur Corradetti in
the strategic
planning, PMP, and
completion report
process as needed.
Under the
supervision of the
Director Elisabeth
Lackner the College
Assistant Patrick
Wynne will continue
to add data to the
Incoming Student
dataset. Predictive
analytics will be
performed by
Elisabeth Lackner
with assistance from
Mr. Patrick Wynne.
Retention and
graduation
predictive analytics
QCC Drop Out
Survey: A deeper
analysis of the
findings from the
survey and the
college career paths
of recent drop outs
will be performed
Director Elisabeth
Lackner will guide
Mr. Patrick Wynne
to query the college
career paths of the
survey respondents.
The association
between survey
feedback and drop
outs’ college career
path will be
explored in fall
2014. Results will
be communicated to
the VPs for SPAIE
and OAA and the
19
Queensborough Community College
Non-teaching Department
July 2014
Retention Task
Force
Measure the
Outcomes of
QCC Graduates
Enable the College
to understand the
value of education to
our graduates
Assist the Retention
Task Force with
analytical work as
needed (Probation
workshop
attendance,
academic
performance of
readmits and
probation students,
reverse transfer
project etc.)
Recent Graduate
Survey
Transfer Out counts
and reports
The Director
Elisabeth Lackner
will advise the Task
Force in analytical
methods and
relevant data
availability.
Senior college
academic
performance
analysis of recent
transfers
Director Elisabeth
Lackner will
develop and
coordinate an
assessment plan
with Dr. Brian Kerr,
Senior Director of
Articulation,
Transfer &
Educational
Partnerships and VP
Karen Steele.
Labor data analysis
Director Elisabeth
Lackner will further
explore the use of
the NYS labor data.
Economic impact of
QCC education
Director Elisabeth
Lackner will
Under the
supervision of the
Director Elisabeth
Lackner, Mrs.
Wenmey Ting will
conduct the annual
online Recent
Graduate Survey
with the
SurveyMonkey
software.
Mrs. Elisabeth
Lackner will write
the final report.
20
Queensborough Community College
Publications,
presentations,
and external and
internal data
reporting
Enable the College
and all
constituencies to
understand the scope
of student
enrollment,
performance, and
outcomes. Present to
the college
community and the
public at large
important findings of
institutional
effectiveness and
achievements
Non-teaching Department
Internal reports on
recent trends in
enrollment,
retention,
graduation, and
other institutional
effectiveness
measures
Fact Book and Fast
Facts
July 2014
research possible
approaches of
economic impact
analysis. The newly
hired Senior
Director will
develop a
comprehensive
economic impact
analysis
Create brief and
timely reports for
the college
community on
recent trends based
on new fall 14
enrollment – small
excerpts of the
larger Fact Book in
collaboration with
VP Dr. Steele.
The Fact Book is a
yearly publication of
the Office. All team
members are
involved in the
production of the
Fact Book.
Fast Facts are
generated in
collaboration with
the Marketing
Department and
serve the need to
communicate quick
and easy to
understand facts to
the Public.
Program Dashboards Mrs. Wenmey Ting
creates Program
Dashboards based
on the latest fall
census data. They
are summary fact
tables for each
21
Queensborough Community College
Non-teaching Department
July 2014
academic program
and are displayed on
the OIRA website.
Support and
services for the
departments,
faculty,
administrators,
and student
services
Annual reports to
MSCHE, Nursing,
Technology &
Engineering,
Business, and Art
accreditation
agencies
Director Elisabeth
Lackner will
coordinate
accreditation
agencies reporting
needs and direct
OIRA staff to gather
data and report as
needed.
Presentations at the
Assessment Institute
Dr. Victor Fichera
will present on
OIRA as a resource
for assessment at the
fall and spring
assessment
institutes.
Collaborate with
AACU/Roadmap
school
Dr. Victor Fichera
will answer any data
requests related to
AACU and
Roadmap school
Under the guidance
of Director Elisabeth
Lackner the Office
of Institutional
Research works
closely with the
Office of the
Registrar, the
Admissions Office,
and the Budget and
Financial Services
Office during
enrollment and
reporting periods.
Enable all
Support enrollment
departments and
management and
offices to make
prediction
informed decisions
based on information
gathered by OIRA.
Assist the Veteran
Affairs Office with
data reports for
internal and external
reporting
Mrs. Wenmey Ting
is coordinating all
data queries and
reports for the
Veteran Affairs
Office.
Reports to the VP
for Student Affairs,
Dr. Victor Fichera
will create
22
Queensborough Community College
Support
Sponsored
Programs
Non-teaching Department
Academies
Advisement, and the
various Student
Services Offices.
comprehensive
reports to the VP for
Student Affairs and
related offices based
on assessment
activities of the
Academies and
other related
assessment.
Institutional Review
Board service for
QCC and CUNYwide manuscript
submissions and
IRB assistance on
campus
Dr. Victor Fichera
serves as the IRB
representative as
needed.
Large incoming
requests and ad hoc
requests from
departments, faculty,
and administrators.
The Director will
review all requests
and directs staff to
work on them as
needed.
The Director
Elisabeth Lackner
will review all
incoming requests
and direct work as
follows:
Sponsored Program
Office application
and reporting needs
Dr. Victor Fichera
will work with the
Sponsored Program
Office to understand
all data needs and
query and report
data accordingly and
with the assistance
from Mr. Patrick
Wynne under the
supervision of
Elisabeth Lackner
Enable the College
to apply for grants
and report on
existing grants with
the most accurate
data required.
Perkins Grant
reports and
institutional profile
Support faculty with
individual grant
proposal and reports
July 2014
Mrs. Wenmey Ting
is responsible for
data reports to STEP
grants and Bridge
grants. Additional
incoming grant
related data requests
will be processed by
23
Queensborough Community College
Non-teaching Department
July 2014
Dr. Victor Fichera.
Gates Foundation
IPAS grant reports
Support CUNY
wide assessment
efforts including
SAM (Student
Achievement
Measure)
Enable the College
to participate in
CUNY wide
assessment efforts.
Noel Levitz and
Student Experience
Survey
implementation and
reporting on campus
Mr. Patrick Wynne
will report data for
the Gates
Foundation IPAS to
Dr. Margot Edlin
under the guidance
of Elisabeth
Lackner.
The Director
Elisabeth Lackner
will be functioning
as the point person
to coordinate the
QCC campus
implementation of
the Noel Levitz
Spring 2015 survey.
Patrick Wynne will
assist as needed.
Coordination of the
Recent Graduate
Survey
Mrs. Wenmey Ting
will coordinate the
timing of the survey
and will report all
responses gathered
by QCC (that were
not gathered by
CUNY central) to
CUNY OIRA.
SAM (Student
Achievement
Measure)
participation
The Director
Elisabeth Lackner
will function as the
point person for
CUNY central to
coordinate all QCC
specific reporting as
required by SAM.
Mr. Patrick Wynne
will assist in all data
needs.
Attend all CUNY
wide OIRA related
meetings and events
when appropriate.
The Director
Elisabeth Lackner
and other members
of OIRA will attend
regular meetings and
events as
appropriate.
24
Queensborough Community College
Non-teaching Department
Stay current
with CUNY
wide research
activities and
discussions
Enable the Office to
stay current with
CUNY wide
research activities
and discussions
Participate in IR
Council, WIKI, and
list serve. Attend
CUNY wide events
related to IR and
education policy
research
Stay informed
about topics in
Higher
Education and
issues
specifically
important to
Community
Colleges
nationwide
Enable the Office to
stay current with
methods and theories
in Institutional
Research and
Assessment.
Review literature,
news, and attend and
participate in
workshops and
conferences
July 2014
Continue to
participate in IR
Council, WIKI, and
list serve. Attend
CUNY wide events
related to IR and
education policy
research. Be an
informed and active
participating IR
office in CUNY
wide discussions,
research, and policy
implementation.
*Targets indicated here will direct assessment efforts for the following year – see part A, column 3.
25