Queensborough Community College
Non-teaching Department
DEPARTMENT: Institutional Research
July 2013
2012-2013 ACADEMIC YEAR
MISSION
The Office of Institutional Research and Assessment supports academic and institutional planning and
assessment, student affairs, sponsored programs, pedagogic research, strategic planning, and other
administrative functions of Queensborough Community College by providing information for decision
making and planning. The office conducts quantitative and qualitative research and evaluation studies for
assessing institutional effectiveness, student support initiatives, program evaluation, and student learning
outcomes. The office monitors the college-going needs, academic progress, and success of students.
The Institutional Research and Assessment Office also routinely gathers, analyzes, and reports
information required by the City University of New York, federal, state, and accrediting agencies. The
Institutional Research staff regularly collaborates with administrators, faculty, and staff about research
design, instrument development, data analysis, and other related research topics.
A. DEPARTMENT CORE ACTIVITIES AND PERFORMANCE
Core Activities
Key Performance Indicators
Indicators to Be Assessed
Briefly list the major activities
conducted or performed to
support the mission of the
department.
Briefly list the corresponding Key Performance
Indicators (KPIs) that measure the effectiveness of
the department’s activity. Key performance
indicators are not outcomes—for example, a KPI
might be “volume of service,” whereas an outcome
might be “increase volume of service by 5
percent”).
Yes or no. Indicators to be assessed should come from
the previous year’s report, part F, column 4.
Support of Academic
Planning and
Assessment initiated
by the Office of
Academic Affairs
Number of data analyses and reports
for the Academic Affairs Office
Assist in the Middle
States Periodic
Review Report
Assist in the organization of the
review process. Data analyses for the
Middle States Periodic Review
Report.
Number of data reports and analyses
for programs undergoing self-study
and review
Support and generate data
analyses and reports as needed
Collaborate with the
Academic Affairs office to generate a
comprehensive
data set on remediation
Generate a regular report on
remedial needs and
outcomes
Oversee statistical analyses
Collaborate with the Academic Affairs
Office and the Committee to understand
the need for data and data presentation
Program Review
support
Assessment of
college-wide strategic
planning goals and
PMP targets
Number of data reports in support of
the targets; attend strategic planning
events and working groups.
Summer 2012: Create data
packets for LA1&WE1, CT2,
ET2, MT2, TC2, and TX2
Present the data to the
self-study committees
Incorporate feedback and
additional requests into a
refined data packet
Provide data as needed by the strategic
planning committee and the Cabinet in
response to the PMP targets
1
Queensborough Community College
Non-teaching Department
Provide institutional
data for the college
communities
Yearly Factbook, Fact Sheet, and
Program Dashboards
Assessment of
Academies and High
Impact Practices
Research report on the effectiveness
of the Academies and High Impact
practices
College community presentations
Presentations outside QCC
Sponsored Programs
support
Reports for grant eligibility
Grant proposals
Number of Perkins grant reports
Number of Academic progress reports
on sponsored programs
Number of individual PI data requests
Number of reports to external
agencies including Middlestate,
Perkins, state and federal
Data analyses and reports to academic
departments
Provide institutional
data to external
agencies
Support Academic
departments
Support Student
Affairs
In-depth analysis of
the Early Alert
initiative
Monitor Transfer Out
Activities
Stay current with
CUNY wide research
activities and
discussions
July 2013
Public presentations of the
factbook and interesting
findings to the college
community
Gather and incorporate
feedback of the usability of
the factbook and the
factsheet for the upcoming
issue
Start the work on the
factbook and factsheet in
November 2012
Streamline analyses and
Reports of Academies and High Impact
Practices
Generate a comprehensive
data set for analytical
purposes
Collaborate with the
Sponsored Programs office
and individual PIs to
understand data needs
Generate reports and analyses as needed
Respond to external requests
Data analyses and data reports for
academic departments as needed
Data analyses and reports to Student
Affairs
Data analyses and data reports for
Student Affairs as needed.
Coordination and logistics of the
CUNY grant
Qualitative and quantitative research
on Early Alert
First reports to the college community
Standard data analysis and report on
transfer out
Collaborate with the Academic Affairs
Office and especially with Dr. Margot
Edlin to analyze the effects of the inhouse Early Alert system, SSN
Participate in IR Council, WIKI, and
list serve. Attend CUNY events
relating to IR and policy research
Create standard CUNY-wide
transfer out queries
Create a standard transfer
out National Student Clearing
House data request
Decide on the best structure
and schedule for a recurring
transfer out report
Participate in IR Council, WIKI, and list
serve. Attend CUNY events relating to
IR and policy research
2
Queensborough Community College
Stay informed about
topics in Higher
Education and issues
specifically important
to Community
Colleges nationwide
Support the college
with
timely and accurate
information for
informed
decision making
B.
Non-teaching Department
Review literature, news, and attend
and participate in workshops and
conferences
Increase the capacity of the
office
July 2013
Attend IR related conference
Review Higher Education
news
Network with other
Community Colleges' IR
offices around the region
Request additional staff -institutional research analyst
DEPARTMENT-SPONSORED ACTIVITIES, 2012-2013
Type of Activity and Topic
Organized,
Presented, or
Both
Presented
Date
Number
Attending
August,
2012
EL, VF
QCC Welcome Back presentation to the college
“Highlights from the Factbook and the Effectiveness
of the Freshman Academies, Fall 2012 Update”
At the Consortium for Student Retention Data
Exchange (CSRDE) Eighth annual National
Symposium on Student Retention in New Orleans,
LA. Michele Cuomo, Susan Curtis, Susan Madera,
Sandra Sacrestano and Victor Fichera conducted a
four hour workshop “Organizing an Integrative First
Year Experience.”
At the QCC Freshman Academies Retreat attended by
the Freshman Academies Review Committee, Victor
Fichera presented a comprehensive update entitled
“The Effectiveness of the Freshman Academies:
Winter 2013 Update.”
Office of Institutional Research and Assessment
Presentation at the New Faculty Orientation
Presented
September,
2012
EL, VF
Conducted
workshop
October,
2012
VF together with
Michele Cuomo,
Susan Curtis,
Susan Madera,
Sandra
Sacrestano
Presented
January,
2013
VF
Presented
January
2013
EL, VF
2013 Community College Futures Assembly, “Forces
for Good”, in Orlando Florida, with Vice President
Zins and Michele Cuomo, presented “The
Queensborough Community College Freshman
Academy Assessment Protocol.” as a Bellwether
award finalist.
Assistance in the development of and presentation at
the Assessment Institute
AAC&U conference in Miami, Florida: “Student
Success and the Quality Agenda” presented at a panel
presentation alongside Michele Cuomo’s presentation
Presented
January,
2013
VF together with
VP Zins and
Michele Como
Both
March,
2013
April, 2013
EL, VF
Office of Institutional Research and Assessment
Presentation at the New Faculty Orientation
Presented
VF together with
Michele Como
3
Queensborough Community College
Non-teaching Department
on the Academies. The QCC Roadmap Team also
presented a poster “The Freshman Academies:
Deepening High Impact Practices.”
Presented on the transfer out analysis for the fact book
at the CUNY IR Directors Council
Presented to the QCC Academy Advisors and Student
Affairs personnel on “Findings on the Effectiveness of
High Impact Practices at QCC: Spring 2013 Update
for the Academy Advisors.”
Assist in organizing the retreat (along with several
other IR directors and especially with Dr. Meg
McAuliffe, IR director at Queens College) and
presented on the QCC Assessment Institute together
with Dr. Ian Beckford at the CUNY IR and
Assessment Joint Retreat at Queens College
Madison Wisconsin AAC&U Institute on High Impact
Practices and Student Success. Victor Fichera, Susan
Madera, Susan Curtis and Michele Cuomo created and
presented the “Roadmap Action Plan” which
described plans to implement and assess the new
Queensborough Academies.
July 2013
Presented
April, 2013
EL
Presented
May, 2013
VF
Both
June, 2013
EL together with
Ian Beckford
Presented
June, 2013
VF together with
Susan Madera,
Susan Curtis and
Michele Cuomo
C. INDIVIDUAL ACTIVITIES/ACHIEVEMENTS OF DEPARTMENT’S
ADMINISTRATIVE STAFF, 2012-2013
Name
Elisabeth Lackner
together with
Margot Edlin and
Jane Hindman
Elisabeth Lackner
together with
Michele Como, the
Academic Affairs
Office, Sponsored
Programs, and IT
Victor Fichera
together with
Michele Como,
Arthur Corradetti
and Susan Madera
(Co-authors)
Achievement type (from
menu)
CUNY Grant awarded
for the evaluation of the
QCC Student Support
Network
Citation
Spring
2013: grant
supports
work over
18 months
April 1,
2013 –
May 31,
2015
Bill and Melinda Gates
Grant awarded for the
Integrated Planning and
Advising Services with
Starfish
Journal article, peerreviewed
Semester
“The Freshman Academies
Assessment Protocol: A
Reflective Tool for Student
Success”. AAC&U Peer
Review, Spring 2013, Vol. 15,
No. 2
Spring
2013
4
Queensborough Community College
Non-teaching Department
July 2013
D. DEPARTMENT CHANGES, 2012-2013
Type (from
menu)
Personnel
Services
Description of
Change
Office Assistant
position was
changed into a
Research Analyst
position
The office is
conducting and
monitoring grant
funded research
activities
Reason for Change
Date/Semester
The office has
expanded research
activities and need
more research
personnel
The office was
actively involved in
proposing and
receiving grants to
analyze and monitor
the Early Alert
systems – both the
SSN and the Starfish
Retention Solution.
Summer, 2013
Started with
Spring 2013
Evaluation of
Change*
NA
NA
*Please note that, if change has been too recent to evaluate, you may indicate NA.
E. ASSESSMENT AND EVALUATION, 2012-2013
Key Performance
Indicator*
Target outcome(s)
for Key Performance
Indicator**
Actual outcome(s)
Support and
generate data
analyses and
reports as needed
Generate data analyses
and data report to the
Academic Affairs
Office as needed in
order to support
academic planning and
assessment.
Comprehensive data
packet on remedial
progress of students.
Presented the data at
the remediation
review committee.
Modify the
monitoring of the
remedial efforts at
QCC based on
review committee
recommendations.
Freshman Cohort
Time Status Change
Analysis
Model regular
reports on the
Volunteer
Framework of
Accountability
(VFA)
developmental
education
measures.
Continue to
support the
Academic Affairs
Office as needed
Collaborate with
the Academic
Affairs office to
generate a
comprehensive
data set on
remediation
Generate a regular
report on remedial
needs and
outcomes
Oversee statistical
analyses
Assist the review
process of the
remediation efforts at
QCC.
Online course
analysis
Reverse Graduation
data report
Recommended
action plan
Recommen
ded status
of Core
Activity
and KPI
(see menu)
Continue
5
Queensborough Community College
Collaborate with
the Academic
Affairs Office and
the Committee to
understand the
need for data and
data presentation
for the Middle
States Periodic
Review Report
Summer 2012:
Create data
packets for
LA1&WE1, CT2,
ET2, MT2, TC2,
and TX2
Present the data to
the self-study
committees
Incorporate
feedback and
additional requests
into a refined data
packet
Provide data as
needed by the
strategic planning
committee and the
Cabinet in
response to the
PMP targets
Be aware of the
ongoing assessment on
campus and
recommend to the
committee specific
data reports and
analyses in support of
the Periodic Review
Report
Enable program review
committees to
understand the
program specific
student and faculty
demographic,
enrollment trends, and
program specific and
institutional
effectiveness measures
in order for the
committee to come to
informed conclusions
and recommendations
Enable the college to
assess proposed targets
and goals.
Public
Provide institutional
presentations of
data for the entire
the factbook and
college community
interesting findings
to the college
community
Gather and
incorporate
feedback of the
usability of the
factbook and the
factsheet for the
upcoming issue
Start the work on
the factbook and
factsheet in
November 2012
Non-teaching Department
July 2013
Attended committee
meetings and
discussed ongoing
program and
academic initiative
assessment, the
importance of the
Assessment Institute
and learning outcome
assessment,
Created data
packets for
LA1&WE1, CT2,
ET2, MT2, TC2, and
TX2
Present the data to the
LA1 and WE1 selfstudy committee
Answered to
additional requests
from the committee
Continue to assist
the committee
with analyses and
reports
Continue
into Spring
2014
Continue with the
data packets but
also include
summary
statements for
faculty to better
understand the
information
conveyed by the
data
Continue
Reported to Dean Dr.
Arthur Corradetti on
specific measureable
outcomes for each
quantifiable target;
Helped define
strategic goals and
measurable outcomes
for the new
Academies;
Improved the
factbook 2012-13.
Included transfer out
data among others.
Also published
program specific
dashboards on the
OIRA website.
Presented recent
findings at the
Welcome Back and at
faculty events incl.
the Assessment
Institute.
Continue with this
process including
the assessment of
the Academies’
specific goals.
Continue
Continuous update
and improvement
of the factbook to
incorporate the
needs of the
college. Insure
that the data
presented in the
About Us/Fast
Facts on the QCC
website is in sync
with the data in
the fact book.
Continue
6
Queensborough Community College
Streamline
analyses and
Reports of
Academies and
High Impact
Practices
Generate a
comprehensive
data set for
analytical
purposes
Ongoing assessment of
the case management
style of advisement of
the Academies and the
ongoing assessment of
High Impact practices.
Provide information on
the impact of these
initiatives on student
success.
Collaborate with
the Sponsored
Programs office
and individual PIs
to understand data
needs
Assist individual
faculty, grant
programs, and the
Office of Sponsored
Programs to write
well-informed grant
proposal and reports
on existing grants.
Generate reports
and analyses as
needed
Respond to
external requests
Stay in compliance
with accreditation
agencies, state, and
federal requirements
Data analyses and
data reports for
Support the academic
departments in
Non-teaching Department
Numerous
presentations by PI
Dr. Victor Fichera on
retention and
graduation and course
outcomes within the
college and
nationwide.
We began to develop
a comprehensive data
set in the summer of
2013. The assessment
protocol was revised
with the
implementation of the
new Academies.
Numerous reports for:
NYSED Perkins; NSF
STEP; CUNY grant
for SSN; Gates
Foundation grant;
Teagle Grant; Title III
and V Eligibility;
Twenty-first Century
Study
Participated in the
Institutional Grant
Working Group
headed by Sponsored
Programs Director
Christina Johnson
Middle States
Institutional Profile
NYSED Perkins
Institutional Profile
Report
Review CUNY
central date reports to
NYSED and IPEDS
Provide data reports
for departments
reporting to
accreditation agencies
such as ABET
(Engineering
Technology), NLNC
(Nursing) and ACPSB
(Business);
College Board
Numerous data
reports to the
July 2013
Implementation of
revised assessment
protocol including
student surveys.
Collaboration with
CETL and faculty
coordinator, the
Academic Affairs
Office, and with
Student Affairs to
refine and update
measurable
outcomes.
Continue
Continuous
support of
sponsored
programs with
data analyses and
reports
Continue
Continuous
reports and review
or reports to
external agencies
Continue
Continue the
ongoing support
Continue
7
Queensborough Community College
academic
departments as
needed
curricular decisions
and pedagogic research
Data analyses and
data reports for
Student Affairs as
needed.
Support the planning
and assessment of
student services and
counseling.
Non-teaching Department
academic
departments:
Math course grade
reports for several
classes;
Data files for Dr.
Michael Guy:
Analyses and data
files and reports to
several Math review
committees: Math
119, Math 440, Math
remedial, and others.
Report to Nicholas
DiZinno, Patrick
Wallach, Prof.
Kostas, David
Lieberman, Karimi
Sasan,
EN 101 grades
analyses,
EN 101 and 102 drop
rates,
Ethnicity counts of
Nursing students,
CH 127 and 128,
Enrollment trends in
Theatre concentration,
STEM URM
graduations, FA1
minor counts; and
others.
Data report for the
Veterans Office.
Development of a
Veteran dashboard
Early Alert student
survey included a
report on the use of
student services
Collaborate with
Grant funded
the Academic
assessment of early
Affairs Office and interventions
especially with Dr.
Margot Edlin to
analyze the effects
of the in-house
Early Alert system,
Ongoing analysis of
how the system is
used and perceived,
course outcome
analysis and student
progress analyses
July 2013
of academic
departments and
faculty. We expect
additional requests
from faculty who
have participated
in the Assessment
Institute and
faculty conducting
pedagogic
research.
Enable the
Veteran office to
account for their
students and to
keep track of
Veteran
enrollment
Ongoing support
of all student
services as needed
Ongoing and will
also incorporate
the analysis of the
Starfish Retention
Solution system
and the
combination of
Early Alert and
Continue
Continue
8
Queensborough Community College
Non-teaching Department
SSN
July 2013
Case Load Model
of Advising
Publish transfer
out rates in future
factbooks
Create standard
Enhance the tracking
CUNY-wide
of student progress in
transfer out queries higher education
Create a standard
transfer
out National
Student Clearing
House data request
Decide on the best
structure
and schedule for a
recurring
transfer out report
Developed a standard
transfer out report
published in the fact
book.
Participate in IR
Council, WIKI,
and list serve.
Attend CUNY
events relating to
IR and policy
research
Stay current with
CUNY wide research
activities and
discussions
Continue
Attend IR related
conference
Review Higher
Education
news
Network with
other
Community
Colleges' IR
offices around the
region
Request additional
staff -institutional
research analyst
Stay informed about
topics in Higher
Education and issues
specifically important
to Community
Colleges nationwide
Regularly participate
in IR Council, WIKI,
and list serve.
Attended CUNY
policy research
presentations and the
IR-Assessment Joint
Retreat
IR staff attended the
AIR and NEAIR
conferences and
workshops, Literature
review and review of
numerous articles
relevant to
Community Colleges
or/and higher
education in general
Ongoing, expect
additional
conference
attendance to
present research
on Early Alert
Continue
We were able to
convert the Office
Assistant line into a
research analyst line
We will need
additional staff to
keep up with the
increase in
demand
specifically for
research in the
area of retention,
remediation, and
Starfish Retention
Solutions. In
addition, the office
needs to provide
more reports to
academic
Continue
Increase the research
capacity of the office
Completed
for the
developme
nt of the
queries and
report
format.
Continue
the
publishing
of transfer
out rates in
the
factbook.
Continue
9
Queensborough Community College
Non-teaching Department
July 2013
departments,
conducts more
surveys, and will
not to report data
to the Volunteer
Framework of
Accountability in
addition to all
exiting reports
Notes:
*The items in this column correspond to “indicators to be assessed” in part A, column 3.
**To be more effective and meaningful, assessment efforts should focus on selected KPIs each academic year; over time, assessments should be
rotated through all the department’s KPIs.
F. ASSESSMENT PLAN FOR NEW YEAR, 2013-2014
Core Activity
(New Year)
Key Performance
Indicator
(New Year)
Target
Outcome(s)*
Support of
Academic
Planning and
Assessment
initiated by the
Office of
Academic
Affairs
Number of data
analyses and reports
for the Academic
Affairs Office
Program Review
support
Number of data
packets and
consultation
meetings
Assist the evaluation
and assessment of
existing academic
initiatives such as
for example online
course offerings.
Assist the Academic
Affairs office in
making informed
decisions on new
initiatives.
Provide information
to review
committees that will
aid the review
process
Provide
institutional data
for the college
community
Yearly Fact book,
Fast Facts, and
Program Dashboards
Increase the
distribution of
information to a
variety of college
constituencies
Continue with the
publishing of the
fact book, insure
that the fast facts on
the website
correspond with the
latest numbers and
update the program
dashboards. Work
with the Marketing
department to
Plan for Achieving
Target Outcome
Divisional
Head
Approval
5/29/14
Collaborate closely
with the VP for
Academic Affairs
and the VP for
Institutional
Effectiveness and
Assessment
Produce the standard
data packets and
include chapters that
summarize the
information the data
presents. Be
available for
departmental
meetings.
Continue the fact
book process.
Collaborate with the
Marketing
department to
develop a plan to
increase the
availability of
reports internally
(password protected)
and information
10
Queensborough Community College
Non-teaching Department
develop a plan to
increase the
availability of
reports internally
(password protected)
and information
highlights to the
public.
Increased
understanding of the
benefits of a case
load model of
advising (The
Academies) and
high impact
practices in courses
Assessment of
the Academies
and the High
Impact Practices
Assessment
according to the
Academies’
assessment protocol
and by incorporate
learning outcome
assessment in High
Impact courses
Retention,
Graduation, and
transfer out
research and
analyses
Develop a mixed
methods plan to
analyze retention,
graduation, and
transfer out in
collaboration with
the Retention
Management Task
Force
Increased
understanding of
student persistence
rates and graduation
rates.
Survey
administration
to students,
faculty, and staff
as needed
Comply with the
CUNY wide
distribution of
surveys, develop and
administer our own
surveys as needed
Obtain feedback
from students,
faculty, and/or staff
on a variety of
initiatives and
programs
Sponsored
Program support
Reports for grant
eligibility; grant
proposals; Number
of grant related data
Continue support by
providing data on
students and
programs related to
July 2013
highlights to the
public.
Update the OIRA
website.
Work closely with
CETL, Academic
Affairs, and Student
Affairs to administer
and refine the
assessment protocol
and to assess the
goals established by
the Academies
review committee
Continue the
development of a
comprehensive data
set to aid retention
and graduation
analyses.
In collaboration with
the Retention
Management Task
Force develop a data
analyses plan and an
outreach initiative
(through surveys or
otherwise) to
students to better
understand students’
motivations and
higher education
goals.
In collaboration with
CUNY, the
Academic Affairs
office, and student
support offices and
develop and
administer surveys
via paper surveys or
survey monkey.
Data reports in
collaboration with
the Office of
Sponsored Programs
11
Queensborough Community College
Provide
institutional data
to external
agencies
reports (Perkins,
NSF, CUNY, and
others)
Comply with
requested reports to
accreditation
agencies, CUNY,
state, and federal
Non-teaching Department
grant funded
activities and grant
proposals.
Comply with
accreditation
requirements, Title
III and V
requirements.
The development of
queries and reports
to comply with the
Volunteer
Framework of
Accountability data
reports starting with
2013-14.
Enable academic
departments to make
informed decisions.
Support
academic
departments
Data analyses and
reports to academic
departments as
needed
Support student
affairs
Data analyses and
reports to student
services and affairs
offices as needed
Enable the student
affairs office and the
student services to
make informed
decisions
Research on the
Early Alert and
Starfish
Retention
Solution
interventions
Collaborate with Dr.
Margot Edlin on indepth research and
analysis of this
intervention.
Understand the
impact and benefits
early interventions
and case load model
of advising.
Stay current
with CUNY
wide research
activities and
discussions
Participate in IR
Council, WIKI, and
list serve. Attend
CUNY wide events
related to IR and
education policy
Be an informed and
active participating
IR office in CUNY
wide discussions,
research, and policy
implementation
July 2013
and the PIs.
Continue to comply
with requested data.
Collaborate with
CUNY central and
other IR directors to
develop a standard
format of reporting
to the Volunteer
Framework of
Accountability
(VFA) consortium.
Collaborate with
faculty and
department chairs on
data reports as
needed. Be open for
ad-hoc requests that
aid the support of
curricular decisions.
Collaborate with
student services and
the student affairs
office on data
reports as needed.
Communicate
findings relating to
student services and
advising as we
continue our
analyses of the
effects of Early
Alert and Starfish.
Continue the CUNY
grant funded
research as outlined
in the grant
documents. Include
additional analyses
of Starfish data.
Continue to
participate in IR
Council, WIKI, and
list serve. Attend
CUNY wide events
related to IR and
12
Queensborough Community College
Non-teaching Department
research
Stay informed
about topics in
Higher
Education and
issues
specifically
important to
Community
Colleges
Increase the
research
capacity of the
office
Review literature,
news, and attend and
participate in
workshops and
conferences
Be aware of latest
developments in
higher education
research and
assessment
Hire an additional
full-time research
analyst
Meet the increased
demand for
assessment and
research especially
with surveys and
statistical analyses
July 2013
education policy
research
Share literature
reviews, news
articles, and
participate in
workshops and
conferences
Propose the creation
of a fourth full-time
position for the
office to be filled by
a research analyst.
*Targets indicated here will direct assessment efforts for the following year – see part A, column 3.
Approved by supervisor 5/29/14
13