Common Triggers for
Progress Reports and
Possible Solutions
Bob DeLorme, EdS, RRT-NPS
Conflict of Interest
I have no real or perceived conflict of
interest that relates to this presentation. Any
use of brand names is not in any way meant
to be an endorsement of a specific product,
but to merely illustrate a point of emphasis.
www.coarc.com
Objectives
 The presenter will:
 describe CoARC standardized progress reports,
 list deficiencies in program outcomes that commonly
require a progress report,
 describe successful strategies for submitting an
acceptable progress report.
CoARC Standard 3.13
Outcome assessment thresholds are established by
CoARC and are related to expectations for graduate
success. The program must, at a minimum, meet the
assessment thresholds established by CoARC for the
following program outcomes, regardless of location
and instructional methodology used: a) Graduate
performance on the national credentialing examination
for entry into practice; b) Programmatic
retention/attrition; c) Graduate satisfaction with
program; d) Employer satisfaction with program; and
e) Job placement (Standard 3.13).
CoARC Standard 3.13
a) Graduate performance on the national
credentialing examination for entry into practice i.e.
credentialing success;
b) Programmatic retention/attrition;
c) Graduate satisfaction with program;
d) Employer satisfaction with program; and
e) Job placement
CoARC Outcomes Thresholds
This Should Not Be A Battle
Outcome Thresholds
CRT Credentialing Success
Based on Participation AND pass rates
NBRC passing score
(set by NBRC)
80% of total number of graduates obtaining NBRC
CRT credential
(3-year average)
Outcome Thresholds
Retention\Attrition
40% attrition of the total number of students
in the enrollment year
(3-year average).
3 yr. avg. can not exceed 40%
Outcome Thresholds
Positive (Job) Placement
70% positive placement
(3-year average)
Outcome Thresholds
Positive (Job) Placement
Defined as a graduate within the three-year
reporting period who is:
a. Employed utilizing skills as defined by the scope of
practice within the respiratory care profession. (i.e. fullor part-time, or per diem), or
b. enrolled full- or part-time in another degree program,
or
c. serving in the military.
Outcome Thresholds
Graduate Survey – Overall Satisfaction
At least 80% of EMPLOYED graduate surveys rating
overall satisfaction 3 or higher on a 5-point Likert
scale.
Also at least 50% of the EMPLOYED graduates
have returned surveys (3-year average)
The calculation is as follows:
# surveys with scores greater than 3
# surveys returned - # surveys (questions) omitted
Outcome Thresholds
Employer Survey – Overall Satisfaction
At least 80% of returned employer surveys
rating overall satisfaction 3 or higher on a 5point Likert scale.
The calculation is as follows:
# surveys with scores greater than 3
# surveys returned - # surveys (questions) omitted
Outcome Thresholds
Employer Survey – Participation
50% of the Employers have returned
surveys
(3-year average)
The total number of employers of program
graduates who return their employer survey.
(3-year average)
Outcome Thresholds
Graduate and Employer Surveys – Overall
Satisfaction*
*The Commission on Accreditation for Respiratory Care
(CoARC) began collecting overall graduate satisfaction
(OGS) and overall employer satisfaction (OES) survey data
in the 2010 reporting year. Originally, the CoARC stated
that no accreditation actions on overall graduate and
employer satisfaction outcomes would take place until the
2013 reporting year. However, because the calculations of
OGS and OES were reported incorrectly the CoARC will
not take accreditation action on graduate and employer
satisfaction outcomes until the submission of the 2015
annual report of current status (RCS).
Outcome Thresholds
On-Time Graduation Rate
 Beginning with the Annual Report that was due July
1, 2011 all programs were required to report their ontime graduation rate. On time means within 30 day of
expected graduation date with their original cohort.
 On-Time Graduation Rate is defined as the Total
Number of On-time Graduates divided by the Total
Number of Graduates.
Outcome Thresholds
On-Time Graduation Rate
70%
This is effective with the
submission of the 2015 Annual
Report of Current Status
Outcome Thresholds
Below CRT Threshold –
What Happens?
 At the Nov. 2013 meeting, CoARC looked at the
data from 2010, 2011, and 2012 (i.e., 3 yr. Avg.).
 The 2013 RCS reported the data from January 1,
2010 through December 31, 2012.
 If first-time below threshold of 80% pass rate, a
Standardize Progress Report (SPR) is required
using the CoARC Standardized Progress Report.
 Report due 9/20/14 for 11/14 CoARC meeting.
Below CRT Threshold –
What Happens?
 At the 11/14 meeting, CoARC will now look at
data from 2011, 2012, and 2013 plus review the
Standardize Progress Report form;
 The program will now be using the data from
2011, 2012, and 2013 in its SPR report (July
2014 RCS);
 If still below threshold, a Progress Report Update
(PRU) will be issued at the Nov 2014 meeting
due 9/2015.
Below CRT Threshold –
What Happens?
 Please make sure you use the correct forms for
the Standardize Progress Report and the
Progress Report Update. They are different
forms requiring different info.
 Forms can be found at the CoARC’s web site.
 PR Update Due 9/20/2015 for the November
2015 Commission meeting.
If You Feel Like This You
Are Not Alone!
Below CRT Threshold –
What Happens?
 The Nov 2015 Commission meeting will review
the Progress Report Update along with the RCS
from July 2015 (3-yr. avg. from 2012, 2013, and
2014).
 If still below threshold, during the November
2015 meeting CoARC will vote to place the
program on Probation.
 A Probation Letter will be sent to the program
and college administration.
Outcome Thresholds
If Program is Placed on Probation:
 Program Required Response (Evidence for
Compliance with Standard):
 Submit the Progress Report Update Form for
achieving the CRT Credentialing Success
threshold (see http://www.coarc.com).
 Submit an updated NBRC Annual School Summary
Report (available at www.nbrc.org).
 Submit the Programmatic Teach-Out
Outcome Thresholds
If Program is Placed on Probation:
 If in the Nov. 2016 meeting, the program is still not meeting
Threshold for CRT Success, CoARC will vote to withhold or
withdraw accreditation.
 Timeline would actually be four 3-year averages: 2011-
2013, 2012-2014, 2013-2015 and 2014-2016. This is 6
consecutive years of data.
 A program may remain on probation for no longer than one
year without demonstrable and remarkable extenuating
circumstances, in which case probation may be extended
for an additional year.
Outcome Thresholds
 CRT is a 3 yr. cycle,
 The following are 4 year cycles:
 Programmatic retention/attrition
 Graduate satisfaction
 Employer satisfaction
 Positive Job placement
 On-Time Graduation rates
Outcome Thresholds
With the exception of CRT outcomes, all other
thresholds use a 4 reporting-year cycle that would
require:
 1 Standardized Progress Report (1st year)
 2 Progress Report Updates (2 & 3rd years)
 1 Probation Period requiring documentation (4th
year – may be extended an additional year).
Outcome Thresholds
What are the Major Problem Areas?
 Credentialing Success, i.e. CRT pass rates
and participation
 Attrition
 Positive Job Placement
Outcome Thresholds
What are the Potential Causes?
 Is it a resource issue?
 Is there insufficient personnel, facilities, clinical sites,
or equipment to meet programmatic goals?
 Is it a curricular issue?
 Are graduates adequately prepared to enter the
profession?
 Is it an admissions issue?
 Are students really prepared to enter the program?
 Is it a retention/persistence issue?
 What factors are impeding the student’s ability to
remain in the program?
Outcome Thresholds
What are the Major Problem Areas?
 Credentialing Success i.e. CRT pass rates
 2011 - 20 programs below 80% threshold
 2012 – 32 programs below threshold
 2013 – 41 programs below threshold
 Is it a participation problem, pass-rate
problem, or both???
Outcome Thresholds
Ways to Improve CRT Success?
 Add computerized instructional packages for
review.
 Computerized practice exams. Multiple
proprietary programs.
 Proprietary review courses
 SAEs and Secure exams
 Addition of a comprehensive exam at the end of
the program.
Outcome Thresholds
Attrition
Attrition Threshold:
 2011 – 13 programs exceeded 40%
Threshold
 2012 – 8 programs exceeded 40%
Threshold
 2013 – 14 programs exceeded 40%
Threshold
Outcome Thresholds
Ways to Improve Attrition
 Review acceptance criteria.



Prerequisites requirement.
GPA requirement
Interviews or possibly a shadowing experience
 Add tutorials – have designated adjunct faculty
who can work with students
 Computerized aided instructional packages
 Utilize College wide process for student who are
having academic troubles.
Outcome Thresholds
Job Placement?
 2011 – 21 programs fell below the 70%
threshold.
 2012 – 24 programs fell below the 70%
threshold.
 2013 – 41 programs fell below the 70%
threshold.
Outcome Thresholds
How to Solve Job Placement?
 Is low placement due to low credentialing
success?
 When are you surveying? Too soon?
 Are you counting PRN employees or graduates
who go right into another program or degree?
 Are you offering placement services?
 Decrease class size.
Outcome Thresholds
QUESTIONS
AND ANSWERS