A Summative Evaluation of a
Community Agency’s Abused
Women Services (AWS)
Keevia Porter, DNP, MSN, NP-C, RN
University of Tennessee Health Science Center
Presenter Disclosures
Presenter: Keevia Porter
The following personal financial relationships with
commercial interests relevant to this presentation
existed during the past 12 months:
“No relationships to disclose”
What is a Program Evaluation?

“ Is the systematic assessment of the
operation and/or the outcomes of a
program or policy, compared to a set of
explicit or implicit standards, as a means
of contributing to the improvement of
the program or policy”
( Weiss, 1998, p. 4)
Why Conduct a Program
Evaluation?

Is the organization/agency fulfilling it’s
purpose?



Justify, improve, and/or continue services
Documentation for funding sources
Publication of findings
(Stanhope and Lancaster, 2008)
A Summative Program Evaluation



Conducted at the end or a phase
Determines extent to which anticipated
outcomes were produced
Provides information about the worth
(Weiss, 1998)
How does an evaluation affect its
stakeholders?

Stakeholders of a community agency may
inquire:
Why do we need this program?
 What is the purpose of this program?
 How well is it meeting its purpose?
 Is it worth the money?
 Should we keep funding it as is, invest or cut more
dollars?
 How is the agency perceived in the community?
(Weiss, 1998)

The Agency

Abused Women Services (AWS)




Hotline and Shelter
Court Advocacy
Immigrant Women’s Services
Community Education
Purpose




A local concern
Increase rates of violence directed toward
women
Women > Men
Prevention and protection is key
Logic Models


Primarily an evaluation tool
Other uses:






Planning
Documenting
Recording
Implementing
Monitoring
A picture of how the agency works!
http://lri.lsc.gov/pdf/other/TIG_Conf._Materials/E
McKay_Logic_Model_Intro_LSC.pdf
Logic Model


It is a systematic approach to understand the
resources available for the program operation.
It also lists the activities and goals the program
plans to achieve.
The planned work
The intended results
http://lri.lsc.gov/pdf/other/TIG_Conf._Materials
/EMcKay_Logic_Model_Intro_LSC.pdf
Conceptual
Framework for
Project
Donabedian’s
Model
(Donabedian,
1968)
Structure
Process
Outcome
Donabedian’s Model
Structure
Structure





Emergency Shelter
Crisis Line
Mission of the overall community agency
AWS Mission
Vision
Donabedian’s model
Process
PROCESS

Policy and Procedure’s Manual







Overview
Staffing
Safety and Security
Crisis/Hot- line
Termination of Services
Family Violence Spread sheets
Client Outcome Reports
OUTCOMES
Emergency Shelter
2008-2009
Black or African American
American Indian/Alaska Native
Asian
Hispanic or Latino
2009-2010
Black or African American
American Indian/Alaska Native
Asian
Native Hawaiian/Other Pacific Islander
Hispanic or Latino
White
Native Hawaiian/Other Pacific
Islander
White
Unkown/Other
Emergency Shelter
Unduplicated Residents
2008-2009
Children and Youth
16
MAR
4
6
2.13
18.8
11
13.55
OCT
15
4.5
OCT
JULY
18
14.13
10.3
3.1
JAN
NOV
14
15
12.1
5.9
AUG
7.2
11
DEC
13.6
8
FEB
14
12
9.5
18
APR
NOV
SEPT
# of Shelter Nights
16
MAR
13.09
5
14
MAY
12.3
11
JAN
Women
JUNE
8
27
APR
DEC
8.8
16
MAY
FEB
# of Shelter nights
21
JUNE
Unduplicated Residents
2008-2009
9
16.6
13
8
23
8.1
SEPT
12
15.5
AUG
11
16.1
JULY
21
13.4
Emergency Shelter
Unduplicated-Residents
2009-2010
Children and Youth
Unduplicated Residents
2009-2010
# of Shelter nights
Women
# of Shelter Nights
JUNE
25
265
JUNE
16
178
MAY
37
296
MAY
21
172
APR
28
315
APR
18
139
MAR
19
170
MAR
14
85
FEB
13
107
FEB
9
58
JAN
12
117
JAN
12
111
DEC
25
283
DEC
15
183
NOV
18
191
NOV
13
160
OCT
9
99
OCT
11
94
SEPT
15
156
SEPT
16
129
91
AUG
12
85
AUG
JULY
13
7
112
JULY
9
115
Emergency Shelter
Unduplicated Non-residential
2008-2009
140
Unduplicated Non-residential
2009-2010
200
180
120
160
100
140
120
80
Children & Youth
60
Women
100
Children & Youth
Women
80
60
40
40
20
20
0
JUNE
MAY
APR
MAR
FEB
JAN
DEC
NOV
OCT
SEPT
AUG
JULY
JUNE
MAY
APR
MAR
FEB
JAN
DEC
NOV
OCT
SEPT
AUG
JULY
0
Crisis/ Hot-Line
Crisis /Hot-Line Calls
250
200
150
2008-09
2009-10
100
50
0
JULY
AUG
SEPT
OCT
NOV
DEC
JAN
FEB
MAR
APR
MAY
JUNE
Conclusion

Recommendations





Structure->Process-> Outcome
Development of benchmarks
Strengthen Policy and Procedure’s Manual
Create programs and intervention for the youth
that are residing in the shelter
Increase in shelter capacity
Questions??
References











Donabedian, A. (1968). The evaluation of medical care programs. Bulletin of the
New York Academy of Medicine, 44(2), 117-124.
Donabedian, A. (2005). Evaluating the quality of medical care. The Milbank
Quarterly, 83(4), 691-729.
Hitchcock, J., Schubert, P., & Thomas, S. (2003). Community health nursing: Caring in
action (2nd ed.). Clifton Park, NY: Delmar Learning.
Kellogg Foundation.(n.d.) Using the logic model for program planning. Retrieved
from
http://lri.lsc.gov/pdf/other/TIG_Conf._Materials/EMcKay_Logic_Model_Intro_LSC.p
df
Operation: Safe Community. (2010). University of Memphis evaluation assesses
community's response to domestic violence. Retrieved from
http://www.memphiscrime.org/
assets/1294/mscc_dv_assessment_release_final2.pdf
Stanhope, M., & Lancaster, J. (2008). Public health nursing: Population centered
health care in the community (7th ed.). St. Louis, MO: Mosby.
Weiss, C. (1998). Evaluation. Upper Saddle River, NJ: Prentice Hall.
YWCA of Greater Memphis. (2011a). About us. Retrieved from
http://www.memphisaywca.org/
YWCA of Greater Memphis. (2011b). Abused Women's Services. Retrieved from
http://www.memphisywca.org/
YWCA of Greater Memphis. (n.d.a). AWS Shelter Program: Policy and Procedures
Manual. YWCA of Greater Memphis Corporate Office, Memphis, TN.
YWCA of Greater Memphis. (n.d.b). Board Orientation. YWCA. YWCA of Greater
Memphis Corporate Office, Memphis, TN.