Equity Point Person Pilot (2010-2011) Evaluation

advertisement
Equity Point Person Pilot (2010-2011) Evaluation
Prepared by the Las Positas College Office of Institutional Research and Planning, Spring 2011
Executive Summary
The EPP is a practice with promise for LPC and possibly for other organizations. Survey data (while
limited) and observations lead to the conclusion that this pilot was moderately successful and the
practice can be made more effective with certain modifications. At the very least it did introduce
reflection and dialogue about equity and inclusion where they might not otherwise have happened. I
believe that over time and with the proper support this practice can increase the amount and quality
of dialogue around issues of equity and inclusion.
This exercise is worth trying for a 2nd year. Expanding to more committees is advisable. Assign the
EPP duty to someone who is well versed in issues of equity and inclusion, comfortably with the role,
and able to initiate and sustain dialogue. Continue conducting the survey of committees annually.
Have one person from CCN become the lead to coordinate communication among EPP. Put EPP as
monthly CNN agenda item.
Background
The Equity Point Person Pilot was initiated by the Campus Change Network for the 2010-2011 academic
year. In Spring 2010 the CCN worked with the College Council and several committee representatives to
select pilot committees for the “Equity Point Person (EPP)”. The committees selected were:
Administrative Council (AC), Planning and Budget Committee (PBC), Faculties Committee (FC), and the
College Council (CC). Each pilot committee selected an “Equity point person” out of its existing
membership for the 2010-2011 academic year. This was not a new person on the committee nor did the
EPP need to be on the Campus Change Network. In fact, the point people were purposely chosen from
those without an affiliation with the CCN. It was thought that this would be an opportunity to develop
new leadership and expertise in the area of equity.
Rather than “policing” committee decisions and discussions the EPP’s role was to provide committees
with an opportunity to consider decisions and processes through an inclusion lens. At the end of each
meeting the EPP would lead the committee’s reflection on the following questions: 1) Are there any
equity/access issues impacted by the decisions we have made?, 2) Has the meeting/process been equitable
for all committee members/constituencies, 3) Are there issues we would like assistance with from the
CCN?
One of the goals of the Campus Change Network has been to institutionalize equity and inclusion efforts
and ensure that our decisions as well as processes are equitable. This work does not happen in one office
or one committee; it’s the responsibility of everyone to further this work in the many forms it takes.
Decision making, resource allocation and determination of policies and processes are embedded in our
Committees. Committees should make a conscious effort to ensure that the decisions it makes and
processes it uses do not have a negative impact on equity and inclusion. The CNN hoped this approach
would increase awareness of and expertise in recognizing and addressing issues of equity and inclusion in
all of the decision-making processes in the College.
Implementation
Not all pilot committees fully participated. Administrative Council and PBC did the reflection all
meetings. Facilities Committee did not meet regularly and when it did the EPP was not completed.
The College Council never selected an EPP and did not do the reflections. In this way the Facilitates
Committee and College Council service as control groups.
The CCN planned to have periodic communication with the EPP throughout the year to get feedback
and possibly brainstorm topics that might come up in meetings as well as ways to probe committee
dialogue. However, due to low staffing levels, the Office of Research and Planning was not able to
follow through. One mid-year memo did go out to EPP and Committee chairs (see attachment #3) to
remind them of the process and to ensure this reflection was on each agenda. This lack of follow-up
may have had an effect on the ultimate effectiveness of the pilot especially considering people who
were not specially trained in equity issues were chosen.
Survey Data:
Survey data was collected from committee members in Spring 2010 (Benchmark) and again in
Spring 2011 (Follow-up). Committees tend to have memberships of 12-17 people. Responses of the
benchmark survey were roughly 75% of committee membership. Responses from the Follow-up
survey was about 25% of membership. Small sample sizes and the low response rate for the Followup survey are limitations of the survey.
Committee members were asked to complete the following survey:
Based on your definitions of equity, access, and social justice, how often did the following things
occur over the course of the academic year?
1) Issues of equity/access were discussed in the committee as they relate to committee business.
2) Committee work consciously furthered the college’s goal to serve a diverse college community by
maintaining and expanding an environment of accessibility, equity, and social justice.
3) The committee functioned in an inclusive/equitable manner and all voices were given fair and
equitable input.
4) Committee members appeared to be conscious of the potential ramifications of their actions on
equity/access for students and employees.
Response fields were: Always = 5, Often = 4, Occasionally = 3, Rarely = 2, Never =1. Composite
scores for each committee were created by creating a scale of all four questions and dividing by the
number of responses so that each committee has one score. Table 1 shows benchmarks and followup scores for each committee. AC, PBC show an increase while the control groups do not. It might
be the case that the monthly reflection exercise did increase the perception that issues of equity and
inclusion were considered as well as meetings were conducted more equitably. Of course, with such
small sample sizes, poor response rates, and lack of control variables, there are many other possible
explanations for the data.
Equity Point Person: Composite Scores Comparisons
20.00
19.00
18.00
17.00
16.00
16.25
16.00
15.17
15.00
14.90
15.00
14.17
14.33
14.20
Baseline
Follow-up
14.00
13.00
12.00
11.00
10.00
Baseline
Follow-up
Administrators
Baseline
Follow-up
PBC
Baseline
Follow-up
Facilities
College Council
Observations
Another source of evaluative information comes from observations of CCN members. In
discussions with CCN members who have attended meetings of the pilot groups, there is a general
agreement that, at times, the exercise was not taken seriously. There is general agreement that over
time the exercise can become rote. While there were occasions that dialogue did happen, more often
than not, it was the CCN members who began and sustained the dialogue.
At THE beginning of pilot the CCN did receive some critical feedback about the exercise. These
written comments presented concerns over the validity, motives, and logistics of the reflections.
There seemed to be some push-back about the need for the exercise and the CCN inserting itself into
committee business. There was also concern expressed over confidentiality. Additionally, there was
feedback given that instead of a reflection, the CCN should ask that before each meeting a statement
be read about equity and inclusion. While there were not more than 2-3 communications sent to the
CNN it should be noted that this pilot did cause a few people concern and these written commentS
might represent a boarder sentiment of concern.
Limitations:
This evaluation is not meant to be a statistically-sound study. It is a quick and dirty look back at the
pilot to determine if there is enough evidence to continue the exercise and what changes can be made
to improve the project. Small samples, non-representative committees, low response rates, lack of
control variables, and the bias of the CCN members are all factors that limit this evaluation. I make
the following recommendations in light of these limitations.
Conclusions and Recommendations
The EPP is a practice with promise for LPC and possibly for other organizations. The reflections did
result in dialogue however, it did not seem to result in dialogue among people not already predisposed to care about and discuss issues OF equity and inclusion. At the very least it did introduce
reflection and dialogue about equity and inclusion where they might not otherwise have happened in
committees that might not have otherwise had them. I believe that over time and with the proper
support this practice can increase the amount and quality of dialogue around issues of equity and
inclusion.
Recommendations:
1) The EPP’s need to be someone familiar with equity/inclusion issues and comfortable in role. The
person needs to be able to bring the reflection to life and create a space for dialogue.
2) Provide training and ongoing support to EPP’s. This could take the form of being an agenda item
at each CCN meeting, posting to the web-site, monthly special topics and opportunities for EPP
dialogue about challenges/ best practices. They can also provide feedback to the CNN for areas of
concern across campus.
3) The role of the EPP needs to change to meet the changing needs and expertise of committees or
the campus. At times it might need to be a highly-scripted activity with many prompts for dialogue.
Other times, when committees gain more expertise, it can be less formal.
4) It might be a good idea to introduce special topics in addition to the 3 reflection questions to keep
the reflection from becoming a rote activity. For example, committees might be asked to consider
the potential equity ramifications of raising fees or adding pre-requisites.
5) There is a critical need to communicate the purpose, intent, and confidentially of the exercise to
the campus community. This exercise can be viewed with suspicion. Clear and consistent messaging
is important.
6) Stress the confidential nature of these reflections. Create a safe environment where people can
talk. Do not take minutes during the reflections. EEP’s should simply note if there was dialogue and
the nature of the dialogue to share with the CNN and other EPP’s.
7) Find a way to evaluate effectiveness in a manner that does not compromise confidentiality. While
the survey is advisable, we should also find ways to evaluate the exercise qualitatively without
compromising confidentiality.
8) This exercise is worth trying for a 2nd year. Expanding to more committees is advisable. Continue
conducting the survey of committee annually. Have one person from CCN become the lead to
coordinate communication among EPP.
9) Put EPP as monthly CNN agenda item.
ATTACHMENT #1: MEMO FROM CCN TO COLLEGE COUNCIL
Campus Change Network
Memo
To:
College Council
From:
Campus Change Network
CC:
Equity Point Person on Committees
Date:
February 17, 2010
Re:
Modifying Committee Structure to Include an Inclusion Position
One of the goals of the Campus Change Network has been to institutionalize equity and inclusion efforts
and ensure that our decisions as well as processes are equitable. This work does not happen in one office
or one committee; it’s the responsibility of everyone to further this work in the many forms it takes. Decision
making, resource allocation and determination of policies and processes are embedded in our Committees.
Committees should make a conscious effort to ensure that the decisions it makes and processes it uses do
not have a negative impact on equity and inclusion.
At this time we are bringing this forth as an FYI item and will bring a more formal proposal to the College
Council in April. We plan to propose that each committee appoint an “Inclusion point person” out of its
existing membership. This would not be a new person on the committee. Rather than “policing” committee
decisions and discussions this person’s role would be to provide committees with an opportunity to consider
decisions and processes through an inclusion lens.
This person would help the committee reflect at each meeting 1) Are there any equity/access issues
impacted by the decisions we have made?, 2) Has the meeting/process been equitable for all committee
members/constituencies, 3) Are there issues we would like assistance with/from the CCN?
This person does not need to be on the Campus Change Network. The CCN will provide support to and
garner feedback from each Inclusion Point Person. This would be a pilot project for the Fall 2010-Spring
2011 academic year, with evaluation occurring Summer 2011. This is a timely endeavor as there are
substantial opportunities of overlap with other campus initiatives such as new Staff Development initiatives,
the on-going re-articulation of Participatory Governance (committee charge), and the seminars on dialogue.
Please share this information item with your constituents so this proposal can be discussed at the next
College Council meeting. If you have feedback please contact Amber Machamer as we would like to
include it in our formal proposal in April.
Thank you for your consideration and guidance as we increase diversity, equity and inclusion through
dialogue, reflection and action.
ATTACHMENT #2: CCN MEMO TO COMMITTEES
Campus Change Network
Memo
To:
Planning and Budget Committee, Student Senate, Facilities Committee, College Council,
Administrators Council
From:
Campus Change Network
CC:
Equity Point Person on Committees
Date:
August 30, 2010
Re:
Equity Point Person
One of the goals of the Campus Change Network has been to institutionalize equity and inclusion efforts
and ensure that our decisions as well as processes are equitable. This work does not happen in one office
or one committee; it’s the responsibility of everyone to further this work in the many forms it takes. Decision
making, resource allocation and determination of policies and processes are embedded in our Committees.
Committees should make a conscious effort to ensure that the decisions it makes and processes it uses do
not have a negative impact on equity and inclusion.
In Spring 2010 the CCN worked with the College Council and several committee representatives to select
pilot committees for the “Equity Point Person”.. Each pilot committee is to appoint an “Equity point
person” out of its existing membership for the 2010-2011 academic year This would not be a new
person on the committee. This person does not need to be on the Campus Change Network. The CCN
will provide support to and garner feedback from each Equity Point Person. This would be a pilot project for
the Fall 2010-Spring 2011 academic year, with evaluation occurring Spring/Summer 2011.
Rather than “policing” committee decisions and discussions this person’s role would be to provide
committees with an opportunity to consider decisions and processes through an inclusion lens. This
person would help the committee reflect at each meeting 1) Are there any equity/access issues impacted
by the decisions we have made?, 2) Has the meeting/process been equitable for all committee
members/constituencies, 3) Are there issues we would like assistance with/from the CCN?
Please share this information with the committee and select the point person at your first meeting. Please
notify Amber Machamer of the appointee. If you have questions or feedback, please contact Amber
Machamer.
Thank you for your consideration and guidance as we increase diversity, equity and inclusion through
dialogue, reflection and action.
ATTACHMENT #3: MID-YEAR MEMO TO COMMITTEE CHAIRS AND EPP’S
Campus Change Network
Memo
To:
Bob Kratochvil, Cindy Rosefield, Ronald Johansen, Rajwant Singh
From:
Campus Change Network
CC:
Guy Lease, Jennifer Adams, Renee Pegues, Cynthia Ross
Date:
January 28, 2011
Re:
Mid-year Check-in for Equity Point Person Pilot
The academic year is a little more than half over as is our Equity Point Person Pilot activity. Over the past few
months we have received feedback as we are sure you have as well. We’d like to take this opportunity to check in
with you about your experiences, re-confirm the goals of this project, as well as do some mid-year fine tuning to the
pilot.
As the Equity Point person, you have been asking the committee the following three questions and facilitating
reflection and dialogue:
1) Are there any equity/access issues impacted by the decisions we have made?
2) Has the meeting/process been equitable for all committee members/constituencies?
3) Are there issues we would like assistance with/from the CCN?
We hope that this has not become a rote exercise. The goal of these questions is to facilitate reflection and dialogue.
As such, you may be called upon to prompt dialogue by asking follow-up questions or offering examples.
To measure the effectiveness of the pilot we are using the following KPI’s that will be measured by surveying you
and your committee members. Please share these with the committee.
How often did the following occur over the course of the 2010-2011 academic year?
1) Issues of equity/access were discussed in the committee as they relate to committee business.
2) Committee work consciously furthered the college’s goal to serve a diverse college community by
maintaining and expanding an environment of accessibility, equity, and social justice.
3) The committee functioned in an inclusive/equitable manner and all voices were given fair and
equitable input.
4) Committee members appeared to be conscious of the potential ramifications of their actions on
equity/access for students and employees.
In response to feedback we have received about the pilot we are suggesting the following:
1) Please make sure that this activity is placed on each meeting agenda and time is devoted to it.
2) When going over the agenda at beginning of the meeting the Chair uses this as an opportunity to set the
tone of the meeting towards an equity/inclusion perspective by pointing out the agenda item and purpose of
the activity.
3) You need not wait until the end to address equity issues. If an issue arises that needs some
consideration, please bring it up at that time if you feel it’s appropriate. This can be a simple as asking: “Can
we take a moment and consider what the equity/inclusion impacts might be?”
4) Go through questions at the end. Offer prompts to promote dialogue. Hopefully, by now, your committee
members have been using an equity/inclusion lens and won’t need much prompting.
5) Periodic contact with a CCN member to give us feedback about your experiences so we can evaluate
the pilot. We do not want transcripts; just some feedback from you about how it is being received, do you
get blank stares or is there dialogue and how we can improve this process. A member of the CCN will be
contacting you this semester to check in and get feedback from you so you can guide the evaluating and
evolution of this project.
If you have any questions or concerns please contact Amber Machamer (X1027)
ATTACHMENT #4 BASELINE SURVEY
Introduction:
Last year, your committee agreed to part of a pilot project designed to increase equity and inclusion
at LPC by assigning one committee member to be the Equity Point Person. We are collecting
baseline data to evaluate the effectiveness of the “Equity Point Person Initiative”. As a past member
of the (insert committee name here) please answer the following questions. All responses are
anonymous; your response will be linked only to the committee listed above and used in aggregate.
Please restrict your answers to the work of committee listed above. If you were on multiple
committees you may be asked to answer this survey more than once. You will be asked to complete
a survey for each of the target committees you served on.
If you have any question or concerns please contact Amber Machamer (925) 424-1027.
Thank you for your cooperation.
___________________________________________________________________
Response fields: Always, Often, Occasionally, Rarely, Never
Based on your definitions of equity, access, and social justice, how often did the following things
occur over the course of the 2009-2010 academic year?
1) Issues of equity/access were discussed in the committee as they relate to committee business.
2) Committee work consciously furthered the college’s goal to serve a diverse college community by
maintaining and expanding an environment of accessibility, equity, and social justice.
3) The committee functioned in an inclusive/equitable manner and all voices were given fair and
equitable input.
4) Committee members appeared to be conscious of the potential ramifications of their actions on
equity/access for students and employees.
________________________________________________________________________
ATTACHMENT #5: FOLLOW-UP SURVEY
Introduction:
Last year, your committee agreed to part of a pilot project designed to increase equity and inclusion
at LPC by assigning one committee member to be the Equity Point Person. We are collecting data to
evaluate the effectiveness of the “Equity Point Person Initiative”. As a past member of the (PBC,
Facilities, Administrators insert committee name here) please answer the following questions. All
responses are anonymous; your response will be linked only to the committee listed above and used
in aggregate. Please restrict your answers to the work of committee listed above. If you were on
multiple committees you may be asked to answer this survey more than once. You will be asked to
complete a survey for each of the target committees you served on.
If you have any question or concerns please contact Amber Machamer (925) 424-1027.
Thank you for your cooperation
________________________________________________________________________________
Alternative instructions for College Council
Introduction:
Last year, 3 committees agreed to part of a pilot project designed to increase equity and inclusion at
LPC by assigning one committee member to be the Equity Point Person. We are collecting data to
evaluate the effectiveness of the “Equity Point Person Initiative”. As a past member of the College
Council, you did not directly participate in the initiative but your responses to these short questions
will help us evaluate it’s effectiveness. Please answer the following questions. All responses are
anonymous; your response will be linked only to the committee listed above and used in aggregate.
Please restrict your answers to the work of committee listed above. If you were on multiple
committees you may be asked to answer this survey more than once. You will be asked to complete
a survey for each of the target committees you served on.
If you have any question or concerns please contact Amber Machamer (925) 424-1027.
Thank you for your cooperation.
___________________________________________________________________
Response fields: Always, Often, Occasionally, Rarely, Never
Based on your definitions of equity, access, and social justice, how often did the following things
occur over the course of the 2010-2011 academic year?
1) Issues of equity/access were discussed in the committee as they relate to committee business.
2) Committee work consciously furthered the college’s goal to serve a diverse college community by
maintaining and expanding an environment of accessibility, equity, and social justice.
3) The committee functioned in an inclusive/equitable manner and all voices were given fair and
equitable input.
4) Committee members appeared to be conscious of the potential ramifications of their actions on
equity/access for students and employees.
Download