Find Your Voice at COM: Oral Communication Across the Curriculum

advertisement
College of the Mainland
Find Your Voice at COM:
Oral Communication Across
the Curriculum
On Site Visit: October 15 – 17, 2012
www.com.edu/qep/
1
College of the Mainland
A Quality Enhancement Plan for the
College of the Mainland
1200 Amburn Road
Texas City, Texas
77591
www.com.edu/qep/
Prepared for the Southern Association of Colleges
and Schools Commission on Colleges
October 2012
2
College of the Mainland
TABLE OF CONTENTS
SECTION I:
EXECUTIVE SUMMARY……………………….…….….....4
SECTION II:
PROCESS USED TO DEVELOP THE QEP……….….....5
SECTION III:
THE TOPIC: ORAL COMMUNICATION
ACROSS THE CURRICULUM………………….……....13
SECTION IV:
DESIRED STUDENT LEARNING OUTCOMES.……...23
SECTION V:
ACTIONS TO BE IMPLEMENTED………….………..….24
SECTION VI:
TIMELINE…………………………………….……….…….38
SECTION VII:
ORGANIZATIONAL STRUCTURE…………………...….42
SECTION VIII:
RESOURCES………………………………………..…..…48
SECTION IX:
ASSESSMENT…………………………………….…...…..53
SECTION X:
CONCLUDING COMMENTS…………………….…...…..61
SECTION XI:
REFERENCES…………………………………….…...…..62
SECTION XII:
APPENDICES…………………………………...………....65
3
College of the Mainland
SECTION I
EXECUTIVE SUMMARY
Based on a two-year topic selection process, College of the Mainland chose as its QEP topic,
“Find Your Voice at COM: Oral Communication across the Curriculum.” This topic was
chosen based not only on data indicating that employers cite the ability to speak articulately as
one of the top skills they seek from graduates, but also because this skill was being addressed
at COM in only a very limited fashion. Input from multiple constituent groups revealed that there
was a discrepancy between the perceived importance of this skill set and the degree to which it
was being effectively addressed by the College. Thus, based on this data-driven process with
broad input from multiple groups, oral communication was identified as the QEP topic.
The College of the Mainland will begin implementing the QEP in 2013 by incorporating oral
communication in high enrollment courses across the curriculum, expanding the QEP to a total
of 24 different courses by the end of the 2014/2015 academic year. Professional development
for faculty will be an important element of this QEP, as faculty will need to be educated not only
about how to evaluate different kinds of oral communication but also about how they might
themselves improve their skills so that they may model effective speech in the classroom.
Aside from the incorporation of oral communication in a more broad-based fashion into courses
across the curriculum, students will experience enhanced instruction and academic support
focused on speaking skills. An electronic student instructional module will be developed by
speech faculty and made available to students in QEP-enhanced courses so that direct
instruction from speech experts will be accessible. In addition, a Speaking, Reading, and
Writing Center has been constructed to include soundproof booths in which students can
practice and record oral communication assignments and receive tutoring in all aspects of
speech. Aside from the emphasis on the development of effective oral communication, speech
anxiety will also be addressed by appropriate personnel (speech faculty, tutors, or counselors).
Thus, not only will students experience significantly expanded opportunities to practice their
speaking skills, but they will also receive augmented instruction and support in this area.
It is also the goal of this QEP to impact the culture on COM’s campus by raising awareness of
the importance of integrating this skill into the curriculum. Events showcasing students who
have demonstrated exceptional speaking skills will be held twice a year, and the QEP will
become a regular agenda item for key administrative and instructional bodies.
Student learner outcomes for this QEP target key elements of effective oral communication
and will be evaluated via a rubric on which faculty will be trained. Communication apprehension
(speech anxiety) will also be evaluated and tracked. Impact on the culture of the College will
also be evaluated on a number of indices.
COM is prepared to commit its resources to this QEP as demonstrated by the allocation of
necessary space, the purchase of software, expansion of tutoring, and the appointment of a
QEP Director. The budget designated for the QEP takes into consideration the current financial
constraints facing institutions of higher education while still placing priority on this initiative.
Thus, by 2018, oral communication will have become an integral part of COM’s educational
experience. As a result of the QEP’s implementation, not only will our students gain confidence
in their ability to communicate their ideas in a clear, effective manner, but they will be equipped
to compete successfully in the workplace and beyond.
4
College of the Mainland
SECTION II
PROCESS USED TO DEVELOP THE QEP
This section demonstrates:
Broad-based
involvement of
institutional
constituencies
Process identifying
key issues emerging
from institutional
assessment
Focus on learning
outcomes in
support of the
College’s mission
The Beginning of the Story: How COM’s QEP Topic Was Selected
The College of the Mainland (COM) is a learning-centered institution, founded in 1967 upon the
belief that everyone deserves an education and that we must strive to boost the economic and
intellectual prosperity of the diverse communities we serve. A two-year community college
located in Texas City, Texas, COM is located approximately ten miles north of Galveston and
twenty miles south of Houston. Serving approximately 4,000 students per semester, COM
seeks to prepare its students to live and work in a changing global society.
COM initiated its efforts to select a Quality Enhancement Plan (QEP) topic in 2006. According
to the Southern Association of Colleges and Schools (SACS), the QEP adopted and
implemented at any institution of higher learning should be based on an “institutional process for
identifying key issues emerging from institutional assessment” and should focus on “learning
outcomes and/or the environment supporting student learning and accomplishing the mission of
the institution” (SACSCOC, 2012, p. 21). Accordingly, COM sought to proceed deliberately and
thoughtfully in the selection of its QEP topic. Specifically, the goal was to ensure that the
process itself was:
1) data-driven,
2) focused on student learning,
3) characterized by broad campus involvement (with special support for a strong faculty
role, as faculty shoulder the largest responsibility for student learning).
From the beginning the goal was to choose a topic that not only emerged from a process that
was broad-based and inclusive but also was grounded in data and focused on student learning.
To accomplish that goal, the topic selection process was conceptualized as a multi-step, facultydriven process, as outlined below.
Steps in the Topic Selection Process
Step 1: Appointment of Faculty QEP Co-Chairs
The initial step in the QEP topic selection process was to appoint faculty QEP Co-Chairs in the
fall of 2006. Then-President Homer Hayes chose Dr. Steve Sewell, Professor of History and
Director of General Education Assessment, and Mr. Bruce Glover, Associate Professor of
Business, to oversee the selection and development of a QEP topic. The appointment of faculty
co-directors was an important step as it ensured accountability for the process as well as strong
faculty input. By placing responsibility for the topic selection process in the hands of faculty
5
College of the Mainland
members, the administration sought to ensure that there would be broad-based involvement of
institutional constituencies in the identification of the QEP topic, thereby enhancing campus
“buy-in,” as opposed to a process in which the administration directed the campus with regard to
what the topic would be. The responsibilities of the co-chairs included becoming educated
about the QEP process through attendance at appropriate SACS conferences and/or other
professional development experiences and oversight of the entire topic selection and
development process.
Step 2: Formation of the QEP Topic Selection Committee
One of the first tasks undertaken by the QEP Co-Chairs was the establishment of a QEP Topic
Selection Committee in the spring of 2007. Membership of this committee reflected broad
campus representation, including individuals from general education departments, workforce
programs, student support services, the administration, and the student body. The committee,
including additional members added to participate in the review of the top proposals submitted
(see Step 8), was composed of 14 faculty members (eight from the General Education
departments and six from the workforce departments), three students, three administrators, and
one administrative support person. See Appendix F for a list of QEP Topic Selection Committee
members.
The first task of the QEP Topic Selection Committee was to develop a process for selecting the
QEP topic. The committee met periodically during the spring and summer 2007 semesters and
focused initially on designing a process that would lead to the selection of a QEP topic that
would measurably enhance student success. The committee determined that the topic
selection process:
1) should provide opportunities for all campus constituencies to have input
2) should be data-based
3) should ultimately identify a topic that is focused clearly on student learning.
Step 3: Review of Data
The QEP Topic Selection Committee conducted exhaustive reviews of sixteen data sources,
including the following:
1) Institutional Research (IR) reports of awards conferred:
Data on certificates and degrees awarded by COM in each academic year
2) IR COMmon Fact Sheet:
Overview of the students enrolled at COM each semester and contact hours generated
3) IR reports of enrollment trends:
Data on unduplicated headcounts, contact hours, and semester credit hours by area
4) IR reports of retention:
Information on student retention overall, and by ethnicity and gender
5) IR reports of the University of Houston-Clear Lake (a local junior-senior institution to
which many COM students transfer) Community College GPA data:
Data on the average GPA for UHCL undergraduates who transferred from Gulf Coast
area community colleges, as well as comparison data for all other UHCL
undergraduates, by student major
6) IR reports of course completions:
Completion and successful completion rates by course and by department
6
College of the Mainland
7) Community College Survey of Student Engagement (CCSSE):
Results from the CCSSE, which asks questions about institutional practices and student
behaviors that are directly related to student learning and retention
8) Graduate follow-up survey:
Data from COM graduates pertaining to how they perceive the education they received
at COM and whether it gave them the skills needed upon entering the workforce
9) Noel Levitz Student Satisfaction survey:
Results from this survey, which measures student satisfaction and priorities
10) COM General Education Assessment Map report and analyses:
Faculty ratings of the degree to which the eight core competencies are taught and
assessed in courses within the core curriculum
11) Texas Higher Education Coordinating Board (THECB) annual data profile:
Data pertaining to first-time-in-college students including graduation and persistence
rates
12) THECB program files:
Data pertaining to graduates by program, gender, ethnicity, and special populations
13) THECB student retention reports:
Retention data by area, gender, and ethnicity
14) THECB accountability report:
Data pertaining to graduation and persistence rates, degrees conferred, transfers, and
licensure rates
15) Achieving the Dream (ATD) data analyses from fall of 2006:
Student outcome data, including successful course completion rates, retention rates,
and graduation rates disaggregated by gender and ethnicity
16) ATD focus group data from January of 2007:
Focus group results from discussion of ATD data
Members of the QEP Topic Selection Committee reviewed each of the data sources listed
above and prepared executive summaries of each to be considered in the determination of the
QEP topic. The executive summaries of each of these data sources are located on the
College’s internal informational network, and they were accessible to faculty and staff during the
topic selection process.
Step 4: Development, Administration, and Analysis of a QEP Survey
While the data sources identified previously were informative with regard to student success
and perceptions of various College services, the QEP Topic Selection Committee wanted to
gather some additional information with regard to specific areas of student learning. To that
end, a survey was developed (see Appendix A) that evaluated the importance of each of nine
identified skill areas or competencies and the effectiveness with which each is addressed
through the COM curriculum (according to the perceptions of the survey respondents). The
nine competencies identified were as follows:
1)
2)
3)
4)
5)
6)
7)
reading comprehension,
written communication,
oral communication,
critical thinking,
math skills,
computer literacy,
interpersonal skills
7
College of the Mainland
8) global awareness,
9) multicultural sensitivity.
These competencies were identified because most of them (all but interpersonal skills and
global awareness) had already been identified by the College as the core competencies
addressed through the general education curriculum. Therefore, those skill sets had previously
been identified as essential for student success. Interpersonal skills and global awareness were
added based on input from workforce faculty on the QEP Topic Selection Committee, who
identified these skills as being among those that are valued by employers, based on their
interactions with community employers with whom their programs interacted.
The survey also gave respondents the opportunity to identify other competencies which they felt
the COM curriculum needed to address.
The survey was administered in the fall of 2007 to respondents who represented multiple
constituencies, including students (N = 1246), faculty (N = 95), professional staff (N = 70),
classified staff (N = 71), alumni (N = 56), local employers serving on workforce advisory councils
to the College (N = 5), community members (N = 30), and members of the Board of Trustees (N
= 3). A total of 1576 QEP surveys were received and analyzed, and an executive summary of
the survey data was prepared (see Appendix B).
With regard to the importance of the nine competencies, mean rankings were ordered as
follows:
Competency Area
Ranking of
Importance
Reading Comprehension
Critical Thinking
Oral Communication
Written Communication
Interpersonal Skills
Math Skills
Computer Literacy
Multicultural Sensitivity
Global Awareness
1
2
3
4
5
6
7
8
9
Table 1: Ranking by COM QEP Survey Respondents of Perceived Importance of Core Competencies
Interestingly, all of the different respondent groups, except the Board of Trustees, ranked the
same competencies in the top four (reading comprehension, critical thinking, oral
communication, and written communication), though not always in exactly the same order. Only
the board members deviated from this trend, ranking interpersonal skills as most important and
multicultural sensitivity as being tied for the second spot with reading comprehension and
computer literacy.
With regard to the effectiveness with which COM prepares students with regard to the nine
competencies, mean effectiveness ratings placed the competencies in the following order (from
most effectively addressed to least effectively addressed):
8
College of the Mainland
Competency Area
Ranking of How Effectively
Each Competency is
Addressed
Written Communication
Reading Comprehension
Computer Literacy
Critical Thinking
Math Skills
Oral Communication
Interpersonal Skills
Multicultural Sensitivity
Global Awareness
1
2
3
4.5 (tie)
4.5 (tie)
6
7
8
9
Table 2: Ranking by COM QEP Survey Respondents of Effectiveness with which COM Addresses
Core Competencies
Of the eight respondent groups surveyed, five rated global awareness (on average) as the skill
area addressed least effectively through the College’s curriculum. Two of the groups
(community members and employers) rated multicultural skills as those that the College least
effectively addresses, and one group (professional staff) rated critical thinking as the skill area in
which students are least effectively prepared. It should be noted, however, that the skill areas
were rated on a seven-point Likert scale, with four being the middle point, and all of the means
were above 4.00 (with a range from 4.53 to 5.40).
Thus, while there was a general correspondence between the perceived importance of a skill
area and the effectiveness with which it was perceived to be addressed via COM’s curriculum,
oral communication was somewhat of an exception to this finding. It was ranked as third most
important but not characterized as one of the skills most effectively addressed (its mean
effectiveness rating placed it sixth).
Competency Area
Reading Comprehension
Critical Thinking
Oral Communication
Written Communication
Interpersonal Skills
Math Skills
Computer Literacy
Multicultural Sensitivity
Global Awareness
Ranking of
Importance
Ranking of How Effectively
Each Competency is
Addressed
1
2
3
4
5
6
7
8
9
2
4.5
6
1
7
4.5
3
8
9
Table 3: Comparison of Importance vs. Effectiveness of Instruction of Core Competencies at COM
Since the QEP Topic Selection Committee was most concerned with discrepancies that
indicated that an important competency was not being effectively addressed, the placement of
oral communication in the top three most important competencies, coupled with its sixth place
9
College of the Mainland
ranking with regard to how effectively it was being addressed, suggested that this topic would
be worthy of consideration for the QEP.
It should also be noted that “life skills,” an additional competency area identified in the openended portion of the survey, might encompass some of the other skill areas identified by
respondents to the survey (such as study skills, time management, career services), and this
set of skills might be considered consistent with some of the competencies targeted in a firstyear experience course.
Step 5: Creation of a “Long List” of QEP Topics
The QEP Topic Selection Committee reconvened in the summer of 2008 to review again the
original sixteen data sources in addition to the results of the QEP survey. Based on the data,
the committee brainstormed ideas for QEP topics, resulting in an original “long list” of 23
potential topics for consideration:























Enhance critical thinking skills across the curriculum
Early alert system
Enhance writing skills across the curriculum
Enhance reading skills across the curriculum
Enhance multi-culturalism
Using technology to enhance student learning
Improve advising process
Engaging the entering student/Engage current students/Empower students/First Year
Experience
Supplemental instruction
Active and collaborative learning
Learning to think globally in the 21st century
Service learning
Course scheduling and availability
Improve oral communication across the curriculum
Life skills – managing time and resources to achieve success
Employability skills
Information literacy
Improve lifelong learning
Learning communities
Transition from developmental to core courses
Self-assessment
Quantitative skills
Translating faculty development into student learning
After topics were merged, consolidated, and/or eliminated (based on additional discussion), a
list of eleven viable topics remained. These eleven topics were identified as follows (in no
particular order):






Enhance writing skills across the curriculum
Enhance reading skills across the curriculum
Improve cultural competency skills
Increase student engagement
Improve oral communication across the curriculum
Enhance active and collaborative learning across the curriculum
10
College of the Mainland





Enhance critical thinking across the curriculum
Enhance ability to think globally in the 21st century
Increase employability through enhancement of life skills
Increase information literacy
Improve mathematical literacy
Step 6: Dissemination of the List of Eleven QEP Topics
The QEP Topic Selection Committee developed a brief definition of each topic and an
explanation of the data supporting each one. This information was posted on the College’s
internal information drive (the I-Drive) for dissemination to the campus in preparation for the
solicitation of two-page QEP proposals from the campus community. The eleven topics were
presented formally to the campus at the fall 2008 semester kick-off convocation event.
For those interested in reading these topic summaries, they may be accessed on the College’s
QEP webpage, following this link: www.com.edu/qep/.
Step 7: Solicitation and Evaluation of Two-Page QEP Proposals
Members of the campus community as well as the community at large were invited at the
beginning of the fall (2008) semester to submit brief, two-page proposals to the QEP Topic
Selection Committee. Not only was the invitation to submit proposals placed on the College
website for public dissemination, but it was also announced at the fall 2008 Convocation event
at the beginning of the semester. Although the list of eleven potential QEP topics was made
available, along with guidelines for writing the proposals, there were no limitations placed on
topics which could be proposed. In the end, seventeen two-page proposals were submitted to
the QEP Topic Selection Committee, all from COM faculty and staff. A stipend of $100.00 was
paid to each of the proposal’s authors.
A rubric developed by the QEP Topic Selection Committee (see Appendix C) was used to
evaluate the seventeen proposals in a blind review (authors’ names were removed from the
proposals prior to their distribution to the committee). The committee members individually
reviewed and assigned rubric scores to the proposals, then used those scores to guide their
group discussion of the strengths and weaknesses of the seventeen proposals. Based on the
committee’s evaluation, the top five proposals were identified, including:





“Enhancing Reading Instruction Across the Curriculum”
“QEP Proposal for Active and Collaborative Learning: Let’s Get Active!”
“Cultural Competence: Understanding and Respecting Differences”
“Let Every Voice Be Heard: Oral Communication Across the Curriculum,”
“Building World Skills.”
The authors of these proposals were then invited to submit expanded, more detailed proposals
to the QEP Topic Selection Committee.
Step 8: Expansion of QEP Proposals
The writers of the top five proposals were given approximately three months (November, 2008
through January, 2009) to develop their expanded proposals, and they were promised a stipend
of $1000.00 for each completed proposal. The authors of these proposals were instructed to
11
College of the Mainland
submit proposals of 3500 to 4000 words, and they were given the rubric (developed by the QEP
Topic Selection Committee) to be used in the evaluation of the proposals (see Appendix D).
In addition, each author was given information from the SACS website regarding key elements
of the QEP. Thus, the authors were informed with regard to what issues needed to be
addressed within their expanded proposals, including:
1)
2)
3)
4)
5)
6)
7)
Definition of the topic
Review of best practices
Identification of student learner outcomes
Identification of actions to be implemented
Establishment of a timeline for implementation
Identification of necessary resources (financial and human)
Description of the administrative infrastructure for the implementation and continuation of
the QEP
8) Description of how the success of the QEP will be assessed
In the end, four expanded proposals were submitted to the QEP Topic Selection Committee in
early February of 2009. In order to broaden representation of campus constituencies on the
committee prior to the evaluation of the final proposals, several additional readers (including
students and faculty members from work force programs, developmental education, and general
education departments) were invited to join the committee in reviewing the expanded proposals.
An “orientation” meeting was held to review with all readers the most important elements of a
successful QEP, so that their evaluation would focus on key components as identified by the
Southern Association of Colleges and Schools (SACS).
The expanded proposals, when completed, were made available for comment by the campus
community via the College’s internal information site (i.e., the I-Drive). After the committee
members had been given time to consider campus feedback and to review and assign rubric
scores to each of the expanded proposals, the author of each proposal met with the committee
(including the additional readers) as a group to answer questions about the proposal and to
clarify or expand on proposal elements, as requested by the committee.
After reviewing rubric scores and discussing each proposal’s strengths and weaknesses, the
committee identified the proposal which they felt would not only have a significant impact on
student learning but would also provide an effective “road map” to the more detailed
development of the QEP. That proposal’s topic, chosen as the finalist by the QEP Topic
Selection Committee (along with the additional readers), was Oral Communication across the
Curriculum.
Not only did the available data demonstrate that oral communication was being minimally
addressed across the curriculum, but the proposal itself cited literature (along with the QEP
survey data) which indicated that these skills are highly valued in the workplace and that
students need to be equipped with the ability to articulate their ideas, regardless of their chosen
career path. The proposal suggested specific interventions that could enhance the College’s
focus on oral communication, and it was determined that our students could not effectively
master these skills without practicing them more broadly across the curriculum.
12
College of the Mainland
SECTION III
THE TOPIC:
ORAL COMMUNICATION ACROSS THE CURRICULUM
This section demonstrates:
Focus on learning
outcomes in
support of the
College’s mission
Process identifying
key issues emerging
from institutional
assessment
Why Oral Communication?
Supporting the College’s Mission
Supporting the Outcomes Identified by the Texas Higher Education Coordinating Board
Importance of Soft Skills
COM Data Supporting Oral Communication as QEP Topic
Consideration of Best Practices at Other Academic Institutions
Conclusion
Why Oral Communication?
The importance of effective speaking skills is easily
understood when one imagines some of the most famous
orations in history being delivered in a less effective fashion.
Suppose Martin Luther King, Jr. had boiled his “I Have a
Dream” speech down into a simple admonition that we should
coexist harmoniously. Would his words still reverberate
today? Suppose, instead of encouraging Mikhail Gorbachev
to “Tear down this wall!,” Ronald Reagan had asked him to
build relationships between the East and the West. Obviously,
the words we choose DO make a difference, and when our
message is tailored to our audience and the context, it is more
readily received and remembered.
Supporting the College’s Mission and Vision
The College of the Mainland has selected oral communication
across the curriculum as its Quality Enhancement Plan topic
based on data that this skill set is perceived as important but is
currently addressed minimally through instruction at the
College. The ability to communicate effectively and to
articulate ideas is crucial to success in any industry, so the
College’s focus on the development of these skills is
consistent with the College’s mission and vision. Equipping
students with these skills will prepare them to be successful
not only in our local community but also in the world beyond.
13
College of the Mainland
Mission
College of the Mainland is
a learning-centered,
comprehensive community
college dedicated to
student success and the
intellectual and economic
prosperity of the diverse
communities we serve.
College of the Mainland
Vision
College of the Mainland
will be a valued and vital
community partner by
striving to enrich our
expanding community and
preparing our students to
learn, work, and live in a
diverse, dynamic, and
global environment.
College of the Mainland
Supporting the Outcomes Identified by the Texas Higher Education Coordinating Board
According to the Texas Higher Education Coordinating Board (THECB), one of the basic
intellectual competencies that should be achieved by students within the core college curriculum
is speaking. The Coordinating Board defines competence in speaking as “the ability to
communicate orally in clear, coherent, and persuasive language appropriate to purpose,
occasion, and audience” (Texas Higher Education Coordinating Board, 1999, para. 13). It is the
view of the Coordinating Board that oral communication is a basic intellectual competency that
is essential to the learning process in any discipline. While the THECB has recently approved
revisions to core curriculum requirements, communicating orally is still emphasized and
classified under the newly developed “core objective” of Communication Skills, which is
intended “to include effective development, interpretation, and expression of ideas through
written, oral and visual communication.” (Texas Higher Education Coordinating Board, 2012,
para. 4). In fact, the THECB now requires that the core objective of communication be
addressed in all foundational component areas. Thus, it is the clear expectation that students
who graduate from institutions of higher learning in Texas should have developed sound skills in
the area of oral expression.
Importance of Soft Skills
As noted by one author, “We listen to a book a day, speak a book a week, read the equivalent
of a book a month, and write the equivalent of a book a year” (Buckley, 1992, p. 1). Clearly,
speaking skills are an essential element of the human experience, and deficits in the ability to
articulate ideas compromise not only our advancement prospects in the workplace but our
personal relationships as well.
Whether language is unique to the human species continues to be debated, but there is no
question that “communication is the vehicle that allows the human race to recall the past, think
in the present, and plan for the future” (Emanuel, 2011, p. 2). In fact, the ability to speak
eloquently and effectively has long been considered the hallmark of an educated person, as
evidenced by the emphasis on the art of oration in ancient Greek times.
So what is the evidence that communication skills matter in the modern world?
A study by the United States government was conducted in the early 1990’s to determine what
skills are necessary to achieve success in the modern workplace, resulting in the Secretary’s
Commission on Achieving Necessary Skills, or SCANS (U.S. Department of Labor, 1990). The
SCANS report identified a number of “soft skills” considered essential for career success,
including working well in teams, having empathy, and communicating effectively. Skip Downing
(2011), whose On Course curriculum serves as the foundation for College of the Mainland’s
student success course, argues that the more technical, “hard skills” are necessary to acquire a
job but may be insufficient to keep that job or to advance to a higher position. In fact, “It’s often
said that hard skills will get you an interview but you need soft skills to get and keep the job. It’s
no longer enough to be an expert in a field of knowledge. Competition is fierce; it’s your soft
skills that make you stand out” (Smith, 2011, para. 10).
That’s because, according to Downing (2011), while most people hired for jobs have the basic
skills necessary to perform the functions of that position (some may perform them better than
others), soft skills will increase an employee’s value in the workplace and position him or her to
advance to a supervisory position. And these soft skills include the ability to tailor one’s
communications to one’s audience and to articulate ideas effectively.
14
College of the Mainland
Furthermore, as Downing points out, soft skills are portable and prepare an employee to move
across specific types of jobs effectively. While skills that are specific to a particular industry may
not transfer to another job category, oral communication and other soft skills will enhance an
employee’s value in any work setting. In other words, soft skills have broader application.
Soft skills have been defined in various ways in workforce literature, but certain elements,
including the ability to communicate effectively, are common to all. Unfortunately, these skills
may be inadvertently minimized by the term “soft skills,” which might suggest that they are “kind
of fluffy, and they’re not really as important, and they’re kind of just a nice little add-on” (Schick,
2000, p. 25). In reality, when institutions of higher learning focus solely on the more technical,
hard skills, pedagogy is not really addressing the student as a whole person, whose life and
work will be enhanced by the development of such behaviors as effective communication,
teamwork, and interpersonal sensitivity.
There is ample evidence that employers value good communication skills. Leaders in the field
of engineering rated communication skills to be more important in the workplace than technical
skills (Felder, Woods, Stice, and Rugarcia, 2000). A study conducted by Harvard Medical
School surveyed more than 2,000 patients about their office visits and found that the most likely
reason given for dissatisfaction and switching doctors was poor communication (Keating,
Green, Kao, Gazmararian, Wu, and Cleary, 2002). In fact, the study highlights the fact that
improved communication with patients results in more accurate diagnoses, better patient
compliance, higher retention rates, more referrals, and fewer lawsuits.
The legal profession also recognizes the importance of communication skills as pertains to
attorney-client relationships, yet law schools typically emphasize trial preparation, trial practice,
settlement and negotiation, while neglecting instruction in how to interview clients effectively
(Willett, 1984). In COM’s QEP survey, local employers serving on advisory councils to the
College (N = 5) were included in the sample of respondents, and oral communication was
ranked second in importance of the nine competencies listed, right behind reading skills.
Similarly, community members were included in the survey sample (N = 30), and they ranked
oral communication as tied with written communication for second place in importance, right
behind reading skills.
According to a 2011 survey conducted by the National Association of Colleges and Employers
(NACE), verbal skills top the list of skills sought by employers in college graduates seeking to
join their organizations. Thus, the ability to communicate effectively is a skill vital to success for
all students, regardless of their eventual occupational choice.
Similarly, in the 2007 report, “College Learning for the New Global Century,” by the Association
of American Colleges and Universities (2007), oral communication was among the top three skill
sets valued by executives in prospective employees. Employers across different occupational
areas view communication skills as essential, and these skills are predicted to assume an even
more important role, as the economy continues to move toward service-oriented businesses
(Buckley, Peach, and Weitzel, 1989). But how do these communication skills play a role in
achieving success in the workplace?
Communication skills are at work in various areas of an individual’s career, including the
following: the first telephone interview, face-to-face interview, negotiating salary after the job
offer, interacting with your boss, interacting with your colleagues, presenting before clients or
customers, and requesting promotion, among other areas (Shweta, n.d.). In fact, it is estimated
15
College of the Mainland
that people in the workplace spend an average of about 75 per cent of their communication time
either speaking or listening versus engaging in written communication (Chapter 10, n.d.). Oral
communication is important in the workplace because:
1) It establishes what needs to be done and the methods for accomplishing workplace
tasks, as “people usually discuss problems and solutions before deciding on a course of
action” (Chapter 10, p. 1).
2) Oral communication helps develop interpersonal relationships, and office conversations
help people learn about each other “and make working together enjoyable” (Chapter 10,
p. 1).
Nor is the demand on an employee’s communication skills limited to those with seniority.
Martin-Young (1996) reports that even entry-level employees are likely to have to prepare
presentations at some level of formality, including leading groups of visitors (such as Cub
Scouts, school teachers, or others) on a tour of the workplace. Sometimes the presentations
assigned to entry-level workers are on a relatively large scale, such as when a rookie police
officer is directed to make safety presentations at public school assemblies. Thus, if employees
wait until they are hired into the workplace to develop their communication skills, they are
already at a disadvantage, and it is incumbent upon institutions of higher learning to prepare
students for success in the workplace and in life.
However, the results of the survey by the Association of American Colleges and Universities
(2007), which indicated that oral communication is valued by prospective employers, indicated
that employers are not always confident that institutions of higher learning are preparing their
students adequately to deliver on these skills. This same finding was documented by Mark
(2008) who reported that the ability to communicate coherently is highly valued by employers
but is also identified as a skill often lacking in college graduates. In fact, some have reported a
“skills gap” in the workplace (Smith, 2000) when it comes to the oral communication abilities
demonstrated by employees and the value of these skills as perceived by employers.
While such a skills gap may exist, it may not be due to a lack of value placed on oral
communication by academicians. When 1,000 faculty members from a variety of disciplines
were asked to identify basic competencies important for every college graduate to develop,
communication skills topped the list (Diamond, 1997). However, Cronin and Glenn (1991)
reviewed the status of oral communication as a key component in general education curricula
and found that “most undergraduates take at most one course emphasizing oral communication
skills…and have little or no opportunity for structured practice with competent evaluation to
refine and reinforce their oral communication skills” (p. 356).
Reinforcing the need to emphasize oral communication in the curriculum, the National
Communication Association (1996) has proposed that communication literacy is paramount to
college students today, and it is the policy of that organization to promote the inclusion of oral
communication as a central component of the general education curriculum. Specifically, it is
argued that “if we expect students to become competent communicators, both as senders and
receivers, then we must provide them with the means to develop their knowledge and abilities
by including oral communication in the GE curriculum. It is unfair to expect that students will be
able to perform satisfactorily without specific educational support“ (National Communication
Association, 1996, para. 7).
It is self-evident, then, that institutions of higher learning have a responsibility to help students
develop competency in this area.
16
College of the Mainland
And along with competency in oral communication, the issue of anxiety over public speaking
must also be addressed. Students often lack confidence in their communication skills, and they
may be reluctant to speak up during class discussions (Friedland, 2004). It is essential to
intervene so that students gain confidence in their ability to orally communicate. After all, the
development of their skills in this area is widely recognized as essential to student success in
both the academic and professional arenas.
Andrews and Higson (2008) surveyed graduates and found that many do not feel that their
educational experience had equipped them effectively with oral presentation skills:
“I feel I could have done with some sort of formal training in how to do presentations.” (p. 415)
“I think there should have been more practice at…presenting things in front of other people as
part of my degree course…” (p. 415)
Thus, a review of literature indicates that while not all professional employment positions require
employees to make formal oral presentations, it is difficult to think of any job that does not
require effective articulation of ideas and information, and students must develop confidence in
their ability to meet this workplace expectation.
COM Data Supporting Oral Communication as QEP Topic
 Curriculum Map:
A QEP topic may be selected on the basis of an institution’s need to improve student learner
outcomes in a given area, on the basis of a need to enhance some aspect of the campus
environment to better support student learning, or on the basis that an important area of student
learning is inadequately addressed.
At the College of the Mainland, one of the data sources available to determine the degree to
which instruction is focused on various skill areas is the curriculum map. The curriculum map is
periodically developed to determine which of the College’s general education competencies is
taught and assessed in which general education courses. Faculty members are surveyed and
asked to reach consensus by academic discipline about the degree to which each competency
is addressed in each high-volume general education course. When the results are aggregated,
it is easy to detect which of the identified competencies are emphasized across the curriculum.
The curriculum map which was developed in 2006, available during the topic selection process,
indicated that the general education competencies were taught and assessed as follows:
17
College of the Mainland
Figure 1: Percentage of Core Curriculum Courses Which Assess or Teach COM’s Eight
Core Competencies (2006)
Thus, this data indicated that students were not being challenged to exercise oral
communication skills across the curriculum. Furthermore, the assessment of oral
communication as a general education competency (i.e., speaking) was limited to the
assessment of student learner outcomes embedded in speech courses in the core curriculum.
(Note: Students completing an Associate of Arts or Associate of Applied Science degree are
required to take one speech course as part of the core curriculum.)
When faculty members were surveyed again in 2010, an updated curriculum map was
produced. According to what faculty members reported in 2010, the general education
competencies were taught and assessed in courses across the core curriculum as follows:
18
College of the Mainland
Figure 2: Percentage of Core Curriculum Courses Which Assess or Teach COM’s Eight
Core Competencies (2010)
The updated 2010 survey responses indicated that oral communication continues to be underemphasized at College of the Mainland. In fact, based on this data, oral communication was
being taught and assessed in even fewer courses in 2010 than in 2006.
 COM QEP Survey:
As discussed in SECTION II, various constituent groups were surveyed to determine which of
nine general education competencies was perceived to be most important as well as which
were perceived to be effectively addressed. Oral communication was ranked third in
importance but sixth with regard to how effectively it is addressed. Thus, not only did the
curriculum map, based on faculty reports, indicate that oral communication skills were
addressed in a limited fashion across the curriculum, but constituent groups as a whole
perceived this skill set to be less effectively addressed than most of the other competency
areas.
 Limited Data for Assessment of Oral Communication Student Learner Outcomes:
Unlike the situation in which student learner outcome data indicates that students are
performing poorly in a particular area of learning, COM’s focus on oral communication prior to
19
College of the Mainland
this QEP was limited, and very little assessment data, outside of student learner outcome data
collected in speech courses, was even available to determine the level of competence achieved
by students in this area. Thus, this QEP is based on the assumption that a skill set minimally
emphasized is not likely to be highly developed among the student body. Given the nature of
oral communication, and the anxiety experienced by some students about speaking publicly, it
stands to reason that a curriculum that fails to address this skill set does not effectively produce
competent speakers.
While COM assesses some of its general education competencies through the administration of
standardized tests, oral communication has been assessed in a very limited fashion through
rubric scores earned by students in speech courses. No data has been available with regard to
student competence in speaking after they complete their course(s) in speech.
Thus, the selection of oral communication as COM’s QEP rests on the assumption that if a skill
set is deemed to be important, as oral communication has been deemed to be (by COM
constituency groups, best practices at other institutions, the THECB, and employers), then that
skill set needs to be taught and assessed broadly across the curriculum. The limited data on
student learner outcomes in this area reveal the truncated way in which oral communication has
been addressed at COM. Thus, the lack of data in this area was a relevant factor in the
selection of oral communication as our QEP topic.
 Data Pertinent to Student Achievement in Other Areas:
The QEP survey administered to various constituent groups revealed that two of COM’s general
education competencies (reading and critical thinking) were perceived to be more important
than oral communication, which was ranked third in importance. However, both of these
competencies were perceived by respondents to be more effectively addressed through COM’s
curriculum than oral communication (reading ranked second, and critical thinking tied for fourth
place with math). In addition, standardized testing of students, using the Collegiate Assessment
of Academic Proficiency (CAAP) tests (American College Testing, 2012), indicated that students
were achieving at or above the national average in writing and critical thinking. Thus, while two
other areas were perceived to be more important than oral communication, oral communication
was the competency perceived to be important but insufficiently addressed.
Consideration of Best Practices at Other Academic Institutions
It is clear that COM had not been emphasizing oral communication across the curriculum, yet
this skill is seen as important by our constituent groups, the THECB, and employers nationwide.
Thus, the importance of oral communication cannot be overstated. But how have other
institutions of higher learning educated students in this area?
Other academic institutions have identified oral communication as a focus of their QEP, as it is
widely recognized that the ability to communicate effectively is a key component to academic
and professional success. The topic has been approached in various ways, but it is commonly
recognized that oral communication must be addressed throughout the curriculum if students
are to emerge with well-developed speaking skills. The University of Southern Mississippi
(2009) has identified oral communication as a key element in its QEP and has established a
Speaking Center to facilitate the development of communication literacy, a strategy which is
discussed further under “Actions to be Implemented.”
20
College of the Mainland
Another institution of higher learning which focuses heavily on oral communication is Alverno
College, a four-year college celebrated for its pedagogical efforts and the establishment of a
learning-centered environment. Alverno electronically catalogues student learning artifacts,
including oral presentations (Alverno College, 2007). Thus, they are able to track the
development of speaking skills from a student’s first semester until graduation. This strategy
will also be discussed further under “Actions to be Implemented.”
Durham Technical Community College’s (2006) QEP focused on the ability to send and receive
audience-specific communications and included both written and oral communication elements.
Durham identified the following among the various types of oral communications in which
students might participate in the classroom: voluntary oral exchange with instructor, voluntary
oral exchange with peers, required oral participation in pairs or small groups during class,
required oral response to whole group, formal presentations in class, responses to instructor
prompts or questions, role play, debates, and games (Cheng, 2007). It is hypothesized that
even if formal presentations become the primary focus of COM’s QEP, students who develop
their speaking skills would be increasingly comfortable participating in multiple types of oral
exchanges.
Also of note, per Durham Technical Community College’s QEP, it must be recognized that the
development of students’ communication skills cannot be the sole responsibility of
communications faculty. It is self-evident that students might develop the basic speaking skills
they will need within the speech courses in the core curriculum, but if they do not exercise these
skills across the curriculum, those skills are likely to deteriorate. As noted in Durham’s QEP, “all
program faculty bear a responsibility to reinforce these skills by giving students opportunities to
practice and master….oral communication skills. Likewise, faculty and staff have the
responsibility of modeling the same communication behaviors expected of students in the
course of their daily interactions with them” (Durham Technical Community College, pp. 14 –
15).
Oral communication is also one of the central components of the University of Miami’s (2008)
QEP: Communication Across the Curriculum. This QEP focuses on communication literacy
and stresses not only speaking skills but competence in listening as well (a skill that is integral
to effective communication). Like the College of the Mainland, the University of Miami surveyed
relevant constituent groups (students and alumni, administrators, and faculty) from which to
derive their QEP topic.
In summary, best practices are founded on the assumption that while courses in speech are an
important part of the general education curriculum, oral communication skills are not likely to be
fully developed and maintained if their usage is not required across the curriculum.
As institutions of higher learning prepare their students to compete successfully in the
workplace, there is increasing acknowledgment that a narrow focus on technical or disciplinespecific skills is insufficient to facilitate career success. Increasingly, employers have expressed
a desire for graduates who apply for positions in their organizations to possess the so-called
“soft skills” that may more strongly predict workplace advancement. These skills have been
defined in various ways, but they are generally considered to include “a range of interpersonal
skills such as courtesy, respect for others, work ethic, teamwork, self-discipline, self-confidence,
conformity to norms, language proficiency, and behavior and communication skills (Waggoner,
2003).
21
College of the Mainland
Best Practices Summary
From these institutions which have focused on the enhancement of oral communication, COM
has identified best practices that will be emphasized and integrated into our QEP:
 If students are to demonstrate achievement in the area of oral communication, which
has been deemed important by our constituency groups, the THECB, and employers,
then oral communication elements must be integrated into course requirements across
the curriculum.
 Instructional support systems, such as focused tutoring in the area of oral
communication, must be developed to support student achievement in this area.
 Tracking achievement in oral communication should occur on both a longitudinal and
cross-sectional basis.
 Inasmuch as faculty will not only be teaching and assessing oral communication skills
but also modeling them, professional development for faculty is a key area of
intervention.
Conclusion: SECTION III
So Why Oral Communication?





Supports the College’s Mission!
Supports the Outcomes Identified by the Texas Higher Education Coordinating Board!
Soft Skills are Important!
Supported by COM Data!
Supported by Best Practices at Other Academic Institutions!
Thus, having employed a QEP topic selection process that was data-driven and inclusive of
multiple campus constituencies, the College of the Mainland chose oral communication as its
QEP topic. COM considered the degree to which it offered students the opportunity to develop
oral communication skills and found that there was limited emphasis on this skill set, despite its
importance according to employers nationwide, the THECB, and our own constituent groups.
Therefore, this QEP seeks to enhance student achievement in this important area so that they
can compete successfully for jobs and advance more rapidly in the workplace.
22
College of the Mainland
SECTION IV
DESIRED STUDENT LEARNING OUTCOMES
This section demonstrates:
Focus on learning
outcomes in
support of the
College’s mission
It is hypothesized that students will demonstrate enhanced oral communication skills and
diminished anxiety attached to public speaking as a result of the following key interventions:
1. the integration of oral communication assignments across the curriculum
2. professional development for faculty focused on how to teach, assess, and model oral
communication
3. enhancement of instruction in effective oral communication across the curriculum
4. provision of individualized tutoring in oral communication via the newly developed
Speaking, Reading, and Writing Center
5. increased institutional emphasis on the importance of oral communication via events like
the Student Speakers Showcase and the “Words that Changed History” day
In specific, the identified student learner outcomes are as follows:
QEP Student Learner Outcomes*
1. Students will demonstrate the ability to express their ideas verbally using expressive,
accurate and appropriate language.
2. Students will use appropriate presentation techniques (i.e., maintain eye contact,
modulate voice, demonstrate appropriate pacing, use appropriate gestures, etc.)
3. Students will demonstrate understanding of the topic by utilizing properly cited facts,
examples, and other forms of support.
4. Students will plan, prepare, and deliver a well-organized, logical oral presentation.
5. Students will demonstrate a decrease in their communication apprehension with
repeated practice of oral communication skills in QEP-enhanced courses.
The measurement of these outcomes (how they will be measured and the criteria for
determining whether the outcomes have been met) will be discussed in SECTION IX
(Assessment).
*These outcomes were developed by COM’s speech faculty based on best practices within their
field of expertise.
23
College of the Mainland
SECTION V
ACTIONS TO BE IMPLEMENTED
This section demonstrates:
Broad-based
involvement of
institutional
constituencies
Focus on learning
outcomes in
support of the
College’s mission
COM’s Quality Enhancement Plan seeks to impact student learning both directly and indirectly
with regard to oral communication. The infusion of oral communication elements across the
curriculum will be an evolving process, and ultimately the QEP seeks to inspire a cultural
change in which students are challenged to develop and exercise these skills on a regular
basis, not only via formal presentations, but through less formal means as well.
The actions to be implemented in order to accomplish the goals of COM’s QEP will include
some initiatives that enhance the learning environment, thus indirectly impacting student
learning, while others will more directly facilitate the learning and development of oral
communication skills. Thus, the QEP initiatives may be conceptualized as falling into two
groups. First, “enhancement interventions” will include those activities and initiatives which
directly facilitate the learning of oral communication skills, including direct instruction and
instructional supports. Second, “environmental interventions” will include all of the actions
that elevate the importance of oral communication and heighten awareness of why effective oral
communication skills matter. Thus, environmental interventions will seek to impact student
learning indirectly by enhancing the emphasis on the ability to speak effectively among
students, faculty, and staff.
Figure 3, below, depicts COM’s QEP interventions differentiated according to whether they
directly impact student learning (i.e., enhancement activities) or indirectly impact student
learning via changes in the campus learning environment (i.e., environmental interventions).
24
College of the Mainland
Environment Interventions
Action #1: Integration Across the Curriculum
Data from the QEP Survey and COM’s curriculum map revealed that oral communication has
not been emphasized much at COM except within speech courses themselves. Thus, a key
element in producing graduates with excellent communication skills is the provision of
opportunities to practice these skills. To that end, the integration of oral communication
components across the curriculum is the primary focus of this QEP.
In contrast to situations where a skill set has been emphasized but with limited success in
achieving student learning outcomes, COM’s QEP topic selection process made it clear that oral
communication had been largely unaddressed across the curriculum. Thus, the first step in
helping students achieve excellence in oral communication must focus primarily on increasing
opportunities for students to practice these skills outside of speech and communication courses.
While instructional methodology also will be addressed, the key intervention must seek to
25
College of the Mainland
broaden the focus on oral communication across the curriculum such that students are required
to practice these skills.
In order to facilitate the integration of oral communication across the curriculum and to elevate
its importance, the culture at COM will have to evolve into one which values and emphasizes
the importance of the oral articulation of ideas. A number of interventions are planned to
enhance the learning environment at COM such that awareness of the value of these skills will
be increased. (These interventions are discussed under Environment Interventions.) But the
inclusion of oral communication elements in more courses represents perhaps the most
fundamental cultural change that must occur in order for students to become effective speakers.
Coincidental with the development of this QEP at COM has been the development of modified
state requirements with respect to the core curriculum by the Texas Higher Education
Coordinating Board (THECB). The state of Texas will require that public institutions of higher
education implement new core objectives as of fall 2014, and one of these core objectives is
Communication, including written, oral, and visual components. What is notable about this
requirement is that it specifies that all foundational component areas must address this core
objective, meaning that all core curriculum courses in the identified foundational component
areas will have to include instructional elements that address communication. Thus, as COM
responds to the state’s mandated changes, we will be identifying which core curriculum courses
must address which type of communication (written, oral, or visual), and those courses
addressing oral communication may be included in the QEP. The proposed changes in COM’s
core curriculum must be submitted to the THECB in fall 2013, so as we scale up the QEP to
include more courses across the curriculum, the list of courses that will be QEP-enhanced may
expand beyond the list presented in this document.
However, the minimum list of courses selected to be QEP-enhanced are those that are
relatively high-volume (with regard to student enrollment) and/or required in the core curriculum.
These courses were also chosen to maximize the chances that students will complete multiple
courses which include oral communication requirements. For example, a student completing
COM’s general education core curriculum will take English 1301 and 1302, either Speech 1315
or 1318, two History courses (typically History 1301 and 1302), a Computer Literacy course
(typically Computer Information Systems 1301), one Humanities course (typically Humanities
1301 or 1302), two Natural Sciences courses (often Biology 2401 or 2402), one Fine Arts
course (often Music 1306), and one Social and Behavioral Sciences course (often Psychology
2301). Therefore, these courses have been identified to be QEP-enhanced. Additional courses
that are high volume courses in workforce programs have also been included, though it should
be noted that several of the general education courses included are also required by workforce
students. Thus, the courses selected for the QEP have been selected to achieve maximum
impact on our student body.
26
College of the Mainland
Courses to be QEP-enhanced will be integrated into the implementation schedule as follows:
Pilot (Spring 2013)
Year1 (2013-14)
Year 2 (2014-15)
Humanities
ENGL 1301
ENGL 1302
Computer Information
Systems
COSC 1301
Cosmetology
CSME 1451
CSME 1491
Social and Behavioral
Sciences
HIST 1301
HIST 1302
PSYC 1300
Nursing
RNSG 1441
RNSG 1343
Process Technology
PTEC 1408
PTEC 1454
EMS
EMS 2143
EMS 1338
Graphic Arts
ARTC 1305
ARTC 2335
Humanities
ENGL 1301
ENGL 1302
Fine Arts
MUSI 1306
Emergency Medical
Services (EMS)
1338
Nursing
RNSG 1441
Note: One section of
each course.
Speech
SPCH 1315
SPCH 1318
Social and Behavioral
Sciences
HIST 1301
HIST 1302
PSYC 1300
Science & Math
BIOL 2401
BIOL 2402
Humanities
HUMA 1301
HUMA 1302
Social and Behavioral
Sciences
PSYC 2301
Table 4: Courses Identified to be QEP-Enhanced at COM
QEP-enhanced courses will include oral communication assignments to be evaluated via a
standard, common rubric, which faculty will be trained to use in a consistent, reliable manner. In
addition, (as described under Action #1: Professional Development for Faculty in Environment
Interventions) faculty will participate in professional development designed to help them improve
their own oral communication skills and to recognize the key elements in effective speech.
Finally, students in QEP-enhanced courses will receive instruction focused on oral
communication via an electronically formatted instructional module (discussed further under
“Action #3: Student Instructional Module, in this section, Enhancement Interventions”).
27
College of the Mainland
However, in order to evaluate the effectiveness of the professional development intervention
and the electronic student instructional module, during the first year of intervention, a subset of
QEP-enhanced courses will involve only minimal faculty professional development (focused on
the use of the oral communication evaluation rubric) and will not include the electronic student
instructional module. During Year 1 of implementation, half of the History and English courses
designated to be QEP-enhanced will be considered QEP-basic (vs. intensive), meaning that
these QEP-basic courses will receive the minimal level of QEP enhancement (basically, the
simple integration of an oral communication assignment into the course requirements). In this
way, we will be able to compare the impact of the more intensive level of intervention (i.e., more
comprehensive faculty professional development and the inclusion of the electronic student
instructional module) to the more minimal level of intervention (i.e., the inclusion of an oral
communication assignment, evaluated via the standard, common rubric).
This design will allow us to evaluate the utility of particular interventions implemented in the
QEP-intensive sections against a comparison condition (i.e., QEP-basic sections in which these
interventions will not be included). The effectiveness of the QEP-intensive interventions will be
evaluated through a review of 1) data pertaining to student learner outcomes, 2) information
gathered through focus groups with faculty members, 3) data from end-of-semester course
evaluations completed by students, and 4) data from COM’s professional development
evaluation instrument, which requires faculty to report how they have integrated the professional
development into their teaching practices.
The review of this data will determine the need to scale up all sections of identified QEP courses
as QEP-intensive and may also suggest ways in which the interventions may need to be
modified.
While the professional development component and the student electronic instructional module
are discussed in more detail later, what follows here is a brief discussion of how oral
communication will be integrated across the curriculum into the QEP-intensive vs. QEP-basic
course sections.
QEP-intensive course sections:
Each instructor teaching a QEP-intensive course (i.e., all QEP-enhanced courses except for half
of the English and History QEP courses during Year 1) will undergo extensive professional
development relevant to oral communication skills, discussed later in Environment Interventions,
such that instructors serve as effective models of oral communication and are equipped to
evaluate their students with regard to these skills in a reliable and competent manner. The
professional development component for faculty teaching QEP-intensive courses is designed to:
1. improve faculty oral communication skills
2. prepare faculty to reinforce good oral communication during everyday interactions with
students (to include coaching students with regard to how to interact appropriately with
classmates and faculty)
3. equip faculty to evaluate the oral communication skills of their students.
28
College of the Mainland
In addition, QEP-intensive classes will include an electronically packaged student instructional
module developed by COM speech faculty and focused on preparing students to develop
effective oral communication skills, with reinforcement from the instructor.
Furthermore, instructors teaching QEP-intensive classes will participate in at least one group
meeting per fall and spring semester to discuss any problems with QEP implementation and to
share pedagogical experiences and ideas. These meetings, facilitated by the QEP Director, will
be offered at different times of the day and at different times of the semester, as needed, in
order to accommodate all faculty schedules.
Finally, faculty in QEP-intensive classes will offer students incentives (such as extra credit) for
seeking tutoring in speaking via the Speaking, Reading, and Writing Center, or they may require
that students visit the Center as part of the course requirements.
QEP-basic course sections:
As noted previously, half of the History and half of the English course sections identified as
QEP-enhanced during Year 1 of implementation will be identified as QEP-basic. The QEPbasic sections will incorporate oral communication elements into their courses but will receive
limited professional development focused primarily on the use of the oral communication
evaluation rubric. The QEP-basic sections will not integrate the student instructional module,
nor will instructors of these sections participate in semester meetings with other QEP instructors
to share ideas, problem-solve, or to ask for assistance.
Thus, both QEP-basic and QEP-intensive classes will integrate oral communication
requirements into their instruction, and both will use a standardized rubric to evaluate oral
communication assignments, but only the QEP-intensive classes will involve comprehensive
professional development for faculty, ongoing support for those instructors, and the electronic
instructional module for students.
29
College of the Mainland
Table 5, below, presents the elements to be included in QEP-Basic vs. QEP-Intensive courses.
Table 5: Key Interventions to be Included in QEP-Basic (Comparison Condition) vs. QEP-Intensive Courses
Types of oral communication:
Faculty will choose what kind of oral communication assignment to incorporate into their
courses from a menu of options to include:
1-Individual Class Presentation
2-Small Group Class Presentation
3-One-on-One Communication (i.e., interviews, etc.)
4-Other (i.e., debates, etc.)
Oral communication evaluation elements:
All oral communication assignments will be evaluated using a rubric (to be discussed further in
SECTION IX on Assessment) which targets the following key components of effective speech:
1. Verbal communication: Uses clear language skills including appropriate language
level, good grammar/syntax, defined concepts, and accurate words
30
College of the Mainland
2. Nonverbal communication: Displays excellent nonverbals such as vocal enthusiasm,
good eye contact, appropriate gestures, good posture, appropriate dress and overall
dynamism
3. Content: Shows an understanding of the topic by having solid and logical facts, citing
the source of facts (statistical or statement driven), having adequate examples and other
forms of support such as testimonials, comparisons, definitions, and visual aids
4. Organization: Excellent organization including clear thesis, clear intent, follows
subtopics as presented, clear topic sentences and transitions when appropriate and
covers all content
The role of adjunct faculty members:
It should be noted that faculty teaching QEP-enhanced courses will be involved in the QEP
regardless of whether they teach on a full-time or part-time basis. COM has made strides over
the last few years to integrate adjunct faculty more fully into the life of the institution, recognizing
that they comprise an important segment of COM’s instructional personnel. To that end, adjunct
faculty are required to participate in a College-sponsored orientation every year, and several
departments hold annual department-specific orientation meetings for their adjunct faculty. In
addition, adjunct faculty must complete the same training with regard to nondiscriminatory
practices that full-time faculty are required to complete. They also submit course-level data on
student learner outcomes every semester. Finally, adjunct faculty are invited to participate in
campus-based professional development opportunities on a regular basis. Therefore, adjunct
faculty will not be exempted from the QEP but will be required to participate in the QEP at the
same level as full-time faculty, attending professional development sessions and implementing
the QEP as designed.
Integration of online courses into the QEP design:
The QEP Implementation Committee will examine methods for scaling up the QEP to include
designated online courses. Currently, some faculty are using various technologies to include an
oral communication assignment in their course requirements, but the College is considering
methods to make this process practical, student-friendly, and consistent across faculty and
disciplines. It is anticipated that online courses will be integrated into the QEP by academic
year 2015-2016.
Schedule of implementation:
In order to make this process manageable and to modify the procedures as necessary based on
feedback from faculty, courses will be phased into the QEP over a period of 2.5 years. Prior to
fall 2013, when the QEP’s implementation will formally begin, the professional development
component and the QEP course enhancements will be piloted in an effort to identify problems in
any of the processes associated with the QEP’s implementation. One section of each of seven
courses (see Table 4) has been identified to participate in this pilot process in spring 2013, with
the professional development component to be conducted with these faculty members starting
in fall 2012. Data from this pilot experience (student learner outcomes, faculty feedback, end-ofsemester course evaluations) will be reviewed, and modifications will be made as indicated.
Beginning in fall 2013, formal implementation of the QEP will begin, with QEP-enhanced
courses to be integrated during the 2013-2014 academic year and additional courses to be
integrated during the 2014-2015 academic year. (See Table 4.) As noted previously, during
31
College of the Mainland
Year 1 of implementation (i.e., the 2013-2014 academic year), half of the History and English
course sections identified as QEP-enhanced will be considered as QEP-basic so that a
comparison can be made between the QEP-basic and QEP-intensive courses, with
modifications to be made in Year 2 of implementation as informed by the data. Ongoing
evaluation of the QEP strategies will guide the implementation of interventions as the QEP
moves forward. For example, if the professional development component included in QEPintensive courses proves to be effective and/or positively received by faculty, all QEP-enhanced
courses will be implemented as QEP-intensive beginning in the second year of implementation.
The ultimate goal of the incorporation of oral communication elements into the curriculum is to
support and facilitate the use of speaking skills in the classroom and beyond.
A timeline for the implementation of the QEP is presented in SECTION VI.
Action #2: The Speaking, Reading, and Writing Center
In support of the integration of oral communication into the classroom across the curriculum, the
College of the Mainland has developed a tutoring center which includes, as one of its primary
focus areas, oral communication. The University of Southern Mississippi (USM) has
established a Speaking Center as part of its QEP and provides a blueprint for how such a center
might operate (University of Southern Mississippi, 2009). Services offered by USM’s Speaking
Center include assistance to students in every phase of the oral presentation composing
process, coaching in ways to improve oral delivery, and management of speaking anxiety.
USM’s Speaking Center also offers a rehearsal studio, in which students can record their
presentations for purposes of improving their presentation skills. The USM Speaking Center
was staffed initially by advanced undergraduate students, under the direction of a doctoral
student in Speech Communication, who, in turn, was supervised by the chair of the Speech
Communication Department. Since its initial inception, however, USM has hired a full-time
faculty director of the Speaking Center and has expanded its services and the number of
students served. The Speaking Center on USM’s campus is centrally located within the
University’s main library.
As one of the key strategies of COM’s QEP, COM has completed development of its Speaking,
Reading, and Writing Center which offers students assistance in all of these skills which support
effective communication. The center is centrally located within a classroom space in the
Technical and Vocational Building (a building which houses most of the classrooms on COM’s
campus). The Speaking, Reading, Writing Center has been modeled after that of USM but
modified to fit with available resources and student needs on COM’s campus. The menu of
services addressing speech will be very similar, to include opportunities for rehearsal and
coaching with the goal of improving oral communication skills. Computer stations are available
so that students may develop visual aids to presentations (such as PowerPoint slides) and
receive assistance in this process. In addition, two soundproof booths have been constructed in
which students may record oral presentations, which may then be reviewed, with tutors, as
needed, for feedback on ways to improve student performance.
The Speaking, Reading, and Writing Center has begun operating on a limited basis using a
part-time professional tutor and a part-time peer tutor. As of fall 2012, staffing will be
supplemented with 15 full-time faculty members from the Humanities Department, each of
whom will serve 1.5 office hours per week in the Center, to be available to any student seeking
help in these academic areas. In order to be optimally equipped to serve students, these faculty
32
College of the Mainland
members will go through training at the beginning of the fall 2012 semester to better understand
the tutoring process, as tutoring is not equivalent to classroom instruction. This training will be
provided by the professional tutor and will seek to assist faculty in understanding how best to
facilitate student learning via the tutoring modality. As the QEP moves forward, usage of the
Speaking, Reading, and Writing Center will be tracked, and additional tutors will be hired as
needed.
In addition to opportunities to rehearse oral presentations or other kinds of oral communication
assignments, the Speaking, Reading, and Writing Center will seek to assist students who suffer
from speaking anxiety by giving them tips and strategies to manage their apprehension
effectively. The Personal Report of Communication Apprehension (PRCA-24, n.d.) will be
administered to students (see discussion in SECTION IX, Assessment), providing a benchmark
against which the student’s comfort with oral presentations can be assessed over time.
Interventions in speaking apprehension may be provided not only by the Center’s staff but also
by COM’s counselors (job responsibilities to be re-organized if necessary, depending on need).
Action #3: Student Instructional Module
QEP-intensive classes will feature an electronically packaged student instructional module
developed by COM speech faculty. This student instructional video will be about twenty
minutes in length, and instructors will be asked to show this video in their classes prior to the
due date of oral communication assignments.
In recognition of the fact that instructors in other disciplines are not trained or credentialed in the
academic discipline of speech/communications, this instructional module will provide the
framework for basic instruction in oral communication. Since not all of the students in the QEPenhanced classes will have already taken courses in speech, this instructional module will orient
them to some of the key elements of effective oral communication. Instructors will then
reinforce those elements through their instruction.
Instructors will be expected to integrate this instructional module into their regular instruction,
but it may also be made available to students through Blackboard, which serves as the
College’s distance education platform, as well as ShareStream. Thus, students who are absent
from class when the module is presented will be able to access this instruction electronically.
Furthermore, by making the module available through ShareStream and the Blackboard
platform, students who wish to review the instructional materials for a second time will be able to
do so.
Key elements of this instructional module will include:
1) Overview of the QEP
2) Review of basic speech concepts
3) Review of five oral communication elements
a) Nonverbal
b) Verbal
c) Organization
d) Using presentation aids
e) Content
4) Review of the Oral Communication Rubric
5) Managing Communication Apprehension
33
College of the Mainland
Action #4: Student Success Workshops on Oral Communication Topics
College of the Mainland offers free Student Success Workshops on a monthly basis, focused on
topics that serve to enhance student learning in a wide range of areas, including financial
responsibility, study skills, and more. Typically, these workshops are held during College Hour,
which is an hour-long period of time (Tuesday/Thursday, 12:30pm – 1:30pm) during which very
few College classes are scheduled. Thus, the workshops are scheduled to enhance
accessibility to all students. They are conducted by COM faculty and staff with expertise in the
specific topical area of each particular workshop.
With the advent of the QEP, some of these workshops will focus on topics pertinent to oral
communication. Topics of relevance will include cross-cultural communication, nonverbal
communication, interviewing skills, etc. At least one workshop per fall and spring semester will
support the QEP by spotlighting an aspect of oral communication. The inclusion of topics
focused on aspects of effective speech will serve not only as an intervention that will directly
impact student learning but will also elevate the importance of oral communication as an
essential competency. These workshops will begin to be implemented in fall 2013.
Environment Interventions
Action #1: Professional Development for Faculty
Professional development for faculty will be an important element of this QEP, and it will be
offered initially as either basic or intensive. See Figure 4 for a comparison of professional
development elements for QEP-basic vs. QEP-intensive faculty members.
QEP-basic professional development:
Training for faculty teaching QEP-basic classes (i.e., half of the History and half of the English
course sections during Year 1 of implementation) will focus primarily on the use of the QEP
evaluation rubric (see SECTION IX) so that faculty can reliably assess student skills in oral
communication. While the student instructional module will not be integrated into these
courses, faculty teaching these courses must include an oral communication requirement in
their syllabi. The QEP-basic classes will serve as a comparison group for the QEP-intensive
classes (in which additional interventions will be implemented), so the primary focus in the basic
course sections will be to require an oral communication assignment and to evaluate it using the
standardized QEP oral communication rubric. In addition, faculty will be trained with regard to
technology used in the classroom to document student presentations.
QEP-intensive professional development:
Not only will faculty in QEP-intensive classes require training in how to effectively assess
student oral presentation skills, but they will also benefit from professional development
experiences which facilitate the improvement of their own speaking abilities, thus enabling them
to more effectively model oral communication skills in the classroom. Professional development
for faculty teaching these course sections will provide more detailed information on what
constitutes effective oral communication and will offer faculty members the opportunity to
improve their own speaking skills. In addition, faculty will be trained in how to use appropriate
34
College of the Mainland
technology for recording student presentations, as these electronically archived presentations
will be used in further assessment of the QEP’s effectiveness (see SECTION IX).
In an additional effort to support faculty participating in the QEP-intensive condition, fall and
spring semester discussion meetings, facilitated by the QEP Director, will be held among QEPintensive instructors to share ideas, problem-solve, and provide assistance as needed.
All elements of the QEP will be piloted in spring 2013, including the professional development
component (some of which will occur in fall 2012), which will be provided to faculty in the pilot
classes at the QEP-intensive level.
See Figure 4, below, for a graphic representation of the professional development elements of
COM’s QEP.
QEP-Basic and
QEP-Intensive
Review
speech
concepts
Review written explanation
of basic speech concepts to
establish reliable use of QEP
oral communication rubric
for grading student
assignments.
Educate faculty in using
technology to capture oral
communication assignments
in the classroom.
QEP-Intensive
only
QEP-Intensive
only
View sample
videos of
speech
concepts
View video
lecture
Videos explaining the five
oral communication topics.
1-Nonverbal
2-Verbal
3-Organization
4-Using Presentation Aids
5-Content (optional)
Videos demonstrating
varying quality examples
on a 1 – 4 scale.
The scale mirrors the QEP
grading rubric where:
4=Excellent
1=Poor
QEP-Intensive
only
Practical
application
exercises
Trainees participate in
demonstration/applicatio
n of topic through
modeling
exercise/activity and role
playing.
Four types of oral
communication
categories are features in
this exercise/activity.
1-Individual Class
Presentation
2-Small Group
Presentation
3-One-on-one
Communication
4-Other (i.e. Debates,
etc.)
Figure 4: Professional Development Elements of QEP-Basic vs. QEP-Intensive Faculty Training
35
College of the Mainland
Action #2: Technological Support
Technological support will be provided so that student presentations can be electronically
recorded. Approximately ten percent of oral presentations (randomly selected) will be
electronically captured for use by the QEP Assessment Committee in establishing convergent
validity of the oral communication rubric. (See SECTION IX Assessment.)
During fall 2011, the Technology Committee along with the QEP Director reviewed products for
storing video presentations and selected ShareStream as the product of choice. This software
product allows access to video recordings via the web and through BlackBoard. Brett Stephens,
a member of the Distance Education Department of the College, will administer the software
and is the primary contact between the College and the company.
Once a semester, in classes selected by the Office of Institutional Research and Effectiveness
for video recording, the student presentations will be recorded using LadiBug document
cameras (or portable digital cameras in classrooms without a Ladibug). Each instructor will save
the presentations and then submit them to the administrator of ShareStream who will upload
them to the ShareStream server. The presentations are in a password protected area to
safeguard students’ identities, and they will be accessible to the student, the instructor, and to
members of the QEP Assessment Committee.
Action #3: Inclusion of QEP Update at COM Board of Trustees Meetings and
Instructional Leadership Council Monthly Meetings
The premise of this QEP is that oral communication has been underemphasized in COM’s
curriculum. Thus, students have had limited opportunities to develop and perfect their speaking
skills.
In order to underscore the importance of these skills, there will be regular QEP updates
provided both at meetings of the Board of Trustees and the Instructional Leadership Council.
COM’s Board of Trustees (BOT) meets monthly, and regular agenda items include updates from
constituent heads, including the President of the Faculty Senate, the President of the
Professional Council, the President of the Classified Council, and the President of the Student
Government Association. Added to the agenda on a rotating basis will be an update on the
QEP from either the QEP Director or the Vice President for Instruction. BOT members will be
kept informed about the status of the QEP, data pertaining to student learner outcomes, and
any modifications made to interventions or assessment processes. By placing the QEP on the
BOT agenda on a regular basis, the importance of oral communication skills will be elevated,
and the QEP’s focus will remain a priority.
The Instructional Leadership Council (ILC) meets monthly, coordinated by the Vice President for
Instruction, and consists of instructional Deans, Department Chairs, Program Directors, and
other identified personnel whose roles are to support instruction. These meetings typically
focus on issues pertinent to instruction, whether administrative in nature or more directly related
to pedagogy. An update on the QEP will become a regular agenda item for this meeting, not
only to keep everyone informed, but also to troubleshoot any problems with regard to
implementation.
36
College of the Mainland
Action #4: Student Speakers Showcase
To further emphasize the potential impact of effective speech, an annual Student Speakers
Showcase will be established. Faculty will nominate students to give an encore performance of
one of their oral presentations at a campus-wide showcase of student speeches. Students may
be given an incentive (such as a bookstore gift certificate) for participating. This showcase will
celebrate student achievement in oral communication and also serve to model effective
communication for others. In addition, it will keep the QEP topic in the public eye, as the
community will be invited to attend. In this way, local employers will appreciate that COM
places emphasis on oral communication, a valued employment skill often cited as lacking in job
applicants. COM regularly hosts guest speakers from diverse backgrounds to make
presentations on a variety of topics, so the Student Speakers Showcase will give students an
opportunity to educate the campus via presentations of their own.
Action #5: “Words that Changed History” Day
In addition to the Student Speakers Showcase, which will celebrate original student
presentations, students will be selected to dramatize famous orations in history at an annual,
campus-wide “Words that Changed History” Day. While dramatization is not equivalent to
developing and delivering one’s own presentation, the purpose of this activity will be to
demonstrate how powerful the effective articulation of ideas can be. Faculty will nominate
students to participate, and the community will be invited to attend this event. Students
attending the event will not only witness effective speech delivery but will also learn about
landmark orations in history.
Action #6: Recruitment of Effective Visiting Speakers
COM already has an impressive track record when it comes to inviting speakers to campus to
deliver presentations on a variety of topics. In any given academic year, guest speakers
address such topics as Hispanic heritage, civil rights, women’s history, literacy, and more.
These efforts will be supported by the QEP Implementation Committee, who will identify
potential orators to be invited to come to campus to speak. These presentations will be
highlighted for students, who will be encouraged to attend and to take note of what made the
presentation effective.
Action #7: Representation of QEP on Institutional Effectiveness Council
The QEP is already a standing agenda item on the monthly meeting agenda of COM’s
Institutional Effectiveness Council (IEC). This body includes representatives from the various
assessment bodies/processes on campus, including the Instructional Assessment Committee,
the Online Course Review Committee, the Achieving the Dream Data Committee, the
Instructional Review process, and the Administrative Review process. Because assessment
and evaluation are important parts of the QEP, the QEP Director serves as a member of the
IEC, and as the QEP moves forward, the assessment of its related student learner outcomes
will be regularly monitored by this body.
37
College of the Mainland
SECTION VI
TIMELINE
A logical calendaring of all actions to be implemented (providing
support for compliance with CS 3.3.2 “institutional capability for the initiation,
implementation, and completion of the QEP”)
Timeline for Implementation of the QEP
March 2009
Formation of QEP Development Committee (to develop detailed plans and
timelines, which will form the basis of the SACS QEP report)
Fall 2010
Survey of faculty to determine which faculty/courses already integrate oral
communication into their instruction
Fall 2011
Identification of courses to serve as pilot courses for the QEP
Fall 2011
Selection of electronic portfolio software/technology needed
Spring 2012
Begin phased acquisition and installation of necessary electronic portfolio
technology in classrooms
July 2012
Development of process for collecting assessment data (coordinated
through IR)
August 2012
Submission of final QEP report to SACS
August 2012
Formation of QEP Implementation Committee (responsible for the actual
implementation of the QEP)
Fall 2012
Professional development training for pilot faculty in effective oral
communication and the types of assignments that might be incorporated
October 2012
SACS on-site review visit
Spring 2013
Implementation of the pilot QEP through the integration of oral
communication assignments into the pilot courses, the use of the
assessment rubric, and the administration of the speech anxiety scale
Spring 2013
Training of faculty/staff involved in QEP courses to be integrated into QEP
in fall 2013 with regard to effective oral communication, the use of relevant
technology, and the use of the oral communication rubric
38
College of the Mainland
Spring 2013
Development of plan to recruit students to give presentations in Student
Speakers Showcase
Spring 2013
Development of plan to recruit students to participate in Words that
Changed History Day
Summer 2013
Analysis of data from spring pilot implementation, to include student learner
outcome data, end-of-semester course evaluations, faculty feedback, and
data from professional development evaluation instrument
Summer 2013
Modification of rubric or other elements of the QEP based on pilot data
(data-based modification to be ongoing, as appropriate)
Fall 2013
Implementation (post-pilot phase) of QEP begins
Fall 2013
QEP Implementation Committee begins process of researching ways of
expanding QEP design to include online course sections
Spring 2014
Review of identified syllabi to validate inclusion of oral communication in
designated courses
Spring 2014
Training of faculty/staff involved in QEP courses to be integrated into QEP
in fall 2014 with regard to effective oral communication, the use of relevant
technology, and the use of the oral communication rubric
April 2014
First annual Student Speakers Showcase
Summer 2014
Analysis and dissemination of student learner outcome data from rubrics
and speech anxiety scale
Summer 2014
Review of random sample of electronically archived student presentations
to determine inter-rater reliability of rubric scoring
Fall 2014
Disseminate feedback to faculty with regard to inter-rater reliability of rubric
scoring; QEP Director to meet with faculty as needed to review scoring
criteria
Fall 2014
Continued expansion of QEP through integration of Year 2 courses
Fall 2014
Survey of faculty to obtain input on QEP process
October 2014
First annual Words that Changed History Day
Spring 2015
Review of identified syllabi to validate inclusion of oral communication in
designated courses
39
College of the Mainland
Spring 2015
Online QEP faculty trained in technology for recording and capturing oral
presentations in distance education format
April 2015
Second annual Student Speakers Showcase
Summer 2015
Analysis and dissemination of data from rubrics and speech anxiety scale
Summer 2015
Review of random sample of electronically archived student presentations
to determine inter-rater reliability of rubric scoring
Summer 2015
Disseminate feedback to faculty with regard to inter-rater reliability of rubric
scoring; QEP Director to meet with faculty as needed to review scoring
criteria
Fall 2015
Inclusion of online courses into QEP design begins
Fall 2015
Survey of faculty to obtain input on QEP process
October 2015
Second annual Words that Changed History Day
Spring 2016
Review of identified syllabi to validate inclusion of oral communication in
designated courses
April 2016
Third annual Student Speakers Showcase
Summer 2016
Analysis and dissemination of data from rubrics and speech anxiety scale
Summer 2016
Review of random sample of electronically archived student presentations
to determine inter-rater reliability of rubric scoring
Summer 2016
Disseminate feedback to faculty with regard to inter-rater reliability of rubric
scoring; QEP Director to meet with faculty as needed to review scoring
criteria
Fall 2016
Survey of faculty to obtain input on QEP process
October 2016
Third annual Words that Changed History Day
Spring 2017
Review of identified syllabi to validate inclusion of oral communication in
designated courses
April 2017
Fourth annual Student Speakers Showcase
Summer 2017
Analysis and dissemination of data from rubrics and speech anxiety scale
40
College of the Mainland
Summer 2017
Review of random sample of electronically archived student presentations
to determine inter-rater reliability of rubric scoring
Summer 2017
Disseminate feedback to faculty with regard to inter-rater reliability of rubric
scoring; QEP Director to meet with faculty as needed to review scoring
criteria
Fall 2017
Survey of faculty to obtain input on QEP process
Fall 2017
Survey of community to solicit their opinions regarding the oral
communication skills of COM students/graduates
October 2017
Fourth annual Words that Changed History Day
Spring 2018
Review of identified syllabi to validate inclusion of oral communication in
designated courses
April 2018
Fifth annual Student Speakers Showcase
Summer 2018
Analysis and dissemination of data from rubrics and speech anxiety scale
October 2018
Fifth annual Words that Changed History Day
October 2018
Submission of SACS Fifth-Year Interim Report (including Part V: The
Impact Report of the Quality Enhancement Plan)
NOTE 1: Professional development experiences will be assessed each time they occur, using COM’s online
evaluation tool, developed as part of the Achieving the Dream initiative.
NOTE 2: For a more detailed timeline of actions taken related to the QEP, see the copy of COM’s Project
Management Timeline in Appendix E.
41
College of the Mainland
SECTION VII
ORGANIZATIONAL STRUCTURE
Clear lines of responsibility for implementation and
sustainability (providing support for compliance CS 3.3.2 “institutional capability
for the initiation, implementation, and completion of the QEP”)
This section demonstrates:
Institutional capability
for the initiation,
implementation, and
completion of the QEP
Administrative Infrastructure
The QEP at COM was organized in three phases to facilitate: 1) the topic selection process, the
topic development process, and 2) the implementation of the QEP.
QEP Topic Selection Process
Members of the QEP Topic Selection Committee were selected by the committee’s co-chairs,
Dr. Steven Sewell and Mr. Bruce Glover, in spring 2007. As noted in SECTION II, membership
of this committee reflected broad campus representation, including individuals from general
education departments, workforce programs, student support services, the administration, and
the student body. See Appendix F for a list of the QEP Topic Selection Committee’s members.
While the co-chairs of the QEP Topic Selection Committee answered directly to the VicePresident for Instruction, COM’s administration supported a faculty-driven topic selection
process and did not direct the committee toward any particular topic.
The organizational structure demonstrates that the QEP was viewed as being primarily an
instructional initiative, based on its goal of enhancing student learning, as evidenced by the
faculty-driven process as well as the organizational structure which placed the QEP under
instructional administration.
The organizational flow chart relevant to the topic selection process is presented below.
42
College of the Mainland
QEP Topic Development Process
Once the QEP Topic Selection Committee completed its task with the selection of oral
communication as the QEP topic, the focus turned to developing elements of the selected QEP
topic proposal. To this end, subcommittees were formed in 2009 to carry out the planning for
the major QEP components, and the chairs of these subcommittees served as the membership
of the QEP Topic Development Committee. The subcommittees formed, and their respective
missions, included the following:
Faculty Development and Coordination Subcommittee
Mission: Plan faculty development experiences, assigning responsibilities, determining target
audiences, etc., focusing on training faculty in the assessment of oral communications, the use
of necessary technologies, and ways to improve their own oral communication skills.
Assessment Subcommittee
Mission: Compile and organize the assessment instruments to be used in the QEP (as outlined
in SECTION IX, Assessment section of this proposal), develop a schedule for assessments, and
create a plan for coordinating these assessments, working with the Office of Institutional
Research and Effectiveness, as appropriate.
43
College of the Mainland
Technology Subcommittee
Mission: Research the various kinds of technology that could be used to record and archive
student presentation and make a recommendation to the QEP Implementation Committee
regarding the type of technology that would best fit the needs of COM’s QEP.
Marketing Subcommittee
Mission: Develop short-term, medium-term, and long-term plans for educating the campus and
community about the QEP (its focus, its purpose, its goals, and its value).
Budget Subcommittee
Mission: Determine and document (on a more specific basis) expected and actual QEP
expenses, including salaries and benefits, office supplies, technology, marketing, professional
development, etc.
Student Speakers Showcase Subcommittee
Mission: Make specific plans for the coordination of this annual event, including the
assignment of responsibilities, methods of recruiting students, how to invite the community, etc.
Words that Changed History Day Subcommittee
Mission: Make specific plans for the coordination of this annual event, including the
assignment of responsibilities, methods of selecting speeches to be dramatized, methods of
recruiting students, how to invite the community, etc.
See Appendix G for a list of the QEP Topic Development Committee’s members.
The organizational flow chart relevant to the topic development process is presented below.
44
College of the Mainland
45
College of the Mainland
QEP Implementation Process
A QEP Director (Dr. Gilchrist White, Professor of English) was appointed in the summer of 2011
to oversee the implementation of the topic. Assuming responsibility for the QEP from the cochairs of the QEP Topic Selection and Topic Development Committees, the QEP Director, with
input from outgoing co-chair, Dr. Steven Sewell, drafted members to serve on the QEP
Implementation Committee, which consists of individuals with expertise in the topic area and/or
a strong interest in implementing the QEP. This committee will be charged with the
responsibility of enacting the plan in its entirety, once the QEP topic is approved by the
Southern Association of Colleges and Schools Commission on Colleges (SACSCOC). Thus,
this committee includes faculty with expertise in oral communication, faculty and staff involved in
implementing the QEP, and student services staff involved in supporting the QEP, including the
implementation of the “Words that Changed History” Day and the organization of the Student
Speakers Showcase.
Most of the subcommittees formed in the topic development phase will continue in operation
during the implementation phase. Those subcommittees include the following:
Faculty Development and Coordination Subcommittee
Assessment Subcommittee
Technology Subcommittee
Marketing Subcommittee
Student Speakers Showcase Subcommittee
Words that Changed History Day Subcommittee
See Appendix H for a list of the QEP Topic Implementation Committee members.
The QEP Director will chair the QEP Implementation Committee, direct the activities of the
various subcommittees, and oversee the operation of the Speaking, Reading, and Writing
Center. She will answer directly to the Vice President for Instruction (VPI), who in turn reports
directly to the President. Regular reports will be provided to the VPI with regard to the schedule
of implementation, budget expenditures, progress with regard to student learner outcomes, and
challenges encountered. As previously noted, regular reports will also be provided to the Board
of Trustees, as well as to the Instructional Leadership Council.
The QEP Director will perform these duties in exchange for two course releases in both the fall
and spring semesters in addition to an annual stipend of $5820, equivalent to the
reimbursement package offered to Department Chairs.
The organizational flow chart relevant to the topic implementation process is presented below.
46
College of the Mainland
47
College of the Mainland
SECTION VIII
RESOURCES
A realistic allocation of sufficient human, financial, and physical
resources (providing support for compliance CS 3.3.2 “institutional capability
for the initiation, implementation, and completion of the QEP”)
This section demonstrates:
Institutional capability
for the initiation,
implementation, and
completion of the QEP
College of the Mainland Capabilities Supporting Oral Communication
The College of the Mainland has a broad range of capabilities that will serve to support the
development of student oral communication skills. Major capabilities will be provided by the
following offices/processes:
Speaking, Reading, and Writing Center
Existing tutoring services will be augmented with services focused on the development of oral
communication skills. A classroom space in the Technical and Vocational Building has already
been converted to house a comprehensive tutoring center that will provide opportunities for
students to receive assistance with reading, writing, and speaking. This center also includes
two soundproof booths in which students can record and practice speech delivery. Tips on
managing speech anxiety will also be shared with students who are uncomfortable speaking in
front of an audience.
The center is already serving students and is staffed currently by a professional tutor and a peer
tutor, but staffing will be augmented beginning fall 2012 with full-time faculty members from the
Humanities Department, who will serve some or all of their office hours in the Center in order to
be available to students.
Counseling and Disability Services
COM’s QEP seeks not only to enhance student oral communication skills but also to increase
student comfort levels with speaking in front of an audience. To that end, speech anxiety will be
assessed (see SECTION IX for more information on this assessment component), and students
with high levels of anxiety may seek assistance from a COM counselor for tips on how to
effectively manage this anxiety. Tutors in the Speaking, Reading, and Writing Center will also
be equipped to assist students in overcoming speaking anxiety.
In accordance with COM’s regular policies, students with documented disabilities who require
accommodations in order to be academically successful will be supported through the Office for
Students with Disabilities. Specific accommodations will be customized according to the
disability in question.
48
College of the Mainland
Student Success Course
The College of the Mainland offers a three-credit-hour student success course (PSYC/EDUC
1300 Psychology for Success) that is mandatory for students testing into developmental classes
in reading, English, and/or math. This course not only seeks to help student navigate the world
of higher education but also focuses on decision-making skills, motivation, and lifelong learning.
An oral communication component is part of the course, often giving students their first
experience in speaking in front of an audience.
Teaching and Learning Committee of the Planning Council
The Planning Council was established at COM in 2009 to serve as a point of consensus in a
participatory process that identifies and analyzes issues of significant interest to the College
community. It is through the Planning Council that the President obtains recommendations for
the annual planning priorities and budget allocations. The Council also evaluates the use of
planning and assessment results to improve the quality of services in the areas of
administration, instruction, student services and college operations.
The Teaching and Learning Committee (TLC) studies, analyzes, and makes recommendations
to the Planning Council about programs, curricular resources, and pedagogy. This includes best
practices, innovations, and related issues serving the facilitation and enhancement of the
teaching and learning process at COM. Recommendations formulated by this committee are
forwarded to COM’s Planning Council, which, in turn, makes recommendations to COM’s
administration with regard to how discretionary funds should be prioritized. As the QEP moves
forward, this committee may recommend actions that support the QEP or address challenges
encountered in its implementation.
Faculty Brown Bag Lunches
Faculty meet on a voluntary basis for “brown bag lunch” discussion groups every other month.
These lunches offer an opportunity for faculty to share pedagogical strategies and concerns on
a variety of topics. While these meetings are scheduled and facilitated by the Faculty Senate
President, the QEP Director will attend these lunches to be available as a resource on QEPrelated questions and concerns as well as to raise the profile of the QEP and its focus on oral
communication. These lunches provide a ready-made forum for faculty to discuss issues
pertaining to the implementation of the QEP, including innovative oral communication
assignments, and effective ways to model oral communication.
Instructional Assessment Committee (IAC)
COM regularly assesses student learning outcomes in a systematic manner, and this process is
overseen by the IAC. All sections of credit-bearing courses (including those taught by full-time
faculty as well as those taught by part-time faculty) are assessed with regard to student learning
outcomes every semester. Data pertaining to these outcomes are entered into an electronic
database, using a five-column model that requires information on how the outcome is assessed,
the criterion for success, actual results from each course section taught that semester, and most
importantly, how the faculty member will use the results to improve outcomes the next
semester. Not only is this data pertinent to the individual faculty member, but the data is also
regularly aggregated across course sections to provide information about how effectively
student learning outcomes are being achieved across all sections of the course in question.
With these processes already in place, the documentation of student learning outcome
achievement related to the QEP will be efficiently accomplished. Faculty members are already
familiar with the assessment process established, so it is anticipated that minimal training will be
required to provide faculty with the skills necessary to access and use the database.
49
College of the Mainland
Institutional Effectiveness Council (IEC)
COM’s IEC provides oversight of all assessment activities at the College. The IEC is comprised
of representatives from assessment bodies across campus in addition to the Director of
Institutional Research and Effectiveness, and other relevant staff. The IEC is charged with
coordinating, compiling, and ensuring the congruence of all assessment data collection and
processes on campus.
Specifically, the IEC is responsible for:
1. Coordination of the various IE processes on campus to avoid duplication of effort and to
ensure consistency and continuity of purpose
2. Making recommendations based on a review and evaluation of institutional effectiveness
reports and assessment data
3. Annual review and evaluation of unit plan objectives, their means of assessment and
use of results to ensure quality in the planning and assessment process
4. Providing support for improving campus wide training on the IE process.
The Director of the QEP, Dr. Gilchrist White, serves on the IEC, reflecting the importance of the
QEP to the College’s mission. Data pertinent to the QEP’s student learning outcomes will be
reviewed by the IEC, who in turn, will report this data in the College’s annual plan.
College of the Mainland Allocation of Funds for the QEP
Presented below is the budget for the QEP, broken out into a primary budget and an in-kind
budget.
50
College of the Mainland
College of the Mainland QEP Budget
2011-12
2012-13
Year 1
2013-14
Year 2
2014-15
Year 3
2015-16
Year 4
2016-17
Year 5
2017-18
Totals
21,000
6,400
2,400
21,000
0
0
21,000
0
0
21,000
0
0
21,000
0
0
21,000
0
0
21,000
0
0
147,000
6,400
2,400
30,000
0
0
0
0
0
0
30,000
0
0
2,000
10,195
2,000
0
2,000
0
2,000
0
2,000
0
2,000
0
12,000
10,195
2,000
15,450
1,175
1,175
1,175
1,175
1,175
22,150
Student Speakers
Showcase
0
0
500
500
500
500
500
2,500
Speaker’s Bureau
0
0
500
500
500
500
500
2,500
6,000
5,820
5,820
5,820
5,820
5,820
5,820
40,920
10,000
10,000
10,000
10,000
10,000
10,000
10,000
70,000
0
4,000
4,000
4,000
4,000
4,000
4,000
24,000
87,995
58,270
44,995
44,995
44,995
44,995
44,995
371,240
Technology
Sharestream
Cameras + equip
Televisions for
Speaking Center
Speaking, Reading,
and Writing Center
Renovation Costs (one
time)
Operational Expenses
Furniture (one time)
Marketing
Personnel
QEP Director’s
Stipend
QEP Director’s Adjunct
Costs
(course releases)
Adjunct Costs for
Speech Faculty
Totals
51
College of the Mainland
College of the Mainland QEP In-Kind Budget
2011-12
2012-13
Year 1
2013-14
Year 2
2014-15
Year 3
2015-16
Year 4
2016-17
Year 5
2017-18
Totals
17,000
0
0
18,400
0
18,400
0
18,400
0
18,400
0
18,400
0
18,400
17,000
110,400
0
7363
3144
3144
3144
3144
3144
23,083
5814
1094
1094
1094
1094
1094
1094
12,378
375
600
600
600
600
600
600
3975
1590
2820
2820
2820
3560
3560
3560
20,730
1100
2200
2200
2200
2200
2200
2200
14,300
25.879
32,477
28,258
28,258
28,998
28,998
28,998
201,866
Speaking, Reading,
and Writing Center
Computers
Tutors (professional
and peer)
Institutional
Research and
Effectiveness
Support
Personnel
Marketing Support
Personnel
Professional
Development
Support
Personnel
Administrative
Support
Personnel (for
ShareStream and
video recording)
Personnel (for
administration)
Totals
52
College of the Mainland
SECTION IX
ASSESSMENT
A comprehensive evaluation plan (providing support for
compliance with CS 3.3.2 “a plan to assess their achievement”)
This section demonstrates:
Identification of
goals and a plan to
assess their
achievement
The emphasis on oral communication throughout the curriculum seeks to transform COM’s
students into excellent speakers. The QEP also seeks to help students become accustomed to
speaking in front of an audience, reducing communication-related anxiety. However, these
efforts must be evaluated to determine whether these outcomes have been achieved.
COM’s culture has become increasingly evidenced-based over the last six years since the
College joined the Achieving the Dream (ATD) initiative in 2006. With its emphasis on datainformed decision-making and its focus on student success, the ATD initiative has facilitated
COM’s evolution into an institution that regularly evaluates its student success interventions,
modifying them as necessary based on the evidence. In addition, COM regularly collects data
on student success indicators to include successful course completions in developmental
education, transitions from developmental education to credit-bearing gateway courses,
successful course completions in gateway courses, retention and persistence, and certificates
and awards. Thus, the evaluation of the QEP’s impact on student learning outcomes will be
integrated into the institution’s regular institutional effectiveness efforts.
QEP Pilot Phase
The professional development modules for faculty will be piloted in fall of 2012 and spring of
2013 with a small group of faculty members who will implement the QEP in pilot courses in the
spring of 2013. During this pilot phase, the professional development experiences, the QEP
Oral Communication rubric, and technology used to capture student presentations will be
evaluated to determine what modifications need to be made. These determinations will be
made based on feedback gathered from faculty members, who will be interviewed with regard to
the implementation of these interventions.
QEP-Intensive vs. QEP-Basic Classes
Following the pilot phase of the QEP, as discussed in SECTION V, the QEP will be
implemented initially along two tracks: QEP-Intensive and QEP-Basic. The primary difference
in these two tracks is the degree to which students and faculty receive training, either via an
electronic instructional module (in the case of students) or via professional development
experiences (in the case of faculty). In both tracks, class syllabi will include an oral
communication component, and student presentations will be evaluated using the QEP Oral
Communication Rubric (discussed later in this section). As noted previously in SECTION V, the
basic and intensive courses will differ as follows:
53
College of the Mainland
Table 6: A Comparison of QEP-Basic vs. QEP-Intensive Course Elements
The effectiveness of interventions implemented in the QEP-intensive conditions will be
evaluated by comparing data collected pertaining to the achievement of student learner
outcomes, based on student scores on the oral communication rubric. In addition, focus groups
will be conducted with faculty teaching basic courses as well as faculty teaching intensive
courses to determine the perceptions of faculty with regard to the supports offered to faculty in
both conditions (basic and intensive). Additionally, data from end-of-semester course
evaluations will be reviewed, as will data from the professional development evaluation
instrument, which requires faculty to identify how they will implement the knowledge/skills
gained through the QEP training. The review of these data sources will guide which elements of
the intensive course interventions will be retained and/or modified as the QEP continues to
move forward in fall 2014.
Assessment of the QEP
The QEP will be assessed both with respect to its operational elements and its impact on
student learning.
Operational Questions
The QEP Director, along with the QEP Implementation Committee with input from the QEP
Assessment Subcommittee, will evaluate the operational elements of the QEP, considering the
following questions:
 Are we implementing the elements of the QEP as planned?
54
College of the Mainland
 What changes, if any, should be made to any of the QEP interventions?
 Are we providing adequate and appropriate support to the faculty and staff involved in
the QEP?
 Are there any emerging best practices that inform any of the key elements of the QEP?
Data collected to be used in the consideration of these questions will include:
 Frequency of the use of the Speaking, Reading, and Writing Center
 Student satisfaction with their experiences in the Speaking, Reading, and Writing Center
 Submission of QEP Oral Communication Rubric scores by faculty
 Feedback from faculty with regard to the professional development component of the
QEP
 Feedback from faculty with regard to the perceived adequacy of the student instructional
module
 Data from Community College Survey of Student Engagement (CCSSE) questions 4a
(“During the current school year, how often have you: Asked questions in class or
contributed to class discussions”) and 4b (“During the current school year, how often
have you: Made a class presentation”)
 Information gained from an annual review of best practices.
Impact Questions
The QEP Director, along with the QEP Implementation Committee with input from the QEP
Assessment Subcommittee, will evaluate the impact elements of the QEP, considering the
following questions:
 What evidence do we have to show student development of oral communication skills?
 What evidence do we have to indicate that students are comfortable speaking in front of
an audience?
 What evidence do we have to show an emphasis on oral communication elements
across the curriculum?
 What conclusions can we draw based on our data?
Data collected to be used in the consideration of these questions will include:
 Student scores on the Oral Communication Rubric
 Student scores on the Personal Report of Communication Apprehension (PRCA-24)
survey administered to students at the beginning and end of each semester in each
55
College of the Mainland
QEP-enhanced course (data to be managed through the Office of Institutional Research
and Effectiveness)
 Data pertaining to faculty oral communication skills from end-of-semester course
evaluations completed by students.
QEP Oral Communication Rubric
Students’ oral communication assignments will be evaluated by faculty using a rubric developed
by the COM’s speech faculty, based on their teaching experiences and best practices. All QEPenhanced courses will use the same rubric. The rubric was developed such that a variety of
types of oral communication (formal presentations, interviewing, etc.) can be evaluated with the
same rubric. The QEP rubric will be used to evaluate student oral communication on four
criteria:
1. Verbal communication
2. Nonverbal communication
3. Content
4. Organization
Student oral communication assignments will be evaluated on a 1 to 4 scale in each of these
four areas, with a score of 4 representing a higher level of performance.
The rubric itself will be shared with students so that they may attend to these elements in
preparing for the oral communication assignment. Feedback will also be given to students
using the rubric so that they may improve their oral communication skills.
While multiple oral communication rubrics can be found in use among other institutions of higher
education, this rubric was designed to be balance ease of use with the potential for useful
feedback for students.
Faculty will receive training on using this rubric in a manner that achieves inter-rater reliability.
Faculty will practice scoring oral communication samples during their professional development
experience, with discussion and feedback given to aid in achieving reliable interpretation of the
scoring categories.
In addition, ten percent of QEP-enhanced course sections per semester (selected in conjunction
with the Office of Institutional Research and Effectiveness) will be videotaped and archived
online for one year and offline for two years. Each year the QEP Assessment Subcommittee
will evaluate a representative sample of the archived presentations to compare their rubric
scores assigned to the scores assigned by the faculty member in whose class the assignment
occurred. The need for follow-up training on the reliable use of the rubric will be determined
based on the degree to which inter-rater reliability is achieved.
In addition, longitudinal tracking of individual students will occur to the greatest extent possible,
such that growth in oral communication skills may be able to be demonstrated via archived
presentations for a small sample of students. The QEP Assessment Committee will review the
archived samples that show student performance at multiple points in time to look for qualitative
evidence that demonstrates growth in oral communication skills.
To view the QEP Oral Communication Rubric, see Appendix I.
56
College of the Mainland
QEP Student Learner Outcomes
It is hypothesized that students will demonstrate enhanced oral communication skills and
diminished anxiety attached to public speaking as a result of the QEP’s interventions. To be
more specific, the QEP Assessment Subcommittee, working closely with speech faculty
members, identified the QEP’s student learning outcomes as follows:
1) Students will demonstrate the ability to express their ideas verbally using expressive,
accurate and appropriate language.
2) Students will use appropriate presentation techniques (i.e., maintain eye contact,
modulate voice, demonstrate appropriate pacing, use appropriate gestures, etc.)
3) Students will demonstrate understanding of the topic by utilizing properly cited facts,
examples, and other forms of support.
4) Students will plan, prepare, and deliver a well-organized, logical oral presentation.
5) Students will demonstrate a decrease in their communication apprehension with
repeated practice of oral communication skills in QEP-enhanced courses.
Assessment Design: Student Learner Outcomes
Instructors in QEP-enhanced courses will score student oral communication assignments using
the established QEP Oral Communication rubric. (See Appendix I.) This data will be entered
into an electronic database (maintained by the Office of Institutional Research and
Effectiveness), allowing multiple statistical analyses, including comparisons of student learner
outcomes by group (QEP-Basic courses vs. QEP-Intensive courses), by instructor, by discipline,
as well as longitudinally. Cross-sectional analyses among students who have completed
increasing numbers of QEP-enhanced courses will be conducted to determine the impact of
repeated practice of oral communication skills in the classroom.
Hypothesis:
 The percentage of students scoring a 3 or 4 on the oral communication rubric will be
greater among students who have taken more QEP=enhanced courses.
Criteria for success are identified as follows:
 QEP Student Learner Outcome 1: Students will demonstrate the ability to express
their ideas verbally using expressive, accurate and appropriate language.
Criteria for success:
 50 percent of students who have completed 2 QEP-enhanced courses will score
3 or higher on a 4-point oral communication rubric.
 60 percent of students who have completed 4 QEP-enhanced courses will score
3 or higher on a 4-point oral communication rubric.
 70 percent of students who have completed 6 QEP-enhanced courses will score
3 or higher on a 4-point oral communication rubric.
 QEP Student Learner Outcome 2: Students will use appropriate presentation
techniques (i.e., maintain eye contact, modulate voice, demonstrate appropriate pacing,
use appropriate gestures, etc.)
57
College of the Mainland
Criteria for success:
 50 percent of students who have completed 2 QEP-enhanced courses will score
3 or higher on a 4-point oral communication rubric.
 60 percent of students who have completed 4 QEP-enhanced courses will score
3 or higher on a 4-point oral communication rubric.
 70 percent of students who have completed 6 QEP-enhanced courses will score
3 or higher on a 4-point oral communication rubric.
 QEP Student Learner Outcome 3: Students will demonstrate understanding of the
topic by utilizing properly cited facts, examples, and other forms of support.
Criteria for success:
 50 percent of students who have completed 2 QEP-enhanced courses will score
3 or higher on a 4-point oral communication rubric.
 60 percent of students who have completed 4 QEP-enhanced courses will score
3 or higher on a 4-point oral communication rubric.
 70 percent of students who have completed 6 QEP-enhanced courses will score
3 or higher on a 4-point oral communication rubric.
 QEP Student Learner Outcome 4: Students will plan, prepare, and deliver a wellorganized, logical oral presentation.
Criteria for success:
 50 percent of students who have completed 2 QEP-enhanced courses will score
3 or higher on a 4-point oral communication rubric.
 60 percent of students who have completed 4 QEP-enhanced courses will score
3 or higher on a 4-point oral communication rubric.
 70 percent of students who have completed 6 QEP-enhanced courses will score
3 or higher on a 4-point oral communication rubric.
Assessment Design: Communication Apprehension
It is predicted that repeated practice of oral communication skills in the classroom will lead to
reduced anxiety over public speaking. In addition, tutors in the Speaking, Reading, and Writing
Center, as well as COM counselors, will be resources for students seeking to conquer speaking
anxiety.
Communication apprehension will be assessed using the Personal Report of Communication
Apprehension (PRCA-24) survey. (See Appendix J.) The number of QEP-enhanced courses
successfully completed is predicted to be related inversely to the student’s level of
apprehension as measured on this instrument.
This instrument will be administered to students at the beginning and end of each QEPenhanced course, and will also be administered to students at the time of their initial placement
testing at entry into COM. Analyses will be conducted correlating each student’s last/most
recent PRCA – 24 score with the number of QEP courses taken, but additional statistical
analyses, including pre-/post-test comparisons will also be conducted.
58
College of the Mainland
Hypothesis:
 Students will demonstrate a decrease in their communication apprehension with
repeated practice of oral communication skills.
Criterion for success is identified as follows:
 QEP Student Learner Outcome 5: Students will demonstrate a decrease in their
communication apprehension with repeated practice of oral communication skills in
QEP-enhanced courses.
Criterion for success:
 There will be a statistically significant negative correlation between the number of
QEP-enhanced courses successfully completed by a student and the student’s
final post-test score on the Personal Report of Communication Apprehension
(PRCA-24) survey. (See Appendix J.)
Assessment Design: Professional Development Experiences
Professional development is a key element of this QEP. Because students will be expected to
practice oral communication skills in courses across the curriculum taught by faculty members
who are not necessarily credentialed to teach speech, faculty need to feel equipped to evaluate
and offer feedback to students with regard to their speaking abilities. In addition, they need to
be able to use the oral communication rubric in a reliable manner, and they need to model
effective oratory skills themselves.
To those ends, professional development will be offered to each new cohort of faculty joining
the QEP, per the schedule presented in SECTION V. These professional development
experiences will be evaluated using an evaluation instrument developed at COM as part of its
Achieving the Dream initiative. (See Appendix K.) This instrument is designed to collect data
not only on the participants’ perceptions of the presenter(s) (i.e., whether or not the presenters
were effective) but also relevant to the application of the information and skills acquired.
Specifically, participants will be asked to think about where and how they will apply the skills
and knowledge gained and to identify the main things gained from the experience.
Approximately six months after the training session, a follow-up survey will be administered to
the participants, in which they will be asked to identify how they have actually applied the
knowledge and skills gained in the time period following the training. This information will be
used to guide modifications of the professional development modules as necessary.
In addition, the impact of the professional development experiences on the actual oral
communication skills of faculty will also be evaluated. Questions relevant to faculty oratory skills
will be added to the College’s regular end-of-course evaluation instrument completed by
students. Students will be asked to rate faculty on oral communication skills similar to those on
which students are rated on the Oral Communication Rubric, including:
 Uses clear language skills including appropriate language, good grammar/syntax,
defined concepts, and accurate words most of the time
 Displays enthusiasm, good eye contact, and appropriate gestures most of the time
59
College of the Mainland
Questions already included in the end-of-semester course evaluations address the other two
criteria of the Oral Communication Rubric such that faculty are already evaluated on issues
pertaining to their knowledge of the subject matter and degree to which their material is
presented in a logical, organized manner.
Scores on these end-of-course evaluation questions will be analyzed to determine whether
there are group differences between faculty teaching QEP-basic courses versus QEP-intensive
courses in Year 1 of implementation, since faculty in the latter group will receive more intensive
professional development. In addition, faculty performance on these items in QEP-enhanced
courses versus non-QEP-enhanced courses will also be compared. As the QEP moves
forward, the scores on these items will be used to offer faculty the opportunity to work to
improve specific components of their own oral communication skills. In addition, the presence
of these items enhances the emphasis placed on oral communication, making it a priority at
COM.
60
College of the Mainland
SECTION X
CONCLUDING COMMENTS
The College of the Mainland is evolving toward becoming an increasingly evidence-driven
institution in its pursuit of student success. With the advent of initiatives like Achieving the
Dream on this campus, we have become much more focused on decision-making that rests on
a solid foundation of data so that expenditures of time, money, and effort are maximally targeted
on enhancing student learning. Sometimes the data indicates that a particular intervention or
methodology is ineffective and needs to be modified; sometimes the data indicates that one
method is better than another. But in the case of COM’s approach to oral communication, what
the data from multiple sources indicated was that there simply was no broad-based effort to
teach these important skills to our students, and therefore, the immediately apparent need was
to develop a process for integrating oral communication into the curriculum.
Once the topic of oral communication was selected, the next step was to develop a plan not
only for its systematic integration into the curriculum but also to equip faculty with the tools
necessary for the instruction and assessment of these skills. Thus, plans for intensive
professional development have been made, and these training experiences will be evaluated
against a comparison condition involving minimally necessary training for faculty. In addition,
we have recognized the need to elevate the profile of oral communication as an essential skill
set, and to that end campus events showcasing effective speech have been planned. We will
also maintain the focus on these skills by including the QEP as a regular agenda item for
meetings of key administrative and instructional bodies.
The assessment of the QEP’s impact will be systematic and direct, focusing primarily on student
performance on oral communication assignments as well as student confidence in their
speaking skills. Faculty will also receive feedback from students via end-of-course evaluations
regarding their own oral communication skills, and this feedback may be used to improve their
own abilities to function as effective role models in the classroom.
The QEP will be data-driven such that plans to expand the QEP following the formal QEP fiveyear period will be informed by the evaluation of the QEP’s impact.
It is our goal to equip students with the skills necessary to perform successfully not only in
college but in the world beyond. As they venture forth to find employment, students need to be
able to compete effectively for jobs and to advance within the workplace once employment is
secured. It is clear that the ability to articulate ideas is valued by employers and necessary to
perform successfully in most jobs. Thus, COM’s QEP seeks to enhance student success not
only on our campus but in the world at large.
“Speech is power: Speech is to persuade, to convert, to compel. It is to bring another out of his
bad sense into your good sense.”
(Ralph Waldo Emerson)
61
College of the Mainland
SECTION XI
REFERENCES
American College Testing. (2012). Collegiate Assessment of Academic Proficiency. Retrieved
January 15, 2012, from American College Testing: www.act.org/caap/
Andrews, J. & Higson, H. (2008). Graduate employability, 'soft skills' versus 'hard' business
knowledge: a European study. Higher Education in Europe, 33(4), 411-422.
Association of American Colleges and Universities. (2007). College learning for the new global
century: a report from the National Leadership Coundil for Liberal Education and
America's Promise. Association of American Colleges and Universities.
Buckley, M. H. (1992). Focus on research: we listen a book a day; speak a book a week:
learning from walter loban. Language Arts, 69, 622-626.
Buckley, M. R., Peach, E. B., & & Weitzel, W. (1989). Are collegiate business programs
adequately preparing students for the business world? Journal of Education for
Business, 65, 101-105.
Waggoner, J. (2003, May). Nothing hard about soft skills in the college classroom/Career
Directions: Job Skills. Tech Directions, 62(10), 22-23. Retrieved from
http://www.wcu.edu/facctr/mountainrise/archive/vol3no2/html/waggoner.pdf
Chapter 10 Oral Communication. (n.d.). Retrieved January 1, 2012, from 210.46.97.180:
http://210.46.97.180/zonghe/book/197-office%20procedure/chapter10.htm
Cheng, S. (2007). Durham Technical Community College. Retrieved January 29, 2009, from
Integrating Oral Communication Demands in the Classroom:
http://courses.durhamtech.edu/tlc/www/html/Special_Feature/Oral%20Communication%
20in%20the%20Classroom%20-%20Spring%202007.ppt
Cronin, M. & Glenn, P. (1991). Oral communication across the curriculum in higher education:
The state of the art. Communication Education, 40(4), 356-367.
Diamond, R. (1997). Broad curriculum reform needed if students are to master core skills.
Chronicle of Higher Education, 43(47), B7.
Downing, S. (2011). On course: Strategies for creating success in college and in life (6th ed.).
Boston, MA: Wadsworth CENGAGE Learning.
Durham Technical Community College. (2006). Durham Technical Community College Quality
Enhancement Plan. Retrieved January 19, 2009, from Durham Technical College :
http://www.durhamtech.edu/html/reaffirmation/qep.pdf
Emanuel, R. (2011). Critical concerns for oral communication education in Alabama and
beyond. Education Research International, 2011, 1-12.
62
College of the Mainland
Felder, R. M., Woods, D. R., Stice, J. E., & Rugarcia, A. (2000). The future of engineering
education: part 2. Teaching methods that work. Chemical Engineering Education, 34(1),
26-39.
Friedland, E. (2004). Oral communication across the curriculum: What's a small college to do?
Journal of General Education, 53(3/4), 288-310.
Keating, N. L., Green, D. C., Kao, A. C., Gazmararian, J. A., Wu, V. Y., & Cleary, P. D. (2002).
How are patients' specific ambulatory car experiences related to trust, satisfaction, and
considering changing physicians? Journal of General Internal Medicine, 29-39.
Loacker, S. G. (1981, November). Alverno college's program in developing and assessing oral
communication skills. Paper presented at the Annual Meeting of the Speech
Communication Association, Anaheim, CA. (ERIC Document Reproduction Service No.
ED212001). Retrieved Dec. 21, 2011 from ERIC database.
Mark, P. (2008). Redefining business communication courses to enhance student employability.
Retrieved January 1, 2012, from B>Quest:
http://www.westga.edu/~bquest/2008/pedagogy08.htm
Martin-Young, N. (1996, March). Communication skills in the workplace: employers talk back.
Retrieved January 1, 2012, from North Carolina Conference of English Instructors:
http://www.nccei.org/newsletter/comskills.html
McCroskey, J. C. (1982). An introduction to rhetorical communication (4th Ed). Englewood Cliffs,
NJ: Prentice-Hall.
National Association of Colleges and Employers. (2011). Job outlook: Verbal communication
skills most sought by employers. Retrieved Dec. 27, 2011 from
http://www.naceweb.org/so12082010/college_skills/
National Communication Association. (1996). Policy statement on the role of communication
courses in general education. Retrieved January 29, 2009, from National
Communication Association: http://www.natcom.org/nca/Template2.asp?bid=526
Personal Report of Communication apprehension (PRCA-24). (n.d.). Retrieved November 6,
2008, from University of Hawaii, Teacher Resources, Oral Communication Focus:
http://www.hawaii.edu/gened/oc/prca.htm
Southern Association of Colleges and Schools Commission on Colleges (SACSCOC). (2012).
The principles of accreditation: Foundations for quality enhancement (5th ed.). Decatur,
GA: SACSCOC.
Schick, S. (2000). Hard truth about soft skills. IT Training & Careers, December 1, 25.
Shweta. (n.d.). Poor communication skills can cost you the job. Retrieved January 1, 2012, from
careerbright.com: http://careerbright.com/career-self-help/poor-communication-skillscan-cost-you-the-job
Smith, M. C. (2000). What will be the demands of literacy in the workplace in the next
millennium? Reading Research Quarterly, 35(3), 378-380.
63
College of the Mainland
Smith, T. (2011, Feb. 8). The growing importance of soft skills. Retrieved Dec. 21, 2011, from
http://www.littlethingsmatter.com/blog/2011/02/08/the-growing-importance-of-soft-skills/
Soft Skills a key to employment today. (2002, October). Career Opportunities News, 20(2).
Texas Higher Education Coordinating Board. (1999). Core Curriculum: Assumptions and
defining characteristics. Retrieved January 29, 2009, from Academic Affairs and
Research: Undergraduate Education:
http://www.thecb.state.tx.us/index.cfm?objectid=7ED36862-993C-10F2C64CA9C9EDF26C4C
Texas Higher Education Coordinating Board. (2012). Elements of the Core Curriculum
http://www.thecb.state.tx.us/index.cfm?objectid=6F049CAE-F54E-26E4ED9F0DAC62FABF7D
University of Miami. (2008). University of Miami Quality Enhancement Plan (revised):
Faculty Learning Communities to Enhance Undergraduate Education. Retrieved from
University of Miami, website:
https://umshare.miami.edu/team/oaa/web/OAA_Web_Files/QEP%20FINAL%20VERSION%203.pdf
University of Southern Mississippi. (2009). Enhancing the learning environment for improved
speaking skills. Retrieved from University of Southern Mississippi Speaking Center:
website: http://www.usm.edu/qep/the_speaking_center.html
U.S. Department of Labor. (1990). The secretary’s commission on achieving necessary skills
(SCANS): Identifying and describing the skills required by work. Washington, DC:
Pelavin Associate, Inc. Retrieved from http://wdr.doleta.gov/SCANS/idsrw/idsrw.pdf
Willett, T. H. (1984, November). Reading the client: nonverbal communication as an
interviewing tool. Proceedings of the Annual Meeting of the Speech Communication
Association.
64
College of the Mainland
SECTION XII
APPENDICES
Appendix A
COM QEP Survey
Page 1 of COM QEP Survey administered in fall of 2007
Page 2 of COM QEP Survey administered in fall of 2007
65
College of the Mainland
Page 3 of COM QEP Survey administered in fall of 2007
Page 4 of COM QEP Survey administered in fall of 2007
66
College of the Mainland
Appendix B
Executive Summary of QEP Survey
Executive Summary: QEP Survey (Fall 2007)
In the fall of 2007, the College of the Mainland’s Quality Enhancement Plan (QEP) Committee
conducted a written survey to determine which of nine skills or competencies were perceived by
respondents to be most important for students to achieve through their college experience.
These competencies included critical thinking, reading comprehension, written communication,
oral communication, math skills, computer literacy, interpersonal skills, global awareness, and
multicultural sensitivity. Respondents were also asked to rate how effectively COM addresses
each of these nine competency areas. In addition, respondents were given an opportunity to list
additional skill areas that they perceived to be important for students to gain through their
experience at COM.
Eight respondent groups were surveyed (faculty, N = 95; professional staff, N = 70; classified
staff, N = 71; board members, N = 3; employers, N = 5; community members, N = 30; COM
graduates, N = 56; and COM students, N = 1246). Results are summarized below.
With regard to the importance of the nine competencies, mean rankings were ordered as
follows:
#1 reading comprehension, #2 critical thinking, #3 oral communication, #4 written
communication, #5 interpersonal skills, #6 math skills, #7 computer literacy, #8
multicultural sensitivity, and # 9 global awareness.
Interestingly, all of the different respondent groups, except the board, ranked the same
competencies in the top four (reading comprehension, critical thinking, oral
communication, and written communication), though not always in exactly the same
order. Only the board members deviated from this trend, ranking interpersonal skills as
most important and multicultural sensitivity as being tied for the second spot with reading
comprehension and computer literacy.
With regard to the effectiveness with which COM prepares students with regard to the nine
competencies, mean effectiveness ratings placed the competencies in the following order (from
most effectively addressed to least effectively addressed):
#1 written communication, #2 reading comprehension, #3 computer literacy, #4/5 (tie)
critical thinking and math skills, #6 oral communication, #7 interpersonal skills, #8
multicultural sensitivity, and #9 global awareness.
Of the eight respondent groups surveyed, five rated global awareness (on average) as
the skill area for which students are least effectively prepared. Two of the groups
(community members and employers) rated multicultural skills as those that the College
least effectively addresses, and one group (professional staff) rated critical thinking as
67
College of the Mainland
the skill area in which students are least effectively prepared. It should be noted,
however, that the skill areas were rated on a seven-point Likert scale, with four being the
middle point, and all of the means were above 4.00 (with a range from 4.53 to 5.40).
Finally, additional skill sets named by respondents were as follows (note that some skill sets
were redundant with some already listed in the nine competencies), with the number of
respondents endorsing the skill in parentheses:
Life skills (72), study skills (62), math (58), time management (56), communication (52),
social science (47), writing (45), reading (42), physical education (40), career services
(40), life science (39), computer science (28), fine arts (27), English (19), global
awareness (19), and history (18).
Concluding Comment: Thus, the skill areas ranked as most important by respondents are
generally also those that they feel the College effectively addresses. Oral communication is
somewhat of an exception, as it was ranked as third most important but not characterized as
one of the skills most effectively addressed (its mean effectiveness rating placed it sixth). It
should also be noted that “life skills,” an additional competency area identified in the openended portion of the survey, might encompass some of the other skill areas identified (such as
study skills, time management, career services), and this set of skills might be considered
consistent with some of the competencies targeted in a first-year experience course.
68
College of the Mainland
Appendix C
COM Rubric for Evaluating Two-Page QEP Proposals from Campus
COM Quality Enhancement Plan
Rubric for Evaluating Topic Proposals
Title:
Reviewer:
There are 7 topic elements to be reviewed plus an overall evaluation element. Each element can
earn a score of 0, 1, 2, or 3 per the descriptor that most appropriately fits the element.
Score
Rationale
0 – Contains no statement of rationale
1 – Rationale is stated only in general terms
2 – Rationale is specific
3 – Rationale is specific and provides a convincing case for the project
Topic is focused, relevant and appropriate
0 – Proposal does not address how student learning and/or environment will be
affected
1 – Proposal only includes vague references to student learning and/or environment
2 – Proposals suggest implicit goals to affect student learning and or environment
3 – Proposal clearly focused on student learning and/or environment identifying
relevant and appropriate goals
Proposal identifies key student learning outcomes
0 – Does not address student learning outcomes
1 – Includes vague or inappropriately constructed student learning outcomes
2 – Provides appropriately constructed student learning outcomes
3 – Clearly describes appropriately constructed student learning outcomes
Topic is measurable and assessable
0 – No outcome assessment procedures are provided
1 – Some outcome assessment procedures are provided but the project focuses most
heavily on indirect measures of student learning.
2 – Outcomes assessment procedures include direct measures of student learning but
are described only in general terms
3 – Outcomes assessment procedures include direct measures that are clearly described
and feasible.
Proposal is well grounded in research
0 – No discussion of literature or best practices are provided
1 – Some discussion of literature, but no best practices is provided
2 – Basic discussion of literature and best practices is provided
3 – Good discussion of previous literature and clear best practices are provided
69
College of the Mainland
Impact on COM
0 – Proposal does not address how different parts of COM will be affected
1 – Proposal incompletely describes how different parts of COM will be affected
2 – Proposal superficially describes how different parts of COM will be affected
3 – Proposal thoroughly describes how different parts of COM will be affected
Implementation
0 – Discussion of implementation is not provided
1 – Discussion of implementation is provided but is not specific and/or realistic
2 – Discussion of implementation is appropriate but not fully developed or convincing
3 – Discussion of implementation is specific, clear, and reasonable given scope of
project and existing constraints
Overall Evaluation
0 – Proposal is poor and should not be approved
1 – Proposal is adequate
2 – Proposal is very good and should be selected
3 – Proposal is outstanding and should definitely be selected
Total
Comments:
70
College of the Mainland
Appendix D
COM Rubric for Evaluating Expanded QEP Topic Proposals from Campus
COM Quality Enhancement Plan
Rubric for Evaluating Expanded Topic Proposals
Elements
Scale
1. Definition of Selected Topic
0
2
4
6
Topic is not well defined
Topic is only vaguely defined
Topic is adequately defined
Topic is well defined
2. Review of Best Practices
0
1
2
3
No discussion of literature/best practices is provided
Minimal discussion of literature/best practices is provided
Good discussion of literature/best practices is provided
Excellent discussion of literature/best practices is provided
3. Identification of student learner outcomes
0
3
6
9
Does not address student learning outcomes
Includes vague or inappropriately constructed student learning outcomes
Provides appropriately constructed student learning outcomes
Clearly describes appropriately constructed student learning outcomes
4. Identification of actions to be implemented
0
3
6
9
No clear plan of actions to be implemented is provided
Plan of actions to be implemented is vague and not systematic
Plan of actions to be developed is appropriate but not fully developed
Well defined, systematic and fully developed plan of actions to be implemented
5. Establishment of a timeline for implementation
0
2
4
6
Timeline is not provided
Timeline is provided but is not specific and/or realistic
Timeline is appropriate but not fully developed or convincing
Timeline is specific, clear, and reasonable given scope of project and existing
constraints
71
Score
College of the Mainland
6. Identification of necessary resources (financial and human)
0
1
2
3
Proposal does not address resources needed
Proposal describes resource needs which are insufficient or excessive for scope of
topic
Proposal describes resource needs that can probably be adapted to the topic
Proposal describes resource needs that are appropriate and sufficient to the topic
7. Description of the administrative infrastructure for the implementation
and continuation of the QEP
0
Proposal does not describe the administrative infrastructure for implementation and
continuation of the QEP
1
Proposal incompletely describes the administrative infrastructure for implementation
and continuation of the QEP
2
Proposal adequately describes the administrative infrastructure for implementation
and continuation of the QEP
3
Proposal fully describes the administrative infrastructure for implementation and
continuation of the QEP
8. Description of how the success of the QEP will be assessed
0
No outcome assessment procedures are provided
3
Some outcome assessment procedures are provided but the project focuses most
heavily on indirect measures of student learning.
6
Outcomes assessment procedures include direct measures of student learning but are
described only in general terms
9
Outcomes assessment procedures include direct measures that are clearly described
and feasible.
Overall Evaluation
0
1
2
3
Proposal is not well developed given the scope of the QEP
Proposal is adequate but key elements seem to be missing
Proposal is very good and should receive consideration
Proposal is outstanding. Selection of this topic will likely lead to significant
enhancement of student learning
TOTAL
Strengths
Weaknesses
72
College of the Mainland
Appendix E
QEP Master Plan Timeline in Project Management:
As of June 2012
73
College of the Mainland
74
College of the Mainland
75
College of the Mainland
76
College of the Mainland
77
College of the Mainland
Appendix F
QEP Topic Selection Committee Members and
QEP Topic Selection Support Personnel
QEP Topic Selection Committee
Position
Name
email
1. Co-chair
Steve Sewell
2. Co-chair
Bruce Glover
3. VP Instruction
James Templer
4. Faculty
Pam Millsap
5. Faculty
Michele Betancourt
6. Faculty
Eliz Revilla
7. Faculty
Jerry Duncan
8. Faculty
Susan Plasek
9. Faculty
Carla Anderson
10. Faculty
Suzzanne Gust-Thomason
11. Faculty
Melvin Williams
12. Faculty
Beth Hammett
13. Fac. Coun.
Pres. Gilchrist White
14. AVP Allied Health Cissy Matthews
15. AVP Gen. Ed.
Drew Nelson
16. Admin. Support Sandra Zavala
17. SGA President
Sam Torrez
18. Outside Reader Cathy Moran
19. Outside Reader Kay Frieze
20. Student
Cresta Bailey
21. Student
Paola Lemus
19. Student
Paola Lemus
18.
78
ssewell@com.edu
bglover@com.edu
jtempler@com.edu
pmillsap@com.edu
mbetancourt@com.edu
erevilla@com.edu
jduncan@com.edu
splasek@com.edu
canderson@com.edu
sgt@com.edu
mwilliams@com.edu
bhammett@com.edu
gwhite@com.edu
cmatthews@com.edu
anelson@com.edu
szavala@com.edu
storrez@com.edu
extension
8117
8552
8562
8192
8216
8677
8607
8442
8276
8340
8385
8389
8316
8461
8242
8579
8681
College of the Mainland
QEP Topic Selection Support Personnel
Position
Name
email
1. VP Finance
2. IR
3. Testing
4. Admissions
5. Library
6. Writing Center
7. Multicul. Team
8. Counseling
9. Public Relations
10. IT
11. WebMaster
12. Admin Support
13. AVP CE
14. AVP Workforce
15. Strategic Planning
16. Project Management
Lisa Templer
Tad Pfiefer
Sophia Tavarez
Kelly Musick
Kathryn Park
Tamara Hoodye
Tillie Henson
Michelle Kettler
Jim Higgins
David Divine
Pete Lares
Sandra Zavala
Geane Stevenson
Bill Raley
Glenda Brents
Guinn Sharpe
ltempler@com.edu
tpfiefer@com.edu
stavarez@com.edu
kmusick@com.edu
kpark@com.edu
thoodye@com.edu
thenson@com.edu
mkettler@com.edu
jhiggins@com.edu
ddivine@com.edu
plares@com.edu
szavala@com.edu
gstevenson@com.edu
braley@com.edu
gbrents@com.edu
gsharpe@com.edu
79
extension
8262
8195
8499
8496
8201
8523
8205
8124
8438
8309
8355
8579
8280
8283
8168
8338
College of the Mainland
Appendix G
QEP Topic Development Committee Members
QEP Co-Chairs: Bruce Glover and Steve Sewell
Area of Responsibility
Mission
Technology
Research the various kinds of technology that
could be used to record and archive student
presentations
Assessment
Compile and organize the assessment
instruments to be used in the QEP (as outlined in
the SECTION IX, Assessment of this proposal),
develop a schedule for assessments, and create a
plan for coordinating these assessments, working
with the Office of Institutional Research and
Effectiveness, as appropriate.
Marketing
Develop short- term, medium-term, and longterm plans for educating the campus and
community about the QEP (its focus, its purpose,
its goals, and its value).
Budget
Determine and document (on a more specific
basis) expected QEP expenses, including salaries
and benefits, office supplies, technology,
marketing, professional development, etc.
Faculty Development and
Plan faculty development experiences (see
Coordination
timeline for estimated timing), assigning
responsibilities, determining target audiences,
etc., focusing on training faculty in the
assessment of oral communications, the use of
necessary technologies, and ways to improve
their own oral communication skills.
Speaking Center
Develop plan for the establishment of the
Speaking Center, including location/space needs,
staffing schedules, supplies/technology needs,
and need for director.
Student Speakers Showcase
Make specific plans for the coordination of this
annual event, including the assignment of
responsibilities, methods of recruiting students,
how to invite the community, etc.
Words That Changed History Make specific plans for the coordination of this
Day
annual event, including the assignment of
responsibilities, methods of selecting speeches to
be dramatized, methods of recruiting students,
how to invite the community, etc.
80
Lead Person
Manzur Khan
Roger Stallings
Lana Pigao
Debbie Servantes
Regina Julian
Speech Faculty
Mara Cooper and
James Tabor
To be deferred
College of the Mainland
Appendix H
QEP Topic Implementation Committee Members with Delineated Responsibilities
Area of Responsibility
Director
Mission
Oversee implementation of the QEP
Lead Person
Gilchrist White
Share Stream Database
Manager
Manage Share Stream Database; responsible
for uploading videos to the Share Stream
database
Brett Stephens
Video Capture Technology
Responsible for oversight of video capture
technology
Brad Denison
Assessment
Oversee assessment of the QEP
Steve Sewell
Marketing
Responsible for QEP marketing
Gina Castro
Budget
Develop and maintain QEP budget
Gilchrist White
Professional Development
Responsible for development and
implementation of QEP-related professional
development for faculty
Nakia Welch
Speaking, Reading, and
Writing Center
Oversee all Speaking, Reading, and Writing
Center operations
Gilchrist White
Student Speakers
Showcase
Make specific plans for the coordination of
this annual event, including the assignment of
responsibilities, methods of recruiting
students, how to invite the community, etc.
Mara Cooper
Words That Changed
History Day
Make specific plans for the coordination of
this annual event, including the assignment of
responsibilities, methods of selecting
speeches to be dramatized, methods of
recruiting students, how to invite the
community, etc.
Gary Wilson
81
College of the Mainland
Appendix I
QEP Oral Presentation Rubric
4
CATEGORY
Uses clear language skills
Verbal
Communication including appropriate language
3
2
1
0
Uses clear language
skills at least 75% of
the time
Only uses clear
language skills about
50% of the time
No effort

Displays excellent nonverbals
such as vocal enthusiasm, good
eye contact, appropriate
gestures, good posture,
appropriate dress and overall
dynamism at least 90% of the
time

Displays excellent
nonverbals at least
75% of the time

Only uses good
nonverbals about 50%
of the time

Shows an understanding of the
topic by having solid and logical
facts, citing the source of facts
(statistical or statement driven),
having adequate examples and
other forms of support such as
testimonials, comparisons,
definitions, and visual aids at
least 90% of the time

Excellent organization including
clear thesis, clear intent, follows
subtopics as presented, clear
topic sentences and transitions
when appropriate and covers all
content at least 90% of the time


Shows an
understanding of the
topic at least 75% of
the time

Only shows an
understanding of the
topic about 50% of the
time

Good organization

Occasional
organization
Demonstrates serious/poor
language skills including
such things as slang, poor
grammar/syntax, undefined
concepts or inaccurate
vocabulary most of the time

Demonstrates serious/poor
nonverbal problems such
as monotone vocals, poor
eye contact, lack of
gestures or over-gesturing,
poor posture, inappropriate
dress and overall lack of
dynamism most of the time

Demonstrates a serious
lack of understanding the
topic most of the time by
having few/no facts, no
citing of facts, poor,
inappropriate or no
examples, testimonials,
comparisons definitions,
visual aids most of the time

Demonstrates serious/poor
organizational skills most of
the time


level, good grammar/syntax,
defined concepts, and accurate
words at least 90% of the time
Nonverbal
Communication
Content
Organization
82

No effort
No effort
No effort
College of the Mainland
QEP Oral Presentation Rubric: Explanation of Criteria
Language Use
(Verbal
Effectiveness)
Delivery
(Nonverbal
Effectiveness)
Content
Organization
Uses advanced language skills
including rich and varied words for
context, good grammar/syntax, and
defined concepts
The delivery is natural and
confident, and enhances the
message - eye contact, gestures,
facial expressions, posture, dress,
volume and pace indicate strong
self-confidence. Delivery style and
tone is consistent with message.
Articulation and pronunciation are
clear.
Clearly defines the topic or thesis
and its significance. Supports the
thesis and key arguments with an
analysis of relevant and appropriate
evidence. Provides evidence of
extensive and valid research from
multiple and varied sources citing
the source of facts (statistical or
statement driven), and having
numerous examples and other
forms of support such as
testimonials, comparisons,
definitions, and visual aids.
Combines and evaluates existing
ideas to form new insights.
Excellent organization. Introduces
the topic clearly and creatively.
Maintains focus on the topic.
Effectively uses smooth transitions
to connect key points. Ends with a
logical, effective and relevant
conclusion.
Uses clear language skills
including appropriate
language for context,
correct grammar/syntax,
and defined concepts
The delivery is effective –
however, some
inconsistency or hesitancy
may be observed with eye
contact, gestures, facial
expressions, posture,
dress, volume and pace
indicate reasonable
confidence. In general,
delivery style and tone is
consistent with message;
articulation and
pronunciation are clear.
Clearly defines the topic
or thesis. Supports the
thesis with evidence.
Provides evidence of valid
research from multiple
sources citing the source
of facts (statistical or
statement driven), and
having adequate
examples and other forms
of support such as
definitions, and visual aids.
Combines existing ideas
to form new insights.
Uses limited language skills
including frequently selecting
words inappropriate for context,
incorrect grammar/syntax , and
undefined concepts
The delivery is, unnatural and
hesitant and distracts from the
message - eye contact, gestures,
facial expressions, posture,
dress, volume and pace indicate
lack of confidence. Delivery
style and tone may be
inconsistent with message.
Articulation and pronunciation
tend to be sloppy.
Good organization.
Introduces the topic
clearly. Maintains focus
on the topic. Includes
transitions to connect key
points. Ends with a
coherent conclusion
based on evidence.
Occasional organization.
Introduces the topic. Generally
does not maintain focus on the
topic, but my jump around in an
illogical fashion. Includes some
transitions to connect key
points, but they may be abrupt
or awkward. Ends with a basic
conclusion not necessarily
based on the evidence.
83
Defines the topic or thesis.
Provides marginal support for
the thesis with evidence.
Provides evidence of research,
citing few if any source of facts
(statistical or statement driven),
and has inadequate examples
or other forms of support such as
testimonials, comparisons,
definitions, and visual aids. More
often lists rather than combines
ideas.
Demonstrates serious/poor
language skills including such things
as slang, poor grammar/syntax,
undefined concepts or inaccurate
vocabulary most of the time
The delivery demonstrates serious
nonverbal issues that significantly
distracts from the message monotone vocals, poor eye
contact, lack of gestures or overgesturing, poor posture,
inappropriate dress mumbling,
speaking inaudibly and overall
lack of dynamism. Delivery style
and tone is inconsistent with
message. Articulation and
pronunciation is sloppy and
inappropriate.
Demonstrates a serious lack of
understanding the topic. Does not
clearly define topic or thesis.
Provides little to no evidence of
research, citing few/no facts, has
poor /inappropriate/no examples
or other forms of support such as
testimonials, comparisons
definitions, and visual aids. Lists
ideas that are inconsistent and
illogical.
Poor organization. Does not
introduce the topic clearly. Does
not establish or maintain focus on
the topic. Uses ineffective
transitions that rarely connect key
points. Ends without a
conclusion.
College of the Mainland
Appendix J
Personal Report of Communication Apprehension (PRCA – 24)
The PRCA-24 is the instrument which is most widely used to measure
communication apprehension. It is preferable above all earlier versions of the
instrument (PRCA, PRCA10, PRCA-24B, etc.). It is highly reliable (alpha regularly
>.90) and has very high predictive validity. It permits one to obtain sub-scores on
the contexts of public speaking, dyadic interaction, small groups, and large
groups. However, these scores are substantially less reliable than the total PRCA24 scores-because of the reduced number of items. People interested only in
public speaking anxiety should consider using the PRPSA rather than the public
speaking sub-score drawn from the PRCA-24. It is much more reliable for this
purpose.
This instrument is composed of twenty-four statements concerning feelings about
communicating with others. Please indicate the degree to which each statement applies
to you by marking whether you: Strongly Disagree = 1; Disagree = 2; are Neutral =
3; Agree = 4; Strongly Agree = 5
_____1. I dislike participating in group discussions.
_____2. Generally, I am comfortable while participating in group discussions.
_____3. I am tense and nervous while participating in group discussions.
_____4. I like to get involved in group discussions.
_____5. Engaging in a group discussion with new people makes me tense and
nervous.
_____6. I am calm and relaxed while participating in group discussions.
_____7. Generally, I am nervous when I have to participate in a meeting.
_____8. Usually, I am comfortable when I have to participate in a meeting.
_____9. I am very calm and relaxed when I am called upon to express an opinion at a
meeting.
_____10. I am afraid to express myself at meetings.
_____11. Communicating at meetings usually makes me uncomfortable.
84
College of the Mainland
_____12. I am very relaxed when answering questions at a meeting.
_____13. While participating in a conversation with a new acquaintance, I feel very
nervous.
_____14. I have no fear of speaking up in conversations.
_____15. Ordinarily I am very tense and nervous in conversations.
_____16. Ordinarily I am very calm and relaxed in conversations.
_____17. While conversing with a new acquaintance, I feel very relaxed.
_____18. I'm afraid to speak up in conversations.
_____19. I have no fear of giving a speech.
_____20. Certain parts of my body feel very tense and rigid while giving a speech.
_____21. I feel relaxed while giving a speech.
_____22. My thoughts become confused and jumbled when I am giving a speech.
_____23. I face the prospect of giving a speech with confidence.
_____24. While giving a speech, I get so nervous I forget facts I really know.
SCORING:
Group discussion: 18 - (scores for items 2, 4, & 6) + (scores for items 1, 3, & 5)
Meetings: 18 - (scores for items 8, 9, & 12) + (scores for items 7, 10, & 11)
Interpersonal: 18 - (scores for items 14, 16, & 17) + (scores for items 13, 15, & 18)
Public Speaking: 18 - (scores for items 19, 21, & 23) + (scores for items 20, 22, &24)
Group Discussion Score: _______
Interpersonal Score: _______
Meetings Score: _______
Public Speaking Score: _______
85
College of the Mainland
To obtain your total score for the PRCA, simply add your sub-scores together. _______
Scores can range from 24-120. Scores below 51 represent people who have very low
CA. Scores between 51-80 represent people with average CA. Scores above 80
represent people who have high levels of trait CA.
NORMS FOR THE PRCA-24: (based on over 40,000 college students; data from over
3,000 non-student adults in a national sample provided virtually identical norms, within
0.20 for all scores.)
Mean
Standard Deviation
High
Low
Total Score
65.6
15.3
> 80
< 51
Group:
15.4
4.8
> 20
< 11
Meeting:
16.4
4.2
> 20
< 13
Dyad (Interpersonal): 14.2
3.9
>18
< 11
19.3
5.1
>24
< 14
Public:
Source:
McCroskey, J. C. (1982). An introduction to rhetorical communication (4th Ed). Englewood Cliffs,
NJ: Prentice-Hall.
(Also available in more recent editions of this book, now published by Allyn & Bacon.)
86
College of the Mainland
Appendix K
COM Professional Development Evaluation Instrument
Professional Development:
Evaluation Instrument
As of 12/7/07
Please help us assess the effectiveness of this professional development experience by providing
candid answers to the questions below. Your answers will be treated confidentially. Thank you for
your time and participation!
Evaluation of the presenter:
Strongly
Disagree
The presenter…
Strongly
Agree
was knowledgeable about the topic.
1
2
3
effectively communicated with the audience about the topic.
1
2
3
covered the topic in a comprehensive manner.
1
2
3
What did you like best about the presentation?
What did you like least about the presentation?
87
4
5
4
4
5
5
College of the Mainland
Evaluation of knowledge/skills gained:
Please name up to three of the most important things you learned from this professional development
experience.
1.
2.
3.
Plans for Implementation of knowledge/skills gained:
Please indicate in what ways you plan to implement the knowledge/skills gained as a result of this
professional development experience by rating the likelihood of doing the following (will be a scale of a)
Definitely Not, b) Probably Not, c) Probably, d) Definitely, e)Not Applicable):
I will modify…
The content of one or more of my lectures (e.g., add content, subtract content, modify content).
How I evaluate student performance (i.e., modify grading strategies).
One or more course assignments (e.g., add an assignment, eliminate an assignment, alter an
assignment).
How I present material in my classroom (i.e., use new technologies, alter the emphasis of the
material, etc.).
How I interact with students in the classroom.
How I interact with students during office hours.
How I interact with colleagues.
88
College of the Mainland
Your ideas (from the question below only) will be grouped anonymously with those of other faculty
and shared with the faculty who participated in this professional development experience. In this
way, we can learn from each other how we might use this experience to improve student success!!
Do you have a great idea? Please list some of the specific ways (i.e., more specific than the above
statements) that you plan to implement the knowledge/skills gained.
89
Download