2014-2015 Annual Program Assessment Report College of Health and Human Development

advertisement
FCS Assessment Report
2014-2015 Annual Program Assessment Report
College of Health and Human Development
Department of Family and Consumer Sciences
Angie Giordano, Assessment Liaison
June 1, 2015
Our Family and Consumer Sciences (FCS) Department has been highly active the past several
years on assessment activities related to the accreditation of our undergraduate program and the
program review of our graduate program. This past spring of 2015, our undergraduate program
hosted the American Association of Family and Consumer Sciences (AAFCS) site reviewers to
conclude our review. The many assessment activities related to our AAFCS reaccreditation are
other available documented in department reports/materials and will not be included in this
current assessment report.
FCS Department Graduate Student Assessment Efforts
For the purpose of this annual assessment report, a review and discussion of our department’s
assessment activities related to the program review of our FCS Graduate Program will be
presented. The following Student Learning Outcomes (SLOs) were developed for the graduate
program in Family and Consumer Sciences during the 2012-2013 academic year. These SLOs
were approved by the FCS Graduate Committee and FCS faculty, as well as the College of HHD
Assessment, Accreditation, and Program Review Committee.
In an effort to support the well-being of individuals, families and communities through their
professional area of interest in FCS, students will be able to:
1. Apply the American Association of Family and Consumer Sciences (AAFCS)
Code of Ethics in scholarship as FCS professionals.
2. Demonstrate ongoing synthesis and application of relevant literature, current
trends, and emerging issues within their professional area of interest within FCS.
3. Design a research study/creative project investigating topics within their
professional area of interest including diverse populations.
4. Apply sound evidence -based practices and applications within their professional
area of interest in FCS.
Our FCS graduate students complete six units of required core courses, 24 elective/area-required
units in their selected areas (Apparel Design and Merchandising, Consumer Affairs, Family
Studies, Interior Design, and Nutrition, Dietetics and Food Science) and a capstone course
1
FCS Assessment Report
designated either for a thesis/project or a comprehensive examination. The core requirements for
all graduate students in the FCS Graduate Program include two research-related courses: FCS
681, Research Methods and FCS 682, Research Applications. Assessment efforts during the
2012-2013 academic year focused on student work completed in these two core classes and the
analysis of these data was presented in our FCS Department’s assessment report for the 20132014 year.
Also related to the assessment of our graduate program, the Graduate Student Exit Survey was
developed during the fall semester of 2013. The initial instrument was drafted by the
Department Assessment Coordinator, feedback was elicited from the full faculty, and edits were
made that resulted in the final instrument (See Appendix 1). The survey gathers student
information pertaining to three foci: (1) students’ classification data, (2) the FCS Graduate
Program’s four SLOs, and (3) the College of Health and Human Development (HHD) SLOs that
have been developed by the HHD College Assessment Committee.
Student classification data is captured in questions asking about students’ major area of study
within the Department, undergraduate degree majors, beginning and ending years/semesters in
the graduate program, and current plans after graduation. A set of questions are included to
assess students’ evaluation of support levels from the following sources: professors, major
advisor, committee members, other students in the program, and family, friends and employers
outside of the CSUN community.
Each of the questions on the Graduate Student Exit Survey that pertain to one of the FCS or
HHD SLOs is scored on a five-point scale by the students, with 5 reflecting Strongly Agree, 4
reflecting Agree, 3 reflecting Neither Agree nor Disagree, 2 reflecting Disagree, and 1 reflecting
Strongly Disagree.
In addition, there are three questions included on the survey that are open-ended and ask for
students to give feedback on (a) strengths of the graduate program, (b) weaknesses of the
graduate program, and (c) any changes that could significantly strengthen the graduate program
in FCS.
The instrument was developed and implemented during the 2013-2014 academic year and
continued into this present 2014-2015 year. Data is collected from graduating graduate students
in all of our FCS programs at the conclusion of both fall and spring semesters using the webbased program Survey Monkey. Graduate students who are enrolled in the FCS 697C class,
which is the class students take during their final semester in the program and during which they
are taking their comprehensive examination, complete the instrument at the end of the semester.
The FCS Graduate Coordinator includes a link to the exit survey in the 697C Moodle class
website and he/she (we have had a change of graduate coordinators) sends out several reminder
announcements to the students to notify them to complete the exit survey prior to their end of the
semester/graduation.
2
FCS Assessment Report
Graduate Student Exit Survey & FCS Department SLO Alignment
Several questions are included in the exit survey specifically to be aligned with the four FCS
Department SLOs.
One question in the Graduate Student Exit Survey corresponds to the FCS Department SLO #1:
Apply the American Association of Family and Consumer Sciences (AAFCS) Code of
Ethics in scholarship as FCS professionals.

The courses I took provided an understanding of the accepted ethical and professional
practice standards in my field.
Five questions are included in the Graduate Student Exit Survey specifically to be aligned with
the FCS Department SLO #2: Demonstrate ongoing synthesis and application of relevant
literature, current trends, and emerging issues within their professional area of interest
within FCS.





I am aware of major theories in my discipline.
I am proficient in conducting bibliographic searches on various topics in my discipline.
I can assess the validity of information and information sources in my discipline.
I am able to synthesize information from a variety of sources toward making informed
conclusions and decisions.
I am aware of and can discuss existing trends and emerging issues within my field of
study.
One question is included in the Graduate Student Exit Survey that aligns with the FCS
Department SLO #3: Design a research study/creative project investigating topics within
their professional area of interest including diverse populations.

I understand research methodologies in my discipline.
Three questions are included in the Graduate Student Exit Survey specifically to be aligned with
the FCS Department SLO #4: Apply sound evidence -based practices and applications within
their professional area of interest in FCS.


The courses in my program provided necessary knowledge in my discipline.
I can apply the major theories in my field of study to real world experiences.
3
FCS Assessment Report

I am aware of cultural differences among families today and I will be able to consider
those differences when working in professional settings.
Graduate Student Exit Survey & Qualitative Open-Ended Questions
Three open-ended questions are included on the survey that collect qualitative data and ask for
students’ feedback on important facets of the graduate program. First, students are asked to
identify current strengths of the graduate program. Second, students are asked to discuss any
weaknesses of the graduate program. Third, graduating students are asked to consider and
propose any changes that could be made by our faculty to significantly strengthen our existing
graduate program in FCS.
4
FCS Assessment Report
Graduate Student Exit Survey Data Fall 2013 through Spring 2015
Data has been gathered on the exit survey over the past four semesters, beginning in the fall 2013
semester through the most recent spring of 2015 semester. Thus far, a total of 60 students have
completed the instrument. Results from the quantitative questions on the exit survey will be
presented first, followed by an analysis and summary of the qualitative open-ended questions on
the exit survey.
Table 1 summarizes students’ responses to the ten questions on the graduate student exit survey
that directly correspond to our Department’s 4 SLOs. Each item is scored on a five-point scale
by the students, with 5 reflecting Strongly Agree, 4 reflecting Agree, 3 reflecting Neither Agree
nor Disagree, 2 reflecting Disagree, and 1 reflecting Strongly Disagree.
Table 1. Graduate Student Exit Survey, FCS Graduate Program SLOs Assessment (n=60)
Question Items
Mean Score
FCS Department SLO #1
The courses I took provided an understanding of the accepted ethical
and professional practice standards in my field.
FCS Department SLO #2
I am aware of major theories in my discipline.
I am proficient in conducting bibliographic searches on various
topics in my discipline.
I can assess the validity of information and information sources
in my discipline.
I am able to synthesize information from a variety of sources
toward making informed conclusions and decisions.
I am aware of and can discuss existing trends and emerging issues
within my field of study.
FCS Department SLO #3
I understand research methodologies in my discipline.
FCS Department SLO #4
The courses in my program provided necessary knowledge in
my discipline.
I can apply the major theories in my field of study to real world
experiences.
I am aware of cultural differences among families today and I will be
able to consider those differences when working in professional
settings.
5
4.37
4.28
4.35
4.30
4.41
4.48
3.96
4.13
4.30
4.54
FCS Assessment Report
Students were also asked to rate the amount of support they received from several sources on a
5-point scale in which 5 is Very Supportive and 1 is Not At All Supportive. Findings are shown
in Table 2.
Table 2. Graduate Student Exit Survey, Support received from different sources (n=60)
Question Items
Support from your professors
Support from your major advisor
Support from your committee members
Support from other students in the program
Support from other outside of CSUN (family, friends, employers, etc.)
Mean Score
4.18
3.80
4.25
4.02
4.38
In addition to the data presented in Table 1 and Table 2, other relevant information about our
graduate student sample includes the following:
Of the total of 60 students who have completed the survey over the past four semesters, students
have graduated with an emphasis in the following options within our department:
Apparel Design and Merchandising
1 student (1.7%)
Consumer Affairs
3 students (5.0%)
Family Studies
20 students (33.3%)
Interior Design
0 students (0%)
Nutrition, Dietetics and Food Science
36 students (60.0%)
When asked about the professional pathways students had planned to pursue after completing the
graduate program, data revealed the following:
9 students had reported that they were applying to or accepted to another higher education
program.
15 students were continuing with their current employer in a current position.
2 students were continuing with his/her current employer in a new position.
7 students were beginning a new position with a new employer.
18 students were looking for a new position
1 student reported not looking for employment at the time of graduation.
6
FCS Assessment Report
It should also be noted that one question on the survey aligns with the HHD College and
University’s commitment to diversity. Specifically, students evaluate their awareness of
“cultural differences among families today” and their ability “to consider those differences when
working in professional settings.” This item was created and included on the instrument
specifically for the purpose of measuring ethnic/cultural understanding and sensitivity, an issue
that has been the recent focus of our HHD College assessment efforts. Interestingly, students’
ratings on this item are the highest of all of the scores, indicating that our FCS graduate students
believe that they will be able to apply their understanding of various cultures when working with
families in professional settings.
Students also responded to three open-ended questions on the survey that asked for feedback on
(a) strengths of the graduate program, (b) weaknesses of the graduate program and (c) any
changes that could significantly strengthen the graduate program in FCS. A content analysis of
these data revealed several pivotal areas that were identified as program strengths and
weaknesses, as well as potential changes that could be made to improve our current FCS
graduate program.
Strengths of the FCS Graduate Program

Curriculum
Well-structured curriculum
Offers seminar courses on a range of topics
Allows courses from other departments to tailor my graduate experience
Clear curriculum requirements
Class times are good for working students
Small classes
Heavy on research and good when research is incorporated into all classes
Info on cultural differences, ethical/professional behaviors and research methods is wellprovided

Professors
Good mentors
Knowledgeable and professional
Good having the same faculty multiple times
Professors care and make the extra effort
7
FCS Assessment Report
Those working in the field gave applied examples
Supportive faculty

Fellow Students
Helpful when students share real life examples in class
Weaknesses of the FCS Graduate Program

Curriculum
Basic, not challenging
Need more courses in the 7 pm time slot
Limited class selection and very few electives offered, impedes a timely graduation
Not enough information in the curriculum to help one complete a thesis

FCS 681 Research Methods & FCS 682 Research Applications Courses
More inclusive of all FCS Options
Need to have same research methods taught across all instructors
Too complicated and confusing
Taught at too fast of a pace
No connection with other courses
Still unclear about how to conduct research

Professors
Need more in numbers
More collaboration among faculty across the FCS Options
Unsupportive faculty, not approachable, students feel alone
Lack of consensus among the faculty, students may get conflicting information
Lack of practical experience

Comprehensive Examination
Not enough preparation given
Not enough time to take the exam
8
FCS Assessment Report
Students forced to do the comp exam instead of a thesis or project

Advisement
Need additional time/format options
Need better career option advisement
Advisement not clear or detailed enough
Changes that can strengthen the FCS Graduate Program

Curriculum
Go beyond the basics, add more challenging classes
Offer weekend graduate classes
Offer more online classes
Need to offer all graduate classes every semester
Increase the student enrollment capacity in the courses
Focus more on research methods in all of the courses
More emphasis on statistical methods and scientific research writing
Make program evaluation a required class
Offer a career oriented class
Add a grant writing class
Add a class for comprehensive examination preparation

FCS 681 Research Methods & FCS 682 Research Applications Courses
Content needs to be better in order to prepare students for the comp exam
Need step by step instruction on how to conduct a research project
More consistent teaching in 681 and 682 between professors
Make 681 and 682 only mandatory for students writing a thesis

Professors
More support and availability from faculty
Hire more professors
9
FCS Assessment Report
Increase communication between faculty and from faculty to students

Comprehensive Examination
Increase the time to take the exam
Better preparation
More support to reduce anxiety related to the exam (i.e., have an in-person meeting for 697)

Advisement
More career advice
Better advisement strategies
Offer student study groups
Not clear on who to go to with advisement questions
More advisement regarding finding a post-graduate job, internship or PhD program

Fellow Students
Encourage students to network with one another more

Other
More emphasis on outside clubs and activities
Better communication and organization within the department
More volunteer opportunities
FCS Department Future Assessment Planned Activities & “Closing the Loop”
The present report was completed by the department’s Assessment Liaison and will be shared
with the Department Chair and the full FCS faculty over the summer of 2015. Currently, our
department’s annual faculty retreat is scheduled for August 20, 2105 and the critical item on the
agenda for the retreat is to make decisions for implementing changes in our graduate program.
The Chancellor’s Office has instructed our department that modifications must be made to our
curriculum, such that we must increase the number of graduate core classes offered in our
graduate curriculum. Thus, our first task will be to decide, collectively as a department, on
which two classes we elect to include in our current core class curriculum.
In addition, and as mentioned earlier in this report, our FCS Graduate Program Review was
completed in the fall of 2014. In that report, twenty recommendations were suggested that
related to (a) student issues, (b) faculty issues, (c) curriculum, (d) assessment/strategic planning,
10
FCS Assessment Report
and (e) other/miscellaneous issues. The faculty will need to engage in a discussion about these
recommendations to prioritize which items should be first addressed and then, subsequently,
develop a plan to make the agreed upon changes and also decide how to divide and assign the
work within the department.
In conjunction with input from these sources, the current assessment report also will be used at
the faculty retreat to highlight information gathered from our graduate student population over
the past two years. Ideally, one goal of the retreat should be to formulate a strategic plan that
outlines changes to be initiated to improve the program. Also, the Department Liaison plans to
lead a discussion about the exit survey instrument to inquire about any changes that faculty
might want to implement. Data collection efforts to obtain information from our graduating
graduate students will continue into the next academic year.
One significant change that has already been put into action is the creation of a FCS Department
graduate student website. The website is being created in Moodle and will house all pertinent
information for our graduate students. Our Department Graduate Coordinator and the Graduate
Committee within the department met with faculty from each of the five department Options
during the spring of 2015. In these meetings, the graduate committee members solicited
feedback from each of the Options on what current and relevant information, resources, websites
and documents should be included and/or linked on the site. The new official site is planned to
be launched at the beginning of the fall 2015 semester. Included in this site will be a link to
which enrolled graduate students may anonymously communicate about any issues, concerns or
ideas for improvement they might have to enhance our graduate student experience in the
program.
11
FCS Assessment Report
Appendix 1: FCS Department Graduate Student Exit Survey
1. Name (Last, First, Middle)
2. Please choose your area within the M.S. program in FCS.
Apparel Design and Merchandising
Consumer Affairs
Family Studies
Interior Design
Nutrition, Dietetics, and Food Science
3. In what major did you receive your undergraduate degree?
4. In which semester and year did you start your Master’s program?
5. In which semester and year are you completing the Master's program?
6. Which of the following best describes your culminating experience in the master's program?
Thesis
Project
Comprehensive Exam
7. If you did a thesis/project, how many semesters did it take from the conception of your topic
to your defense?
8. How would you rate the amount of support you had from each of the sources below during
your master's program?
Very
Somewhat
Slightly
Not At All
Supportive Supportive Neutral
Supportive Supportive
Your professors
Your major advisor
Your committee members
Other students in the
program
Others outside CSUN
(family, friends, employers,
etc.)
Please add any comments
12
FCS Assessment Report
9. Indicate your level of agreement with the following statements concerning the classes you
took during the Master’s program in FCS.
Neither
Strongly Agree Agree Disagree Strongly
Agree
Nor
Disagree
Disagree
The courses in my program provided necessary
knowledge in my discipline
I understand research methodologies in my
discipline
I am aware of major theories in my discipline
I can apply the major theories in my field of
study to real world experiences
The courses I took provided an understanding of
the accepted ethical and professional practice
standards in my field
I am proficient in conducting bibliographic
searches on various topics in my discipline
I can assess the validity of information and
information sources in my discipline
I am able to synthesize information from a
variety of sources toward making informed
conclusions and decisions
I am aware of and can discuss existing trends
and emerging issues within my field of study
I am aware of cultural differences among
families today and I will be able to consider
those differences when working in professional
settings
Academic/professional interactions with other
students contributed significantly to attaining
my educational goals
Add any other comments about the course work in your program
10. Please comment on the strengths of the graduate program in FCS.
11. Please comment on any weaknesses of the graduate program in FCS.
12. Please identify any changes you believe that can significantly strengthen the graduate
program in FCS.
13
FCS Assessment Report
13. What are your current plans after completing the graduate program?
Applying to or accepted to another higher education program
Continuing with current employer in current position
Continuing with current employer in a new position
Returning to a previous employer in a new or previous position
Beginning a new position with a new employer
Looking for a new position
Not looking for employment
14
Download