Indirect Measure(s) - Florida Agricultural & Mechanical University

advertisement

March 17, 2010

11:00 a.m. – 2:30 p.m.

Assessing Research in the FAMU

Environmental Sciences Institute

Marcia Allen Owens, J.D., Ph.D.

Assistant Professor

Chair, ESI Assessment Committee

FAMU Assessment Roundtable

March 17, 2010

FAMU Environmental Sciences Institute

 Established in 1995

 Bachelors, Masters, Doctoral Degrees

Environmental Biotechnology

Environmental Restoration and Waste Management

Marine and Estuarine Environments

Environmental Policy and Risk Management

Radiation Protection

 Thesis required for all ESI degrees

FAMU ESI Mission

The objectives of the Environmental Sciences

Institute are to provide instruction, conduct research , perform public service, and initiate technology transfer which will result in the development of remedies for existing environmental problems; the enlightenment of communities on environmental science issues; and the production of students uniquely prepared to address present and future environmental science concerns.

FAMU Environmental Sciences Institute

 Currently 10 Full-Time Tenured/Tenure Track

Faculty (including 1 Distinguished Professor)

 1 Visiting Faculty

 4 Postdoctoral Research Fellows

 100 Students

 #1 Producer of Black PhD’s in Environmental

Sciences

FAMU ESI 7-Year Review Strengths

 A strong environmental science program at an HBCU that has an excellent chance not only to succeed but to excel

 Potential for supporting and promoting a dynamic research program and establishing strong partnerships with other Universities and with federally-funded research labs

 Productive faculty at Research I universities as well as scientists with federal environmental entities are anxious to collaborate with ESI and increase minority representation in the Environmental Sciences

 Provides significant employment opportunities for graduates in all sectors

FAMU ESI 7-Year Review Strengths

 Interdisciplinary approach to student education and research

 Formal seminar series with distinguished lecturers from around the country

 Recognized faculty throughout the State of Florida and the Nation

 This small group produced nearly 40 publications in peer-reviewed scientific journals, books and reports, generated $4.5 million in research grants and graduated four Ph.D. students. (2005-2006)

Guiding Principles of Development of ESI

Assessment Plan

 Preparing Stewards of the Discipline

 An ESI student is expected to serve as “a steward of her discipline or profession, dedicated to the integrity of its work in the generation, critique, transformation, transmission, and use of its knowledge.”

Lee Shulman, President, The Carnegie Foundation for the the Advancement of

Teaching

Expected Research Objectives/Outcomes

① Maintain an academic culture that incorporates the core values identified in the University’s mission statement, specifically collaboration, collegiality and integrity throughout all aspects of the ESI research enterprise which includes including but not limited to, idea generation, proposal development, execution of studies and dissemination of research-based products.

Criteria for Success – Objective 1

Direct Measure(s)

 50% of full-time, tenured and tenure-track faculty will have competitive funding

Indirect Measure(s)

 70% of full-time, tenured and tenure-track faculty will rate their ability to conduct and promote environmental science research as satisfactory.

Performance Measures – Objective 1

Direct Measure(s)

 ESI will generate an annual and cumulative list of competitive funds garnered, refereed publications, citations, conference presentations and engagement in local, regional, national, and international organizations and agencies.

Indirect Measure(s)

 Inventory of research activities compiled from annual report submitted to Office of Sponsored

Programs

 ESI will continue to use its 7-year program review to identify and develop implementation strategies for research

Expected Research Objectives/Outcomes

② Place emphasis on areas that advance our institutional mission while addressing grand challenges throughout all aspects of the ESI research enterprise, including but not limited to, idea generation, proposal development, execution of studies and dissemination of researchbased products.

Criteria for Success – Objective 2

Direct Measure(s)

 60% of existing research products will align with

ESI focus areas

Indirect Measure(s)

 100% of ESI faculty will be able to articulate a research connection with at least one of ESI’s focus areas.

Performance Measures – Objective 2

Direct Measure(s)

 ESI will evaluate faculty and student research for alignment with ESI focus areas

 ESI will evaluate curriculum and syllabi for alignment with ESI focus areas

Indirect Measure(s)

 ESI will continue to use its 7-year program review to collaborate faculty self report, and to identify and develop implementation strategies for research and proper alignment with focus areas

Expected Research Objectives/Outcomes

③ Actively engage students all along the educational pipeline, particularly those from underrepresented groups, in the research enterprise in ESI.

Criteria for Success – Objective 3

Direct Measure(s)

 ESI will annually review and revise (when needed) policies for ensuring student engagement in the research enterprise

Indirect Measure(s)

 40% of ESI students will report involvement in the research enterprise with multiple constituencies

Performance Measures – Objective 3

Direct Measure(s)

 ESI will generate a list of students’ refereed publications, citations, conference presentations and engagement in local, regional, national, and international organizations and agencies

Indirect Measure(s)

 Analysis of focus group data conducted at the end of each academic year will report student consensus that they have engaged in multiple opportunities for research with different constituencies since the prior academic year

Lessons and Challenges

Lessons

 Set realistic goals which allow for improvement

 Use 100% sparingly

 Use existing data collection mechanisms as much as possible

Challenges

 Conceptual acceptance of assessment as important

 Difference in faculty and student perceptions

 Faculty acceptance of student focus group data

Questions????

marcia.owens@famu.edu

(850) 599-8556

March 17, 2010

11:00 a.m. – 2:30 p.m.

Assessing Research and

Community/Public

Service

Jennifer Collins, Ph.D.

School of Business and Industry

Public/Community Service

SBI Goal: The School of Business and

Industry will engage in Economic

Development on the Southside of

Tallahassee and statewide.

Public/Community Service

Objectives

1.

SBI will work with community organizations to provide economic development opportunities in the Big Bend area.

2.

SBI faculty will seek funding opportunities that support development on the Tallahassee

Southside.

3.

SBI will provide financial literacy opportunities to residents in the Big Bend area.

4.

SBI faculty will participate in professional associations.

5.

SBI faculty and administrators will serve in leadership positions of civic and social organizations in Tallahassee and elsewhere.

Objective 1: SBI will work with community organizations to provide economic development opportunities in the Big Bend area

.

 Direct Measure: SBI will work with community organizations and/or the Small Business Development

Center to provide at least two (2) small business/ entrepreneurship workshops annually.

 Indirect Measure: 75% positive feedback on workshop participant survey.

 Direct Measure: A database of attendees at SBI sponsored or co-sponsored workshops will be developed for data collection.

 Indirect Measure: A customer satisfaction survey will be conducted to assess participant satisfaction with the workshops.

Objective 2: SBI faculty will seek funding opportunities that support economic development on the Tallahassee

Southside

.

 Direct Measure: SBI faculty and/or staff will secure one (1) grant or contract bi-annually that will provide economic development funding support for the Tallahassee Southside.

 Indirect Measure: 80% of the faculty will rate themselves as being satisfied with the level of support they received from the School of

Business and Industry to participate in grant opportunities.

Objective 3: SBI will provide financial literacy opportunities to residents in the

Big Bend area.

 Direct Measure: SBI will sponsor and/or cosponsor two (2) financial literacy workshops annually in the Big Bend area.

 Indirect Measure: 75% positive feedback on participant surveys.

 Direct Measure: A database of outreach activities/contributions will be developed for data collection purposes.

 Indirect Measure: A customer satisfaction survey will be conducted to assess participant satisfaction with the financial literacy workshops.

Objective 4: SBI faculty will participate in professional associations.

 Direct Measures:

 90% of faculty will hold membership in professional associations within their disciplines.

 30% of faculty will hold leadership positions in professional associations within their disciplines.

 50% of faculty will review articles submitted for conference presentations and/or publication in refereed journals.

 Indirect Measures:

 30% of faculty will participate in invited presentations within their discipline.

 80% of the faculty will rate themselves as being satisfied with the level of support they received from the School of Business and Industry that made it possible to participate in research related activities.

Objective 4 cont’d

 Direct Measure: A database of faculty participation in professional associations will be developed for data collection purposes.

 Indirect Measures: A faculty survey will be conducted in the Spring semester. There will be items that measure faculty satisfaction with the level of support they receive from the School of

Business and Industry to participate in professional associations.

Objective 5: SBI faculty and administrators will serve in leadership positions for civic and social organizations in Tallahassee and elsewhere.

 Direct Measure: 20% of faculty will hold leadership positions in civic and social organizations in Tallahassee and elsewhere.

 Indirect Measure: 80% of the faculty will rate themselves as being satisfied with the level of support they received from the School of

Business and Industry that made it possible to participate in civic and social organizations.

 Direct Measure: A database of faculty participation in civic and social organizations will be used for data collection purposes.

 Indirect Measure: A faculty survey will be conducted in the Spring semester. There will be items that measure faculty satisfaction with the level of support they receive from the School of Business and

Industry to participate in civic and social organizations.

What we’ve done…

Objective 1

Innovation Insights hosted by

Innovation Matters beginning March

2010

Workshops for small businesses will begin May 2010

Satisfaction surveys to be administered at each session.

Objective 2

We have secured a grant from Thurgood

Marshall College Fund for $20,000 to conduct research on economic development via small businesses in Big

Bend Area.

Faculty satisfaction survey will be administered in April 2010.

Objective 3

Financial literacy workshops to be offered for SBI students (April 1

st

),

FAMU and community (April 8

th

), and Tallahassee community (March

27

th

)

Satisfaction surveys to be administered at each session.

Objective 4

Database of faculty credentials has been developed

Faculty satisfaction survey will be administered in April 2010.

Objective 5

Faculty credentials database includes information on civic organization membership and leadership positions

Faculty satisfaction survey will be administered in April 2010.

Questions?

March 17, 2010

11:00 a.m. – 2:30 p.m.

Florida A&M University

Assessment Roundtable

March 17, 2010

Presented by:

Dr. Marjorie McNeill and Prof. Aurelia Alexander

Make it a team effort that is spearheaded by a dedicated committee.

Inform all faculty of goals and procedures.

Have assessment as a standing item on all meeting agendas – division/department, school/college.

Give frequent reminders for documentation of activities participated in. Supply deadlines and the process to get data in a timely manner.

Foster a culture of continuous improvement to ensure student success and institutional effectiveness.

SECTION II_ COLLEGE/SCHOOL MISSION/GOALS CONNECTION

FAMU is committed to inspirational teaching, exemplary research, and meaningful public and community service through creative partnerships at the local, state, national, and global levels.

Strategic Goal 3.4: Firmly establish the University as a competitive doctoral/research-intensive

University that is highly regarded in the research community and is noted for state-of-the-art research that supports high quality graduate, undergraduate, and professional programs.

SOAHS Mission Statement:

The mission of the School of Allied Health Sciences is to provide an enlightened and enriched academic, intellectual, moral, cultural, ethical, technological, and student-centered environment for the purpose of educating individuals to become competent allied health professionals who are capable of:

Complex critical thinking

Comprehensive communication skills

Interdisciplinary collaboration

Analysis and involvement in research processes

Improving the health status of under-represented and underserved populations

Lifelong learning

This mission will be accomplished through the contributions of dedicated faculty and staff that are capable of meeting student needs through inspirational and creative teaching, exemplary scholarship and meaningful public, community, and professional service at local, stat e, national, and global levels. As a result, students will be prepared to meet existing and emerging health care needs that will benefit the citizens of Florida, the nation, and the world.

1.

2.

3.

Expected Outcomes:

Faculty will present profession specific best practices and research findings at local, state, and national meetings.

Faculty will attend professional development activities in the area of research.

Faculty will participate in student research activities.

Step 1

Step 2

SECTION III_ FAMOUS SIX STEPS

EXPECTED RESEARCH OUTCOME #1

Formulate Outcome

Faculty will present profession specific best practices and research findings at local, state, and national meetings.

Direct Measure

10% of full-time faculty will make at least one presentation at the local, state, or national level.

Ascertain Criteria for Success

Indirect Measure

80% of full-time faculty will rate themselves as being satisfied with opportunities to present best practices and research findings at professional meetings.

Step 3

Step 4

Measure Performance Using

Direct and Indirect Methods of Assessment

Direct Measure

Compilation of professional meeting presentations.

Indirect Measure

Results from a faculty survey administered annually.

Direct Measure

29% (6/21) of full-time faculty have made a presentation at the local, state, or national level.

Observe and Summarize

Results

Indirect Measure

100% (12/12) of faculty are satisfied (1-completely satisfied; 4 – very satisfied; 7 – somewhat satisfied) with opportunities to present best practices and research findings at professional meetings.

Step 5

Step 6

Use of Results for

Improvement

(Implemented)

Results are shared with all faculty. Faculty members are encouraged to submit proposals at the local, state, and national professional meetings.

Strengthen College or School

(Action Plan)

Continue to monitor outcomes and identify opportunities to present.

SECTION II_ COLLEGE/SCHOOL MISSION/GOALS CONNECTION

FAMU is committed to inspirational teaching, exemplary research, and meaningful

Excerpt(s) Citing Linkage to

University Mission Statement for

Community/Public Service public and community service through creative partnerships at the local, state, national, and global levels.

Strategic Goal 4.2: To enhance the services provided to the local, state, national, and international communities.

Excerpt(s) Citing Linkage to

University Goal (s)

Statement for

Community/Public Service

Program Mission/Goals on

Community/Public Service

From College or School

Strategic Plan

SOAHS Mission Statement:

The mission of the School of Allied Health Sciences is to provide an enlightened and enriched academic, intellectual, moral, cultural, ethical, technological, and student-centered environment for the purpose of educating individuals to become competent allied health professionals who are capable of:

 Complex critical thinking

Comprehensive communication skills

Interdisciplinary collaboration

Analysis and involvement in research processes

Improving the health status of under-represented and underserved populations

 Lifelong learning

This mission will be accomplished through the contributions of dedicated faculty and staff that are capable of meeting student needs through inspirational and creative teaching, exemplary scholarship and meaningful public, community, and professional service at local, stat e, national, and global levels. As a result, students will be prepared to meet existing and emerging health care needs that will benefit the citizens of Florida, the nation, and the world.

Program Objectives or

Outcomes on

Community/Public Service

From College or School

Strategic Plan

1.

2.

3.

Expected Outcomes:

The School will participate in community health events in an effort to share knowledge regarding healthy lifestyles.

The School will provide continuing education for community healthcare providers and/or the general public.

The School will participate in the development of health care policy at the local, state, and national levels.

Step 1

Step 2

Step 3

Step 4

Step 5

Step 6

SECTION III_ FAMOUS SIX STEPS

EXPECTED COMMUNITY/PUBLIC SERVICE OUTCOME #1

Formulate Outcome

The School will participate in community health events in an effort to share knowledge regarding healthy lifestyles.

Ascertain Criteria for

Success

Direct Measure

Faculty and students in the School will participate in at least 2 local area health fairs or other related community events during the academic year.

Indirect Measure

80% of community agencies will give a satisfactory rating for the level of participation they received from the School in community health events.

Measure Performance Using

Direct and Indirect Methods of Assessment

Observe and Summarize

Results

Direct Measure

Annual report listing community health event, date, location, audience, participating divisions within School.

Indirect Measure

Confirmation of participation from community agency.

Direct Measure

Faculty and/or students have participated in the following community events:

1.Habitat for Humanity – Health Science students; continuous, ongoing participation

2.CarFit for Seniors – Occupational Therapy faculty and students; October

2008

3.ATTAC Tobacco Cessation Program in collaboration with the Big Bend

AHEC; Fall 2008

4.Open Airways – Cardiopulmonary Science faculty and students; Fall

2008

5.American Lung Association Lung Walk – Cardiopulmonary Science faculty; Spring 2009

6.Live Oak Geriatric Education Center – Dean’s Office; continuous, ongoing participation

7.Health Check/Balance Clinic – Occupational Therapy faculty and students; Fall 2008

8.Adaptive Equipment Tech Fair – Occupational Therapy faculty and student; Fall 2008

9.Habitat for Humanity/Rainbow Rehabilitation – Occupational Therapy faculty; Spring 2009

Use of Results for

Improvement

(Implemented)

Strengthen College or

School (Action Plan)

Indirect Measure

100% (9/9) of community agencies have indicated a satisfactory rating for the level of participation they received from the School.

Faculty/student involvement and community agency feedback will be used to strengthen the School’s efforts in sharing knowledge of healthy lifestyles.

Continue community involvement and partnering efforts. Seek additional opportunities to participate in.

This is a learning process for all!

Remember, this is a way to demonstrate all the hard work that is already going on in each of our areas.

By sharing good news, we can make informed decisions regarding change.

QUESTIONS and ANSWERS

Dr. Marjorie McNeill

561-2021 marjorie.mcneill@famu.edu

Prof. Aurelia Alexander

561-2018 aurelia.alexander@famu.edu

March 17, 2010

11:00 a.m. – 2:30 p.m.

Download