July 23, 2014
Advisory Board Meeting
Agenda
•
•
•
•
Welcome & Re-Introduction
Part I
Results of Our First Year (15 months)
Next Steps
Part II
Carousel Brainstorm – Board Member Input
July 23, 2014
Advisory Board Meeting
Operation STEM Advisory Board Members
Deirdre Mageean, Provost and Honorary Advisory Board Chair
Meredith Bond, CSU Dean, College of Sciences and Health
Professions
Ellen Burts-Cooper, Senior Managing Partner, Improve!
Consulting and Training Group
Thomas Geaghan, CSU Director of Institutional Research
Brian Harper, Associate Professor, CSU Department of
Curriculum and Foundations
Edward Hren, Partner, Chagrin Valley Engineering, LTD
Pat Kan, Undergraduate Program Coordinator & Instructor,
CSU Department of Math
Anette Karlsson, CSU Dean, Fenn College of Engineering
Felipe Martins, Calculus Coordinator & Professor, CSU
Department of Mathematics
Antoinette (Toni) Marquard, Undergraduate Program
Coordinator & Instructor, CSU Department of Math
July 23, 2014
Advisory Board Meeting
Jeff McClellan, Head of School, MC2STEM High School
Jan Morrison, President & CEO, Teaching Institute for
Excellence in STEM (TIES)
Susan Nagorney, Math Department Coordinator,
Cuyahoga Community College/Metro
Candice Quinn, Operation STEM Curriculum Developer &
Instructor, CSU Department of Mathematics
Julie Rittenhouse, Director, CSU Development for Corporate
and Foundation Relations
Ieda Rodrigues, PreCalc Coordinator & Professor, CSU
Department of Mathematics
Wanda Shippy, Social Responsibility Manager,
Progressive Insurance
Nigamanth Sridhar, Associate Professor, Software
Engineering, CSU Department of Electrical and Computer
Engineering
Sajit Zachariah (Zac), CSU Dean, College of Education &
Human Services
Jianping Zhu, CSU Senior Vice Provost & Dean of College of Graduate Studies
NSF STEP Grants & Operation STEM

NSF-STEP grants exist to increase the number of STEM
graduates in U.S. colleges and universities.

The mission of NSF-STEP grant, Operation STEM, is to
increase the number of students who successfully
complete the calculus sequence (PreCalc I – Calc II) and
graduate with a STEM degree.
July 23, 2014
Advisory Board Meeting
Our Successes Since
Last Board Meeting - January 31, 2014





Precalculus II pass rate: 87% (previously 61%) +26%
Due to passing the OpSTEM Summer Calculus I course,
35 students continue in their STEM degree
2 New PBL Projects Launched (Ringtone & Formula 1 Racing)
Partnership with Cleveland Indians established
Successful OpSTEM components to be replicated in another
start up STEM program
July 23, 2014
Advisory Board Meeting
Overall Results of Our First Year (15 Months)
(Chronological Order from March 2013 to June 2014)









2013 STEM Education Conferences (N=51)
OpSTEM Summer Institute (N=36)
Precalculus I pass rate: 81% (previously 57%) +24%
Precalculus II pass rate: 87% (previously 61%) +26%
Tuition-free, paid Calculus I – 35 students passed
3 PBL Projects Launched (Bridge, Ringtone & Formula 1 Racing)
2014 STEM Education Conferences (N=50)
2 Credit PHY 493 OpSTEM Research Methods for Spring ’15
In Summer 2014 - Successful OpSTEM components will start to be
replicated in LSAMP - Louis Stokes Alliance for Minority Participation
July 23, 2014
Advisory Board Meeting
Results to Report Since January 31st Board Meeting








2013 STEM Education Conferences (N=51)
1 Summer Institute (N=36)
Precalculus I pass rate: 81% (previously 57%) +24%
Precalculus II pass rate: 87% (previously 61%) +26%
Summer Calculus I - 35 students passed
3 PBL Projects Launched (Bridge, Ringtone & Formula 1 Racing)
2014 STEM Education Conferences (N=50)
2 Credit PHY 493 OpSTEM Research Methods for Spring ’15
July 23, 2014
Advisory Board Meeting
Term
Enrollment *
Withdrawals
(Percentage & Number )
Overall Fall
Spring 2008
Spring 2009
Spring 2010
766
86
77
102
16% (122)
15% (13)
13% (10)
18% (18)
Pass Rate
(Percentage & Number
Passed with C or >)
58% (444)
50% (43)
58% (45)
58% (59)
Spring 2011
99
20% (20)
55% (54)
Spring 2012
Spring 2013
111
110
14% (15)
13% (14)
68% (75)
63% (69)
Overall Spring
(Excluding SP 14)
585
15% (90)
59% (345)
Spring 2014
135
3% (4)
87% (118)
July 23, 2014
Advisory Board Meeting
*Includes all official and unofficial withdrawals for MTH 168.
Significance of Spring 2014
MTH 168 Precalculus II Pass Rates

28 fewer students who need to RETAKE Precalculus II
◦ If 10 of these 28 do not drop out because of successful completion of
course, tuition gain of $289,080
($9636 annual tuition X 10 students X 3 years)


Larger enrollment in MTH 168 Precalc II (135) in part because
of success of MTH 167 Precalc I (57%  81% pass rate)
Fewer withdrawals (3%) {Spring semester avg. 15%)
July 23, 2014
Advisory Board Meeting
Spring 2014
MTH 168 Section
OpSTEM
Section
(Enrollment*)
PBL
Sect.
Course
Enrollment**
9:45am–10:50am MWF
11:00am–12:05pm • SPT/PBL-MW
YES
(14)
YES
4:00pm – 5:50pm MW
6:00pm-7:00pm • SPT-MW
YES
(5)
1:30pm – 2:35pm MWF
3:00pm – 4:00pm • SPT/PBL-MW
%/No. Withdraws
# Who
Took Final
&
Completed
the Course
Pass Rate
(Percentage
C or >)
Official
Unofficial
37
3%
(1)
0%
(0)
36
95%
(35)
NO
31
0%
(0)
6%
(2)
29
90%
(28)
YES
(5)
YES
38
5%
(2)
3%
(1)
35
87%
(33)
8:00am-9:50am TTH
10:00am-11:00am • SLA-TTH
NO
NO
29
3%
(1)
3%
(1)
27
76%
(22)
TOTALS
3/4
2/4
135
3%
(4)
3%
(4)
127
87%
(118)
 Out of 127 students who completed the course, only 9 did not pass.
July 23, 2014
Advisory Board Meeting
*Enrollment of OpSTEM Scholars in Precalc II section.
**Includes official and unofficial students who withdrew from the course.
# of
Students*
Cohort
OpSTEM
Scholars
NonOpSTEM
Scholars
July 23, 2014
Advisory Board Meeting
%/Number of
Withdraws
Mean
Final
Exam
Score
Mean
Course
Grade
Pass Rate
(Percentage
& Number of
Students
with C or >)
PBL
20
10%
(2)
83%
89%
90%
(18)
Non
-PBL
5
0
85%
82%
80%
(4)
PBL
55
2%
(1)
81%
87%
91%
(50)
Non
-PBL
55
2%
(1)
75%
82%
84%
(46)
Factors Which MAY Have Contributed to
MTH 168 – Precalculus II 87% Pass Rate

Maintained class size cap at 37
All sections (4) taught with mandatory SPT Sessions

 Provides 2 extra hours of STEM Peer Teacher instruction
2 sections taught with Project Based Learning


More prepared students, experienced SPTs,
cohort bonding
July 23, 2014
Advisory Board Meeting
%/Number
of
Withdraws
Mean
Final
Exam
Score
Mean
Course
Grade
Pass Rate
(Percentage
& Number
of Students
with C or
>)
Moved on to
OpSTEM
Calculus I
MTH
180/181
Cohort
# of
Students*
OpSTEMS
25
8%
(2)
84%
88%
88%
(22)
21*
Non-OpSTEMS
110
2%
(2)
78%
84%
87%
(96)
20
NOTE: 1 OpSTEM Scholar took MTH 168 in Fall 2014 and later joined OpSTEM Summer Calculus I for a total
enrollment of 42 students.
* Changed major, difficult high school-freshman transition, life challenges, etc.
July 23, 2014
Advisory Board Meeting









Intended Major
Financial Aid
First Generation
Precalculus I Final Grade & Precalculus II grade in February
Taking another Class During Summer I
Taking Calculus II in the Fall
2 Letters of Recommendation
Candidate’s 250 Word Essay
Reviewed by Drs. Stephen Duffy,
Debbie Jackson and Susan Carver
July 23, 2014
Advisory Board Meeting








6 weeks – May 19th thru June 28th – 5 days a week (28 classes)
Mandatory 1.5 hr. lecture & 1 hr. SPT session with 4 SPTs
1 hr. daily optional open lab with 1 SPT, 2 Jr. SPTs and Professor
Marquard’s assistance (avg. 20+ in attendance)
PBL 1x/week – Formula 1 Race Car Project
42 registered students – 1 withdrawal
$1000 stipend to be paid to 22 OpSTEM Scholars who pass course
20 OpSTEM Summer Calculus 1 Scholarship students
Began course with Ellen Burts-Cooper’s, Improve Consulting,
Brain Game Competitions as an ice-breaker
July 23, 2014
Advisory Board Meeting
Operation STEM Social Event Support
Thank you
Ellen Burts-Cooper, Senior Managing
Partner, Improve! Consulting and
Training Group for sponsoring her
consultant, Jarvis Bills, who engaged the
42 Summer Calculus OpSTEM Scholars in
Brain Game Competitions as their
ice breaker activity for the course.
July 23, 2014
Advisory Board Meeting
Total Number of
Students
Final
Course Grade
≥ 70%
42
25
60%
Final
Course Grade
60-69%
10
24%
Final
Course Grade
< 60%
7
17%
Of the 35 students who passed MTH 180-OpSTEM Summer Calculus I 25 move on to
MTH 182-Calculus II.
July 23, 2014
Advisory Board Meeting

Possible Factors Which MAY Have Contributed to
MTH 181 – Calculus I low success rate
Error in syllabus grading scale. Needed a 60%
(should have been a 70%) to:
1) pass course, 2) go on to Calculus II, 3) receive $1000 stipend





Despite very low grades, did not drop course because
of free tuition and/or $1000 stipend
Did not feel the pace of the intensive 6-week course
Large class size (N=42)
Complacent/Burned out
Underdeveloped critical thinking skills
July 23, 2014
Advisory Board Meeting
Of the time spent outside of class, SPT session and the one-hour optional lab time, HOW
MUCH TIME on average per day (HOURS & MINUTES) was designated to homework, other
study techniques, i.e, Kahn Academy, paper and pencil practice problems.
REPRESENTATION OF 42 STUDENTS’ ANSWERS
WebWorks
1.5hr
3hr
20min
40min
1.5hr
30min
1.5hr
1hr
1hr
3hr
1hr
1hr
1hr
4.5hr
1.5hr
35min
Reviewing Notes
20min
1hr
20min
30min
Paper & Pencil Practice Problems
2hr
1.5hr
15min
30min
30min
30min
1hr
10min
15min
1hr
1hr
30min
15min
1hr
0-5min
15min
1hr
30-60min
5min
1hr
5min
Online Resources
Infinite hours
30min
30min
45min
1hr
10min
30min
Other
10min
1hr
1.5hr
5min
30min
10min
Comments:
1. I tried to spend as much time as I could outside of class, when I wasn't working I spent as much time as I could on
homework and practicing but I have to work quite a bit and that was just not possible every day.
2. I would have loved to spend more time trying to figure out the Calculus but I did not have that much time to give to
it. If I was solely focusing on Calc I might have done better.
July 23, 2014
Board
3.Advisory
I studied
withMeeting
my grandfather for 3 hours before each exam.



B- or higher in Precalculus I and II during 2014-2015
Minimal work hours during 8-week course
Sliding grade scale to earn specific stipend, max. $500
Earned Letter Grade
July 23, 2014
Advisory Board Meeting
Stipend Amount
A
$500
A-
$450
B+
$400
B
$350
B-
$300
C+
$200
C
$100
Project-Based Learning Looking Back

Fall 2013
◦ Bridge project

Spring 2014
◦ Exploring Trigonometry
Through Sound Project

Summer 2014
◦ Formula 1 Racing Strategy Project
July 23, 2014
Advisory Board Meeting
Project-Based Learning
MTH 168 – Exploring Trigonometry Through Sound Project




Ringtones were created using sine equations
Criteria of the project
 Contain 3 pure tones
 Contain 1 complex tone
 Plays for 10 seconds
Multimedia Project
 Maple – graphical representation of the waves
 WolframAlpha – musical representation of the waves
PBL Symposium in April 2014
 Tones were played on iPads
 Tones were displayed on poster board
July 23, 2014
Advisory Board Meeting
Project-Based Learning
MTH 180 – Formula 1 Racing Strategy Project




Model Time for a Formula 1 Racing Strategy
 Recognition of given parameters.
 Understand relation between each parameter
Knowledge used
 Algebraic Methods
 Integration
Race Day
 Pairs worked together to come up with 1 strategy
 Computer simulation
Final Paper
 Explaining the method used
 All calculations used and how they were created
 Explanation of their mathematical thinking during the project
July 23, 2014
Advisory Board Meeting
Project-Based Learning: Looking Forward
• Better align the content of the project to the course material
• Scaffold the knowledge and skills required to complete
projects throughout the three courses
• Integrate the project into the course as much as possible
• Meet collaboratively with the instructor(s), SPTs, and project
coordinator to design and implement the projects
July 23, 2014
Advisory Board Meeting
Where are the 36 OpSTEM Scholars Who Began
the Program with the 2013 Summer Institute?




26 – on the path to a STEM degree
2 – no longer STEM Majors
7 – left CSU
1 – MC2STEM student
ADD:
 11 – Qualified Summer Calculus Scholarship Recipients
 38 – TOTAL now in 2013 OpSTEM
July 23, 2014
Advisory Board Meeting
2014 STEM Education Summer Conference
July 23, 2014
Advisory Board Meeting
2014 STEM Education Summer Conference Leads to Continued
Partnership with Indians & Progressive Insurance
•
Cleveland Indians provided: 6 Dugout Suites and the Visitor’s
Clubhouse (lovely locker room), ½ cost of breakfast & lunch
• In-kind contribution: $10,000
July 23, 2014
Advisory Board Meeting
2014 STEM Education Summer Conference Leads to Continued
Partnership with Indians & Progressive Insurance
•
Progressive Insurance, OpSTEM, & CSUTeach will provide:
• hands-on middle school curriculum and 2014 Professional
Development for educator implementation during 2014-2015
•
creation & implementation of “STEM Education Day” at
Progressive Field prior to Indians 1 p.m. game May 2015
• Financial contribution: $1600
• In-kind contribution: $1200 + volunteer hours TBD for
future curriculum design, writing, and implementation
during 2014-2015 academic year
July 23, 2014
Advisory Board Meeting
2014 STEM Education Summer Conference Support
Thank you
Wanda Shippy, Social Responsibility
Manager, Progressive Insurance for:
•
•
•
providing curriculum writer
2014 conference presenters
ongoing event planning, project
management, curriculum support,
design and implementation for 2014
Professional Development & STEM
Education Day in May 2015
July 23, 2014
Advisory Board Meeting
2014 STEM Education Summer Conference Support
Thank you
Dr. Meredith Bond
Dean, College of Sciences and Health Professions
Dr. Anette Karlsson
Dean, Washkewicz College of Engineering
Dr. Sajit Zachariah (Zac)
Dean, College of Education & Human Services
for providing the much appreciated funds for K-6 meals,
materials, and educator and presenter stipends.
July 23, 2014
Advisory Board Meeting
NEXT STEPS
•
•
•
•
•
•
•
Recruit, improve and implement 2014 Summer Institute
Utilize LSAMP Math Education Coordinator, Candice Quinn,
(newly created position) to enhance Precalc I - Calc II
Cover all future SPT sessions for Precalc I & II both semesters
Enchance Precalculus, Calculus & PBL content and delivery
Increase SPT training, support & mentoring
Create OpSTEM Scholar Profiles of Success
Execute 2014 STEM Ed. Professional Development and 2015
STEM Education Day with Cleveland Indians and Progressive
July 23, 2014
Advisory Board Meeting
NSF 3rd Year Review Process
• We have received funding for first 3 years
• Final 2 years of funding contingent on successful
3rd year review
• NSF has a set of 16 questions we must answer
• Submission due to NSF January 2015
• Interview in March 2015 with 2-3 NSF Program
Officers
• Several of the questions involve Advisory Board input
July 23, 2014
Advisory Board Meeting
10-minute BREAK
Please enjoy more water/coffee/tea, breakfast, etc.
July 23, 2014
Advisory Board Meeting
Carousel Brainstorm Questions

What has been the impact of Operation STEM?

What sources of evidence can be used to assess
OpSTEM’s progress?

What current and future challenges do you envision?

What improvements/changes could be made?

What are steps to ensure sustainability?
July 23, 2014
Advisory Board Meeting
Thank you!
Our NSF 3rd Year Review submission is
due on January 30th.
We need your input prior to that date.
Next Operation STEM Advisory Board Meeting:
Wednesday, January 14 or 21, 2015?
July 23, 2014
Advisory Board Meeting