OTHER - SPS Council 2007

advertisement
REPORT ON THE QUALITATIVE ANALYSIS OF A
SAMPLE OF SOCIETY OF PHYSICS STUDENTS INTERN JOURNALS
Anne-Barrie Hunter
Ethnography & Evaluation Research
Center to Advance Research and Teaching in the Social Sciences
University of Colorado, Boulder
abhunter@colorado.edu
May, 2007
TABLE OF CONTENTS
Table of Figures ........................................................................................................................... iv
Table of Tables ..............................................................................................................................v
Executive Summary .................................................................................................................. viii
Introduction ...................................................................................................................................1
SPS Summer Intern Program ..................................................................................................1
SPS Summer Intern Program Support ....................................................................................2
Goals of the SPS Summer Intern Program..............................................................................2
Purpose of Qualitative Analysis of Intern Journals ................................................................3
Method .......................................................................................................................................... 3
Sample Selection........................................................................................................................... 4
Internship Placement ............................................................................................................
Year of Internship Placement ...............................................................................................
5
5
The Data Set .................................................................................................................................. 6
Findings.......................................................................................................................................... 7
Grouping of Observations and Major Parent Categories and Overview of Findings ........... 7
Overview of observations of program outcomes .......................................................... 7
Overview of general observations ............................................................................. 7
Discussion of Parent Category Contents..............................................................................
9
Observations of Program Outcomes ..........................................................................
9
Personal growth .................................................................................................
Personal-professional gains ...............................................................................
Professional collegiality ........................................................................
Supervisor mentoring .............................................................................
Personal gains from professional work .................................................
Thinking and working like a professional .........................................................
Applied learning gains ...........................................................................
Increased knowledge ..............................................................................
Enhanced understanding of professional work contexts and preparation for
advance study and entry to the workforce ..................................................
ii
10
16
16
21
23
25
25
30
32
Becoming a professional ....................................................................................
Understanding the realities of professional work..................................
Demonstrated attitudes and behaviors necessary to professional work.
Skills ..................................................................................................................
Career clarification.............................................................................................
Enhanced educational experience .....................................................................
41
41
47
50
54
57
General Observations .............................................................................................
59
SPS general internship elements ........................................................................
Positive, “mixed,” and negative program/internship evaluations ......................
Positive evaluations ...............................................................................
“Mixed” evaluations ..............................................................................
Negative evaluations ..............................................................................
Structural elements of supervising .....................................................................
How gains were produced ..................................................................................
Miscellaneous ....................................................................................................
59
67
67
74
74
74
76
79
Analyses of Internship Type and Gender ...........................................................................
84
Discussion..................................................................................................................................
86
Conclusions ...............................................................................................................................
89
References ....................................................................................................................................90
APPENDIX A. Number of interns offering a particular observation, by type of internship
experience and by gender .................................................................................................... 93
APPENDIX B. All men’s observations by category and type of internship ..................... 100
APPENDIX C. All women’s observations by category and type of internship .................. 108
.
iii
TABLE OF FIGURES
Figure 1. Intern journal sample by gender and type of internship ..................................................4
Figure 2. SPS internship placement by organization/association and by gender ...........................5
Figure 3. Internship placement by year and gender .........................................................................6
Figure 4. Gains codes used per journal, total number of gains observations coded, and percent of all gains
observations, by intern ................................................................................................................85
iv
TABLE OF TABLES
Table 1. Number and percent of all observations by group, category and type of internship .........8
Table 2. Number and percent of all observations by group, category and gender ..........................9
Table 3. PROGRAM OUTCOMES: Observations of personal growth, by type of internship .....11
Table 4. PROGRAM OUTCOMES: Observations of personal growth, by gender ......................11
Table 5. PROGRAM OUTCOMES: Number of interns citing personal growth by type of
internship and gender ..............................................................................................................12
Table 6. PROGRAM OUTCOMES: Observations of personal-professional gains by type of
internship..................................................................................................................................17
Table 7. PROGRAM OUTCOMES: Observations of personal-professional gains by gender .....18
Table 8. PROGRAM OUTCOMES: Number of interns citing personal-professional gains by type
of internship and gender ..........................................................................................................19
Table 9. PROGRAM OUTCOMES: Observations of “thinking and working like a professional”
by type of internship ...............................................................................................................26
Table 10. PROGRAM OUTCOMES: Observations on “thinking and working like a
professional” by gender ..........................................................................................................26
Table 11. PROGRAM OUTCOMES: Number of interns citing gains in “thinking and working
like a professional” by type of internship and gender .............................................................27
Table 12. PROGRAM OUTCOMES: Observations of enhanced understanding of professional
work contexts and preparation for advance study and entry to the workforce by type of
internship..................................................................................................................................33
Table 13. PROGRAM OUTCOMES: Observations of enhanced understanding of professional
work contexts and preparation for advance study and entry to the workforce by gender .......34
Table 14. PROGRAM OUTCOMES: Number of interns citing enhanced understanding of
professional work contexts and preparation for advance study and entry to the workforce by
type of internship and gender ..................................................................................................35
Table 15. PROGRAM OUTCOMES: Observations of “Becoming a professional” by type of
internship..................................................................................................................................42
Table 16. PROGRAM OUTCOMES: Observations of “Becoming a professional” by gender ....43
v
Table 17. PROGRAM OUTCOMES: Number of interns citing gains in “Becoming a
professional” by type of internship and gender .......................................................................44
Table 18. PROGRAM OUTCOMES: Observations on gains in skills by type of internship .......51
Table 19. PROGRAM OUTCOMES: Observations on gains in skills by gender.........................51
Table 20. PROGRAM OUTCOMES: Number of interns citing gains in skills by type of internship
and gender ...............................................................................................................................52
Table 21. PROGRAM OUTCOMES: Observations on gains in career clarification by type of
internship..................................................................................................................................55
Table 22. PROGRAM OUTCOMES: Observations on gains in career clarification by gender ...55
Table 23. PROGRAM OUTCOMES: Number of interns citing gains in career clarification by
type of internship and gender ..................................................................................................56
Table 24. PROGRAM OUTCOMES: Observations on enhanced educational experience by type
of internship .............................................................................................................................57
Table 25. PROGRAM OUTCOMES: Observations on enhanced educational experience by
gender .......................................................................................................................................58
Table 26. PROGRAM OUTCOMES: Number of interns citing gains in enhanced educational
experience by type of internship and gender ...........................................................................58
Table 27. GENERAL: Observations of SPS general internship elements by type of internship ..60
Table 28. GENERAL: Observations of SPS general internship elements by gender ....................61
Table 29. GENERAL: Number of interns citing SPS general internship elements by type of
internship and gender ..............................................................................................................62
Table 30. GENERAL: Observations of program/internship evaluations by type of internship ....68
Table 31. GENERAL: Observations of program/internship evaluations by gender .....................69
Table 32. GENERAL: Number of interns citing program evaluations by type of internship and
gender ......................................................................................................................................70
Table 33. GENERAL: Observations of structural elements of supervising by type of internship 75
Table 34. GENERAL: Observations of structural elements of supervising by gender .................75
vi
Table 35. GENERAL: Number of interns citing structural elements of supervising by type of
internship and gender ..............................................................................................................75
Table 36. GENERAL: Observations on how gains were produced by type of internship ............76
Table 37. GENERAL: Observations on how gains were produced by gender .............................77
Table 38. GENERAL: Number of interns citing how gains were produced by type of internship
and gender ...............................................................................................................................78
Table 39. GENERAL: Miscellaneous observations by type of internship ....................................80
Table 40. GENERAL: Miscellaneous observations by gender .....................................................81
Table 41. GENERAL: Number of interns citing miscellaneous observations by type of internship
and gender ...............................................................................................................................82
vii
REPORT ON THE QUALITATIVE ANALYSIS OF A
SAMPLE OF SOCIETY OF PHYSICS STUDENTS INTERN JOURNALS
Anne-Barrie Hunter
Ethnography & Evaluation Research
Center to Advance Research and Teaching in the Social Sciences
University of Colorado, Boulder
abhunter@colorado.edu
May, 2007
Executive Summary
The SPS Summer Intern Program
Since the beginning of its summer intern program in 2001, the Society of Physics Students (SPS)
has provided internships to 37 undergraduates. SPS internships are designed to create broadbased learning opportunities for undergraduate physics majors in the areas of scientific research
and science education outreach/policy work. Successful applicants are placed in organizations
and agencies in the Washington, DC area, such as the National Institute of Standards and
Technology (NIST) and the National Aeronautics Space Administration (NASA) for researchbased internships, or placed within professional associations such as the American Association
of Physics Teachers (AAPT) and the American Astronomical Society (AAS) for science
education outreach/policy internships. These organizations and associations utilize the energy
and diversity of physics undergraduates to enhance their programs in the advancement of physics
and allied sciences, and seek to contribute to students’ professional development through
meaningful, hands-on engagement in projects relevant to their programs. Participating agencies
assign one or more mentors from senior staff to guide interns’ work and overall experience.
As part of the SPS Summer Intern Program, students participate in an orientation session and
intermittent half-day field trips to broaden their exposure to physics and allied science
environments. Sometime during the internship, each student also gives a 20-minute professional
presentation on his or her work, accomplishments, and overall internship experience, to the staff
scientists of the American Institute of Physics and invited guests. Interns receive a $3200
stipend, paid housing at George Washington University, and paid transportation to and from
Washington, DC, for eight and a half weeks of work over the summer.
The goals of the SPS Summer Intern Program align with SPS’ mission to (among others):
encourage and assist students interested in physics to develop the knowledge, competence,
enthusiasm, and social responsibility that are essential to the advancement of physics; stimulate
interest in advance study and research in physics; and develop collegiality among physics
students and professionals in physics and allied sciences.
Qualitative Analysis of a Sample of SPS Summer Intern Journals
SPS interns are required to submit a weekly journal as a way of documenting their internship
experience. However, reporting expectations are largely undefined and leave interns to decide for
themselves what to include, or even how much to write. Interns were simply directed to “submit
viii
a weekly journal entry highlighting your work and/or a particular experience associated with the
internship.” Gary White, Director, Society of Physics Students (SPS), Sigma Pi Sigma Director
and Assistant Director of Education, American Institute of Physics, requested the services of
Ethnography & Evaluation Research to qualitatively analyze a sample of student intern journals
in order to determine the usefulness of this type of program assessment in evaluating the SPS
Summer Intern Program.
SPS seeks both summative and formative information on their summer intern program from a
qualitative content analysis of interns’ journals: summative findings address the intellectual,
personal, professional and other types of gains that students take away from their intern
experience; formative results concern strengths and weaknesses of the program and allow the
program director to make informed policy decisions for the future direction of the SPS Summer
Intern Program based upon empirical evidence. Understanding qualitative differences
discovered by comparing and contrasting the types of gain students report from their experience
either in the science research or science education outreach/policy internships will also aid the
program director to assess the quality of both types of internship offered and direct recruitment
of faculty and industry partnerships in alignment with program objectives. Identification of any
issues related to gender is also an aim of this analysis.
Method
A sample of 20 intern journals was selected from a set of 37. Intern journals were randomly
chosen within specific parameters to sample participant characteristics (race/ethnicity,
Americans with Disabilities Act status, type of home institution [i.e., 2-year colleges, R1
institutions, public and private colleges and universities], as well as a balance between the two
types of internship offered [science research or science education outreach/policy work], and
between men and women) so as to provide a view of the broadest range of SPS internship
participation possible.
A qualitative analysis of a sample of SPS intern journals was conducted to identify activities,
attitudes, and gains that interns recorded in their journal entries while working in an SPS
internship. Particular emphasis was placed on exploring evaluation questions important to SPS:
What evidence recorded in interns’ journal demonstrates:






students’ intellectual, personal and professional gains from the internship experience?
opportunities to integrate academic knowledge with field applications?
gains in skills and knowledge that add value to their academic study?
enhanced preparation in knowledge and skills for advance academic study or entry to the
workforce?
clarification and/or confirmation of participants’ intended career paths?
knowledge of the physics and allied science community and increased opportunities for
professional networking and career development?
From the results of the analysis, what can be learned regarding:
ix



formative information that highlights program strengths or that indicates areas in need of
improvement?
comparison and contrasts of the different types of gains students make from the two types
of summer experiences offered by SPS internships?
issues of gender?
To start, an intern’s weekly journal entries were compiled chronologically (from first to last) as
an individual document file. The resulting 20 document files varied in length depending upon
how much an intern had written, week to week or cumulatively. These files were then imported
into NVivo 7.0, a computer software program used for qualitative data analysis. In conducting a
content analysis, the analyst reads through all of the documents—the text data—searching for
information relevant to the evaluation questions. Text segments referencing distinct ideas are
tagged by code names. Codes are not preconceived, but empirical: each new code marks a
discrete idea not previously raised. All of the code names that are developed are collected in a
codebook. When the analyst reads a text passage that relates an idea previously encountered, the
same code name is used again to mark the relevant passage. Thus codes and their associated text
passages are linked, amassing a data set of code names and their frequency of use across the data
set. Once all of the text data is coded in this manner, codes similar in nature are grouped
together to define themes; the clustered frequencies, represented as grouped themes or
categories, describe both the range and relative weighting of issues in participants’ collective
report.
Since no word limit was imposed and parameters concerning what interns should write about
were somewhat loose—requesting that they convey “a variety of science, policy and outreachrelated activities” and other weekly or special events—journal entries reflect a freeform data set.
Thus while we may expect commonalities among interns’ journals concerning weekly activities
and structured events, what they record in regards to learning gains is notable, as these
observations are offered spontaneously, without prompting. Again, because guidelines for
interns’ journal entries are rather open-ended, it likely means that at least some gains are underreported.
Findings
Grouping of Observations and Major Parent Categories, and Overview of Findings
Observations were sorted according to textual content into 14 distinct categories. These parent
categories divided into two groups: observations on program outcomes and general observations.
Broadly, analysis of interns’ journals identified: types of gains derived from participation in the
SPS Summer Intern Program; descriptions of general SPS internship elements; and program
evaluations.
Overview of observations of program outcomes
Nearly 70% of participants’ observations (67%) described benefits from participating in the SPS
Summer Intern Program. They discussed gains in:


personal growth (20%)
personal-professional gains (14%)
x



increased understanding of how science research and science education outreach/policy
work is actually done, and other intellectual gains (13%)
enhanced understanding of professional work contexts and preparation for advance study
and entry to the workforce (9%)
increased understanding of professional norms and practice and demonstration and
development of character traits necessary to professional practice (8%)
Small numbers of participant observations also mentioned gains in: skills (2%), career
clarification and confirmation (1%) and enhanced educational experience (just two comments).
Overview of general observations
One third of participant’s comments (33%) were grouped as general observations. A majority of
interns’ observations comprising general observations described:


general SPS internship elements (18%)
program evaluations (10%)
Small numbers of participants also mentioned: specific ways in which mentors supported their
work as interns (1%); how gains were produced (1%); and miscellaneous comments (2%).
Discussion of Parent Category Contents
Observations of Program Outcomes
Interns’ observations of program outcomes show the multiple dimensions of students’ growth
and learning as a result of their SPS summer internship experience in Washington, DC.

Personal growth. (n=274, 19% res., 22% ed. out./pol.; 22% men, 19% women)
The highest number of all observations reported in interns’ journals described gains in personal
growth as an outcome of participating in an SPS summer internship (20%). Ninety-five percent
of interns wrote about the numerous opportunities to explore Washington, DC and to take in the
wealth of learning the city has to offer. A majority of interns (80%) also included accounts of
other personal time spent outside their internship, such as reading, shopping, and going out
places in DC. Comments related to interns’ personal growth also described the strong
collegiality that developed between SPS interns in their time away from work. Two–thirds of
interns mentioned going places and doing things together with other SPS interns in their time off.
These comments related the sense of community that was engendered by living closely together
as a group over summer. As well, nearly half of interns specifically noted their SPS summer
internship as a wonderful personal experience that helped them as young adults to discover
themselves. Several interns offered observations of their internship as providing novel
experiences and opportunities to learn about new things. Thus the largest set of benefits
discussed by interns in their journal entries encompassed personal gains, such as exploring
Washington, DC, other personal time spent outside their internship, including strong collegiality
and friendship among the interns as a community, and reflections on ways in which they had
grown personally as a result of their summer internship.
xi

Personal-professional gains. (n=197, 14% res., 15% ed. out./pol.; 15% men, 14% women)
Ranking second in number of intern observations on program outcomes, a smaller percentage of
all observations (14%) described personal-professional gains—personal gains associated with
their professional work experience. Participants’ comments in this category emphasized the
benefit of collegiality built upon close interaction with other interns in the work environment.
Gains in professional collegiality were reported by 60% of interns. These comments show the
positive relationships that developed between interns working together, helping one another, and
learning from one another and the sense of community professional collaboration engendered.
Sixty percent of interns also mentioned opportunities for closer interactions with their
supervisors. Nearly half mentioned ways in which supervisors mentored them and supported
their learning during their internship, sharing knowledge and experience, modeling professional
practice, and offering good guidance. Participating in and the development of a broader group
collegiality were also noted in 55% of interns’ journals. In these entries, interns related larger
group activities both as part of their work, i.e., organized tours, science education outreach
events or attending events on Capitol Hill, as well as more relaxed social interactions with SPS
program staff. While a majority of interns (55%) noted how happy and excited they were to get
good results and were relieved and satisfied to find their work activities successful, only a
handful of interns’ (four) went further, expressing gains in confidence due to their learning and
sense of accomplishment. Interns’ personal-professional gains demonstrate positive affective
benefits associated with authentic professional work experience. These gains support
professional socialization and students’ identity development as young professionals.

Thinking and working like a professional. (n=171, 14% res., 10% ed. out./pol.; 10% men,
14% women)
Close in number of observations to the personal-professional gains category, 13% of intern
comments collected in “thinking and working like a professional” described intellectual benefits
derived from the SPS Summer Intern Program. Overall, interns noted several types of intellectual
gains. A majority of interns (80%) described applied learning gains in terms of their active
engagement in authentic work (i.e., “learning by doing”)—gains in understanding how the
profession works in hands-on practice. Some interns (eight) went further and mentioned their
results fitting theoretical models, demonstrating a higher-level intellectual gain from their
experience. Four interns discussed another high-level intellectual gain: participating in the design
of their research or participating in lesson planning and development for science education
outreach activities. Sixty-five percent of interns also described gains in new knowledge, as well
as increased understanding of connections within and between the sciences. These gains
highlight interns’ intellectual growth. By providing the opportunity to integrate academic
knowledge with field applications, interns increased their understanding of how work is actually
done, in applied practice. In addition, a majority of interns (60%) cited both increases in
knowledge and increased understanding of connections between and within the sciences as other
intellectual outcomes of their SPS summer intern experience.
xii

Enhanced understanding of professional work contexts and preparation for advance
study and entry to the workforce. (n=122, 7% res., 12% ed. out./pol.; 9% men, 9% women)
To meet the objective of developing collegiality among physics students and professionals in
physics and allied sciences, the SPS Summer Intern Program has specifically structured the
program to provide opportunities for interns to interact with professionals in varied fields and
work contexts. Nine percent of intern observations recounted ways in which participation in the
SPS Intern Program enhanced their understanding of professional work contexts and their
preparation for advance study and entry to the workforce. Attending congressional hearings and
sessions with law- and policy makers as well as intern-organized tours of their work sites
enhanced understanding of professional life and practice. As part of relating the activities of their
internship, 65% of interns discussed opportunities to meet with, talk with, and learn from
politicians, science researchers, and science education outreach and policy practitioners in
authentic professional contexts. These observations demonstrate the ways in which the half-day
field trips to attend various congressional hearings and tours of government research labs
broadened interns’ exposure to physics and allied science environments (reported by 55% of
interns). Talking with their supervisors and other professionals, learning about what
professionals do in their work, gaining a closer view of professionals balancing work life and
personal life, and making connections with important people in the field were program outcomes
recorded in SPS intern journal entries concerning ways in which participation had broadened and
extended their understanding of and preparation for future professional opportunities, advance
study and entry to the workforce.

Becoming a professional. (n=103, 9% res., 5% ed. out./pol.; 8% men, 8% women)
Intern comments collected in the “becoming a professional” category conveyed (in almost equal
measures) increased understanding of the nature of professional work and the demonstration and
development of attitudes and behaviors viewed as character traits necessary for professional
work in the field. Authentic, applied experiences showed interns the realities of working in
science research and the difficulties of conducting science education outreach activities in
practice: 65% of interns noted that the work can be slow, that there are difficulties and mistakes,
that carrying out science activities with and teaching school-aged children is easier said than
done. Comments related to understanding the nature of the work were balanced by a set of intern
observations denoting demonstration and development of attributes important to professional
practice. Half of interns expressed strong enthusiasm for and excitement at the prospect of their
internship and the opportunity to work with respected professionals. Smaller numbers of interns
also described the development of a range of attitudes necessary for professional practice, such
as gains in tolerance, patience and perseverance, increased willingness to think creatively and to
work through problems independently, or being extra diligent, taking greater care, or putting in
extra effort. As with the above categories, these types of gains are evidence that interns’ are
developing as young professionals and that program participation encourages their professional
socialization. These outcomes are viewed as important to students “becoming professionals” and
to ensuring the future professional workforce.
Small numbers of participant observations also mentioned gains in: skills (2%), career
clarification and confirmation (1%) and enhanced educational experience (just two comments).
xiii
In summary, nearly 70% of interns’ observations described program outcomes encompassing a
broad range and variety of personal, intellectual and professional benefits. Interns’ observations
of program outcomes related gains in: personal growth, personal-professional gains directly
related to their engagement at their internship; increased understanding of how science research
and science education outreach/policy work is actually done, and other intellectual gains;
enhanced understanding of professional work contexts and preparation for advance study and
entry to the workforce; and increased understanding of the nature of professional work, norms
and practice and the development and demonstration of character traits deemed important to
working professionally in the field. Small numbers of interns also reported gains in skills, career
clarification and confirmation or enhanced educational experience. Collectively, interns report
program outcomes demonstrating multiple dimensions of students’ learning from SPS Summer
Intern Program participation.
General Observations
Following a majority of observations reporting program outcomes, a remaining 33% of intern
observations were grouped as general observations. The majority of comments in this category
described general elements comprising internship experiences, followed by intern program
evaluations.

SPS general internship elements. (n=250, 18% res., 18% ed. out./pol.; 20% men, 17%
women)
Comments comprising the category of “general internship elements” were 18% of all intern
observations. These observations highlight the structural elements of the SPS Summer Intern
Program and inform understanding of the role of structural elements in supporting interns’
success and in achieving program objectives. From their accounts, it is clear that interns were
participating in authentic work in which they had the opportunity to integrate academic
knowledge with field applications (95% of interns offered clear descriptions of their active
engagement in their projects and 75% of interns provided clear accounts demonstrating
conceptual and practical understanding of their work objectives and assigned responsibilities).
All interns reported group SPS field trips and opportunities to see a variety of physics and allied
science work environments. Nearly half mentioned attending congressional hearings.
Descriptions of engaging in authentic work, group SPS field trips and structured opportunities
for interns to see a variety of work contexts, interns’ clear understanding of project objectives
and work responsibilities, and other structured activities (i.e., the SPS orientation session, safety
trainings, or other informational meetings) show that the SPS program structure is successful in
supporting interns’ learning and in meeting stated program objectives.

Positive, “mixed,” and negative program/internship evaluations. (n=141, 9% res., 12%
ed. out./pol.; 9% men, 9% women)
The majority (nearly 90%) of intern program evaluations were highly positive: 90% of interns
described how much they were enjoying their internship; 75% of interns described what a great
summer they were having and how “time was flying by.” Interns’ positive evaluations reflect
and corroborate program outcomes reported from their SPS intern experience.
xiv
Small numbers of participants also mentioned: specific ways in which mentors supported their
work as interns (1%); how gains were produced (1%); and miscellaneous comments (2%).
In summary, just over a third of all intern observations were grouped as general observations.
The majority described structural program elements supporting intern learning and highly
positive program evaluations. Very small numbers of comments and actual numbers of interns
reported: supervisors’ structural internship elements, intern views on how their learning was
enabled, and other miscellaneous observations.
Analyses of Internship Type and Gender
Overall, percentages of observations by type of internship and by gender are well balanced. This
is also true for actual numbers of interns citing a particular observation. Observations made by
participants in science research vs. science education outreach/policy internships and by men and
women were similar in nature and in number. Indeed, there is remarkable alignment in the
balance of observations recorded by science research vs. science education outreach/policy
interns and between men’s and women’s observations in every category across the data set.
From analyses of the data set, it is evident that the many benefits which interns described as
outcomes of program participation were reported equally by science research interns as by
science education outreach/policy interns and by men as by women.
Conclusions
Findings from the qualitative analysis of a sample of intern journal entries exploring the efficacy
of this type of program assessment as a tool for program evaluation document strong impacts on
participants’ personal, professional and intellectual development and provide empirical evidence
that the SPS program structure is well aligned with and supports the achievement of its program
objectives. Overwhelmingly positive program evaluations are testament to interns’ excellent
experiences with the SPS Summer Intern Program.
Observations recorded in intern journals support the conclusion that program objectives aimed at
encouraging and assisting students interested in physics to develop knowledge, competence
enthusiasm and social responsibility, interest in advance study and research in physics, and
collegiality among physics students and professionals in physics and allied sciences, are being
met. Evidence of many of the learning gains associated with program participation, i.e., personal
growth, personal-professional development, gains in intellectual understanding of how a
profession operates in practice, exposure to varied work contexts and possibilities (and gaining
connections to them) as well as demonstrated attitudes and behaviors necessary to students’
continuing on in the profession, are benefits that coincide with research documenting the
beneficial outcomes of similar intensive, mentored learning experiences.
The largest set of benefits discussed by interns in their journal entries reflected personal gains
they took away from their experience. In a recent report presenting outcomes from a Carleton
College off-campus field research program in marine biology, personal growth also ranked first
among outcomes (Hunter, 2006). Personal gains are important because they speak to the goals of
educating students as well-rounded human beings and of helping students to develop as young
adults capable of participating in and negotiating a complex world. Indeed, providing a holistic
education that meets the needs of the “whole” student is a longstanding tenet of education that is
xv
still viewed as a central purpose of colleges and universities today (Dewey, 1933, 1938; Shor,
1987; Giroux, 1988; Freire, 1990; Boyer Report, 1998; Baxter Magolda, 1999, 2001, 2004).
From SPS interns’ journal entries, it is clear that living in and exploring Washington, DC, as well
as living closely among a group of peers, strongly contributed to their personal growth.
Gains categories comprised of observations related to participants’ personal growth, personalprofessional gains, “thinking and working like a professional,” “enhanced preparation”
“becoming a professional,”—and, in much smaller numbers, skills and career clarification—
match those described by Seymour, et al. (2004) and Hunter, Laursen & Seymour (2006) in their
study to establish the benefits to students of undergraduate research (UR) experiences, as well as
other recent research studies of UR (Ward, Bennett and Bauer, 2002; Zydney, et al., 2002; Bauer
and Bennett, 2003; Lopatto, 2004; Russell, 2005). Gains cited across these categories all
document the depth of participants’ engagement in their learning, and, again, reflect participants’
holistic learning. Importantly, these learning gains demonstrate program benefits that are
consistent with national science education policy objectives and are promoted by relevant
national funding organizations and institutions of higher education (Boyer Commission, 2002;
NSF, 2000, 2003a; NRC, 1999, 2000, 2003a, 2003b).
Collectively, intern observations on personal growth, personal-professional gains, increased
understanding of how work is actually done, increases in knowledge, enhanced understanding of
and preparation for advance study and workforce entry, increased understanding of the
difficulties encountered in professional work and the demonstration and development of
character traits and attitudes necessary to professional practice document powerful program
outcomes. Highly positive program evaluations of interns’ intensive, experiential learning
opportunities in which they had the opportunity to integrate academic knowledge with field
applications complement interns’ gains observations. Findings from the qualitative analysis of a
sample of SPS intern journals demonstrate a breadth of important personal, intellectual and
professional outcomes resulting from program participation in the SPS Summer Intern Program.
Qualitative analysis of interns’ journals shows their efficacy as a tool for program assessment.
However, as previously stated, open-ended guidelines for interns’ journal entries likely means
that at least some gains are under-reported. Although intern journals are clearly useful as a
program assessment tool, there is a weakness in that they do not collect the same information
from every participant consistently, e.g., as a survey would. Too, analyzing this qualitative data
for the purposes of program evaluation is costly and time intensive.
A strong benefit of having conducted this qualitative analysis is that SPS now has a framework
upon which a grounded survey instrument that can query all participants about all gains, or other
issues, may be built. Indeed, qualitative research typically precedes survey development. Thus,
having identified the range and type of benefits interns report from program participation, SPS is
now in a good position to move forward in developing an instrument that will provide greater
consistency and accuracy of data to aid in evaluating program outcomes. Development of such
an instrument, might, in fact, serve as the basis of a future SPS summer intern opportunity.
xvi
REPORT ON THE QUALITATIVE ANALYSIS OF A
SAMPLE OF SOCIETY OF PHYSICS STUDENTS INTERN JOURNALS
Anne-Barrie Hunter
Ethnography & Evaluation Research
Center to Advance Research and Teaching in the Social Sciences
University of Colorado, Boulder
abhunter@colorado.edu
May, 2007
Introduction
This report presents findings of a qualitative analysis of a sample of the Society of Physics
Students (SPS) intern journals aimed at exploring their efficacy in providing relevant data for the
evaluation of the SPS Summer Intern Program.
SPS Summer Intern Program
SPS summer internships are designed to create broad-based learning opportunities for
undergraduate physics majors in the areas of scientific research and science education
outreach/policy work.
Interns are selected based upon scholastic record, potential for future success, evidence of
participation in SPS events and activities, and evidence of experience in either science research
or in science education outreach/policy work. SPS carefully screens all applicants to assure a
good match between an organization’s specific needs and the student’s interests.
Successful applicants are placed in organizations and agencies in the Washington, DC area, such
as the National Institute of Standards and Technology (NIST) and the National Aeronautics
Space Administration (NASA) for research-based internships, or placed within professional
associations such as the American Association of Physics Teachers (AAPT) and the American
Astronomical Society (AAS) for science education outreach/policy internships. These
organizations and associations utilize the energy and diversity of physics undergraduates to
enhance their programs in the advancement of physics and allied sciences, and seek to contribute
to students’ professional development through meaningful, hands-on engagement in projects
relevant to their programs. Participating agencies assign one or more mentors from senior staff to
guide interns’ work and overall experience.
As part of the SPS Summer Intern Program, students participate in an orientation session and
intermittent half-day field trips to broaden their exposure to physics and allied science
environments. Sometime during the internship, each student also gives a 20-minute professional
presentation on his or her work, accomplishments, and overall internship experience, to the staff
scientists of the American Institute of Physics and invited guests.
Interns receive a $3200 stipend, paid housing at George Washington University, and paid
transportation to and from Washington, DC, for eight and a half weeks of work over the summer.
During the academic year following their internship, students give a presentation on their
internship experience at an SPS zone meeting or other regional science meeting. Students with
exceptional presentations may be asked to speak about their internship at the American
Association of Physics Teachers (AAPT) summer meeting, or other member society meeting.
Since the beginning of its summer intern program in 2001, SPS has provided internships to 37
undergraduates.
SPS Summer Intern Program Support
Organizations and professional associations who partner with SPS to mentor a summer intern
make a financial contribution to offset program expenses.
SPS also derives support for this program from the American Institute of Physics (AIP).
The awards and scholarship programs of SPS are made possible, in part, through generous
contributions of Sigma Pi Sigma members and friends. Scholarships and awards are supported by
income derived from designated funds that have been provided as gifts. In this way, the physics
alumni, and especially the Sigma Pi Sigma members, contribute to the generations of students
who follow them.
Goals of the SPS Summer Intern Program
The goals of the SPS Summer Intern Program align with SPS’ mission to (among others):
encourage and assist students interested in physics to develop the knowledge, competence,
enthusiasm, and social responsibility that are essential to the advancement of physics; stimulate
interest in advance study and research in physics; and develop collegiality among physics
students and professionals in physics and allied sciences (see
http://www.spsnational.org/governance/constitution/).
Benefits identified by SPS of participating in the SPS Summer Intern Program include (see
http://www.spsnational.org/programs/internships/benefits.htm):
To the student • Receive a unique learning experience, and a close-up look at the Washington, DC,
physics and allied sciences community; create access to networking opportunities and
professional connections;
• Integrate academic knowledge with field applications, improve competitiveness and
improve marketability upon graduation;
• Enhance technical and interpersonal skills through meaningful and challenging
professional assignments.
To the Institution/Agency • Enrich and diversify organization’s programs and scientific endeavors through the efforts
of eager, bright SPS undergraduate students;
• Secure direct contact with SPS students to facilitate/improve the understanding of this
population;
• Provide future employee recruitment opportunities;
• Impact the development of tomorrow’s leaders in physics.
2
To SPS • Augment the professional element to SPS membership.
• Forge effective partnerships between SPS and other institutions and agencies.
• Develop highly skilled SPS graduates who may choose careers in science and/or
managerial careers.
Purpose of Qualitative Analysis of Intern Journals
Gary White, Director, Society of Physics Students (SPS), Sigma Pi Sigma Director and Assistant
Director of Education, American Institute of Physics, requested the services of Ethnography &
Evaluation Research to qualitatively analyze a sample of student intern journals in order to
determine the usefulness of this type of program assessment in evaluating the SPS Summer
Intern Program.
SPS seeks both summative and formative information on their summer intern program from a
qualitative content analysis of interns’ journals: summative findings address the intellectual,
personal, professional and other types of gains that students take away from their intern
experience; formative results concerning strengths and weaknesses of the program allow the
program director to make informed policy decisions for the future direction of the SPS Summer
Intern Program based upon empirical evidence. Understanding qualitative differences discovered
by comparing and contrasting the types of gain students report from their experience either in the
science research or science education outreach/policy internship will also aid the program
director to assess the quality of both types of internship offered and direct recruitment of faculty
and industry partnerships in alignment with program objectives. Identification of any issues
related to gender is also an aim of this analysis.
Method
A qualitative analysis of a sample of SPS intern journals was conducted to identify activities,
attitudes, and gains that interns recorded in their journal entries while working in an SPS
internship. Particular emphasis was placed on exploring evaluation questions important to SPS:
What evidence recorded in interns’ journal demonstrates:






students’ intellectual, personal and professional gains from the internship experience?
opportunities to integrate academic knowledge with field applications?
gains in skills and knowledge that add value to their academic study?
enhanced preparation in knowledge and skills for advance academic study or entry to the
workforce?
clarification and/or confirmation of participants’ intended career paths?
knowledge of the physics and allied science community and increased opportunities for
professional networking and career development?
From the results of the analysis, what can be learned regarding:



formative information that highlights program strengths or that indicates areas in need of
improvement?
comparison and contrasts of the different types of gains students make from the two types of
summer experiences offered by SPS internships?
issues of gender?
3
To start, an intern’s weekly journal entries were compiled chronologically (from first to last) as
an individual document file. The resulting 20 document files varied in length depending upon
how much an intern had written, week to week or cumulatively. These files were then imported
into NVivo 7.0, a computer software program used for qualitative data analysis. In conducting a
content analysis, the analyst reads through all of the documents—the text data—searching for
information relevant to the evaluation questions. Text segments referencing distinct ideas are
tagged by code names. Codes are not preconceived, but empirical: each new code marks a
discrete idea not previously raised. All of the code names that are developed are collected in a
codebook. When the analyst reads a text passage that relates an idea previously encountered, the
same code name is used again to mark the relevant passage. Thus codes and their associated text
passages are linked, amassing a data set of code names and their frequency of use across the data
set. Once all of the text data is coded in this manner, codes similar in nature are grouped
together to define themes; the clustered frequencies, represented as grouped themes or
categories, describe both the range and relative weighting of issues in participants’ collective
report.
In addition to an analysis of the number and type of observations that participants recorded in
their weekly journals, an analysis looking at the actual number of participants reporting a
particular observation by type of internship and by gender has also been conducted. This analysis
allows for a very accurate assessment of students’ gains and views concerning participation in
the SPS Summer Intern Program, overall.
Sample Selection
A sample of 20 intern journals was selected from a set of 37. Intern journals were randomly
chosen within specific parameters to sample participant characteristics (race/ethnicity,
Americans with Disabilities Act status, type of home institution [i.e., 2-year colleges, R1
institutions, public and private colleges and universities], as well as a balance between the two
types of internship offered [science research or science education outreach/policy work], and
between men and women) so as to provide a view of the broadest range of SPS internship
participation possible. The intern journal sample is shown in Figure 1.
Figure 1. Intern journal sample by gender and type of internship.
Gender
Research Internship
Science education outreach/policy internship
Men
Brent Janus (2002)
Justin Stimatze (2003)
Joseph York (2004)
Bridger Anderson (2005)
Alex Brown (2006)
Mark Lentz (2001)
Jason Tabeling (2003)
Matthew Shanks (2004)
Kibrom Tewolde (2004)
Matt Hall (2005)
Women
Eva Wilcox (2002)
Kathryn Peak (2002)
Christine Zaruba (2004)
Lindsay Windsor (2005)
Kacey Meaker (2006)
Melissa Hanafee (2003)
Stacey Elizabeth Sude (2003)
Heather Lunn (2004)
Rebecca Keith (2005)
Ann Deml (2006)
4
Internship Placement
 Four men and three women were placed at NIST (National Institute of Standards and
Technology), Washington, DC, for their internship;
 One man and two women worked at NASA (National Aeronautics Space Administration)
Goddard Space Flight Center for the summer;
 One man and three women had their internship working with ComPADRE (part of the
National Science Digital Library) organization;
 One man and two women spent their summer internship at NSF MRSEC (Materials
Research Science and Engineering Centers);
 Two men did their internship at the SPS National Office;
 One man interned at AAPT (American Association of Physics Teachers).
Participants’ intern placement is shown in Figure 2.
Figure 2. SPS internship placement by organization/association and by gender.
Organization/Association
Men
Women
Research Internship:
NIST, Washington, DC
Justin Stimatze (2003)
Joseph York (2004)
Bridger Anderson (2005)
Alex Brown (2006)
Eva Wilcox (2002)
Lindsay Windsor (2005)
Kacey Meaker (2006)
NASA Goddard Space Flight Center
Brent Janus (2002)
Kathryn Peek (2002)
Christine Zaruba (2004)
ComPADRE
Kibrom Tewolde (2004)
Melissa Hanafee (2003)
Rebecca Keith (2005)
Ann Deml (2006)
NSF MRSEC
Matthew Shanks (2004)
Stacey Elizabeth Sude (2003)
Heather Lunn (2004)
SPS National Office
Mark Lentz (2001)
Jason Tabeling (2003)
AAPT
Matt Hall (2005)
Science education outreach/policy
internship:
Year of Internship Placement
Figure 3, below, shows the number of men and women in an SPS internship by their year of
participation:
5






one man in 2001 (first year of SPS internship program);
one man and two women in 2002;
two men and two women in 2003;
three men and two women in 2004;
two men and two women in 2005; and
one man and two women in 2006.
Figure 3. Internship placement by year and gender.
Year
2001
2002
2003
2004
2005
2006
TOTALS
Men
Women
1
1
2
3
2
1
2
2
2
2
2
10
10
The Data Set
SPS interns are required to submit a weekly journal as a way of documenting their internship
experience. However, reporting expectations are largely undefined and leave interns to decide for
themselves what to include, or indeed, how much to write. Initially, interns were simply directed
to “submit a weekly journal entry highlighting your work and/or a particular experience
associated with the internship.” Currently, while students are encouraged to enjoy their summer,
they are reminded that this is also a summer of work and to include details of their internship
activities along with other facets of their summer in Washington, DC. Interns are also reminded
that their journal entries will be made public:
Ahhh... the dog days of summer. Sun, sand and surf. Hotdogs, hamburgers, and apple pie.
But wait...you're an SPS Intern, so your summer also includes a variety of science, policy
and outreach-related activities.
Share a synopsis of your weekly activities and special events with your fellow SPS
members, potential interns, friends, family and sponsors in the space provided below.
We'll post your responses on the SPS website, and will develop several into feature
articles for the SPS Observer and Radiations, the official publication of Sigma Pi Sigma.
So get those fingers flying, and press submit!!
(http://www.spsnational.org/programs/internships/journals.htm)
All appropriate documents created by the student are published on the national Society of
Physics Students web site (http://www.spsnational.org/).
Since no word limit was imposed and parameters concerning what interns should write about
were somewhat loose—requesting only that they convey “a variety of science, policy and
6
outreach-related activities” and other weekly or special events—journal entries reflect a freeform
data set. Thus while we may expect commonalities among interns’ journals concerning weekly
activities and structured events, what they record in regards to learning gains is notable, as these
observations are offered spontaneously, without prompting.
Findings
Grouping of Observations and Major Parent Categories and Overview of Findings
Observations were sorted according to textual content into 14 distinct categories. These parent
categories divided into two groups: observations on program outcomes and general observations.
Broadly, analysis of interns’ journals identified: types of gains derived from participation in the
SPS Summer Intern Program; descriptions of general SPS internship elements; and program
evaluations.
Throughout this report, results are presented by type of internship and by gender to help the
discovery of any relevant differences that may be reflected in the number or type of observations
that interns provided in their written journal entries. Table 1 provides an overview of all interns’
observations by group, parent category, and type of internship; Table 2 provides the same
overview according to gender. In discussing detailed breakouts of the major parent categories,
tables showing the actual number of participants reporting a particular observation are also
presented according to type of internship and by gender. Quotations were selected to be
representative of the sample by type of internship, gender, and year of participation. Quotations
illustrating category content are used largely in full to provide context and show the
interrelatedness of program outcomes, as described by the interns themselves. As interns’
journals are a matter of public record, quotations are attributed.
Overview of observations of program outcomes
Nearly 70% of participants’ observations (67%, see Tables 1 and 2) described benefits from
participating in the SPS Summer Intern Program. They discussed gains in:





personal growth (20%)
personal-professional gains (14%)
increased understanding of how science research and science education outreach/policy
work is actually done, and other intellectual gains (13%)
enhanced understanding of professional work contexts and preparation for advance study
and entry to the workforce (9%)
increased understanding of professional norms and practice and demonstration and
development of character traits necessary to professional practice (8%)
Small numbers of participant observations also mentioned gains in: skills (2%), career
clarification and confirmation (1%) and enhanced educational experience (just two comments).
Overview of general observations
One third of participants’ comments (33%, see Tables 1 and 2) were grouped as general
observations. A majority of interns’ observations comprising general observations described:
7


general SPS internship elements (18%)
program evaluations (10%)
A small number of comments also mentioned: specific ways in which mentors supported their
work as interns (1%); how gains were produced (1%); and miscellaneous comments (2%).
Table 1. Number and percent of all observations by group, category and type of internship.
N of Obs.
% of Obs.
Parent Category
N of
% of
Sci. ed.
Sci. ed.
TOTAL
Obs.
Obs.
outreach/
outreach/
ALL
Res.
Res.
policy
policy
OBS.
OBSERVATIONS OF
PROGRAM OUTCOMES
Gains from program participation:
Personal growth
140
19%
134
22%
274
Personal-professional gains
102
14%
95
15%
197
"Thinking and working like a
106
14%
65
10%
171
professional"
%
ALL
OBS.
20%
14%
13%
49
7%
73
12%
122
9%
69
18
13
9%
2%
2%
34
7
1
5%
1%
0%
103
25
14
8%
2%
1%
1
0%
1
0%
2
0%
Subtotal: Program outcomes
GENERAL OBSERVATIONS
SPS general internship elements
Program/internship evaluations
Structural elements of supervising
How gains were produced
Miscellaneous
498
67%
410
66%
908
67%
135
66
12
8
19
18%
9%
2%
1%
3%
115
75
5
7
11
18%
12%
1%
1%
2%
250
141
17
15
30
18%
10%
1%
1%
2%
Subtotal: General observations
TOTALS
241
739
33%
100%
212
622
34%
100%
453
1361
33%
100%
Enhanced understanding of
professional work and
preparation for advanced
study and entry to the
workforce
Becoming a professional
Skills
Career clarification and
confirmation
Enhanced educational
experience
8
Table 2. Number and percent of all observations by group, category and gender.
N of
% of
N of
% of
TOTAL
Parent Category
Obs.
Obs.
Obs.
Obs.
ALL
Men
Men
Women
Women
OBS.
OBSERVATIONS OF PROGRAM
OUTCOMES
Gains from program participation:
Personal growth
131
22%
143
19%
274
Personal-professional gains
90
15%
107
14%
197
"Thinking and working like a
62
10%
109
14%
171
professional"
Enhanced understanding of
%
ALL
OBS.
20%
14%
13%
53
9%
69
9%
122
9%
45
9
2
8%
2%
0%
58
16
12
8%
2%
2%
103
25
14
8%
2%
1%
1
0%
1
0%
2
0%
393
66%
515
68%
908
67%
122
55
7
2
16
207
600
20%
9%
1%
0%
3%
35%
100%
128
70
10
13
14
246
761
17%
9%
1%
2%
2%
32%
100%
250
141
17
15
30
453
1361
18%
10%
1%
1%
2%
33%
100
%
professional work contexts
and preparation for
advanced study and entry to
the workforce
Becoming a professional
Skills
Career clarification and
confirmation
Enhanced educational experience
Subtotal: Program outcomes
GENERAL OBSERVATIONS
SPS general internship elements
Program/internship evaluations
Structural elements of supervising
How gains were produced
Miscellaneous
Subtotal: General observations
TOTALS
Discussion of Parent Category Contents
Observations of Program Outcomes
Interns’ observations of gains derived from participation in the SPS Summer Intern Program
encompassed: personal growth; personal-professional gains; increased understanding of how
science research and science education outreach/policy work is actually done, and other
intellectual gains; enhanced understanding of professional work contexts and preparation for
advance study and entry to the workforce; and increased understanding of professional norms
and practice, as well as the demonstration and development of character traits necessary to
professional practice. Small numbers of observations also registered gains in skills, career
clarification and confirmation, and enhanced educational experience. These benefits reflect the
9
multiple dimensions of students’ growth and learning as a result of their SPS summer internship
experience in Washington, DC.

Personal growth. (n=274, 19% res., 22% ed. out./pol.; 22% men, 19% women)
The highest number of all observations reported in interns’ journals described gains in personal
growth as an outcome of participating in the SPS Summer Internship Program (20%, see Tables
1 and 2). Observations grouped in this category detail interns’ sightseeing excursions, other
personal time spent outside their internship, including strong collegiality and friendship among
the interns as a community, and reflections on ways in which they had grown personally over the
summer.
In line with directions from SPS that journal entries should relate events and activities of interest
to their family and peers, over half of interns’ comments within this category discussed
sightseeing and leisure time activities outside of their intern work (31% and 25% respectively,
see Tables 3 and 4). Ninety-five percent of the interns (n=19: 10 res., 9 ed. out./pol.; 10 men, 9
women) highlighted the benefit of living for a period of time in the nation’s capitol, in which
they had ample opportunity to explore the wealth of museums, science exhibits, music, theater,
street life and other attractions; 80% (n=16: 9 res., 7 ed. out./pol.; 9 men, 7 women) mentioned
things they had done during personal time away from their internship (see Table 5):
For fun we hit up the Shakespeare Theater and a Classical music concert. Lady
Windermere’s Fan was the play. It was pretty good. I will have to remember some of
those quotes. "Experience is what fools call their mistakes". "I can resist everything
except temptation". (Bridger Anderson, Research Internship, 2005)
This weekend was great too! Friday, my roommate and I went to the Washington
Haunted Walk with Anthony and learned a bunch about the haunted Lafayette Park and
White House. We learned that Dolly Madison lived in the yellow house on the corner and
about parallels to the assassinations of Lincoln and Kennedy. (Heather Lunn, Education
outreach/policy internship, 2004)
Last weekend, Heather and I went to see Monticello and ride pedal boats in the tidal
basin. We had a really REALLY great time - it's probably been one of my very favorite
days here. …While we were paddling around, we ran into a bunch of ducks…. They
followed us around nearly half the basin… Once our two hours were up, we went back to
dock the U.S.S. Duck (that is what we named our boat) and got a picture to remember the
day by.… Then we went to take pictures of Monticello (the Jefferson Memorial). It was
really cool. I think we both took a gazillion pictures. We walked around some more and
then headed to Pentagon City to get a few groceries. We stopped at Aunti Ann's and got a
pretzel dog and a dutch ice -MAN ALIVE that's good eatin! I highly recommend it - it's
just in the food court right there in the mall. On Sunday, we went and did a bunch of
shopping. We had both been pinching pennies lately, so we had to purge ourselves of all
of all the moderation. And purge we did! :) (Christine Zaruba, Research internship, 2004)
10
Table 3. PROGRAM OUTCOMES: Observations of personal growth, by type of internship.
N of
% of
Obs.
Obs.
N of
% of
Sci. ed. Sci. ed.
Obs.
Obs.
Out./
Out./
Type of Observation
TOTAL
Res.
Res.
policy
policy
OBS.
%
OBS.
Opportunities for sightseeing
Personal time away from research/science
education/policy outreach work
Peer collegiality, fooling around, socializing
in evening, helping each other
Parents, family, friends come to visit; Some
going to visit
Learning interesting things not related to
internship
39
34
28%
24%
47
34
35%
25%
86
68
31%
25%
41
29%
26
19%
67
24%
6
4%
14
10%
20
7%
6
4%
7
5%
13
5%
Novel personal experiences Really wonderful
8
6%
3
2%
11
4%
Internship has been a wonderful personal
growth experience
TOTALS
6
4%
3
2%
9
3%
140
100%
134
100%
274
100%
Table 4. PROGRAM OUTCOMES: Observations of personal growth, by gender.
N of
% of
N of
% of
Obs.
Obs.
Obs.
Obs.
Type of Observation
TOTAL
Men.
Men.
Women Women
OBS.
%
OBS.
Opportunities for sightseeing
45
34%
41
29%
86
31%
Personal time away from research/science
education/policy outreach work
Peer collegiality, fooling around, socializing
in evening, helping each other
Parents, family, friends come to visit; Some
going to visit
Learning interesting things not related to
internship
33
25%
35
24%
68
25%
24
18%
43
30%
67
24%
14
11%
6
4%
20
7%
6
5%
7
5%
13
5%
Novel personal experiences Really wonderful
5
4%
6
4%
11
4%
Internship has been a wonderful personal
growth experience
TOTALS
4
3%
5
3%
9
3%
131
100%
143
100%
274
100%
11
Table 5. PROGRAM OUTCOMES: Number of interns citing personal growth by type of internship and gender.
N of
Research
Interns
N of
Sci ed
outreach/
policy
Interns
% of
Research
Interns
% of
Sci ed
outreach/
policy
Interns
N of
Men
N of
Women
% of
Men
% of
Women
TOTAL
INTERNS
%
INTERNS
Opportunities for sightseeing
10
9
50%
45%
10
9
50%
45%
19
95%
Personal time away from research
policy outreach work
9
7
45%
35%
9
7
45%
35%
16
80%
7
6
35%
30%
7
6
35%
30%
13
65%
Internship has been a wonderful
personal growth experience
6
3
30%
15%
4
5
20%
25%
9
45%
Parents, family, friends come to
visit; Some going to visit
3
5
15%
25%
4
4
20%
20%
8
40%
Learning interesting things not
related to internship
3
4
15%
20%
3
4
15%
20%
7
35%
Novel personal experiences really
wonderful
4
3
20%
15%
2
5
10%
25%
7
35%
Type of Observation
Peer collegiality, fooling around,
socializing in evening,
helping each other
12
Saturday morning, Ann made pancakes for all of us, and we headed off for a day at the
National Zoo. We saw the pandas, snakes, turtles, fish, elephants, birds, and some
Canadians (no, really. There was a display of Canadian culture, displayed by authentic
Canadians). There was a particular bird that was about the size of a buzzard, but made the
sound of a shrieking child. Although deafening, it was pretty impressive. (Alex Brown,
Research Internship, NIST, 2006)
I have been hearing about the Smithsonian Institute from the time that I was in grade
school.… The first building on my "to see" list was the National Museum of Natural
History. This was the building that housed something that I had longed to see: dinosaurs!
LOOK! There's bunches of them! The fossils of these ancient giants intrigued me. In this
area of the building was also the Ice Age fossils which were, to my surprise, as or more
impressive than the ancient reptiles. The towering giant land sloth looked like something
from a Sci-Fi movie and the American mastodon looked like an ancient tank. It was
amazing to think that these mammals roamed the earth that I now stand on less than
15,000 years ago is just humbling. I saw fossil after fossil of reptiles and mammals that
looked as if they were from another world, yet they were merely from another time. The
past, present and future of creation and evolution makes my simple mind dizzy. …The
Smithsonian Institute definitely has the most impressive collection of rarities of which I
have ever heard and certainly the most impressive that I have ever seen. That's one
museum down, and only 14 more to go! I look forward to each and every one! (Mark
Lentz, Education outreach/policy, 2001)
Nearly one quarter of interns’ comments (24%) referenced time spent with their SPS peers and
SPS directors and were recorded in 65% of interns’ journals (n=13: 7 res., 6 ed. out./pol.; 7 men,
6 women). Descriptions of time spent together outside of their intern work responsibilities
included accounts of going out at night, eating meals together, and relaxing with one another.
This set of observations demonstrates the strong collegiality that developed between interns
during personal time away from their internship:
All of the interns are fun and easy to hang out with. We’ve already had some good times
on the metro carrying our groceries back, and our daily trips to Pentagon City for things
we forgot to pack or simply need are priceless. I think this is going to be a very fun
summer. (Joseph York, Research internship, 2004)
Monday night Andy played his guitar as he often does, but Katherine also sang for us. It
is fun to see them so excited about their music. Also this week, Jackie bought a bag of
toys for us to share. We have been playing with them every night since then, outside and
in the hallway. …After work, Katherine also cut Pat's hair. It is very cute and natural for
her at shoulder length now. …Katherine and her fiancé, Tyler, cooked a Cajun meal that
we all got to try. It was hot but very delicious, and they told us all about crawfish farms
as a result. (Ann Deml, Education outreach/policy internship, 2006)
Brent, Katie, Lauren, and myself got together Monday to watch "Strangers on a Train" by
Alfred Hitchcock on the lawn of the National Mall. This was part of the Screen on the
Green series which shows several movies outdoors during the summer. Of course, let's
13
not leave out the fact that admission is free! Once again, D.C. comes through with
awesome entertainment value! (Jason Tabeling, Education outreach/policy internship,
2003)
With more swing dancing, Sunday night dinner together with all the interns, a little stroll
around DuPont Circle, and the discovery of a real grocery store open 24 hours, I'm
enjoying the city, the culture, and the company =) (Lindsay Windsor, Research
internship, 2005)
Though only a small number of observations (3%), almost half of the interns (45%) (n=13: 6
res., 3 ed. out./pol.; 5 men, 4 women) stated that the SPS Summer Intern Program had been a
tremendous personal growth experience. These comments reflect students’ positive personal
development over the summer: their increased sense of self, confidence, and growing
independence. These comments also demonstrate the cumulative impact of accreted program
gains. Not surprisingly, many of these observations were offered in interns’ final journal entries:
My lessons from this summer are so many and so varied it's hard to break them down….
I realized that my worst fears can sometimes be part of the greatest benefits. My biggest
fear coming here this summer was that I would be given something I had no experience
with and would be expected to be competent in it. I had no experience with organic
chemistry or semiconductor electronics before coming here, but needed to quickly gain a
basic understanding of all the jargon and ideas that form the basis of this work. Though it
was quite challenging, it wasn't too much, and I found I really enjoyed the intense
learning and studying. Wenyong said yesterday that it's when you're stretched the most
that you have the best time because you're learning the most. I agree. It's been a summer
of being stretched, but in a new way, and I'm so glad I came. Many thanks to all of you
who have made this possible!!! (Lindsay Windsor, Research internship, 2005)
My experience this summer truly was different than any of my previous summers away
from home (this was the eighth in a row). This time I was, to a much greater degree than
before, on my own in a completely new place. When people talk about their study abroad
experiences, I think of my time in DC because at first it was about as foreign to me. By
the end I was fairly comfortable and able to take advantage of many opportunities I
would not normally have that are available in this larger city. (Matt Hall, Education
outreach/policy internship, 2005)
It sure does seem weird, even for me now, to think about how I just picked up and left for
2 months, without knowing anyone or ever coming here before. I thought something like
that wasn't in me, but I honestly believe that it was something I needed to do for myself. I
am having a once in a lifetime experience here in DC and I would've been so mad at
myself if I wouldn't have taken this internship. Even though I had to go from my own
apartment to living in a dorm, it really isn't all that bad! I work in a really nice place, and
it is about to get really exciting again. I will be leading a summer camp at the U of MD
and teaching girls physics! I wish I would've had an opportunity like they do of joining
these programs. I am really getting excited and I hope everything goes well. I also
learned a few things about myself, but I am not! sure they are appropriate to talk about
14
here. I now know that I can leave home for two months without my world crashing down,
which is good to know. (Heather Lunn, Education outreach/policy internship, 2004)
In closing, I'd like to sincerely thank Gary White and Liz Caron for their help, advice,
and tireless efforts to keep us all sane throughout the internship process. Special thanks to
Dr. Vogel for always taking the time to help me understand and for being patient even
when I was behind schedule, to Dr. Seiler for making all the NIST interns in Division 812
feel like part of a family, and to Dr. Suehle for always letting me think out loud and for
his helpful advice on several matters of programming style. Thanks to the SPS interns for
proving that no matter how different our backgrounds, the goals and ideals of science can
bring us together as friends. I wish you all continued success. It was a pleasure to get to
know you all. A professional nod to Mr. Klenzing, who provided not only fascinating
conversations on topics ranging from advanced mathematics to Italian opera but was also
a fine colleague who I hope to have the opportunity to work with again some day.
Finally, heartfelt thanks to Erin, Sky, and Stuart for taking me into the fold and
expanding my horizons. This summer was an incredible experience and I sincerely hope
that SPS members reading this will consider this program for their next internship. (Justin
Stimatze, Research internship, 2003)
About one third of interns (n=7; 4 res., 3 ed. out./pol.; 2 men, 5 women) mentioned novel
experiences and learning about new things. Taken together, these were 12% of interns’
comments in this category:
Wednesday night I went to swing dancing lessons with Lindsay. I learned how you are
supposed to take your steps "step, step, rock-step". This much different than how I first
learned to take steps. I will go again with her next week. (Bridger Anderson, Research
internship, 2005)
Anthony knocked on my door and he and Allison invited me to go to the Capital Building
with them to see President Reagan [lying in state]. We stood in line for a solid six hours,
something I NEVER thought I would do, but it was well worth the wait. We were very
fortunate though because when it was our turn it happened to be time for a guard change.
Amazing. Truly amazing. I stood there looking at the coffin, watching the soldiers come
change places and all of a sudden feet no longer hurt, backs no longer ached, knees felt
no weakness. It was just a moment of pure, honest respect and it FILLED the room. You
could nearly reach out and touch it. It is amazing how close you can feel to a room full of
strangers. We went outside and signed the condolence books for Mrs. Reagan and caught
a taxi home. …We made it though and all it cost was some sore feet and six and a half
hours of waiting - not a bad deal for something I'll remember for the rest of my life.
(Christine Zaruba, Research internship, 2004)
I also talked to a lot of people and learned about the development of racial stereotyping in
children, the biochemistry of oil spills, invasive butterfly species, and a million other
things that I can't remember right now. (Kacey Meaker, Research internship, 2006)
Saturday most of us went together to see some sights. First we checked out the botanical
gardens, which were very cool. There are exotic plants from across the globe and some
15
you could find in your backyard. Next, we moved on to the Smithsonian Air and Space
Museum. As a model rocket builder and stargazer I thought it was awesome. I saw
fullscale rockets, a bunch of space suits and a model of the Hubble Space Telescope. I
learned a lot about our space race with Russia. (Matt Hall, Education outreach/policy,
(2005)
In sum, intern observations comprising the category of personal growth emphasize participants’
opportunities to explore Washington, DC and take in the wealth of learning the city has to offer.
Comments in this set of observations also related the strong collegiality that developed between
SPS interns in their time away from work: going places and doing things together, eating
together, relaxing together, and show the sense of community that is engendered by their living
closely together over the summer weeks. Nearly half of interns specifically noted their SPS
summer internship as a wonderful personal experience that helped them as young adults to
discover themselves.

Personal-professional gains. (n=197, 14% res., 15% ed. out./pol.; 15% men, 14% women)
Ranking second in number of intern observations on program outcomes, a somewhat smaller
percentage of all observations (14%, see Tables 1 and 2), described personal-professional
gains—personal gains associated with interns’ professional work experience. Participants’
comments in this category largely emphasized the benefits of professional collegiality built upon
close interaction with other interns at work. Positive interactions with their supervisors also
contributed to participants’ successful internships. Thus, observations of collegiality collected in
this category relate to professional collegiality with interns and supervisors at the internship, as
distinct from observations of personal collegiality that developed among interns outside of work,
as discussed above. Another set of intern comments collected in the personal-professional gains
category mention affective benefits from their professional work experience, such as feeling a
sense of accomplishment or gains in confidence, among others.
Professional collegiality
Over half of intern comments in the personal-professional gains category (54%, see Tables 6 and
7) mentioned participating in group activities organized by SPS, developing collegial work
relations with other interns and a sense of belonging to a community. Professional collegiality
was a benefit recorded by 60% of interns (n=12; 6 res., 6 ed. out./pol.; 5 men, 7 women). These
comments show the positive relationships that developed between interns working together,
helping one another, and learning from one another and the sense of community professional
collaboration engendered:
Erin and I have our desks right next to each other, which has been very nice in getting to
know one another and learning about our available resources. (Ann Deml, Science
education outreach/policy internship, 2006)
Thursday brought more annoyance from the solid angle problem. However I did have
some good correspondence with my roommate Adam about the problem, it felt good to
be discussing a problem and working through it with him. (Matthew Shanks, Science
education outreach/policy internship, 2004)
16
Table 6. PROGRAM OUTCOMES: Observations of personal-professional gains by type of internship.
N of Obs. % of Obs.
Type of Observation
N of
% of
Sci. ed.
Sci. ed.
Obs.
Obs.
Out./
Out./
TOTAL
%
Res.
Res.
policy
policy
OBS.
OBS.
Professional collegiality
Belonging to community: group SPS social
activities
Peer collegiality in general
Very strong sense of community/
belonging to a community
Peer collegiality working with other intern
Work peers invite intern to lunch off site
Intern supervises another intern for
program outside SPS
Belonging to community at internship
Subtotal
Supervisor Mentoring
Supervisor collegiality; opportunity for
closer interactions
Supervisor provides meaningful
interaction: shares knowledge,
experience, good guidance
Supervisor provides meaningful good
feedback to intern
Supervisor is patient
Supervisor is cool, laid back
Supervisor is nice, understanding
Subtotal
Personal gains from professional work:
Excited that results are good/will be
publishable; Outreach work has gone
so well; Personal satisfaction with
good results produced
Being taken seriously; Active participation
exciting; Feedback from professionals
encourages bonding to the profession
Gains in confidence: Knowledge of subject
Gains in confidence: Sense of
accomplishment
Making an original contribution is
EXCITING, feels thrill of discovery
Gains in confidence Knows
instrumentation way around lab
Subtotal
TOTALS
21
21%
21
22%
42
21%
12
12
12%
12%
12
7
13%
7%
24
19
12%
10%
1
5
4
1%
5%
4%
6
1
0
6%
1%
0%
7
6
4
4%
3%
2%
4
59
4%
58%
0
47
0%
49%
4
106
2%
54%
9
9%
14
15%
23
12%
9
9%
9
9%
18
9%
2
2%
6
6%
8
4%
0
1
1
22
0%
1%
1%
22%
1
0
0
30
1%
0%
0%
32%
1
1
1
52
1%
1%
1%
26%
11
11%
11
12%
22
11%
0
0%
6
6%
6
3%
3
3
3%
3%
1
0
1%
0%
4
3
2%
2%
3
3%
0
0%
3
2%
1
1%
0
0%
1
1%
21
102
21%
100%
18
95
19%
100%
39
197
20%
100%
17
Table 7. PROGRAM OUTCOMES: Observations of personal-professional gains by gender.
Type of Observation
Professional collegiality
Belonging to community: group SPS social
activities
Peer collegiality in general
N of Obs. % of Obs. N of Obs. % of Obs.
Men
Men
Women
Women
TOTAL
OBS.
%
OBS.
25
28%
17
16%
42
21%
9
10%
15
14%
24
12%
Very strong sense of community/belonging
to a community
Peer collegiality working with other intern
7
8%
12
11%
19
10%
3
3%
4
4%
7
4%
Work peers invite intern to lunch off site
2
2%
4
4%
6
3%
Intern supervises another intern for program
outside SPS
Belonging to community at internship
3
3%
1
1%
4
2%
3
3%
1
1%
4
2%
52
58%
54
50%
106
54%
Supervisor collegiality; opportunity for
closer interactions
Supervisor provides meaningful interaction:
shares knowledge, experience, good
guidance
Supervisor provides meaningful good
feedback to intern
Supervisor is patient
16
18%
7
7%
23
12%
9
10%
9
8%
18
9%
4
4%
4
4%
8
4%
0
0%
1
1%
1
1%
Supervisor is cool, laid back
1
1%
0
0%
1
1%
Supervisor is nice, understanding
0
0%
1
1%
1
1%
30
33%
22
21%
52
26%
7
8%
15
14%
22
11%
0
0%
6
6%
6
3%
1
1%
3
3%
4
2%
0
0%
3
3%
3
2%
0
0%
3
3%
3
2%
0
0%
1
1%
1
1%
8
90
9%
100%
31
107
29%
100%
39
197
20%
100%
Subtotal
Supervisor Mentoring
Subtotal
Personal gains from professional work:
Excited that results are good/will be
publishable; Outreach work has gone so
well; Personal satisfaction with good
results produced
Being taken seriously; Active participation
exciting; Feedback from professionals
encourages bonding to the profession
Gains in confidence: Knowledge of subject
Gains in confidence: Sense of
accomplishment
Making an original contribution is
EXCITING, feels thrill of discovery
Gains in confidence Knows instrumentation
way around lab
Subtotal
TOTALS
18
Table 8. PROGRAM OUTCOMES: Number of interns citing personal-professional gains by type of internship and gender.
Type of Observation
Professional collegiality
Belonging to community: group SPS social activities
Peer collegiality in general
Very strong sense of community/belonging to a community
Peer collegiality working with other intern
Work peers invite intern to lunch off site
Intern supervises another intern for program outside SPS
Belonging to community at internship
Supervisor Mentoring
Supervisor collegiality; opportunity for closer interactions
Supervisor provides meaningful interaction: shares
knowledge, experience, good guidance
Supervisor provides meaningful good feedback to intern
Supervisor is patient
Supervisor is cool, laid back
Supervisor is nice, understanding
Personal gains from professional work:
Excited that results are good/will be publishable; Outreach
work has gone so well; Personal satisfaction with good
results produced
Being taken seriously Active participation exciting Feedback
from professionals encourages bonding to the profession
Gains in confidence Knowledge of subject
Gains in confidence Sense of accomplishment
Making an original contribution is EXCITING, feels thrill of
discovery
Gains in confidence Knows instrumentation way around lab
N of
Research
Interns
N of
Sci ed
outreach/
policy
Interns
% of
Research
Interns
% of
Sci ed
outreach/
policy
Interns
N of
Men
N of
Women
% of
Men
% of
Women
TOTAL
INTERNS
%
INTERNS
7
6
5
1
2
2
4
6
1
4
1
0
35%
30%
25%
5%
10%
10%
20%
30%
5%
20%
5%
0%
6
5
3
1
2
1
5
7
3
4
1
1
30%
25%
15%
5%
10%
5%
25%
35%
15%
20%
5%
5%
11
12
6
5
3
2
55%
60%
30%
25%
15%
10%
3
0
15%
0%
2
1
10%
5%
3
15%
6
5
6
4
30%
25%
30%
20%
7
5
5
4
35%
25%
25%
20%
12
9
60%
45%
2
0
1
1
4
1
0
0
10%
0%
5%
5%
20%
5%
0%
0%
3
0
1
0
3
1
0
1
15%
0%
5%
0%
15%
5%
0%
5%
6
1
1
1
30%
5%
5%
5%
5
6
25%
30%
4
7
20%
35%
11
55%
0
3
0%
15%
0
3
0%
15%
3
15%
3
1
2
1
0
0
15%
5%
10%
5%
0%
0%
1
0
0
3
1
2
5%
0%
0%
15%
5%
10%
4
1
2
20%
5%
10%
1
0
5%
0%
0
1
0%
5%
1
5%
19
After another week at NIST, I have to admit that I almost feel more at home there than I
do at the GWU dormitory. The working environment exemplifies all the things I love
about my normal schoolwork; the constant learning, encountering interesting new
subjects, and collaboration with motivated colleagues, all combined with the thrill of
doing something with practical applications. I'm really looking forward to introducing the
other SPS interns to this beautiful campus when Jeff and I give the NIST tour in the very
near future. (Justin Stimatze, Research internship, 2003)
Friday was the last day of work…. We made brownies and lemon-lime bars that we
brought to work to thank everyone for being so wonderful all summer. Emily invited a
bunch of people from the hall into Cynthia and Emily's office where we had brownies,
listened to music, and Cynthia asked her typical philosophical questions. I was kind of
sad though, because it was our last day of work and I really didn't want to leave everyone.
(Kacey Meaker, Research internship, 2006)
Participating in and the development of a broader group collegiality were also noted in interns’
journals. Descriptions of engaging in group activities were noted by 55% of interns (n=11; 7 res.,
4 ed. out./pol.; 6 men, 5 women). In these entries, interns related these larger group activities
both as part of their work, i.e., organized tours, science education outreach events or attending
events on Capitol Hill, as well as more relaxed social interactions with SPS program staff, such
as evenings out in DC, get-togethers, and picnics:
After the presentations on Tuesday, we had a tour of AGU (American Geophysical
Union), which was very informative. On Wednesday, Jack took us to a play at the Arena
Stage on Waterfront. Crowns, an excerpt of The African American Praise in Church was
very deep and very profound. It had a great message and I learned the reason behind
wearing Hats on Sunday praise services! After the show, all the interns had dinner at
TGIF. Thanks a lot once again Jack! (Kibrom Tewolde, Science education outreach/
policy internship, 2004)
Tweak; practice; meantime, let's have some more fun
A tour of the Pentagon and wars that we won
And a play called Crowns we went to go see
Thanks, Bridger and John =) …tweedle-ee-dee…
At NIST, we spent time with a Nobel Prize winner
Time, Einstein, and clocks he explained with great flair
Later we met with him as a small group apart
Dr. Phillips was chatty, engaging, so smart!
Friday we went to NIST's nuclear building
Bridger and I joined the SURF kids in touring
I learned about how nuclear waste is produced
About collisions with neutrons, and radiation reduced
(Lindsay Windsor, Research internship, 2005: journal entry in iambic pentameter)
20
The ACP picnic in the afternoon was a lot of fun. There was very good food, and I got to
meet Jeff’s girlfriend, Margie, as well as Andy’s parents who were all very nice. In the
“Physics is Cool” room of demonstrations and activities for the kids, I helped mostly with
a hot and cold water activity. It did not always work right away, but I still enjoyed talking
with the participants. (Ann Deml, Science education outreach/policy internship, 2006)
Friday we had the AIP picnic. It was pretty fun. I let Mika paint my face up. When I went
to the concert I still had red paint on my face that I hadn't been able to wash off yet. I met
Liz's kids. Luke wanted to hold my hand as we stepped past some of the equipment that
was available for the kids to play on. Little Cole was so well behaved. A bunch of people
were holding him and he didn't make very much noise. Poor guy seemed pretty tired
throughout the whole picnic though. (Bridger Anderson, Research internship, 2005)
The week ended with a cookout at Gary White's house. We met his family and also Liz
Dart Caron's family came. There was tasty food, including some great gumbo that Gary
made, and some fun stories. We got to play with some cool magnets and physics-ish toys.
Overall I think it was a very pleasant, relaxing evening. Thanks again, Gary. (Matt Hall,
Science education outreach/policy internship, 2005)
The following quotation is representative of several interns’ accounts concerning finding oneself
as part of a community; it generated strong statements of thanks and friendship:
Last, but by no means least, interacting and collaborating with the other SPS interns has
really been incredible. It's gratifying to know that, despite our varying origins and
sometimes dramatically different backgrounds, we have all been brought together by the
unifying subjects of science and learning. I've thoroughly enjoyed getting to know these
remarkable people, and I hope that the friendships built here will last a lifetime. (Justin
Stimatze, Research internship, 2003)
This set of comments in the personal-professional gains category demonstrates interns’
engagement with: their work peers, professional and organized SPS activities, and also with each
other as an SPS community.
Supervisor mentoring
In a second subset of observations in the personal-professional gains category, just over a quarter
of interns’ comments (26%) described a collegial relationship with their supervisors, both inside
and outside of the internship. Sixty percent of interns (n=12; 6 res., 6 ed. out./pol.; 7 men, 5
women) mentioned opportunities for closer interactions with their supervisors:
A big part of a research physicist's life appears to be lunch. People gather in the cafeteria
or outside under a big tree to discuss their research, philosophy, religion, politics, or
anything in which a couple of them have interest. I join in on those discussions and
groups when I stay on NIST's campus for lunch, but the best midday meals are when Dr.
Nguyen invites me out to lunch with him. We have gone to a great Chinese restaurant a
few times so far, and yesterday, he took me to a Vietnamese soup place. The food I've
been having is amazing, but rather spicy. I think he likes taking me to these places
21
because while I'm turning red and wiping my forehead, he's pouring more chili sauce on
his soup and smiling with a calm, dry face. It's a great life, being an SPS Intern, and
there's no better lab to be an intern in than at NIST. (Alex Brown, Research internship,
2006)
Yom Revee ee—Presentation day! My first business presentation went quite well…and
the group leader, Eric Vogel, was impressed with the work Bridger and I had done.
Whew! Eric actually ended up joining Bridger and me for lunch a little bit after the
meeting, and it was an awesome opportunity to talk with him. Bridger had to leave
shortly, but I got to hear a lot about his work, his family, and how he got into physics,
and it was fun to share a little bit of my world and my interest in physics too. I was happy
to have a more personal contact with the boss. (Lindsay Windsor, Research intern, 2005)
I went to lunch with Fred and I met his daughters and another scientist, Joe Santos, took
us on a tour of the DDL lab on Friday. (Christine Zaruba, Research internship, 2004)
After this breakfast, we went to the Rayburn building, which is one of the House office
buildings, to observe a hearing before a subcommittee of the science committee. The
hearing was about reprocessing our spent nuclear fuel and whether or not we should
invest in doing so. It was fascinating to watch the hearing process and listen to the
ensuing debate. Even more interesting were the things I learned later on when we met
with Jack Hehn to discuss the hearing. He told us about a lot of the subtle things that
were going on. For instance, the order in which people were allowed to speak and the
order in which things were said and to whom mattered very much. The chairwoman made
a point to talk about bipartisan actions, only to have the ranking minority member say
something contrary early in his opening remarks. We had all missed that, but it was very
important. I think most of us are interested in seeing other hearings if we can. (Matt Hall,
Science education outreach/policy internship, 2005)
Nearly half the interns (45%) (n=9; 5 res., 4 ed. out./pol.; 5 men, 4 women) specifically
mentioned ways in which supervisors supported their learning during their internship.
Meaningful interactions with their supervisor included the sharing of knowledge, experience, the
modeling professional practice, and good guidance. Interns learned from these opportunities:
After completing the reading assignments I had been given the previous week I was
finally in a position to decipher what everyone was talking about. I had a firm grip on the
science behind the instrumentation I would be using. Not all of this came through reading
though. Everyday I spent an hour discussing topics with my lead advisor so that he could
explain or clarify anything I was struggling to understand. This is when he introduced me
to the primary means of data collection and analysis. All of the data NEAR collected
before it went into darkness are stored in a restricted database online. This made retrieval
easy and convenient. I had finally begun my work. (Brent Janus, Research internship,
2002)
On Monday I finally got to sit down and talk to Jayne about my project. I had been
working on the DNA project, but she originally wanted me to work on a new project
22
about cyclodextrins. Cyclodextrins are these really cool little molecules made up of about
6-9 and sometimes more units of glucose formed in a ring. The inside is hydrophobic and
the outside is hydrophilic so they are often used in pharmaceuticals to make normally
insoluble compounds more soluble. We're using them as a kind of model for enzymes,
because proteins are normally far too big to use in this way. After talking about which
project I should work on, I decided to focus primarily on the cyclodextrin project,
because I found out through reading a lot of journal articles that a lot of the DNA stuff
had already been done before. Jayne's really nice, and she's very helpful when I have
problems with my calculations. (Kacey Meaker, Research internship, 2006)
I finally found Dr. Berg and he was kind enough to take me through the demos room and
explain to me the apparati of which I was unfamiliar. As it turns out, many of the setups
that I didn't understand were sort of magic tricks. They were optical illusions, and very
impressive ones at that! While we were touring the demos room, we were also gathering
equipment for a demonstration session on properties of light and sound that he was to be
giving within the next few hours to a group of junior high students. I was very interested
to see "the man" in action…. The very next day I went back to the University of
Maryland and watched Dr. Berg perform his sound and light waves show to a group of at
least 60 junior high students. His excitement and magician style presentation was
impressive. His ability to explain concepts via everyday relation and graphic analysis of
his demos in a diverse and amusing way was something that the students seemed to enjoy
and no doubtedly learned from. He was very engaging. He would generally start off a
demonstration by asking the students what they think would or should happen. Then after
having explained and demonstrated a concept he would ask the students another question
that was related to the concept and the correctness of the students’ answers would
improve greatly. The entire program made me think back to one of my favorite daytime
shows as a younger student, "Mr. Wizard's World". It was a learning program that was
extremely interesting and engaging. It was very exciting and most of all, I learned from it.
(Mark Lentz, Science education outreach/policy internship, 2001)
There are several viable ideas for the light portion of the SOCK, many of which have
been explored in previous year's SOCKs. The lessons could focus on the properties of
light as waves and particles or the observation of various materials' spectra. Gary and I
spent quite a while trying to reach a purely qualitative understanding of some light
phenomena, in order to devise a means to convey new concepts to children. We played
with a tray of water to try to visualize the change in a wave's propagation through various
slit sizes, forming passages between 2 sponges. We tried using spandex in the same
respect. We also toyed with the idea of illustrating constructive and destructive
interference at a level eighth graders could understand. Gary tirelessly indulged my
qualitative questions with tedious sketches of light geometry. What an amazing teacher!
(Stacey Elizabeth Sude, Science education outreach/policy internship, 2003)
Personal gains from professional work
In the last set of observations in the personal-professional gains categories, one-fifth of intern
comments described personal, affective gains as an outcome of participation. Interns said that
they gained confidence due to their learning and also from a sense of accomplishment. A small
23
majority of interns (n=11; 5 res., 6 ed. out./pol.; 4 men, 7 women) noted how happy and excited
they were to get good results and were relieved and satisfied to find their work activities
successful:
On Wednesday, Gary White visited NIST and spent some time talking with Dr. Vogel
and I. It was satisfying to be able to discuss my project with more technical confidence, a
benefit of the steep learning curve I encountered during my first week. (Justin Stimatze,
Research internship, 2003)
The internship is coming to a close. One week remaining, much work to be done. I think
all the interns are feeling the push to the end now. I realized with some pleasure that I
reached, this week, the threshold of an actual working knowledge of my project. I have
read enough papers on dust in the solar corona to be able to pick one up and understand
its contribution to the debate without having to look up every third term. It's a fun place
to be with a topic. (Kathryn Peak, Research internship, 2002)
The tour of NASA-Goddard on Monday was unbelievable, given that I've wanted such a
thing since about the age of 11. Several clean rooms and filter walls, and much to my
shock I was actually able to use some of what I knew from my engineering endeavors to
answer questions about AC and air pressure in said rooms. Total dork stuff, but it made
me feel good. (Melissa Hanafee, Science education outreach/policy internship, 2003)
Both last Friday and today I've been running the temperature-dependent measurements
for my device. We're getting tons and tons of data, and then the next few weeks will be
spent "creating a story" to make sense of it all. Wednesday I gave my second presentation
of the summer. I spent Tuesday drawing up data tables, making pretty graphs, analyzing
data, and sticking the analysis into a Powerpoint presentation; then all evening Tuesday I
spent making it look cohesive, professional, and color-coordinated. So much work, but
really rewarding to have a finished, quality presentation that I can be proud of. (Lindsay
Windsor, Research internship, 2005)
Observations captured in the personal-professional gains category detailed interns’ highly
positive interactions with peers and supervisors at their internship and highlighted their
opportunities for professional interactions. The development of a broader, group collegiality was
also noted in interns’ descriptions of participating in larger group activities, both as part of their
work, as well as more relaxed social interactions with SPS program staff. A last set of comments
in this category described personal gains associated with their professional work experience,
such as satisfaction in the project’s success, the thrill of getting “good” results, and gains in
confidence as a result of their SPS internship experience.
24

Thinking and working like a professional. (n=171, 14% res., 10% ed. out./pol.; 10% men,
14% women)
Close in number of observations to the personal-professional gains category, 13% interns’
comments described intellectual benefits derived from the SPS Summer Intern Program (see
Tables 1 and 2). A majority of comments in this category described participants’ applied
learning gains—gains associated with understanding how science and education outreach/policy
work is applied in professional, hands-on practice—gains that interns directly related to
engagement in authentic, professional work (67%). Another 33% of intern observations
described increases in knowledge per se. (See Tables 9 and 10.)
Applied learning gains
In the “thinking and working like a professional” gains category, 56% of interns’ comments
discussed applied learning gains—gains from doing hands-on work—and 80% of interns (n=16:
8 res., 8 ed. out./pol.; 8 men, 8 women, see Table 11) mentioned “learning by doing” in writing
about their internship activities. These comments largely described students’ daily work. These
accounts show how actively involved interns were with their projects and the opportunity for
interns to integrate academic knowledge with field applications:
I had the task of going through the orbital data very carefully. It was important to weed
out data that had been corrupted but at the same time preserve as much as possible to
limit the uncertainty of our conclusions. Also, for the purposes of analysis I had to divide
the data into two categories-high (~200 km) and low (~35 km) orbit. Having uncorrupted
data for the Gamma Ray Spectrometer from these two points will help in determining
overall composition. Around Friday I had finished and had finally produced my first
spectrum. The rest of the spectra will probably be finished early next week. The programs
that will be used to analyze them for elemental composition are being constructed here at
NASA. Interactive Data Language (IDL) is the platform being used to construct the
programs. As they are not finished quite yet I will probably take a few days to work with
IDL and the main programmer and then start my analysis late next week. I'll let you
know. (Brent Janus, Research internship, 2002)
Work is going pretty well. I started writing a basic introduction of my project and all the
different aspects of it, and I'm actually really starting to understand how cool it really is. I
finished all of the minimized structures in Maestro and then used this other fun program
called Moe to do docking and scoring. I've also been reading a lot of book chapters about
how all the programs work so I know the physics behind it as well. I found two new
proteins called zonulin and zot that I will start looking at as well in Maestro and Moe.
This has been a very productive week until Friday when my x-terminal broke again.
(Kacey Meaker, Research internship, 2006)
25
Table 9. PROGRAM OUTCOMES: Observations of "thinking and working like a professional" by type of
internship.
Type of Observation
Gains in the application of knowledge and skills:
Expresses learning by doing; Hands-on
experience; Applied learning
Increased understanding of how science
research/science education outreach/policy
works in applied practice
Understanding results produced fit theoretical
models
Learned research design/Developed, planned
science education outreach activities
Subtotal: Applied learning gains
Increased knowledge:
New knowledge gains
Opportunity to integrate coursework with handson work; understanding connections/transfer
between/within sciences
Subtotal: Knowledge gains
TOTALS
N of
Obs.
Res.
% of
Obs.
Res.
N of
Obs. Sci.
ed. Out./
policy
% of Obs.
Sci. ed.
Out./
policy
TOTAL
OBS.
%
OBS.
26
25%
25
38%
51
30%
11
10%
12
18%
23
13%
13
12%
1
2%
14
8%
1
1%
6
9%
7
4%
51
44
56%
12
9
68%
0%
18%
14%
95
27
28
48%
0%
25%
26%
39
37
23%
22%
55
106
52%
100%
21
65
32%
100%
76
171
44%
100%
Table 10. PROGRAM OUTCOMES: Observations on "thinking and working like a professional" by gender.
N of
% of
N of
Type of Observation
Obs.
Obs.
Obs.
% of Obs. TOTAL
%
Men
Men
Women
Women
OBS.
OBS.
Gains in the application of knowledge and skills:
Expresses learning by doing; Hands-on
21
34%
30
28%
51
30%
experience; Applied learning
Increased understanding of how science
9
15%
14
13%
23
13%
research/science education outreach/policy
works in applied practice
Understanding results produced fit theoretical
models
Learned research design/Developed, planned
science education outreach activities
4
6%
10
9%
14
8%
2
3%
5
5%
7
4%
Subtotal: Applied learning gains
Increased knowledge:
New knowledge gains
Opportunity to integrate coursework with handson work; understanding connections/transfer
between/within sciences
36
59
28
22
54%
0%
26%
20%
95
11
15
58%
0%
18%
24%
39
37
56%
0%
23%
22%
Subtotal: Knowledge gains
TOTALS
26
62
42%
100%
50
109
46%
100%
76
171
44%
100%
26
Table 11. PROGRAM OUTCOMES: Number of interns citing gains in “thinking and working like a professional” by type of internship and gender.
Type of Observation
Gains in the application of knowledge and
skills:
Expresses learning by doing; Hands-on
experience; Applied learning
Increased understanding of how science
research/science education
outreach/policy works in applied
practice
Understanding results produced fit
theoretical models
Learned research design/Developed,
planned science education outreach
activities
Increased knowledge:
New knowledge gains
Opportunity to integrate coursework with
hands-on work; understanding
connections/transfer between/within
sciences
N of
Research
Interns
N of
Sci ed
outreach/
policy
Interns
% of
Research
Interns
% of
Sci ed
outreach/
policy
Interns
N of
Men
N of
Women
% of
Men
% of
Women
TOTAL
INTERNS
%
INTERNS
8
8
40%
40%
8
8
40%
40%
16
80%
6
5
30%
25%
5
6
25%
30%
11
55%
7
1
35%
5%
3
5
15%
25%
8
40%
1
3
5%
15%
1
3
5%
15%
4
20%
7
8
6
5
35%
40%
30%
25%
5
6
8
7
25%
30%
40%
35%
13
13
65%
65%
27
Wednesday brought a fun opportunity. A few of us got to go to a third grade class to
teach a lesson/do an experiment. Basically we got to play with some kids while having
them learn, which they may not have realized. It was great. It reminded me of my Cub
Scout camp counselor days, which I loved (I did that for the 5 summers before coming to
college). This was also a chance to get kids excited about science, and I think that is
certainly a good thing. I spent most of the week at work creating physics trivia questions
and finding more information about where to buy time capsules. It's tough to think of
good questions. I'm thinking about going to museums to wander around looking for
inspiration. If anyone has any ideas, I'd love to hear them. On Wednesday Mika, Morgan
and I got to go to the third grade class again. This time we helped the kids analyze the
data they collected last week. They made predictions and graphs. I'm really surprised to
see how far along they are on their math skills. I don't know if I'm misremembering my
education or if schools are moving faster now. The kids all had a great time, and I think
all of us did too. (Matt Hall, Science education outreach/policy internship, 2005)
I survived my first conference call on Thursday about the scholarship clearinghouse. We
were able to lay out some guidelines in terms of criteria and format for the website. I am
now working on a letter to send out to scholarship providers asking them to post their
info on our website as well as obtaining a more concise list of sources I need to contact.
So if you're reading this and you know of any good science scholarships... I also made
some headway on the SOCKs project. I sent in a request to purchase the materials for the
SOCKs we are making, hopefully the shipment arrives soon. I'm also working on a letter
to send out to introduce the new SOCK for 2005. We want to make this one special since
it is the World Year of Physics and we've been throwing around some ideas to include in
the SOCKs. The cool thing is one of these ideas involved marshmallows! so I got to eat
plenty of those. Unfortunately some pictures taken, I have to try to confiscate them.
(Melissa Hanafee, Science education outreach/policy internship, 2003)
What I've learned this week is that I like little kids better than middle schoolers.
Elementary aged children tend to be a bit more disorganized but generally follow
directions when they are given. (Matthew Shanks, Science education outreach/policy
internship, 2004)
Understanding that research results produced fit theoretical models was noted by 40% of interns
(n=8; 7 res., 1 ed. out./pol.; 3 men, 5 women). Most citing this gain were engaged in a science
research internship:
At work, I've been analyzing my SE data and preparing my end-of-summer presentations
for the group and for ACP. My data is fitting the models, and the numbers are reasonable!
(Alex Brown, Research internship, 2006)
The other project of the week has been to do some modeling of the hafnium films, for
which we had to fabricate a dielectric function because hafnium dioxide has no published
dielectric function. Part of that is because the function changes depending on how the
film is grown, and even how thick it is made. We have made a lot of progress in fitting a
28
function to our experimental data, so there is hope that in studying these functions we
will find publishable data. (Eva Wilcox, Research internship, 2002)
Data analysis—We have so much data that analyzing it all is a lot of work, but also
rewarding to discover trends that fit with theoretical models. We've found some patterns
and repeatable behavior, and I've organized the information on one looooong 26-slide
powerpoint presentation. (I will have much editing to do for the presentation at the end of
the summer nobody wants to hear me talk that long!) =) We're still working on the story
to make sense of the data. (Lindsay Windsor, Research internship, 2005)
The one observation of this type offered by a science education outreach intern demonstrates
understanding teaching in practice, the need to think about learning from different points of
view, and seeing how an inquiry-based teaching practice helped students to learn:
Camp started this week. I've got twenty-five or so eighth grade girls in an afternoon roller
coaster workshop, which is part of the Summer Girls science day camp at the University
of Maryland. …Bridget and I have given lessons and demonstrations on kinetic and
potential energy, centripetal force, gravity, and friction. To illustrate aspects of energy
and centripetal force, we rolled a ball along a roller-coaster-shaped track and reminded
the girls that they would have to keep these concepts in mind when constructing their
own roller coasters out of K-nex. To indicate the universality of the force of gravity, we
used free-falling objects. Each student dropped two objects of varying sizes and shapes
and recorded their observations about the objects landing. Their hypotheses about the
results; ranging from the effect of the height from which the objects were dropped, the
respective weights of the objects, and the objects reactions to air; were shared with the
class and then subjected to further testing. The girls all participated and seemed very
engaged. For friction, we employed a fun, hands-on demo; the students compared the
difficulty of pulling a classmate seated on a rubber surface with that of pulling her on a
smooth spandex surface. The girls immediately acknowledged the role of friction in the
phenomena they witnessed, without coaxing. It was rewarding to see them spontaneously
thinking in scientific terms about their observations…. Outreach work is great. I like to
think it's serious; an adult must think like a kid in order to understand how kids learn and
what they are capable of learning at a particular stage. (Stacey Elizabeth Sude, Science
education outreach/policy internship, 2003)
Just 20% of interns discussed learning how to design research or active involvement in
developing science education outreach activities. Of the four, three of these interns were engaged
in science education outreach/policy work (n=4; 1 res., 3 ed. out./pol.; 1 men, 3 women):
In terms of research and research process, I learned about clean rooms, about the steps in
the process of designing and conducting an experiment, and about how to write a
scientific paper (Lindsay Windsor, Research internship, 2005)
This week has been interesting at times and mind numbing at others. Let's begin with
Monday. On Monday Heather and I did some last minute preparations for the CNSF
event and worked out how we were going to get to the event. Other than that I also
received an email from Jeff, one of the guys who I am helping with the summer camp. I
29
also worked on sketching out some sort of lesson plan type thing for coefficient of
restitution and friction. (Matthew Shanks, Science education outreach/policy internship,
2004)
I also had a chance this week to try out ideas for the SOCK. During the GK-12 seminar
on Wednesday, Ashley presented the cylinder-dropping experiment to the other fellows
and I presented a light lesson. The focus of my lesson was a spectral scavenger hunt. I
collected various spectral sources from UM s immense physics demo stock, from
mercury vapor tubes to variable intensity filaments, threw in some glow sticks and lasers,
and let the fellows loose with diffraction grating glasses to search for substances based on
continuous and discrete spectra. (Stacey Elizabeth Sude, Science education
outreach/policy internship, 2003)
The above sets of observations encompass interns’ applied learning gains: gains in applying their
learning in the context of authentic, professional practice.
Increased knowledge
The remaining observations in this category are comprised of interns’ comments stating
knowledge gains. Observations on knowledge gains per se were of two kinds: new knowledge
(17%) and transfer of knowledge between coursework and hands-on work in the field (16%).
Gaining new knowledge was a benefit recorded in 65% of all intern journals (n=13: 7 res., 6 ed.
out./pol.; 4 men, 8 women):
This week I began to learn how the spectra data is analyzed to both identify particular
elements within the asteroid and determine how much of those elements are present. The
first is standard spectroscopy stuff. Using a program that plots the data and fits a line
peaks occur at different energy levels. Since different elements emit gamma rays at
different energies then a peak at a certain energy indicates a particular element. For
example, a peak at 320 keV indicates 51Cr, which is an isotope generally used to
calibrate the instrument. Elemental abundance is determined through a calculation
relating the number of times the detector was set off to the number of photons (in this
case, gamma rays) required to do so. That's all very scientific to the average person. I
apologize. Needless to say, I am learning a lot. Very shortly we will all be attending a
tour at Eva's workplace, NIST. Hopefully, we will get to see some of their physics labs
and stuff. It should be interesting. (Brent Janus, Research internship, 2002)
Well, this is the second week of my internship, and I am enjoying myself! There are
times when things seem a bit hectic, but I just take one thing at a time and seem to do
okay! I have learned so much about some of the programs that Matt and I are going to be
representing at the CNSF event next week. I didn't even know that these programs
existed, but now I am trying to be the expert on them, I am excited about the event!
(Heather Lunn, Science education outreach/policy, 2004)
I suppose I should reflect on my summer a little bit as this is my last journal entry. I
learned so much this summer I don't even know where to start. I learned some Unix and a
lot of computer programs, and I also learned a lot of biology and chemistry and even
30
some physics. But I also learned a lot more important stuff. (Kacey Meaker, Research
internship, 2006)
Thursday brought more annoyance from the solid angle problem. However I did have
some good correspondence with my roommate Adam about the problem, it felt good to
be discussing a problem and working through it with him. So I worked on that some and
also on creating a more fleshed out lesson plan on bounciness. That brings us to today,
Friday. Today has been alright, I finally figured out why my answer to the solid angle
problem was not giving me the correct answer in the limit of a whole sphere. The
problem lay in my assumption that I needed to think of the area of a dome as a sort of
shrinking cylinder and thus take into account height of said cylinder. This, while
seemingly a decent assumption was completely wrong, the height factor in fact does not
matter in my treatment because all I am doing is summing circumferences and that
depends on the angle existing from the vertical to the edge of the triangle created by
tacking a 2D slice of the cone. Anyway, besides that I went to the lecture on chaos during
lunch today that was given by Phil Schewe (Matthew Shanks, Science education
outreach/policy internship, 2004)
Sixty-five percent of interns also mentioned increased conceptual understanding of the
connections between and within the sciences (n=13: 8 res., 5 ed. out./pol.; 6 men, 7 women):
One of the obstacles that I had earlier in the week was getting used to the different
terminology between Chemists and Physicists. I am pretty familiar with all the concepts,
but the Chemists decided to give their own names to everything. It must be fun for them.
(Bridger Anderson, Research internship, 2005)
This week the research got fun and interesting! In fact, the hafnium data that I have been
analyzing turned out to have some interesting features in the dielectric functions for the
samples. These features, or the lack thereof, describe whether the material is amorphous
or crystallized. So, now my job is to make connections between what types of samples
(how they are grown, annealed, etc.) have these features and develop a working theory as
to why or when the hafnium becomes crystallized. I don't know how much more I can say
as my advisor plans to write a paper on this very soon. (Eva Wilcox, Research internship,
2002)
My group's project is so, so fun. I'm researching the conductivity of organic polymers on
the nanoscale. I didn't realize I would enjoy the research this much. I spent a lot of time
researching the materials I would need for the actual project, and in the process learned a
ton about organic materials. (Who knew I would need orgo?) (Lindsay Windsor,
Research internship, 2005)
I was especially surprised by finding that there were 2 VERY opposite camps on the
goals of what our jobs as physics teachers are. The main part that sticks in my mind was
hearing Commander Lawrence Norris (Naval Academy, NSBP) say that, "My job is to
produce physics Ph.D.'s" and to have Bernie Khoury (Executive Officer of AAPT)
violently disagree in favor of educating everyone through HS, then letting people choose
31
if they want to continue a science education. I guess I was surprised because I thought the
one was symptomatic of the other, that they weren't so separate that separate programs
would have to be considered for each. I really got an education on how much effort goes
into effective teaching! (It makes me doubly impressed by those who do this work.)
(Melissa Hanafee, Science education outreach/policy internship, 2003)
Overall, interns noted several types of intellectual gains. A majority described applied learning
gains in terms of their active engagement in authentic work and the opportunity to integrate
academic knowledge with field applications. Some interns (less than half) went further and
mentioned their results fitting theoretical models, demonstrating a high-level intellectual gain.
Four interns discussed another high-level intellectual gain: participating in the design of their
research or participating in lesson planning and development for science education outreach
activities. Interns also described gains in new knowledge, as well as increased understanding of
connections within and between the sciences.

Enhanced understanding of professional work contexts and preparation for advance
study and entry to the workforce. (n=122, 7% res., 12% ed. out./pol.; 9% men, 9% women)
To meet the objective of developing collegiality among physics students and professionals in
physics and allied sciences, the SPS Summer Intern Program has specifically structured the
program to provide opportunities for interns to interact with professionals in varied fields and
work contexts. Attending congressional hearings and sessions with law- and policy makers as
well as intern-organized tours of their work sites enhanced understanding of professional life and
practice. As part of relating the activities of their internship, participants discussed the
experience of these opportunities to meet with, talk with, and learn from politicians, science
researchers, and science education outreach and policy practitioners in authentic professional
contexts. Observations collected in this category demonstrates the ways in which the half-day
field trips to attend various congressional hearings and tours of government research labs
broadened interns’ exposure to physics and allied science environments.
Responses in this category (9% of all observations, see Tables 1 and 2) emphasized the ways in
which program participation enhanced interns’ preparation for professional work and graduate
study by providing an up-close view of professionals and their work contexts. Fewer in number,
other intern comments comprising this category mentioned gains in knowledge and skills that
enhanced their preparation for advance study and entry to the workforce, networking
opportunities, and glimpsing a more personal view of professionals’ lives.
Descriptions of meeting and talking with well-known, important people were nearly one quarter
of interns’ observations in this category (24%, see Tables 12 and 13) and were recorded by 65%
of interns (n=13: 5 res., 8 ed. out./pol.; 7 men, 6 women; see Table 14). Conversing with
respected scientists and politicians, among others, provided a larger view of the professional
working world:
32
Table 12. PROGRAM OUTCOMES: Observations of enhanced understanding of professional
work contexts and preparation for advance study and entry to the workforce by type of
internship.
Type of Observation
Opportunities to meet and talk with important
people discussing science
N of
Obs.
Res.
11
% of
Obs.
Res.
N of
Obs.
Sci. ed.
Out./
policy
% of
Obs.
Sci. ed.
Out./
policy
TOTAL
OBS.
%
OBS.
22%
18
25%
29
24%
More realistic understanding how
professionals work in practice
Opportunity to see professional working
context; Increased knowledge of physics
and allied science community
7
14%
13
18%
20
16%
4
8%
15
21%
19
16%
Opportunity to find out what hands-on work
in this field is like
5
10%
7
10%
12
10%
Knowledge gains that enhance preparation
for/transfer to advance study or
workforce entry
5
10%
6
8%
11
9%
Enhanced skills for advance study or entry to
workforce
Opportunities for professional networking and
career development
5
10%
4
5%
9
7%
3
6%
4
5%
7
6%
Opportunities to see who, what personal life
of a scientist is like
4
8%
3
4%
7
6%
Career networking advice/help provided by
professional
3
6%
3
4%
6
5%
Learning "real life stuff," work world in
practice
TOTALS
2
4%
0
0%
2
2%
49
100%
73
100%
122
100%
33
Table 13. PROGRAM OUTCOMES: Observations of enhanced understanding of professional
work contexts and preparation for advance study and entry to the workforce by gender.
N of
Obs.
Men
% of
Obs.
Men
N of
Obs.
Women
% of
Obs.
Women
TOTAL
OBS.
%
OBS.
Opportunities to meet and talk with
important people discussing science
14
26%
15
22%
29
24%
More realistic understanding how
professionals work in practice
10
19%
10
14%
20
16%
Opportunity to see professional working
context; Increased knowledge of
physics and allied science community
10
19%
9
13%
19
16%
Opportunity to find out what hands-on work
in this field is like
4
8%
8
12%
12
10%
Knowledge gains that enhance preparation
for/transfer to advance study or
workforce entry
5
9%
6
9%
11
9%
Enhanced skills for advance study or entry
to workforce
3
6%
6
9%
9
7%
Opportunities for professional networking
and career development
2
4%
5
7%
7
6%
Opportunities to see who, what personal life
of a scientist is like
2
4%
5
7%
7
6%
Career networking advice/help provided by
professional
3
6%
3
4%
6
5%
Learning "real life stuff," work in practice
0
0%
2
3%
2
2%
TOTALS
53
100%
69
100%
122
100%
Type of Observation
34
Table 14. PROGRAM OUTCOMES: Number of interns citing enhanced understanding of professional work contexts and preparation
for advance study and entry to the workforce by type of internship and gender.
N of
Research
Interns
N of
Sci ed
outreach/
policy
Interns
% of
Research
Interns
% of
Sci ed
outreach/
policy
Interns
N of
Men
N of
Women
% of
Men
% of
Women
TOTAL
INTERNS
%
INTERNS
Opportunities to meet and talk with
important people discussing
science
Opportunity to see professional
working context; Increased
knowledge of physics and allied
science community
5
8
25%
40%
7
6
35%
30%
13
65%
2
9
10%
45%
5
6
25%
30%
11
55%
More realistic understanding of how
professionals work in practice
3
6
15%
30%
5
4
25%
20%
9
45%
Opportunity to find out what hands-on
work in this field is like
Knowledge gains that enhance
preparation for/transfer to
advanced study or workforce
entry
Enhanced skills for advanced study or
entry to workforce
Opportunities for professional
networking and career
development
Opportunities to see who, what
personal life of a scientist is like
Career networking advice/help
provided by professional
Learning "real life stuff," work world
in practice
5
3
25%
15%
3
5
15%
25%
8
40%
2
5
10%
25%
4
3
20%
15%
7
35%
1
3
5%
15%
2
2
10%
10%
4
20%
2
1
10%
5%
1
2
5%
10%
3
15%
4
3
20%
15%
2
5
10%
25%
7
35%
2
3
10%
15%
2
3
10%
15%
5
25%
2
0
10%
0%
0
2
0%
10%
2
10%
Type of Observation
35
What's up? My name is Heather Lunn and it is my first week at AIP. I have learned so
much this week it is unreal. The first day I met so many people (many of who are
extremely important) and I still don't remember all of their names! ...I will be
representing AIP at the CNSF event on June 22 along with another intern and I have
learned volumes about the programs already. Beware world: AIP is out to change
everyone's view (children's too) about how and what science really is. They are also
working their butts off to improve our science and math teachers across the nation. This
is very important to me because I know what it is like to have a horrible teacher for a
subject that is very important to me. In other words, I am very excited to go to the CNSF
event at Capitol Hill in DC. (Heather Lunn, Science education outreach/policy internship,
2004)
The Coalition for National Science Funding CNSF was on Tuesday evening at the
Rayburn Bldg at Capitol Hill. Matt and Heather, the interns at MRSEC were presenting
so Allison and me went to support them. There was a very exquisite reception together
with a plethora of famous faces. We met a lot of VIPs so to speak; from school presidents
to NSF chair people to organization CEOs to Congressmen. That was a very encouraging
and eye-opening event. We had a good time. (Kibrom Tewolde, Science education
outreach/policy internship, 2004)
From there, we waltzed off to meet with Gail Porter, who directs the Public and Business
Affairs Office for NIST. (The process of arranging this meeting was a little complicated
but quite fun - I got to meet NIST's Chief of Staff and some of the other head officers
along the way =) ). She gave an informative tour on the main exhibits in the Admin.
building, focusing mostly on how NIST is involved in the real world and how their
standards, processes, and technology are really fundamental for so much of modern
industry and commerce. (Lindsay Windsor, Research internship, 2005)
Fifty-five percent of interns, (n=11: 2 res., 9 ed. out./pol.; 5 men, 6 women) mentioned learning
about a broad variety of work activities within physics and allied sciences in their accounts of
visiting government research labs and other SPS field trips. These professional development
opportunities informed interns’ knowledge of future work possibilities. These were 16% of
observations collected in the category:
After our talks on Thursday we went to NASA to see what Christine has been up to this
summer and to see what NASA is up to in general. It was really cool there. We got to go
in their clean room and see what some of their engineers were working on in there. We
also got to see a new satellite that will be launching this fall. NASA is a place I would not
mind receiving a paycheck from later in life. They get to play with some fun stuff over
there, and I'm jealous. That sums up this week. Stay tuned next week for my last full
week entry (single tear to the left eye)! (Joseph York, Research internship, 2004)
The rest of the week involved relatively little time at work as we started with a NIST tour
Monday afternoon. I went to work with Kristen for the morning at the American
Astronomical Society (AAS) which I had never been to before. The tour was interesting,
and I liked seeing the labs that Alex and Andy work in, the molecules that Kacey has
36
been working with, and other things that I have heard them and Pat talking about all
summer. (Ann Deml, Science education outreach/policy internship, 2006)
Jeff and I have also been busy planning a tour of our workplace [at NIST] for the other
interns. …We're both really looking forward to introducing the other interns to our
supervising scientists and giving them a close-up view of our work. Although, in my
case, that work consists mainly of typing long cryptic strings of text on a keyboard and
staring intently at print outs of code covered in hand-written notes of various colors.
However, the theoretical model behind the simulation is fascinating and I hope I can
properly convey my excitement for the project to the other interns. (Justin Stimatze,
Research intern, 2003)
On Friday, our division chief gave a presentation for all the summer students during
which he gave an introduction to all the types of work people in the division are doing,
and as an added incentive, he brought pastries, popcorn, Oreos, Cheetos, and candybars.
(Alex Brown, Research internship, 2006)
Forty-five percent of interns discussed greater understanding of how professionals operate in the
“real, working world” and enhanced knowledge of how national science policy is formed
(n=9: 3 res., 6 ed. out./pol.; 5 men, 4 women):
I was invited to attend the entire editors meeting and really enjoyed it. The editors
themselves along with Bruce, the director of ComPADRE, were interesting to meet. It
was a nice change from working at my computer all day, and I learned a lot about the
ComPADRE project overall. I now know about many of the tools used for the other
ComPADRE collections and was very interested in speaking with the web technicians
about the special features available. The meeting also allowed for me to learn more about
my role in the Physics Teacher Education Coalition (PTEC) collection that is being
developed. Afterwards, I drafted a letter to send to all of the PTEC member institutions to
get more information about their physics teacher education programs. With my title as
editor, I will play a part in posting that information when it is returned. (Ann Deml,
Science education outreach/policy internship, 2006)
I attended a hearing in Congress on Wednesday about NSF funding. It was very
interesting, mostly because the representatives are really trying to find a way to pass a
new budget for NSF, doubling its funding to match the doubling of NIH funding. This is
because the technology supporting NIH comes from research supported by NSF. In
addition, NSF supports educators with grants, there is a large concern because the 50% of
the science and math teachers leave after five years to work in industry or research for
double the money. It is hoped that we can remedy this problem by paying teachers more.
The next stage after this hearing is for appropriation of funds, this one merely was
collecting information as to why NSF should receive additional funding. (Eva Wilcox,
Research internship, 2002)
As far as work goes, I've been staying busy on the computer still and we are ever so close
to finishing the paper. The hearing on Capital Hill was interesting too—and boo Mr.
Wyden (D) from Oregon, boo! We don't believe a word you said! As far as the NIST tour
37
went, I was pretty surprised to see so many similarities to NASA (NASA is still better
though, tee hee hee...) Well, it's been a great week, and thanks to everyone for making it
so. (Christine Zaruba, Research intern, 2004)
Ashley and I also talked with Alicia Torres, Director of Media and Government Relations
for AIP. She gave us insight into the interactions between AIP and major media
networks, as well as government. One of AIP's primary media projects at this time are the
Discoveries and Breakthroughs in Science (DBIS) reports; short, broadcast-ready science
news reports that are aired by local news programs and are aimed at increasing the
public's appreciation and awareness of current science. Alicia also showed us some of the
methods used by AIP to get the attention of government. AIP periodically sends
congressmen and senators informational packets about the importance of science and
science education accompanied by conceptually intriguing physics toys. (Stacey
Elizabeth Sude, Science education outreach/policy internship, 2003)
My roommate in college always used to tell me that 80% of learning was done outside
the classroom and I finally know what she meant by it. I'm learning a lot not just about
my project but also about being a scientist and how to find a job and how to be a
professional from the people in my group. I've been learning a lot about real life stuff that
I've never really thought about before. (Kacey Meaker, Research internship, 2006)
Forty percent of interns also described how knowledge and skill gains from their internship
experience transferred to and enhanced their preparation for advance study and workforce entry
(n=8: 5 res., 3 ed. out./pol.; 3 men, 5 women). This set of observations was also 16% of
comments in the “enhanced preparation” category:
Wenyong taught me a lot about what it means to do research in graduate school, and I
learned the crucial importance of finding a good advisor. Wenyong also taught me about
the practical lifestyle difference between theorists and applied physicists, and I studied
the options for my future both in science and in science policy…. This summer I'm
working at Pacific Northwest National Laboratory on the Radiation Portal Monitoring
Project. We develop technical solutions for homeland defense against nuclear weaponry.
It is fascinating work, and I'm enjoying learning about nuclear physics and radiation
detection. The SPS internship was definitely excellent experience that helped prepare me
for this summer's work as well through exposure to real lab experience, helpful advisors,
and glimpses into the world of science policy. As I begin my final year of college, I'm
looking towards taking a little bit of time to travel after graduation before starting
graduate school in security studies or nuclear engineering. (Lindsay Windsor, Research
internship, 2005)
Well, I've made it through the 3rd week and I am still alive!! Matt Shanks and I had our
big CNSF event this past Tuesday June 22, 2004, and it was really exciting and nervewrecking at the same time. I learned that if you don't force yourself to go talk to all of the
important people, they won't come talk to you. That is how it is in many jobs and other
situations. So that is something that I will try to get used to as life goes on for me and I
have to talk to more important people at school, work, and meetings. I talked to the
38
Science Adviser to the President of the US, without knowing it, and it was easier that
way. Although, I wish I would've known before hand so I could have been even more
careful in how I worded things--you know first impressions are everything!! (Heather
Lunn, Science education outreach/policy internship, 2004)
Looking back on my internship experience now that I am back in the crazy flow that is
life at school, it seems that its effects have been even greater than I thought they were
several months ago as the internship ended. I have begun to see the value to AAPT of the
work that I was doing for them…. I learned some valuable skills during my internship-the
most important of which deal with working with other people. I have talked before about
my dislike for working in an office, but honestly I do miss the people and the
environment sometimes.… I will need to learn to adapt better to the politics of the office
environment and culture, but my experience this summer will help to make that transition
easier. The connections that I have made with the people I met and worked with this
summer will continue to be valuable as I finish school and move on to new adventures.
(Matt Hall, Science education outreach/policy internship, 2005)
I applied for several high school teaching positions and was offered all of them, despite
my lack of student teaching experience. I believe my lack of formal experience was offset
by the SOCK curriculum development portion of my internship. (Jason Tabeling, Science
education outreach/policy internship, 2003)
Thirty-five percent of interns (n=7: 4 res., 3 ed. out./pol.; 2 men, 5 women) described
opportunities to see their supervisors as real people with personal lives (these observations were
only 6% of all comments in this category). From these entries, we see that interns were aware of
the ways in which their supervisors juggled family responsibilities and the realities of personal
life:
As far as work went, I started a day late because my scientist, Dr. Fred Herrero, had to
pick his daughter up at the airport on Monday - she had been in Italy for two weeks. But
on Tuesday we hit the ground running!!! (Christine Zaruba, Research internship, 2004)
Sunday was given over to reading a new book and finishing Stephen Hawking's The
Theory of Everything. (Thank you Daddoo!) Tomorrow Justin and Jeff are going to give
the rest of us an afternoon tour of NIST (the National Institute of Standards and
Technology), and my boss will be back in town after spending the weekend both moving
into a new apartment and traveling out of state to see family. (Melissa Hanafee, Science
education outreach/policy internship, 2003)
One of the best things about this summer was the really great role models that I had the
privilege of working with and learning from. They were all such wonderful people who
are really smart and determined, and I learned a lot about how to balance career and
personal life, how to deal with unhelpful people at work, and lots of other practical things
that you don't actually learn in a classroom. (Kacey Meaker, Research internship, 2006)
A smaller number of interns, five, noted opportunities for professional networking and career
development (n=5: 2 res., 3 ed. out./pol.; 2 men, 3 women). These comments were 20% of
39
category observations. Though few in number, these interns clearly appreciated the chance to
connect with and receive help from professionals in the field:
At the NIST picnic this week I met the head of the microelectronics division. He
suggested a bunch of places that I should apply to if I wanted a job in semiconductor
development. I prepared my new resume and will meet with him on Monday, maybe he
knows some bigwigs personally and will be willing to put in a good word for me if I
apply. (Bridger Anderson, Research internship, 2005)
During lunch, I was asked by a man at my table what field of physics most interests me,
and I said that I really liked what I had done this summer, but I was interested in looking
into astrophysics, because I've never taken a course on it, and I wanted to see what it's all
about. The man then handed me his card, and it was Kevin Marvel, the Executive Officer
of American Astronomical Society! So that turned out well. (Alex Brown, Research
internship, 2006)
This was a high-speed week. Following a frenzied bout of effort towards our projects, we
all prepared and presented our work to date as a formal event on Friday. Several people
from each of our projects/institutions were there to cheer us on and help to answer
audience questions, which was quite pleasant. Very profitable in networking terms as
well - I ended up talking with Tony and his boss at NASA about pro's and con's of using
tungsten shielding in the "prototype tricorder" they're making, relaxing a bit with Dr.
David Seiler from NIST (also a Purdue University graduate :-) ), and emailing with Dr.
Theodore Hodapp, Program Director in the Division of Undergraduate Education at NSF.
It makes me nervous just to look back over the list! I wasn't nervous at the time though must have been the business suit. ;-) Later in the afternoon we got to tour the American
Geophysical Union building (Dupont Circle) and meet some of the scientists working
there …We discussed AGU's programs, its online publications, and some of Phillip's
work there, as well as viewed presentations on EarthData (leader in airborne imaging,
mapping and Geographic Information Systems (GIS)) and START (System for Analysis,
Research and Training, which is aimed at coordinating global efforts related to climate
change). (Melissa Hanafee, Science education outreach/policy internship, 2003)
SPS Executive Committee members were present including my advisor, Dr. Earl
Blodgett. I really enjoyed talking with him and the others there, because we were able to
have much more sincere and personal conversations than those at the Coalition for
National Science Funding exhibit had been. (Ann Deml, Science education
outreach/policy internship, 2006)
This category of observations shows a range of benefits from students’ participation in the SPS
Summer Intern Program that enhanced their understanding of professional work contexts and
prepared them for advance study and entry to the workforce. Seeing different work
environments, talking with professionals, learning about what professionals do in their work,
gaining a closer view of professions and professionals’ personal lives, and making connections
with important people in the field were program outcomes valued by SPS interns.
40

Becoming a professional. (n=103, 9% res., 5% ed. out./pol.; 8% men, 8% women)
Similar in number of observations as the “enhanced preparation” category, 8% of interns’
comments were collected in the “becoming a professional” category (see Tables 1 and 2).
Interns’ observations in the “becoming a professional” category were fairly balanced between
two types: 55% of interns’ comments discussed coming to a better understanding of the realities
of working in science research and of developing and conducting science education outreach
activities in the field. The remaining 45% of comments mention the development of attitudes,
traits and behaviors that underpin work as science researchers and science education
outreach/policy professionals (see Tables 15 and 16).
Understanding the realities of professional work
Authentic, applied experiences showed interns the realities of working in science research and
the difficulties of conducting science education outreach activities in practice. Most of interns’
observations in this category show that interns learned that the work can be slow, that there are
difficulties and mistakes with instrumentation and with producing results, that carrying out
science activities with and teaching school-aged children is easier said than done (32%). This
type of observation was found in 65% of interns’ journals (n=13: 7 res., 6 ed. out./pol.; 7 men, 6
women)(see Table 17). Interns’ comments show the ways in which students not only went about
their daily tasks, as noted above in comments comprising the “thinking and working like a
professional” category, but also include additional descriptions of the realities encountered in
actually doing the work—breaking a piece of equipment when learning a new technique,
surmounting difficulties and setbacks, handling the pressure of deadlines, having to plan ahead,
or pick up supplies:
Research has been going well. I've analyzed nearly all the ellipsometry data, and my
results have been forwarded to the sample manufacturer. My photoemission work is slow
going, as the instrument is not cooperating right now. (Alex Brown, Research internship,
2006)
Monday's work was a little more challenging as I was searching for information about
very specific topics and had difficulty finding good results. (Ann Deml, Science
education outreach/policy internship, 2006)
This week we did a lot of research at NIST. We got some good data for our work
functions. Now our SPM is acting up and spitting all sorts of peculiar things at us.
(Bridger Anderson, Research internship, 2005)
In about 2 days I was able to learn how to use the Scanning Probe Microscope. It's pretty
simple once you've run through it a few times. The biggest thing is just being patient with
the $150,000 machine. I take my time so that I don't break anything. I broke a worn down
tip yesterday. I zoomed in too far onto the surface of the material. No problem, new tips
aren't too expensive, but I won't make a habit of breaking them. Today I accurately
scanned a 2x2 micron section of gold. If it wasn't gold, then it was a pretty stationary
speck of dust. (Bridger Anderson, Research internship, 2005)
41
Table 15. PROGRAM OUTCOMES: Observations of “Becoming a professional” by type of
internship.
Type of Observation
Increased understanding of the realities of
professional work—
Science research/science education outreach/
policy work slow going;
Difficulties/mistakes with
instrumentation and producing
results/working with children
Trial and error is necessary in research work
Learning as we go: supervisor and intern feel
way forward Unknown future
Research requires waiting, patience,
perseverance
Understanding that confronting/overcoming
difficulties is part of science
research/science education
outreach/policy work
Sheer bad luck work effects results
Keeping good notes is important
Strange results present a mystery to be
unraveled
Expresses understanding the results must be
repeatable
Subtotal: Understanding realities of professional work
Demonstrated attitudes and behaviors necessary
to professional work—
Going above and beyond, putting in extra
effort
Excitement at prospect of working with real
scientists; excited/enthusiastic about
ensuing internship
Gains personal view of who scientists are as
real people
References increased patience and care with
work tasks
Intern recognizes that different info for
different audiences important in
presentations
Intern is aware/careful to maintain personal
life separate from professional life
Learned to work and THINK independently
Learned importance of balancing personal
and professional life
Describes outreach work as "playtime"
Expresses "feeling like a scientist"
Subtotal: Demonstrated attitudes and behaviors
TOTALS
N of
Obs.
Res.
% of
Obs.
Res.
N of Obs.
Sci. ed.
Out./
policy
% of Obs.
Sci. ed.
Out./
policy
TOTAL
OBS.
%
OBS.
21
30%
12
35%
33
32%
6
2
9%
3%
0
2
0%
6%
6
4
6%
4%
2
3%
2
6%
4
4%
2
3%
2
6%
4
4%
2
1
1
3%
1%
1%
0
1
0
0%
3%
0%
2
2
1
2%
2%
1%
1
1%
0
0%
1
1%
38
55%
19
56%
57
55%
15
22%
2
6%
17
17%
4
6%
8
24%
12
12%
5
7%
2
6%
7
7%
1
1%
2
6%
3
3%
2
3%
0
0%
2
2%
1
1%
0
0%
1
1%
1
1
1%
1%
0
0
0%
0%
1
1
1%
1%
0
1
31
69
0%
1%
45%
100%
1
0
15
34
3%
0%
44%
100%
1
1
46
103
1%
1%
45%
100%
42
Table 16. PROGRAM OUTCOMES: Observations of “Becoming a professional” by gender.
Type of Observation
Increased understanding of the realities of
professional work—
Research/science education outreach/ policy work
slow going; Difficulties/mistakes with
instrumentation and producing
results/working with children
Trial and error is necessary in research work
Learning as we go: supervisor and intern feel way
forward Unknown future
Research requires waiting, patience, perseverance
Understanding that confronting/overcoming
difficulties is part of science research/science
education outreach/policy work
Sheer bad luck work effects results
Keeping good notes is important
Strange results present a mystery to be unraveled
Expresses understanding the results must be
repeatable
Subtotal: Understanding realities of professional work
Demonstrated attitudes and behaviors necessary to
professional work—
Going above and beyond, putting in extra effort
Excitement at prospect of working with real
scientists; excited/enthusiastic about ensuing
internship
Gains personal view of who scientists are as real
people
References increased patience and care with work
tasks
Intern recognizes that different info for different
audiences important in presentations
Intern is aware/careful to maintain personal life
separate from professional life
Learned to work and THINK independently
Learned importance of balancing personal and
professional life
Describes outreach work as "playtime"
Expresses "feeling like a scientist"
Subtotal: Demonstrated attitudes and behaviors
TOTALS
N of
Obs.
Men
% of
Obs.
Men
N of
Obs.
Women
% of
Obs.
Women
TOTAL
OBS.
%
OBS.
18
40%
15
26%
33
32%
2
1
4%
2%
4
3
7%
5%
6
4
6%
4%
2
2
4%
4%
2
2
3%
3%
4
4
4%
4%
1
2
0
0
2%
4%
0%
0%
1
0
1
1
2%
0%
2%
2%
2
2
1
1
2%
2%
1%
1%
28
62%
29
50%
57
55%
7
7
16%
16%
10
5
17%
9%
17
12
17%
12%
1
2%
6
10%
7
7%
1
2%
2
3%
3
3%
0
0%
2
3%
2
2%
1
2%
0
0%
1
1%
0
0
0%
0%
1
1
2%
2%
1
1
1%
1%
0
0
17
45
0%
0%
38%
100%
1
1
29
58
2%
2%
50%
100%
1
1
46
103
1%
1%
45%
100%
43
Table 17. PROGRAM OUTCOMES: Number of interns citing gains in “Becoming a professional” by type of internship and gender.
N of
Research
Interns
N of
Sci ed
outreach/
policy
Interns
% of
Research
Interns
% of
Sci ed
outreach/
policy
Interns
N of
Men
N of
Women
%
of
Men
% of
Women
TOTAL
INTERNS
%
INTERNS
7
6
35%
30%
7
6
35%
30%
13
65%
Trial and error is necessary in research work
Learning as we go Supervisor and intern feel way
forward Unknown future
Research requires waiting, patience, perseverance
4
2
0
1
20%
10%
0%
5%
2
1
2
2
10%
5%
10%
10%
4
3
20%
15%
1
1
5%
5%
1
1
5%
5%
2
10%
Understanding that confronting/overcoming difficulties
is part of science research/science education
outreach/policy work
Sheer bad luck work effects results
Keeping good notes is important
Strange results present a mystery to be unraveled
2
2
10%
10%
2
2
10%
10%
4
20%
2
1
1
0
1
0
10%
5%
5%
0%
5%
0%
1
2
0
1
0
1
5%
10%
0%
5%
0%
5%
2
2
1
10%
10%
5%
Expresses understanding the results must be repeatable
1
0
5%
0%
0
1
0%
5%
1
5%
2
7
10%
35%
5
4
25%
20%
9
45%
5
3
1
2
2
2
2
0
25%
15%
5%
10%
10%
10%
10%
0%
4
1
1
0
3
4
2
2
20%
5%
5%
0%
15%
20%
10%
10%
7
5
3
2
35%
25%
15%
10%
1
0
5%
0%
1
0
5%
0%
1
5%
1
1
0
0
5%
5%
0%
0%
0
0
1
1
0%
0%
5%
5%
1
1
5%
5%
0
1
1
0
0%
5%
5%
0%
0
0
1
1
0%
0%
5%
5%
1
1
5%
5%
Type of Observation
Increased understanding of the realities of professional
work—
Research/policy/education outreach work slow going;
Difficulties/mistakes with instrumentation and
producing results/working with children
Demonstrated attitudes and behaviors necessary to
professional work—
Excitement at prospect of working with real scientists;
excited/enthusiastic about ensuing internship
Going above and beyond, putting in extra effort
Gains personal view of who scientists are as real people
References increased patience and care with work tasks
Intern recognizes that different info for different
audiences important in presentations
Intern is aware/careful to maintain personal life
separate from professional life
Learned to work and THINK independently
Learned importance of balancing personal and
professional life
Describes outreach work as "playtime"
Expresses "feeling like a scientist"
44
A Bad Week for the Microprobe. The low temperature microprobe was doing great until
last Thursday morning. The vertical axis of one of the probes broke. This meant that the
whole probe socket had to be taken out of the vacuum apparatus. John (one of my
advisors) and I ended up swapping around components of probes to make two
functioning low temperature microprobes to work with. (Joseph York, Research
internship 2004)
This week I started by running force field and semi-empirical calculations with just the
cyclodextrins with some amino acids attached on. I also absconded with a three-button
mouse, because I need a middle button to rotate my molecules. I was having a lot of
problems with my semi-empirical ones. They kept failing and giving me really weird
output messages. I spent almost three whole days doing and redoing them and trying to
get them to work. Finally they started working yesterday afternoon at 4. So I was
frantically trying to get them all exported and into Altix before I had to leave at 5:30. It
was such a great feeling to finally be getting them done. I was feeling really frustrated
and upset about my research, but then I figured it out all by myself (well mostly). And so
research is going pretty well right now. Today I'm going to meet with Jayne and go over
the first set of results and then hopefully start on another set of calculations. (Kacey
Meaker, Research internship, 2006)
I learned a lesson myself on Monday. Some time during the course of the scavenger hunt,
a red laser went missing. (Thankfully, it wasn't the pricy green one.) I was inclined to
avoid dealing with the incident, but this response didn't seem adequate. Though the red
laser is not an expensive or rare item, I felt I needed to make a statement about the
unfortunate event to the students. I had to figure out a way to convey the importance of
respecting other people's property without inadvertently accusing any number of innocent
bystanders. Bridget and I decided to conduct an anonymous group survey, in which each
student was to write down anything she knew about the disappearance of the laser on a
scrap paper and hand it in to us. We told everyone that we would like to see the laser
returned, but that we would not hold anything against anyone with information.
Unfortunately, the survey was not fruitful, but I think we made a point, which I now
recognize is the most significant goal of the disciplinary action. I am learning more every
day about teaching and handling students in this age group. (Stacey Elizabeth Sude,
Science education outreach/policy internship, 2003)
Yesterday I made about 8,000 copies for my summer camp and it was nerve wrecking to
make sure every thing was ready for 12:30--and it was! Boy, those girls sure have a
bunch of energy!! Some of them have already started building their roller coasters
because they were so excited. Others sorted the K'nex from last year because all the
pieces were mixed together. The 4th week has been stressful because I felt like I had 5
separate things to do and they all needed to be done NOW. (Heather Lunn, Science
education outreach/policy internship, 2004)
Yom Chameeshee—Because the equipment for taking new data was in use, we used
Thursday to prepare a different sample for measurement. Having learned my way around
the clean room (in theory, anyway, for the exam), it was interesting to go back to spin
polymer and use the evaporator and UV oxide cleaner again. This time, I knew what the
45
instruments were for, what I was doing and why, and could notice all the tubs of HF
sitting around on the counters nearby. I also discovered that one of the chemicals I
ordered was supposed to appear at the airport at 3 PM that day, but the company had
neglected to inform me that I was responsible for going to pick it up. Hence, Friday
morning’s errand I would much rather be taking measurements, but there was no way to
get around it. (Lindsay Windsor, Research internship, 2005)
Along with confronting difficulties in accomplishing their work, some interns noted growing
awareness that this type of work required particular temperamental attributes, including patience
and perseverance:
This week was definitely a test of patience. I found out why people with computer
dependent jobs often curse the machine's fickle nature. While creating my website, I ran
across numerous problems with the design program. After many long hours, I was finally
able to improvise around the problem and get back to where I started. (Jason Tabeling,
Science education outreach/policy internship, 2003)
Thursday is where my patience with the children was truly tried. Thursday was an all day
field trip to a minor league baseball game. Let me tell you, taking kids in a van and
getting them all relatively happy is not the easiest thing. Then we got to the game and all
they seemed to do was complain about the heat. In the end we took them back early and
let them hang out until their parents picked them up. (Matthew Shanks, Science education
outreach/policy internship, 2004)
The summer has finally settled into a routine and the project is really starting to come
together. The week was primarily spent debugging, documenting, and refining the
program. The debugging itself is painfully slow, due to the fact that I can only tell if the
calculations are correct at any particular step of the simulation by comparing the output
of both implementations as they run side-by-side. However, many minor issues have been
resolved and watching the new code run through its paces is very satisfying. (Justin
Stimatze, Research internship, 2003)
Small numbers of observations and actual numbers of interns (refer to Tables 15, 16, and 17)
documented other types of gains associated with increased understanding of professional
practice, including understanding that: trial and error is necessary, results must be repeatable and
that sheer bad luck may affect results. There is “no easy way” to do this work:
I worked a whopping 3 days at NIST this weekend. We finally found the secrets to
recording good data and getting stable readings on the SKPM. Flatten all saved data
before jpeg exporting. Don't allow the SKPM tip holder to be overlapping the copper
tape. The tape and tip holder weren't touching, but they were close enough were we were
seeing effects of small amounts of current (we shouldn't have had any current flowing).
Aaron and I got Friday off for our hard work and accomplishments. I finally have the
surgical precision required to mount and un-mount tips without killing them. The tip
survival rate is up from about 50% to 90%. I haven't killed any tips in days. (Bridger
Anderson, Research internship, 2005)
46
This week, I got the hang of running the equipment: I didn't break or drop a single thing!
We have improved the way we do the repeatability measurements, so that more factors
are held constant than we used to. Now we keep track of the humidity and temperature, as
well as use a very stable sample: stable because it has been open to the air for a very long
time so the oxide layer has stopped growing. (Eva Wilcox, Research internship, 2002)
This week I spent a few days looking through the data and clearing out certain dates with
obvious problems. At times major solar events or other phenomenon increased the count
rate in the detectors by several orders of magnitude. It was sheer bad luck that NEAR was
in orbit at the peak of the Sun's active cycle. Nevertheless, there still appears to be a large
amount of data that is usable and plans are to finish cleaning the spectra by next week.
(Brent Janus, Research internship, 2002)
Well that s about all I did this week. Now what I learned this week was pretty simple.
There is no easy way to teach. It seems like teaching has to adapt and be flexible for
whoever you are teaching. That’s really about it. (Matthew Shanks, Science education
outreach/policy internship, 2004)
This set of observations demonstrates interns’ active engagement in authentic work contexts and
the opportunity it provided for understanding what working in the field was actually like as a
professional. Beyond gains in understanding the nature of work in their field, interns recognized
that this work required patience and perseverance, and further demonstrated understanding of
professional work norms and practice.
Demonstrated attitudes and behaviors necessary to professional work
A second subset of observations grouped in the “becoming a professional” category described
attitudes and behaviors necessary to becoming professionals in the field. Most of these
observations (17%) expressed sincere curiosity, interest in, enthusiasm for and excitement at the
prospect of their internship and working with respected professionals. Such comments were
recorded by nearly half the interns (45%, n=9: 2 res., 7 ed. out./pol.; 5 men, 4 women):
When I got to the university, I was quite curious to see some of the demonstration tools
that I had either read about or seen pictures of on the extensive website. In my searching
for Dr. Berg, I found myself in a basement with rooms full of what looked like physics
experiments that had been left standing. There were bicycle rims fixed to swivel stands
that are used to teach about conservation of momentum, ballistic chambers that are used
to teach about many different physical concepts, electron beam setups that are used to
teach about the quantum nature of matter and many, many more. These enormous rooms
were filled with such setups. They were organized and appeared to be in extremely good
working order (I couldn't stop myself from trying out a few of them!). My immediate
thought when I saw all of this was, "Wow, this must have taken quite a bit of time and a
lot of work!" But to think that this extensive collection was constantly being used! (Mark
Lentz, Science education outreach/policy internship, 2001)
While the supercomputers and control centers were a fantasy, the accomplishments that
the organization has achieved are very real. My disappointment turned to excitement as I
began talking with my advisors, a group of highly skilled veterans of NASA more than
willing to share their time and knowledge with an undergraduate. All that was required to
47
be excited about an old PC and a bunch of physicists was to realize that this was how it
worked. These guys had been on the inside of many of the unmanned missions
throughout the Solar System for the last several decades. This was exciting in itself, but
nothing was as thrilling as realizing that for the next eight weeks, I would be one of them.
(Brent Janus, Research internship, (2002)
Overall, the internship is off to a very active and exciting start. I feel privileged to work
in such a beautiful, comfortable building at ACP and to be amongst so many interesting
and caring people. I have never been exposed to the mechanisms of the science,
education, and policy worlds in such an intimate and mentored way. (Stacey Elizabeth
Sude, Science education outreach/policy internship, 2003)
Another 12% of observations in this subcategory spoke of interns’ exhibiting extra effort and
intellectual engagement—going above and beyond assigned responsibilities, especially in terms
of educating themselves on the project and in preparing for presentations. These comments were
recorded by 35% of interns (n=7: 5 res., 2 ed. out./pol.; 4 men, 3 women):
I am currently finishing the very last of the single base pair calculations, and Maestro
started working again so I can start testing bigger molecules on Amber. I've been reading
and working through this book called Teach Yourself Unix in a Week, so I'm learning
stuff about it and how cool it actually is. Oh no I'm turning into a Unix nerd. The world
might come to an end, but it is rather fun to use now. I'm also still reading books and
papers about DNA and computational chemistry. The NIST library is really cool. There
are so many awesome books about such cool things, but it makes me sad because I want
to read all the books about everything, but that's sort of impossible. Yesterday I went with
Alex to the library and got two new books for fun. One is a Richard Dawkins book that I
have been meaning to read for a while, and the other is a book about controversies in
biology. (Kacey Meaker, Research internship, 2006)
My project is turning out to be really interesting. The solar corona is amazing! For
instance, did you know that (in white light) it is one hundred times brighter at the solar
limb than just one solar radius out? And its radiation is layered with four different
coronae. The K-corona (K for something German that looks like "continuous") is the
light scattered off electrons, while the F-corona (F for our buddy Fraunhofer) is the light
scattered off dust particles. While the K-corona dominates near the sun, beyond two solar
radii they are equally matched in brightness. The other, less powerful contributions are
the E-corona (E for emission) and T-corona (T for thermal). Texts on the solar corona try
and get rid of the F to study the K, but it's the F-corona that I'm interested in! So I've been
reading lots of papers on interplanetary dust instead. My goal is to have a paper
summarizing what is known about the population of dust grains at about three solar radii.
And the project is allowing me to learn both about the sun and about dust, two topics I
had never studied in much detail before. So things are going well, assuming I can stop
panicking about how much I have left to do! (Oh, that's right, I'm NOT panicking. I
forgot.) (Kathryn Peak, Research internship, 2002)
48
I get to take cool measurements with fun toys, and the subject is so interesting that I
started reading a textbook in my free time—who would have thought? I had a brilliant
insight over the weekend that Mika s old chem textbook was still sitting around her dorm,
and it could be exactly what I needed to clear up a bunch of lingering questions for me
before I gave a presentation for the NIST group on Wednesday. Mika generously donated
to my cause (more happy to get rid of it than anything else, I think), and I proceeded to
read the entire textbook Monday and Tuesday. Much of the book was physics I already
knew or chemistry I recognized from high school, but the new information was
EXACTLY what I needed to know and hence fascinating to study. (Lindsay Windsor,
Research internship, 2005)
I spent most of the week at work creating physics trivia questions and finding more
information about where to buy time capsules. It's tough to think of good questions. I'm
thinking about going to museums to wander around looking for inspiration. If anyone has
any ideas, I'd love to hear them…Thursday was easily one of the most exciting and
interesting days so far. We had the opportunity to go to a constituent breakfast for Dianne
Feinstein, one of the senators from California. She spoke a bit and introduced her staff
and interns. We were a little disappointed with some of what she had to say. This has
sparked our interest in going to as many other events like this as we can. We started
researching our other senators and hope to visit more of them. (Matt Hall, Science
education outreach/policy internship, 2005)
Small numbers of observations and actual numbers of interns discussed other types of attitudes
and gains important to practicing the profession (refer to Tables 15, 16, and 17). The balance of
observations demonstrating attitudes and behaviors requisite to professional practice discussed
demonstrated gains in interns’ tolerance, patience and perseverance, their ability to think
creatively and to work through problems independently, exhibiting extra diligence and care with
work tasks and techniques, and showing greater intrinsic interest in their field. The following
quotations are representative of these types of observations:
One of the biggest things I have learned so far is that I may feel competently
overwhelmed with tons to do, but haste makes waste, and if you only want to do it once,
take your time. Fortunately, I learned this the easy way! :) (Heather Lunn, Science
education outreach/policy internship, 2004)
As far as at work goes, the microprobe station is just not functioning as well as we'd like
it to right now. We're doing everything we can to get it down and running so that I can
take several measurements before leaving. I might not get them done in time for our
presentations on the 27th, but that is not discouraging me from keeping at the station.
(Joseph York, Research internship, 2004)
Then there was pizza for lunch which really made my day. Then it came time for me to
go to the summer camp. I was honestly dreading seeing those kids again. However, I
steeled myself and threw myself into the tempest and was pleasantly surprised. Today the
children were energetic and bouncy and chaotic but they were all doing pretty much what
they were supposed to and being good sports about it. That made me happy. (Matthew
Shanks Science education outreach/policy internship, 2004)
49
This summer I also learned to do a lot of independent work and how to figure a lot of
things out by myself. (Kacey Meaker, Research internship, 2006)
I've also enjoyed being at NASA this summer, I must say. I've decided that I enjoy
spending my summers at places where all people do is research. It's such a different
atmosphere than school, being somewhere that only has students around for two months
of the year instead of nine. Walking past offices and overhearing conversations on all
aspects of earth and space science always warms the heart. (Kathryn Peek, Research
internship, 2002)
One intern commented that he had learned about professional norms and how to handle himself
professionally:
THE journey has come to a STOP. As they say, for every beginning there is an END and
thus this would be my last journal entry. It has been a great battle, a surmountable one at
that. I have had such a great time in the corporate world and the memories would surely
stick with me forever. I have learned the essence of accomplishing tasks in a manner
endowed with professionalism and efficiency. (Kibrom Tewolde, Science education
outreach/policy internship, 2004)
Reflected by a peer’s observation, one intern noted a sense of actually feeling like a scientist:
With Monday came proof in two forms that my job is awesome. .. Finally taking
measurements on the device we fabricated! The results seemed to show a new discovery
about the polymer we tested. In Morgan's words to me later that night, “You're a real
scientist!” (Lindsay Windsor, Research internship, 2005)
Intern comments collected in the “becoming a professional” category conveyed (in almost equal
measures) increased understanding of the nature of professional work and the demonstration and
development of attitudes and behaviors viewed as character traits necessary for professional
work in the field.
Remaining intern observations on program outcomes are very small in number. Comments
concerning gains in skills were 2% of gains observations. The “career clarification and
confirmation” category was 1% all intern comments. Two comments were offered concerning
the transfer of knowledge between the internship and future coursework (see Tables 1 and 2).

Skills. (n=25, 2% res., 1% ed. out./pol.; 2% men, 2% women)
Participants’ few comments in the “skills” category include interns’ observations on gains in:
working with various computer software programs (48%) reported by 35% of interns (n=7: 5
res., 2 ed. out./pol.; 4 men, 3 women). Aside from developing skills in working with computer
software, interns also reported learning to operate lab instruments (20% of observations) reported
by 20% of interns (n=4: 3 res., 1 ed. out./pol.; 2 men, 2 women)(see Tables 18, 19, and 20). Two
men, both in research internships, mentioned working with newly developed software
50
Table 18. PROGRAM OUTCOMES: Observations on gains in skills by type of internship.
N of
% of
Obs.
Obs.
Type of Observation
N of % of Sci. ed. Sci. ed.
Obs. Obs.
Out./
Out./ TOTAL
%
Res.
Res.
policy
policy
OBS.
OBS.
Working with computer software programs
Working with new instrumentation
8
4
44%
22%
4
1
57%
14%
12
5
48%
20%
Learning new techniques
Working with new software program developed
for analysis of data
Web development skills
3
17%
0
0%
3
12%
2
0
11%
0%
0
2
0%
29%
2
2
8%
8%
Answered difficult questions after presenting
1
6%
0
0%
1
4%
TOTALS
18
100%
7
100%
25
100%
Table 19. PROGRAM OUTCOMES: Observations on gains in skills by gender.
N of
Obs.
Men
% of
Obs.
Men
N of
Obs.
Women
% of
Obs.
Women
TOTAL
OBS.
%
OBS.
Working with computer software programs
Working with new instrumentation
Learning new techniques
Working with new software program developed
for analysis of data
Web development skills
Answered difficult questions after presenting
4
2
1
44%
22%
11%
8
3
2
50%
19%
13%
12
5
3
48%
20%
12%
2
0
0
22%
0%
0%
0
2
1
0%
13%
6%
2
2
1
8%
8%
4%
TOTALS
9
100%
16
100%
25
100%
Type of Observation
51
Table 20. PROGRAM OUTCOMES: Number of interns citing gains in skills by type of internship and gender.
N of
Research
Interns
N of
Sci ed
outreach/
policy
Interns
% of
Research
Interns
% of
Sci ed
outreach/
policy
Interns
N of
Men
N of
Women
% of
Men
% of
Women
TOTAL
INTERNS
%
INTERNS
Working with computer software
programs
4
3
20%
15%
4
3
20%
15%
7
35%
Working with new instrumentation
3
1
15%
5%
2
2
10%
10%
4
20%
Learning new techniques
Working with new software program
developed for analysis of data
2
0
10%
0%
1
1
5%
5%
2
10%
2
0
10%
0%
2
0
10%
0%
2
10%
Web development skills
Answered difficult questions after
presenting
0
2
0%
10%
0
2
0%
10%
2
10%
1
0
5%
0%
0
1
0%
5%
1
5%
Type of Observation
52
specifically designed for research purposes. Learning webpage development was a benefit
reported by two women in science education outreach/policy internships:
Anyway it was busy busy busy last week. I made about a million different charts and
plots and runs on Simion and Kaleidagraph. I know Kaleidagraph sounds all fun and
whiz poppy, like kaleidoscope, but don't be fooled. It's not quite as much fun... It's pretty
easy to use though, so that's good. I like it better than having to use Excel to make the
graphs. It's alright that I've had to make so many though because we are gonna use them
for a big long paper that we are writing up, so it's not like I'm just doing them for busy
work, I'm just anxious to get to the soldering and stuff on the actual detector. (Christine
Zaruba, Research internship, 2004)
The online research to order the materials got tedious, but today I got to play with the lab
equipment for the first time. It's really expensive and pretty technical stuff, but I got it to
work quite well and had a huge sense of accomplishment =) I've always thought that life
in a lab would be so removed from humanity that it wouldn't be terribly interesting, but
I'm surprised by how much it excites me and captures my interest. I can't wait to see the
results of the experiment - and even if nothing terribly exciting happens, the process will
still be interesting and worthwhile. (Lindsay Windsor, Research internship, 2005)
I worked a whopping 3 days at NIST this weekend. We finally found the secrets to
recording good data and getting stable readings on the SKPM. Flatten all saved data
before jpeg exporting. Don't allow the SKPM tip holder to be overlapping the copper
tape. The tape and tip holder weren't touching, but they were close enough were we were
seeing effects of small amounts of current (we shouldn't have had any current flowing).
Aaron and I got Friday off for our hard work and accomplishments. I finally have the
surgical precision required to mount and un-mount tips without killing them. The tip
survival rate is up from about 50% to 90%. I haven't killed any tips in days. (Bridger
Anderson, Research internship, 2005).
Around Friday I had finished and had finally produced my first spectrum. The rest of the
spectra will probably be finished early next week. The programs that will be used to
analyze them for elemental composition are being constructed here at NASA. Interactive
Data Language (IDL) is the platform being used to construct the programs. As they are
not finished quite yet I will probably take a few days to work with IDL and the main
programmer and then start my analysis late next week. I'll let you know. (Brent Janus,
Research internship, 2002).
I learned/am learning Dream Weaver, and am making my first web pages for the
questionnaire submission form. (Yes, my first web pages. I take another (tiny) step
towards true geekdom.) (Melissa Hanafee, Science education outreach/policy internship,
2003)
Skills gains predominantly described gains in working with computer software and programs
designed for their research or in webpage development.
53

Career clarification. (n=14, 9% res., 5% ed. out./pol.; 8% men, 8% women)
This small category of gains includes participants’ observations on program outcomes associated
with helping interns as students to: discover an increased interest in science (29% of comments)
recorded by 15% of interns (n=3: 3 res., 0 ed. out./pol.; 1 men, 2 women); realize how much they
“loved” doing science research (29%) recorded by two interns (10%), both of whom were
women (n=2: 2 res., 0 ed. out./pol.; 0 men, 2 women). Very small numbers of observations and
actual numbers of interns discussed confirming and solidifying their interest in a field of study,
being introduced a new area of interest, or clarifying a field of study. (See Tables 21, 22, and
23):
I am teaching physics to eighth-graders and it is really fun. They began building their
roller coasters this week and they are really excited to get them done. They had a bit of
trouble with the friction issue, but most of them tried different angles and heights of the
hills to compensate for friction and at least 4 groups got their cars to go through most of
the track they had built!! They were screaming and yelling and jumping up and down
because they were so happy! (Heather Lunn, Science education outreach/policy
internship, 2004)
The afternoon was spent at the American Geophysical Union, learning more about the
AGU and the other organizations housed within the building. A presentation I found
particularly interesting was given by a representative of EarthData Inc. One of the topics
covered was the use of rapidly acquired GIS data in the recovery and rescue efforts after
the September 11 attack. The ability to quickly deliver critical data to ground teams
within a matter of hours will be an increasingly powerful tool in other catastrophic
situations and the company is on the cutting edge of technological innovation in the field.
This application of physics, geoscience, and technology really appeals to me and I think I
may have to learn more about the subject when I return home. (Justin Stimatze, Research
internship, 2003)
I suppose I should reflect on my summer a little bit as this is my last journal entry. I
learned so much this summer I don't even know where to start. I learned some Unix and a
lot of computer programs, and I also learned a lot of biology and chemistry and even
some physics. But I also learned a lot more important stuff. I finally realized how much I
love research. I guess I sort of knew that before, but I guess I just realized how much I
truly love it. I loved going to work and reading papers and looking stuff up and putting
things together in a certain way that no one else has thought of before. (Kacey Meaker,
Research internship, 2006)
Working at NIST this summer, I discovered that I really enjoyed doing research, much
more than I thought I would. I quickly realized that I much prefer experimental rather
than theoretical physics. Because I love to learn and be challenged, experimenting this
summer allowed me to continually stretch myself in studying, learning, and discovering
new things. (Lindsay Windsor, Research internship, 2005)
54
Table 21. PROGRAM OUTCOMES: Observations on gains in career clarification by type of
internship.
N of
% of
Obs.
Obs.
Type of Observation
N of
% of
Sci. ed. Sci. ed.
Obs.
Obs.
Out./
Out./ TOTAL
%
Res.
Res.
policy
policy
OBS.
OBS.
Increased interest in science, generally
4
31%
0
0%
4
29%
Opportunity to discover I LOVE research!
4
31%
0
0%
4
29%
3
23%
0
0%
3
21%
1
8%
0
0%
1
7%
1
8%
0
0%
1
7%
0
0%
1
100%
1
7%
13
100%
1
100%
14
100%
SPS interns offered jobs at place of
internship
Likes research, but AFFIRMS interest in
TEACHING
Clarified area of interest, field of study to
pursue
Considering new career ideas: web
development
TOTALS
Table 22. PROGRAM OUTCOMES: Observations on gains in career clarification by gender.
N of
Obs.
Men
% of
Obs.
Men
N of
Obs.
Women
% of
Obs.
Women
TOTAL
OBS.
%
OBS.
Increased interest in science, generally
1
50%
3
25%
4
29%
Opportunity to discover I LOVE research!
0
0%
4
33%
4
29%
SPS interns offered jobs at place of
internship
Likes research, but AFFIRMS interest in
TEACHING
Clarified area of interest, field of study to
pursue
Considering new career ideas: web
development
0
0%
3
25%
3
21%
0
0%
1
8%
1
7%
0
0%
1
8%
1
7%
1
50%
0
0%
1
7%
TOTALS
2
100%
12
100%
14
100%
Type of Observation
55
Table 23. PROGRAM OUTCOMES: Number of interns citing gains in career clarification by type of internship and gender.
Type of Observation
N of
% of
Sci ed
Sci ed
N of
outreach/
% of
outreach/
Research policy Research policy
Interns
Interns
Interns
Interns
N of
Men
N of
Women
% of
Men
% of
Women
TOTAL
%
INTERNS INTERNS
Increased interest in science, generally
3
0
15%
0%
1
2
5%
10%
3
15%
Opportunity to discover I LOVE
research!
2
0
10%
0%
0
2
0%
10%
2
10%
SPS interns offered jobs at place of
internship
1
0
5%
0%
0
1
0%
5%
1
5%
Likes research, but AFFIRMS interest
in TEACHING
1
0
5%
0%
0
1
0%
5%
1
5%
Clarified area of interest, field of study
to pursue
1
0
5%
0%
0
1
0%
5%
1
5%
Considering new career ideas: web
development
0
1
0%
5%
1
0
5%
0%
1
5%
56
Walking past offices and overhearing conversations on all aspects of earth and space
science always warms the heart. I love teaching too much to work at a research institution
for forever, but they do make wonderful internship experiences. (Kathryn Peak, Research
internship, 2002)
Ironically, I am now giving more consideration to a career which will probably put me in
an office (working on web design and development). (Matt Hall, Science education
outreach/policy internship, 2005)
Though few in number, a small number of interns registered gains in: an increased interest in
their fields of study; discovering a real passion for the profession of science research; and
benefits of confirming, clarifying and focusing pre-existing interests and career ideas.

Enhanced educational experience. (n=2: 1 res., 1 ed. out./pol.; 1 men, 1 women)
A couple of interns (10%) mentioned that learning taken from their internship experience would
benefit their future coursework (see Tables, 24, 25 and 26):
This week I've also been thinking about all the pros and cons of going to a large research
university. I go to a school which has state-of-the-art laboratories, professors whose
research gets published on the front pages of magazines like Physics Today or Nature,
incredible funding, and outstanding capabilities. I also go to a school where the
professors aren't there to teach and where it's easy to overlook all these possibilities and
get lost in the crowd. I've been inspired this summer to go back to college and take
advantage of all the resources at school - especially the labs and the connections I have
here to the outstanding researchers there - and I've also been inspired to see how I can
search out the encouragement and investment of our faculty as support for wherever I
head next in my academic or professional life. (Lindsay Windsor, Research internship,
2005)
It's time to close with some thank you’s to SPS, AAPT, Carol, Dr. Hein, Liz, Gary, Jack
and everyone else who helped me this summer. It really has been a great experience.
Thanks also to anyone who took the time to read about what I've been up to all summer.
DC is a fun place to be. I hope to come back someday. Now it's time to take the things
I've learned and head home to use them. (Matt Hall, Science education outreach/policy
internship, 2005)
Table 24. PROGRAM OUTCOMES: Observations on enhanced educational experience by type
of internship.
N of Obs. % of Obs.
Type of Observation
Sci. ed.
Sci. ed.
N of
% of
Out./
Out./
TOTAL
%
Obs. Res. Obs. Res.
policy
policy
OBS.
OBS.
Skills/knowledge gained during
internship will transfer to future
coursework
1
100%
57
1
100%
2
100%
Table 25. PROGRAM OUTCOMES: Observations on enhanced educational experience by
gender.
Type of Observation
Skills/knowledge gained during
internship will transfer to future
coursework
N of
Obs. Men
% of
Obs. Men
N of Obs.
Women
1
100%
1
% of Obs. TOTAL
Women
OBS.
100%
2
%
OBS.
100%
Table 26. PROGRAM OUTCOMES: Number of interns citing gains in enhanced educational
experience by type of internship and gender.
Type of
Observation
Skills/knowledge
gained
during
internship
will transfer
to future
coursework
N of
% of
Sci ed
Sci ed
N of outreach/ % of outreach/
Research policy Research policy N of N of
% of
Interns Interns Interns Interns Men Women Men
1
1
5%
5%
1
1
5%
% of
TOTAL
%
Women INTERNS INTERNS
5%
2
10%
In summary, nearly 70% of interns’ observations described program outcomes encompassing a
broad range and variety of personal, intellectual and professional benefits. Interns’ observations
of program outcomes related gains in: personal growth, personal-professional gains directly
related to their engagement at their internship; increased understanding of how science research
and science education outreach/policy work is actually done, and other intellectual gains;
enhanced understanding of professional work contexts and preparation for advance study and/or
entry to the workforce; increased understanding of the nature of professional work, norms and
practice, as well as the demonstration and development of attitudes, traits and behaviors that
underpin work as science researchers and science education outreach/policy professionals. Few
numbers of observations and interns also reported gains in skills, career clarification and
confirmation or enhanced educational experience. Collectively, interns report program outcomes
demonstrating multiple dimensions of students’ learning from SPS Summer Intern Program
participation.
58
General Observations
Following a majority of observations reporting program outcomes, a remaining 33% of intern
observations were grouped as general observations. The majority of comments in this category
described general elements comprising internship experiences (18%), followed by intern
program evaluations (10%) (see Tables 1 and 2).

SPS general internship elements. (n=250, 18% res., 18% ed. out./pol.; 20% men, 17%
women)
The largest percentage of comments in the grouped in “general observations” provided
descriptions of general internship elements (32%, see Tables 27 and 28). While these structural
elements are embedded in intern accounts describing program outcomes, as discussed above,
here they are counted in terms of reports of basic program elements.
From their accounts, it is patent that interns are participating in authentic work in which they had
the opportunity to integrate academic knowledge with field applications. Ninety-five percent of
interns (n=19: 9 res., 10 ed. out./pol.; 10 men, 9 women) offered clear descriptions of their
active engagement in their projects:
I have been learning how to do many things and of course this entails making many
mistakes. I threw an optic for a mirror out of alignment so my advisor took the
opportunity to redesign the optic entirely. I then turned to data analyzation and modeling
of thin film samples to determine such things as thicknesses of Hafnium dioxides and
optical constants like the dielectric function of Hafnium dioxide, and hit many program
glitches. By today, however, I am back taking data again and running the system almost
on my own (I naturally am still making some really blatant mistakes) and analyzing the
repeatability of the Spectroscopic Ellisometry system, compared to the commercial
vacuum ultraviolet system in the next lab over. (Eva Wilcox, Research internship, 2002)
I have learned that PhysTEC is a program to improve our teachers by improving our
students and building out from there. It seems like a wonderful program, especially for
those of us who have had a baaaaad teacher or prof. I have also learned a bit about
comPADRE and that is going to be an awesome project when it is expanded even more.
It is so great to have a resource like that that helps teachers, students, and the general
public with physics and astronomy. Very exciting! I also learned about the demos I will
be doing at the summer camps--very cool! I will be putting a pencil through a piece of
plywood, looking at stuff in a vacuum, and doing the 'ol pull the table cloth out from
under the plates and wine glasses! Well, I have very exciting and busy weeks ahead,
that's all for now folks! (Heather Lunn, Science education outreach/policy internship,
2004)
The realities of software development asserted themselves with a vengeance on Monday
morning, with one final logic error that had to be removed. Fortunately, I found it quickly
and spent Tuesday and Wednesday running the simulator through a set of well-defined
59
Table 27. GENERAL: Observations of SPS general internship elements by type of internship.
N of
Obs.
Res.
% of
Obs.
Res.
N of Obs.
Sci. ed.
Out./
policy
% of
Obs. Sci.
ed. Out./
policy
TOTAL
OBS.
%
OBS.
Describes policy outreach work tasks:
hands-on work
39
29%
42
37%
81
32%
Group SPS professional field trips
meetings
34
25%
26
23%
60
24%
Discusses purpose of research
outreach work: expresses
understanding
19
14%
12
10%
31
12%
Time preparing poster for presentation
11
8%
8
7%
19
8%
Gives presentation to internship group
10
7%
3
3%
13
5%
Gives presentation to SPS intern
group
Attended congressional hearing on
NSF budget/stem cell research:
how science is funded/argued
9
7%
3
3%
12
5%
3
2%
8
7%
11
4%
Attended orientation session at
beginning of summer
4
3%
4
3%
8
3%
AIP representative to CNSF
0
0%
5
4%
5
2%
Attended safety training meetings
4
3%
0
0%
4
2%
Attended informational meetings
1
1%
2
2%
3
1%
Attending conferences: Mortarboard
Society, AAPT
1
1%
2
2%
3
1%
135
100%
115
100%
250
100%
Type of Observation
TOTALS
60
Table 28. GENERAL: Observations of SPS general internship elements by gender.
N of
Obs.
Men
% of
Obs.
Men
Describes policy outreach work tasks:
hands-on work
Group SPS professional field trips
meetings
46
38%
35
27%
81
32%
28
23%
32
25%
60
24%
Discusses purpose of research outreach
work: expresses understanding
11
9%
20
16%
31
12%
Time preparing poster for presentation
9
7%
10
8%
19
8%
Gives presentation to internship group
5
4%
8
6%
13
5%
Gives presentation to SPS intern group
9
7%
3
2%
12
5%
Attended congressional hearing on NSF
budget/stem cell research: how
science is funded/argued
5
4%
6
5%
11
4%
Attended orientation session at
beginning of summer
4
3%
4
3%
8
3%
AIP representative to CNSF
1
1%
4
3%
5
2%
Attended safety training meetings
1
1%
3
2%
4
2%
Attended informational meetings
Attending conferences: Mortarboard
Society, AAPT
2
1
2%
1%
1
2
1%
2%
3
3
1%
1%
122
100%
128
100%
250
100%
Type of Observation
TOTALS
61
N of
% of
Obs.
Obs.
TOTAL
Women Women
OBS.
%
OBS.
Table 29. GENERAL: Number of interns citing SPS general internship elements by type of internship and gender.
Type of Observation
Describes policy outreach work
tasks: hands-on work
Group SPS professional field
trips meetings
Discusses purpose of research
outreach work: expresses
understanding
Time preparing poster for
presentation
Gives presentation to internship
group
Gives presentation to SPS intern
group
Attended congressional hearing
on NSF budget/stem cell
research: how science is
funded/argued
Attended orientation session at
beginning of summer
AIP representative to CNSF
Attended safety training
meetings
Attended informational meetings
Attending conferences:
Mortarboard Society,
AAPT
N of
Research
Interns
N of
Sci ed
outreach/
policy
Interns
% of
Research
Interns
% of
Sci ed
outreach/
policy
Interns
N of
Men
N of
Women
% of
Men
% of
Women
TOTAL
INTERNS
%
INTERNS
9
10
45%
50%
10
9
50%
45%
19
95%
10
10
50%
50%
10
10
50%
50%
20
100%
8
7
40%
35%
7
8
35%
40%
15
75%
5
5
25%
25%
5
5
25%
25%
10
50%
5
3
25%
15%
5
3
25%
15%
8
40%
7
3
35%
15%
5
5
25%
25%
10
50%
3
6
15%
30%
3
6
15%
30%
9
45%
4
4
20%
20%
4
4
20%
20%
8
40%
0
3
5
0
0%
15%
25%
0%
1
1
4
2
5%
5%
20%
10%
5
3
25%
15%
1
2
5%
10%
2
1
10%
5%
3
15%
1
1
5%
5%
1
1
5%
5%
2
10%
62
test situations designed to stress each module. The simulator passed with flying colors
and I spent most of the week walking around with a huge grin on my face. Not only was
the new simulator producing more precise output than the old code (a side effect of the
extra two digits of precision in floating point numbers provided by the new development
environment), but it was doing it in a small fraction of the old execution time. I then
spent a few hours polishing up the code and checking the structure of the modules to
make sure that everything was internally self-consistent. (Joseph York, Research
internship, 2004)
When the convention got going, we found ourselves leaping on everyone who came to
our booth, delineating the merits of the various projects. We advertised PTRA and
Phystec, initiatives to improve the pedagogy of physics teachers; Spin-Up TYC, an effort
to increase the quality of community college physics departments; and ComPADRE and
Physics Central, comprehensive websites that provide information about physics for
physicists, teachers, students, or the general public. After a while we began to relax and
adopt a more conversational style to convey our message. Some of the notable people we
attracted during the exhibition were NSF officials, staffers for congressmen, and
representatives on the House Committee on Science, including Vernon Ehlers (R), who
has a Ph.D. in physics and is sympathetic to our cause. We learned later that eight
congressmen attended the event. This week was an opportunity to learn about and
directly participate in the policy efforts of the science community. It was an investigation
of the communication paths between science, government, and the public. (Stacey
Elizabeth Sude, Science education outreach/policy internship, 2003)
All interns (100%, n=20: 10 res., 10 ed. out./pol.; 10 men, 10 women) reported group SPS field
trips and opportunities to see a variety of physics and allied science work environments. (Interns’
gains from these experiences were described above, i.e., interns’ enhanced preparation.) This
type of observation comprised 24% of the comments collected in this category:
We had a group tour of NIST last Thursday where Anthony and I got to show the rest of
the crew (minus Heather who was busy) the NIST campus and what we are doing at
NIST. They got to see our new buildings and clean room which is all class 100 for those
dying to know (aka VERY clean). I think the most fun part of the trip was riding in the
elevator in the new clean room building that you could honestly fit an elephant in and still
have room to fill. The door to the elevator was about fifteen feet wide to give you a clue
as to how big it was. (Joseph York, Research internship, 2004)
The tour of NASA-Goddard on Monday was unbelievable, given that I've wanted such a
thing since about the age of 11. Several clean rooms and filter walls, and much to my
shock I was actually able to use some of what I knew from my engineering endeavors to
answer questions about AC and air pressure in said rooms. Total dork stuff, but it made
me feel good. We talked a great deal with Dr. Trombka the most about upgrades for the
Hubble and a few cosmology experiments slated for the upcoming few years. (I had
heard his name from the VERITAS project at Purdue, and he is an absolute joy to talk
to.) (Melissa Hanafee, Science education outreach/policy internship, 2003)
63
Seventy-five percent of interns (n=15: 8 res., 7 ed. out./pol.; 7 men, 8 women) provided clear
accounts demonstrating conceptual and practical understanding of their work objectives and
assigned responsibilities (12% of category observations discussed this). Interns new what was
expected of them:
My mentor, Dr. Vogel, arrived at NIST on Tuesday. The following days were filled with
my questions and our discussions of the project goals. We've decided to make a quick
two week detour away from the original specifications of my internship to port our
existing chunk of simulation software from Visual Basic to standard C++. We felt that
this would be a valuable addition to the project and that it would streamline the process of
adding more functionality to the simulator at a later point in the summer. I'm planning to
implement the algorithm in a very modular way so that it can be easily extended and I
feel the structure and clarity of C++ is perfect for the job. Another feature of the
reimplementation will be the strict separation between the GUI generating the parameter
file, the simulation driver, and the actual algorithm. I'm really excited at the prospect of
getting my hands dirty, so to speak, and I feel the process of recoding the algorithm will
really force me to grapple with the nuances of the theoretical background of the project.
Hopefully, it will also greatly simplify the task of adding more advanced features to the
computational model. (Justin Stimatze, Research internship, 2003)
I am investigating the strengths of the different bonds that hold DNA together moving
toward investigating this interesting problem where when DNA is pulled with a specific
force it will double in length. I am studying the interactions of the bases with each other,
sets of bases pairs with other base pairs, and the interactions of the whole chain when it is
stretched out. It's really cool and interesting, and I've been reading a lot of interesting
books and papers about it. On Monday I finally got to sit down and talk to Jayne about
my project. I had been working on the DNA project, but she originally wanted me to
work on a new project about cyclodextrins. Cyclodextrins are these really cool little
molecules made up of about 6-9 and sometimes more units of glucose formed in a ring.
The inside is hydrophobic and the outside is hydrophilic so they are often used in
pharmaceuticals to make normally insoluble compounds more soluble. We're using them
as a kind of model for enzymes, because proteins are normally far too big to use in this
way. After talking about which project I should work on, I decided to focus primarily on
the cyclodextrin project, because I found out through reading a lot of journal articles that
a lot of the DNA stuff had already been done before. Jayne's really nice, and she's very
helpful when I have problems with my calculations. (Kacey Meaker, Research internship,
2002)
One of my main jobs this summer is to find scholarships for the scholarship
clearinghouse that will be on the Nucleus website. So I've been pretty busy with that,
trying to find applicable scholarships for the website. It's harder than I originally thought
it would be…. (Rebecca Keith, Science education outreach/policy internship, 2005)
Forty percent of interns (n=8: 5 res., 3 ed. out./pol.; 5 men, 3 women) mentioned time spent
preparing for presentations and half (n=10: 7 res., 3 ed. out./pol.; 5 men, 5 women) said that they
gave presentations at their internships as well as to the SPS group as a whole. Overall, however,
64
observations of this type were relatively few in number, as they are for the rest of the
observations collected in this category (refer to Tables 27 and 28):
Hey everybody, this last week flew by. The final pressure is starting to build up because
our Powerpoint presentations for this summer's work are due by noon on Wednesday
(yikes!). I've been working on mine for a while now and our weekly meetings here at
NIST have been beneficial with all the excel work I did for them. My presentation is
coming together fairly smoothly, in fact there is too much to talk about. (Joseph York,
Research internship, 2004)
Presentations are due this week and that took a big chunk of my time. I was frantically
trying to analyze all the survey data I had gathered and man was that a lot of data. I think
I know every little icon on the excel spreadsheet by now. But I had used Microsoft
Powerpoint for my work and after consulting with Gary, I learned that I have to give a
dual presentation with Allison. So the question of how to go about it came to the table. I
worked with Alison diligently on this matter and we had something along the lines of a
presentation to turn in. Thursday was the practice presentation sessions and I had
received quite a few constructive criticisms, so did everyone else, and hence cleaned up
my work. As a matter of fact, the final presentations are on Tuesday july 28 and I'm still
trying to make it smoother. (Kibrom Tewolde, Science education outreach/policy
internship, 2004)
I spent a lot of time out of the office this week because of our final presentations.
Tuesday afternoon was spent rehearsing, which was very helpful. Then on Wednesday
was the real deal. Everybody did well, getting a lot of positive comments from the
audience. Naturally I noticed the little things about mine that were not quite right and had
to be convinced that it was good. A bunch of people came to see us speak about our
experiences this summer. Sometime over the next year we will each need to give our talk
at a professional meeting. (Matt Hall, Science education outreach/policy internship,
2005)
This week I presented twice: once for the entire AIP general public, and once for about 5
people in my research group. The difference for me was that the AIP presentation was
relatively short and general since I had a general audience with a lot of people, while the
group presentation was twice as long and included all the details of my research. I greatly
enjoyed both actually, although I always get nervous in front of large groups. I was
pleased with the good questions asked about my research in both cases. It was rewarding
to see so many important people at the AIP presentation. It was a completely new
experience on the other hand, to give a technical, detailed presentation and I am very glad
I had that opportunity. My group was well pleased with the amount and type of work I
have accomplished this summer. (Eva Wilcox, Research internship, 2002)
Forty-five percent of interns (n=9: 3 res., 6 ed. out./pol.; 3 men, 6 women) mentioned attending
congressional hearings (i.e., policy hearings concerning NSF science education funding and
restrictions on stem cell research). Most were in science education outreach/policy internships.
However, as the following quotations demonstrate, attending congressional hearings was not
65
necessarily chosen according to internship type: a research intern reports learning about national
science education funding policy and a science education outreach intern discussed learning
about stem cell research:
Thursday was the epitome of DC-ness, attending a House Science Committee hearing on
the research budget of the Department of Energy. Did you know that the DOE provides
40% of the research support in the physical sciences? This astounded me. They fund
things in cosmology, graduate student research, and other useful things. (Useful to my
career, that is.) And their funding has remained flat (at or below the rate of inflation)
since the fall of the USSR. At the hearing, the director of the DOE Office of Science
spoke about their funding needs, and two Nobel laureates (1996 in Chemistry and 1990 in
Physics) spoke about the role of the DOE in physical science research. Most of the
conversation centered on getting the younger generations interested in science. They
discussed society's perception of scientists, and how it affects youth as they choose their
careers. They also debated such topics as the need for alternative energies, and why it is
socially acceptable to be scientifically ignorant. It was a fascinating hearing, and it
reminded me how easy it is to disappear into the ivory tower of science, but how
important it is to remain politically active throughout a scientific career. (Kathryn Peak,
Research internship, 2002)
We went to a senate hearing regarding Adult Stem cells on Capital Hill on Tuesday, July
13th and it was quite a show. Lawyers vs. Scientists. The battle was quite a spectacle.
The scientists presented their testimonies and then the lawyers just ripped them apart with
yes or no questions. The scientists were getting frustrated in the end because they were
not concise in the manner they tried to answer the senators' objections. Never the less, the
doctors had a valid alibi; patients that had been treated with stem cells and that had
shown dramatic improvements in their lives. It was an experience that will stay in my
mind for a while because I realized that no matter how legitimate your case is; it’s all
about articulating it in a manner that will make everybody quiet. That's all it is... (Kibrom
Tewolde, Science education outreach/policy internship, 2004)
Small numbers of observations and actual numbers of interns (refer to Tables 27, 28, and 29)
mention other structural elements of their internships, such as attending the SPS orientation
session, safety trainings, or other informational meetings:
Monday served as our Orientation Day. We met many people serving in a variety of
positions and it quickly became too many to remember. There are also an overwhelming
number of acronyms continually used within the American Institute of Physics. (Ann
Deml, Science education outreach/policy internship, 2006)
On Monday morning, we were given a half-day orientation at the beautiful American
Center for Physics. The dedicated and enthusiastic staff immediately made us feel
welcome and they provided a fascinating tour of the various organizations that make up
the American Institute of Physics. (Justin Stimatze, Research internship, 2003)
66
Yesterday we had our quarterly Division safety meeting. Woohoo!!!! Just kidding it was
rather boring. We talked about how you have to have stickers on your phone that give the
room, paper signs outside the rooms to say whose office it is, and hazard labels outside
the door and on any cabinets and refrigerators that contain chemicals. Of course, a large
group of us are only theoretical, so we don't really have any chemicals or other safety
hazards…. These two guys came to tell us about (sell us) ergonomic chairs. Mostly they
just talked about why this one chair is really great and how to get one and stuff. And I
learned that my desk and chair are not ergonomic at all. My desk is too high, and my
chair doesn't bend or provide lumbar support or anything. Oh well I guess I will manage
to survive. It's kind of funny though. So that concluded our safety meeting. (Kacey
Meaker, Research internship, 2006)
Thursday Heather and I had several meetings to help us learn about the programs we will
be representing at the CNSF event up on Capitol Hill. (Matthew Shanks, Science
education outreach/policy internship, 2004)
Comments comprising the category of “general internship elements” highlight the structural
elements of the SPS Summer Intern Program and inform understanding of the role of structural
elements in supporting interns’ success and achieving program objectives. Descriptions of
engaging in authentic work, group SPS field trips and structured opportunities for interns to see a
variety of physics and allied science work environments, interns’ clear understanding of project
objectives and work responsibilities, preparing for and giving presentations, attending
congressional hearings, and other structured activities (i.e., the SPS orientation session, safety
trainings, or other informational meetings) show the ways in which SPS supported interns’
learning over the summer through its program structure.

Positive, “mixed,” and negative program/internship evaluations. (n=141, 9% res., 12%
ed. out./pol.; 9% men, 9% women)
The next largest number of responses collected under general observations (10% of all
observations, see Tables 1 and 2) related intern program evaluations, the majority of which were
highly positive, with very few “mixed” and negative observations.
Positive evaluations
Eighty-nine percent of interns’ evaluative observations were positive (see Tables 30 and 31).
Ninety percent of interns (n=18: 9 res., 9 ed. out./pol.; 8 men, 10 women) described how much
they were enjoying their internship work and 75% mentioned how much they were enjoying
themselves, what a great summer they were having, and how “time was flying by” (n=15: 8 res.,
7 ed. out./pol.; 7 men, 8 women) (see Table 32). Positive program evaluations of these types
were 32% and 33% of intern observations, respectively:
Everyone was very excited to return home that evening and tell each other about their
positions. (Ann Deml, Science education outreach/policy internship, 2006)
Tuesday was less hectic and I had no problem of finding a project to get into. The
projects I'm involved in seem to be a lotta fun so I'm psyched up about them. (Kibrom
Tewolde, Science education outreach/policy internship, 2004)
67
Table 30. GENERAL: Observations of program/internship evaluations by type of internship.
N of
% of
Obs.
Obs.
Type of Observation
N of % of Sci. ed. Sci. ed.
Obs. Obs.
Out./
Out./
TOTAL
%
Res.
Res.
policy
policy
OBS.
OBS.
Positive program/internship evaluations
Time flying by, really enjoying self; Great
summer
20
30%
27
36%
47
33%
Enjoying, highly engaged in science
research/ science education
outreach/policy work; Examples
21
32%
24
32%
45
32%
Likes location, setting; Washington, DC is
a nice place
9
14%
3
4%
12
9%
Great food
Excellent staff, excellent support
Group hiking trip good
SPS "goody bags" are nice
SPS is protective, provides good
supervision of interns
4
3
2
1
0
6%
5%
3%
2%
0%
7
1
1
1
1
9%
1%
1%
1%
1%
11
4
3
2
1
8%
3%
2%
1%
1%
60
91%
65
87%
125
89%
When available supervisor gives good
guidance, but often is not available
Good experience, overall, but afternoons
are SLOW
3
5%
1
1%
4
3%
1
2%
2
3%
3
2%
Sometimes lonely; no one around at work
Feels slightly misinformed about what
internship work would be
1
0
2%
0%
0
1
0%
1%
1
1
1%
1%
Wants MORE peer group interaction
0
0%
1
1%
1
1%
Negative feeling about Washington, DC,
but redeemed by seeing instance of
niceness
0
0%
1
1%
1
1%
Subtotal
Negative program/internship evaluations
Opportunities for professional networking
NOT engaging
5
6
3
8%
0%
4%
11
1
8%
0%
2%
4
8%
0%
3%
Washington, DC is NOT a nice place;
people are rude
0
0%
1
1%
1
1%
1
66
2%
100%
4
75
5%
100%
5
141
4%
100%
Subtotal
Mixed program/internship evaluations
Subtotal
TOTALS
68
Table 31. GENERAL: Observations of program/internship evaluations by gender.
N of
% of
N of
% of
Type of Observation
Obs.
Obs.
Obs.
Obs.
TOTAL
Men
Men
Women Women OBS.
Positive program/internship evaluations
Time flying by, really enjoying self;
22
37%
25
31%
47
Great summer
Enjoying, highly engaged in science
17
28%
28
35%
45
research/science education outreach/
policy work; Examples
Likes location, setting; Washington, DC
8
13%
4
5%
12
is a nice place
Great food
4
7%
7
9%
11
Excellent staff, excellent support
2
3%
2
2%
4
Group hiking trip good
1
2%
2
2%
3
SPS "goody bags" are nice
1
2%
1
1%
2
SPS is protective, provides good
0
0%
1
1%
1
supervision of interns
55
92%
70
86%
Subtotal
125
Mixed program/internship evaluations
When available supervisor gives good
1
2%
3
4%
4
guidance, but often is not available
Good experience, overall, but afternoons
1
2%
2
2%
3
are SLOW
Sometimes lonely; no one around at
0
0%
1
1%
1
work
Feels slightly misinformed about what
0
0%
1
1%
1
internship work would be
Wants MORE peer group interaction
0
0%
1
1%
1
Negative feeling about Washington, DC,
1
2%
0
0%
1
but redeemed by seeing instance of
niceness
3
5%
8
10%
Subtotal
11
Negative program/internship evaluations
Opportunities for professional
networking NOT engaging
Washington, DC is NOT a nice place;
people are rude
Subtotal
TOTALS
%
OBS.
33%
32%
9%
8%
3%
2%
1%
1%
89%
3%
2%
1%
1%
1%
1%
8%
1
2%
3
4%
4
3%
1
2%
0
0%
1
1%
2
60
3%
100%
3
81
4%
100%
5
141
4%
100%
69
Table 32. GENERAL: Number of interns citing program evaluations by type of internship and gender.
% of
Research
Interns
% of
Sci ed
outreach/
policy
Interns
N of
Men
N of
Women
% of
Men
% of
Women
TOTAL
INTERNS
%
INTERNS
7
40%
35%
7
8
35%
40%
15
75%
9
9
45%
45%
8
10
40%
50%
18
90%
5
2
25%
10%
5
2
25%
10%
7
35%
3
3
15%
15%
2
4
10%
20%
6
30%
Excellent staff, excellent support
3
1
15%
5%
2
2
10%
10%
4
20%
Group hiking trip good
2
1
10%
5%
1
2
5%
10%
3
15%
SPS "goody bags" are nice
1
1
5%
5%
1
1
5%
5%
2
10%
SPS is protective, provides good supervision
of interns
Mixed program/internship evaluations
When available supervisor gives good
guidance, but often is not available
0
1
0%
5%
0
1
0%
5%
1
5%
2
1
10%
5%
1
2
5%
10%
3
15%
Good experience, overall, but afternoons are
SLOW
Sometimes lonely; no one around at work
Feels slightly misinformed about what
internship work would be
Wants MORE peer group interaction
Negative feeling about Washington, DC, but
redeemed by seeing instance of niceness
1
2
5%
10%
1
2
5%
10%
3
15%
1
0
0
1
5%
0%
0%
5%
0
0
1
1
0%
0%
5%
5%
1
1
5%
5%
0
0
1
1
0%
0%
5%
5%
0
1
1
0
0%
5%
5%
0%
1
1
5%
5%
1
3
5%
15%
1
3
5%
15%
4
20%
0
1
0%
5%
1
0
5%
0%
1
5%
Type of Observation
Positive program/internship evaluations
Time flying by, really enjoying self; Great
summer
Enjoying, highly engaged in science research/
science education outreach/policy work;
Examples
Likes location, setting; Washington, DC is a
nice place
Great food
Negative program/internship evaluations
Opportunities for professional networking
NOT engaging
Washington, DC is NOT a nice place; people
are rude
N of
Research
Interns
N of
Sci ed
outreach/
policy
Interns
8
70
This summer is going by so fast. I'm having a lot of fun out here. (Bridger Anderson,
Research internship, 2005)
Well, this is the second week of my internship, and I am enjoying myself! There are
times when things seem a bit hectic, but I just take one thing at a time and seem to do
okay! (Heather Lunn, Science education outreach/policy internship, 2004)
I had a great time this summer. DC has started to grow on me, even the crazy humidity. I
don't want to start getting mushy, so thanks everyone who made this internship an
enjoyable and memorable one! (Rebecca Keith, Science education outreach/policy
internship, 2005)
This summer was an incredible experience and I sincerely hope that SPS members
reading this will consider this program for their next internship. (Justin Stimatze,
Research internship, 2003)
Hello again, and welcome to Summer Adventures with Lindsay! Wow – I can't believe
that today is my last day in DC. How shall I sum up my summer? These past eight weeks
have flown by, but I've learned so much in such a short time. This internship gave me the
chance to learn tons about conducting research, but also much more about DC and
science policy. And the internship provided the opportunity to do research, but the people
I worked with this summer at NIST were the ones who really made my first research
experience so excellent. Many thanks are due =) (Lindsay Windsor, Research internship,
2005)
I hope everyone has had as much fun as me. This has been a great experience. (Joseph
York, Research internship, 2004)
Small numbers of observations and actual numbers of interns (refer to Tables 30, 31, and 32)
discussed: liking Washington, DC, the great food, and the excellence of SPS staff and their
support of interns:
I love DC - it's a wonderful city with so many important people working in important
buildings and doing so many important things. I love the convenience of being downtown
and within walking distance of a plethora of stores, restaurants, the metro, theatres, etc. quite disparate from Ithaca! And how weird is it to walk home and pass the White
House?! (Lindsay Windsor, Research internship, 2005)
D.C. is a terrific place to go running. There is a national monument on every street
corner. (Bridger Anderson, Research internship, 2005)
The ACP picnic on Monday was fantastic. The food was amazing, and the physics
demonstrations were a blast. There were various door prizes, but since most of the interns
were doing demonstrations for kids, we weren't around to hear the drawings, so no lcd
televisions, dvd recorders, or $100 gas cards for us. (Alex Brown, Research internship
2006)
71
Sunday morning I made a French toast breakfast for Kristen and me just because she is a
great roommate. In the afternoon Erin, Kacey, and I went to Arlington Cemetery. We
watched the changing of the guards at the Tomb of the Unknown Soldier and walked
around a lot, but my favorite thing was seeing the Iwo Jima statue. Sunday night we
began a new tradition for ourselves as an intern group and had an amazing supper
together. Everyone was home even those who had been gone for the weekend, and we
had some really great food. It was incredibly nice to all be together sort of like a family.
(Ann Deml, Science education outreach/policy internship, 2006)
The week ended with a cookout at Gary White's house. We met his family and also Liz
Dart Caron's family came. There was tasty food, including some great gumbo that Gary
made, and some fun stories. We got to play with some cool magnets and physics-ish toys.
Overall I think it was a very pleasant, relaxing evening. Thanks again, Gary. (Matt Hall,
Science education outreach/policy internship, 2005)
Some of interns’ final journal entries invoked reflective accounts of their summer intern
experience. While portions of the following quotations have been used as illustrative evidence
throughout this analysis, I think it worthwhile to provide here, in their fuller context, some
quotations that provide summative statements relating program outcomes and that particularly
exemplify interns’ positive experience of participating in the SPS Summer Intern Program:
I suppose I should reflect on my summer a little bit as this is my last journal entry. I
learned so much this summer I don't even know where to start. I learned some Unix and a
lot of computer programs, and I also learned a lot of biology and chemistry and even
some physics. But I also learned a lot more important stuff. I finally realized how much I
love research. I guess I sort of knew that before, but I guess I just realized how much I
truly love it. I loved going to work and reading papers and looking stuff up and putting
things together in a certain way that no one else has thought of before. This summer I
also learned to do a lot of independent work and how to figure a lot of things out by
myself. One of the best things about this summer was the really great role models that I
had the privilege of working with and learning from. They were all such wonderful
people who are really smart and determined, and I learned a lot about how to balance
career and personal life, how to deal with unhelpful people at work, and lots of other
practical things that you don't actually learn in a classroom. I also learned so much from
my fellow interns that there is no way for me to detail everything. Thanks again guys!!!
You are what made the summer so great. Cheers!!!! (Kacey Meaker, Research internship,
2006)
One final thought: Yesterday I looked back at the pictures of our orientation day. It is so
strange for me to think that only two weeks ago, we did not know each other at all and
had no idea what was going to be happening. I feel like we have all been together for so
much longer and already I would not give up this experience. Thanks so much to
everyone who is contributing to it! (Ann Deml, Science education outreach/policy
internship, 2006)
In closing, I'd like to sincerely thank Gary White and Liz Caron for their help, advice,
and tireless efforts to keep us all sane throughout the internship process. Special thanks to
72
Dr. Vogel for always taking the time to help me understand and for being patient even
when I was behind schedule, to Dr. Seiler for making all the NIST interns in Division 812
feel like part of a family, and to Dr. Suehle for always letting me think out loud and for
his helpful advice on several matters of programming style. Thanks to the SPS interns for
proving that no matter how different our backgrounds, the goals and ideals of science can
bring us together as friends. I wish you all continued success. It was a pleasure to get to
know you all. A professional nod to Mr. Klenzing, who provided not only fascinating
conversations on topics ranging from advanced mathematics to Italian opera but was also
a fine colleague who I hope to have the opportunity to work with again some day.
Finally, heartfelt thanks to Erin, Sky, and Stuart for taking me into the fold and
expanding my horizons. (Justin Stimatze, Research internship, 2003)
My lessons from this summer are so many and so varied it's hard to break them down, but
here are several areas: Academically I learned tons about chemistry. I learned about
benzene rings and pi conjugation, and refreshed my memory on a lot of basic chem too. I
learned more about how structure is related to function, and of course about organic
conducting polymers. I figured out what nanotechnology is like in the real world – not
like the self-replicating robot abstract idea, but what is being researched and used on such
a small scale and what it's good for. In terms of research and research process, I learned
about clean rooms, about the steps in the process of designing and conducting and
experiment, and about how to write a scientific paper. I learned too that labs have lots of
fun, expensive toys to play with – and I learned how to use several of them. I experienced
the joy of discovery and the frustration of finicky experiments. Wenyong taught me a lot
about what it means to do research in graduate school, and I learned the crucial
importance of finding a good advisor. Wenyong also taught me about the practical
lifestyle difference between theorists and applied physicists, and I studied the options for
my future both in science and in science policy. I learned about people skills. At work,
the group leader of our division was really effective, and watching his leadership style
was interesting and helpful. I also found out that connections are really, really important
even in the sciences. I learned to listen more to the chatty people around me, and to be
unafraid to pose deep personal questions to people I've only known for a few weeks
(remember the 4 AM game of war, kids? =) ) At work, I learned what "business casual"
means, and I learned that NIST is not. I learned how to give a Powerpoint presentation,
and I experienced having a job that ends when I leave the workplace (unless there's a
presentation the next day!). I learned about living in a city, taking the metro, and finding
a grocery store. I experienced living in a city with four Starbucks within a four-block
radius, and loved it. I found that Amtrack is not the best way to go from DC to Boston,
but I learned how to take the train. I found out that the Washington Memorial actually is
open, and that DC professional theatre and music is absolutely wonderful. Personally I
discovered that I really enjoyed doing research, much more than I thought I would. I was
also reminded that I love to learn and love to be challenged, and quickly get bored if I'm
not – which I think made those first few weeks of research all the more exciting because
they were intense learning and challenging. And finally, I realized that my worst fears
can sometimes be part of the greatest benefits. My biggest fear coming here this summer
was that I would be given something I had no experience with and would be expected to
be competent in it. I had no experience with organic chemistry or semiconductor
73
electronics before coming here, but needed to quickly gain a basic understanding of all
the jargon and ideas that form the basis of this work. Though it was quite challenging, it
wasn't too much, and I found I really enjoyed the intense learning and studying.
Wenyong said yesterday that it's when you're stretched the most that you have the best
time because you're learning the most. I agree. It's been a summer of being stretched, but
in a new way, and I'm so glad I came. Many thanks to all of you who have made this
possible!!! (Lindsay Windsor, Research internship, 2005)
The large majority (nearly 90%) of interns’ evaluative observations offered highly positive
accounts of their internship experiences. Ninety-percent of interns mentioned enjoying, and
being highly engaged in their internships.
“Mixed” evaluations
Only 8% of interns’ evaluative program observations were of a mixed nature (n=11) (see Tables
30 and 31). Mixed evaluative observations related something positive and negative. Three
interns said that their supervisor provided good guidance when available, but often was not
available (2 res., 1 ed. out./pol.; 1 men, 2 women) (see Table 32). Three interns noted an overall
good experience, but that sometimes afternoons were “slow going.” Because no one was around
at work, one woman research intern, felt lonely on occasion. While the majority of interns
described clear understanding of their project and work responsibilities, as noted above, one
woman, a science education outreach intern, expressed feeling slightly misinformed about what
the nature of the internship work would be. One intern, also a woman in a science education
outreach, voiced wanting a bit more peer group interaction. A male science education outreach
intern thought people in DC were rude, but seeing an instance of niceness, reconsidered his
assessment.
Negative evaluations
Just 4% of interns’ evaluative program evaluations were of a negative quality (n=5) (see Tables
30 and 31). Four interns (three from the same 2005 cohort) said that a particular organized event
was not interesting or a disappointment. A final negative comment (the same male science
education outreach intern offering the mixed evaluation above) concluded, after all, that DC was
a rude city and not a nice place.
Overwhelmingly, interns recorded highly positive statements of their SPS Summer Intern
Program experience, with only a few “mixed” and negative observations.

Structural elements of supervising. (n=17, 3% res., 2% ed. out./pol.; 3% men, 2% women)
One percent of all intern observations mentioned structural elements provided by their intern
supervisors (vs. by SPS, discussed above) (see Tables 1 and 2). Forty percent of interns (n=8: 4
res., 4 ed. out./pol.; 3 men, 5 women) attended an orientation session at their internship
placement. Thirty percent (n=6: 6 res., 0 ed. out./pol.; 3 men, 3 women) said their supervisor had
provided them background literature to help familiarize them with their projects. One research
intern reported that his supervisor held weekly group meetings with the research group.
74
Table 33. GENERAL: Observations of structural elements of supervising by type of internship.
N of
Obs.
Res.
% of
Obs.
Res.
N of
Obs.
Sci. ed.
Out./
policy
Supervisor provides orientation to intern
5
42%
5
100%
10
59%
Supervisor provides reading materials/
background info for project
6
50%
0
0%
6
35%
Supervisor holds regular group meetings
1
8%
0
0%
1
6%
TOTALS
12
100%
5
100%
17
100%
Type of Observation
% of Obs.
Sci. ed.
Out./
policy
TOTAL
OBS.
%
OBS.
Table 34. GENERAL: Observations of structural elements of supervising by gender.
N of
Obs.
Men
% of
Obs.
Men
N of
Obs.
Women
% of Obs.
Women
TOTAL
OBS.
%
OBS.
Supervisor provides orientation to intern
4
57%
6
60%
10
59%
Supervisor provides reading materials/
background info for project
3
43%
3
30%
6
35%
Supervisor holds regular group meetings
0
0%
1
10%
1
6%
TOTALS
7
100%
10
100%
17
100%
Type of Observation
Table 35. GENERAL: Number of interns citing structural elements of supervising by type of
internship and gender.
N of
Research
Interns
N of
Sci ed
outreach/
policy
Interns
Supervisor provides
orientation to
intern
4
Supervisor provides
reading
materials/
background
info for project
Supervisor holds
regular group
meetings
Type of Observation
% of
Research
Interns
% of
Sci ed
outreach/
policy
Interns
N of
Men
N of
Women
% of
Men
% of
Women
TOTAL
INTERNS
%
INTERNS
4
20%
20%
3
5
15%
25%
8
40%
6
0
30%
0%
3
3
15%
15%
6
30%
1
0
5%
0%
0
1
0%
5%
1
5%
75

How gains were produced. (n=15, 1% res., 1% ed. out./pol.; 0% men, 2% women)
Though a small number, comments in this category highlight how these interns learned: 1%
percent of all intern observations detailed how gains were produced (see Tables 1 and 2). Three
interns (1 res., 2 ed. out./pol.; 1 men, 2 women, see Table 38) said that the process of planning
for, practicing, and giving presentations was valuable in improving their presentation skills.
Three interns (1 res., 2 ed. out./pol.; 1 men, 2 women) described how intensive, authentic work
experience produced gains unavailable in “classroom” learning. One science education outreach
intern said that her present science education outreach/policy internship involved entirely
different learning than that of a previous research experience:
This week was all about getting my Powerpoint presentation done for the real deal that is
TOMORROW (July 27th)! On Tuesday I gave a crude presentation to my NIST group to
get their input on my speech, and I did the same thing with my AIP group on Thursday.
Everybody has given me some pointers that I've taken into account on my presentation
and I feel it's now a solid presentation (Joseph York, Research internship, 2004)
I learned a lot about how to balance career and personal life, how to deal with unhelpful
people at work, and lots of other practical things that you don't actually learn in a
classroom. (Kacey Meaker, Research internship, 2006)
I found I really enjoyed the intense learning and studying. (Lindsay Windsor, Research
internship, 2005)
This was a somewhat low-key workweek. There were several meetings (staff,
ComPADRE, phone, etc.), and I scheduled future meetings with even more people, but
there was none of the late-into-the-night equipment running that I'm used to. (Melissa
Hanafee, Science education outreach/policy internship (2003)
Table 36. GENERAL: Observations on how gains were produced by type of internship.
N of
Obs.
Res.
% of
Obs.
Res.
N of Obs.
Sci. ed.
Out./
policy
% of Obs.
Sci. ed.
Out./
policy
TOTAL
OBS.
%
OBS.
Peer group learning beneficial: improved
presentation; general increase in
learning from constructive feedback
“Real life” learning can not be learned in
classroom; active participation
Intensive learning
4
50%
5
71%
9
60%
2
25%
1
14%
3
20%
2
25%
0
0%
2
13%
Different type of research experience than in
previous experience: different learning
experience
0
0%
1
14%
1
7%
TOTALS
8
100%
7
100%
15
100%
Type of Observation
76
Table 37. GENERAL: Observations on how gains were produced by gender.
N of
Obs.
Men
% of
Obs.
Men
Peer group learning beneficial: improved
presentation; general increase in learning
from constructive feedback
“Real life” learning can not be learned in
classroom; active participation
2
100%
7
0
0%
Intensive learning
0
Different type of research experience than in
previous experience: different learning
experience
TOTALS
Type of Observation
77
N of
% of
Obs.
Obs.
Women Women
TOTAL
OBS.
%
OBS.
55%
9
73%
3
23%
3
20%
0%
2
15%
2
13%
0
0%
1
8%
1
7%
2
100%
13
100%
15
100%
Table 38. GENERAL: Number of interns citing how gains were produced by type of internship and gender.
N of
Research
Interns
N of
Sci ed
outreach/
policy
Interns
% of
Research
Interns
% of
Sci ed
outreach/
policy
Interns
N of
Men
N of
Women
% of
Men
% of
Women
TOTAL
INTERNS
%
INTERNS
Peer group learning beneficial:
improved presentation;
general increase in learning
from constructive feedback
1
2
5%
10%
1
2
5%
10%
3
15%
“Real life” learning can not be
learned in classroom; active
participation
2
1
10%
5%
0
3
0%
15%
3
15%
Intensive learning
1
0
5%
0%
0
1
0%
5%
1
5%
Different type of research
experience than in previous
experience: different
learning experience
0
1
0%
5%
0
1
0%
5%
1
5%
Type of Observation
78

Miscellaneous. (n=30, 3% res., 2% ed. out./pol.; 3% men, 2% women)
Two percent of all intern observations were collected in a “miscellaneous” category (see Tables
1 and 2). This category captures comments not easily categorized elsewhere. Two important
types of “miscellaneous” observations included: six interns who noted that their supervisor was
away (5 res., 1 ed. out./pol.; 2 men, 4 women, see Table 41) and four (2 res., 2 ed. out./pol.; 2
men, 2 women) who reported working independently while their supervisor was away, mostly
with good pre-planned direction:
Wow. Wow. Did I say wow? This sure has been a busy week. It has absolutely just flown
by! I can't believe it - I swear that yesterday was Monday! Anyway, it was a really good
week. I made a lot of progress on my project. Fred was out 2 days, but I had plenty to
keep me busy. I got together with him (Christine Zaruba, Research internship, 2004)
Well, this week was largely uneventful. Mostly because my adviser is on vacation. He
gave me a good start last week, and came in on Monday just to check in, but it was a
week of being self-directed (Kathryn Peak, Research internship, 2002)
This week, my supervisor was at a conference presenting a paper, so I was kind of on my
own at work. I continued to analyze the SE data, and tried some more to take data on the
IPE instrument, but it appears to need repairs. (Alex Brown, Research internship, 2006)
Before Gary left for vacation and business last week, he charged me with the task of
ordering supplies for and assembling variable intensity light sources for the light portion
of the SOCK. He suggested that I purchase battery holders and batteries, bulb holders and
bulbs, 1 F capacitors, and alligator clips in order to construct the lamps. (Stacey Elizabeth
Sude, Science education outreach/policy internship, 2003)
Another observation in this category was an intern’s hope that students he worked with came
away from their experience with a view of science that was less “nerdy”:
What I've learned this week is that I hate to leave camp. This time around I had to leave
the kids and deal with their questions on why I was leaving. It was hard to tell them I had
to leave and wouldn't see them again. I really enjoyed getting to know them and I hope
they don't fall into the pitfall of believing learning isn't fun because of the nerdy
stereotype (Matthew Shanks, Science education outreach/policy internship, 2004)
Another relates an intern’s understanding that the science being taught needed to be aimed at the
appropriate level:
Gary and I spent quite a while trying to reach a purely qualitative understanding of some
light phenomena, in order to devise a means to convey new concepts to children. We
played with a tray of water to try to visualize the change in a wave's propagation through
various slit sizes, forming passages between 2 sponges. We tried using spandex in the
same respect. We also toyed with the idea of illustrating constructive and destructive
interference at a level eighth graders could understand. (Stacey Elizabeth Sude, Science
education outreach/policy internship, 2003)
79
Table 39. GENERAL: Miscellaneous observations by type of internship.
N of
Obs.
Res.
% of
Obs.
Res.
N of Obs.
Sci. ed. Out./
policy
% of Obs.
Sci. ed.
Out./
policy
TOTAL
OBS.
%
OBS.
Supervisor is away
With supervisor away intern
has to work
independently
6
3
32%
16%
1
1
9%
9%
7
4
23%
13%
Easy adjustment to internship
re. living situation
2
11%
2
18%
4
13%
Long commute by subway to
internship
3
16%
0
0%
3
10%
Living in university dorm
room
Student sick: goes to ER
1
5%
1
9%
2
7%
1
5%
0
0%
1
3%
Family member passed away
1
5%
0
0%
1
3%
Credit card cancelled
1
5%
0
0%
1
3%
1st research exp
1
5%
0
0%
1
3%
2nd research exp
0
0%
1
9%
1
3%
Hopes outreach students have
learned about real
scientists; corrected
stereotypes
Understanding teaching at
appropriate level
0
0%
1
9%
1
3%
0
0%
1
9%
1
3%
Observations of student
learning gains from
education outreach work
0
0%
1
9%
1
3%
Peers in college SPS chapter
tell about intern
experience: motivate
increased involvement
Strong mentoring in college
SPS chapter is positive
experience important to
intern's involvement in
SPS
TOTALS
0
0%
1
9%
1
3%
0
0%
1
9%
1
3%
19
100%
11
100%
30
100%
Type of Observation
80
Table 40. GENERAL: Miscellaneous observations by gender.
N of
% of
Type of Observation
Obs.
Obs.
N of Obs.
Men
Men
Women
% of
Obs.
Women
TOTAL
OBS.
%
OBS.
Supervisor is away
2
13%
5
36%
7
23%
With supervisor away intern has
to work independently
1
6%
3
21%
4
13%
Easy adjustment to internship re.
living situation
Long commute by subway to
internship
2
13%
2
14%
4
13%
2
13%
1
7%
3
10%
Living in university dorm room
2
13%
0
0%
2
7%
Student sick: goes to ER
1
6%
0
0%
1
3%
Family member passed away
1
6%
0
0%
1
3%
Credit card cancelled
1st research exp
1
0
6%
0%
0
1
0%
7%
1
1
3%
3%
2nd research exp
1
6%
0
0%
1
3%
Hopes outreach students have
learned about real scientists;
corrected stereotypes
1
6%
0
0%
1
3%
Understanding teaching at
appropriate level
0
0%
1
7%
1
3%
Observations of student learning
gains from education
outreach work
0
0%
1
7%
1
3%
Peers in college SPS chapter tell
about intern experience:
motivate increased
involvement
Strong mentoring in college SPS
chapter is positive
experience important to
intern's involvement in SPS
TOTALS
1
6%
0
0%
1
3%
1
6%
0
0%
1
3%
16
100%
14
100%
30
100%
81
Table 41. GENERAL: Number of interns citing miscellaneous observations by type of internship and gender.
Type of Observation
Supervisor is away
With supervisor away intern has to work
independently
Easy adjustment to internship re. living
situation
Long commute by subway to internship
Living in university dorm room
Student sick: goes to ER
Family member passed away
Credit card cancelled
1st research exp
2nd research exp
Hopes outreach students have learned
about real scientists; corrected
stereotypes
Understanding teaching at appropriate
level
Observations of student learning gains
from education outreach work
Peers in college SPS chapter tell about
intern experience: motivate increased
involvement
Strong mentoring in college SPS chapter
is positive experience important to
intern's involvement in SPS
N of
Research
Interns
N of
Sci ed
outreach/
policy
Interns
% of
Research
Interns
% of
Sci ed
outreach/
policy
Interns
N of
Men
N of
Women
% of
Men
% of
Women
TOTAL
INTERNS
%
INTERNS
5
3
1
1
25%
15%
5%
5%
2
1
4
3
10%
5%
20%
15%
6
4
30%
20%
2
2
10%
10%
2
2
10%
10%
4
20%
3
1
1
1
1
1
0
0
0
1
0
0
0
0
1
1
15%
5%
5%
5%
5%
5%
0%
0%
0%
5%
0%
0%
0%
0%
5%
5%
2
2
1
1
1
0
1
1
1
0
0
0
0
1
0
0
10%
10%
5%
5%
5%
0%
5%
5%
5%
0%
0%
0%
0%
5%
0%
0%
3
2
1
1
1
1
1
1
15%
10%
5%
5%
5%
5%
5%
5%
0
1
0%
5%
0
1
0%
5%
1
5%
0
1
0%
5%
0
1
0%
5%
1
5%
0
1
0%
5%
1
0
5%
0%
1
5%
0
1
0%
5%
1
0
5%
0%
1
5%
82
One intern mentioned strong mentoring in the SPS chapter at his university was important to his
increased involvement with SPS and the SPS Summer Intern Program:
Mark's involvement in SPS chapter activities was low-key at first. He would basically
listen to what other members in the chapter were working on, such as presentations,
outreach programs, and papers. It was with the united chapter effort of organizing and
hosting an SPS Zone Meeting that his involvement grew. From this experience and with
the immense support of his chapter advisor, Dr. White, he got involved in physics and
science outreach projects. His involvement in his chapter's outreach activities have turned
out to be some of the most rewarding experiences he's had. The positive feedback, thank
you's and complements that he's received from students, teachers and fellow classmates
after having given an outreach presentation have been quite moving and very inspiring.
When he first got involved in these projects, he had no idea that they would have such a
positive impact in so many ways. His involvement in outreach programs also played a
large part in his being selected as an SPS Intern at the American Institute of Physics
(AIP). (Mark Lentz, Science education outreach/policy internship, 2001)
The remaining comments are, generally, simple statements about their summer living experience
(i.e., living in university dorms, long metro rides) and individuals’ unique problems (i.e., getting
sick and going to the ER, having a credit card cancelled, etc.) (refer to Tables 39, 40 and 41).
In summary, just over a third of all intern observations were grouped as general observations.
The majority described structural program elements supporting intern learning and highly
positive program evaluations. Very small numbers of comments and actual numbers of interns
reported: supervisors’ structural internship elements, intern views on how their learning was
enabled, and other miscellaneous observations.
As a final review, broadly, analysis of interns’ journals identified: types of gains derived from
participation in the SPS Summer Intern Program; descriptions of general SPS internship
elements; and program evaluations. Nearly 70% of participants’ observations described benefits
from participating in the SPS Summer Intern Program. They discussed gains in: personal growth,
personal-professional gains; increases in applied understanding of how science research and
science education outreach/policy work is actually done; gains in knowledge; enhanced
understanding of professional work contexts and preparation for advance study and entry to the
workforce; increased understanding of professional norms and practice, as well as demonstrated
and developed character traits deemed important to professional work in the field. Few
observations were offered concerning gains in skills, career clarification and confirmation, or
enhanced educational experience. The remaining one-third of intern comments were grouped as
general observations. A majority of interns’ comments comprising general observations
described SPS internship elements and program evaluations. A small number of interns also
mentioned: specific ways in which mentors supported their work as interns; how gains were
produced and miscellaneous comments. Collectively, intern observations described a rich, multifaceted range of benefits derived from program participation and the structural elements
supporting learning. Highly positive program evaluations offered by interns were testament to
the fun, hard work, and community experienced by these participants in the SPS Summer Intern
Program.
83
Analyses of Internship Type and Gender
One of the objectives of analyzing SPS intern journals was to uncover discernable differences in
the reports of participants engaging in a science research vs. science education outreach/policy
internship, or between men’s and women’s experience of the SPS Summer Intern Program.
In looking at percentages of observations offered by interns in science research vs. those in
science education outreach/policy internships (see Table 1) and those offered by men vs. women
(see Table 2), we can see that for each category of findings (across program outcomes, as well as
general observations), that both sets are well-aligned. Observations of program outcomes were
67% of science research interns’ comments as compared to 66% of science education
outreach/policy interns’ and 66% of men’s comments as compared to 67% of women’s.
Remaining general observations, obviously, reflected proportionately balanced results.
The top ranking categories in program outcomes—personal growth and personal-professional
gains—show evenly distributed percentages, both for internship type and gender. The one
instance where we see a slight imbalance appears to be idiosyncratic to the type of internship:
14% of research vs. 10% for science education outreach/policy intern observations discussed
gains in “thinking and working like a professional.” This is due to a much higher number of
science research interns (n=7: 3 men, 5 women) vs. science education outreach interns (just one)
(see Table 11) who reported understanding results produced in their research work fit theoretical
models. Indeed, one would not necessarily expect science education outreach/policy interns to
report this type of gain from their experience.
As the sample is small (20 interns), differences in percentages between types of internship and
gender become less meaningful in the lower ranked categories, i.e., for inference from findings
for “enhanced preparation” (9% of all observations) and “becoming a professional” (8% of all
observations) categories, or below.
However, in reviewing tables of individual breakouts of each category presented throughout this
report, we again see that percentages of observations by type of internship and gender are well
balanced. This is also true for actual numbers of interns citing a particular observation. There are
two instances of variation by research type. Deviations by type of internship at this discrete level
are again explained by the different work experiences offered in science research internships
from those in science education outreach/policy work. A noticeably higher number of science
education outreach/policy interns mentioned opportunities to see professional work contexts,
increased knowledge of physics and allied science community, and how work is done in practice:
9 vs. two research interns (5 men, 6 women) (see Table 14). This is likely due to observations
offered by the five education outreach interns (1 man, 4 women) who were representing the
American Institute of Physics at the CNSF (no science research interns reported this). In the
“becoming a professional” category, four science research (2 men, 2 women) , but no science
education outreach/policy interns (see Table 17) reported learning that trial and error is necessary
in research work: again, not a gain necessarily to be expected from a science education
outreach/policy internship. Thus, there were no important differences between the types of gains
that were reported by those participating in science research internships vs. those participating in
science education outreach/policy internships.
84
Overall, there were no discernable differences between men’s and women’s accounts of their
SPS Summer Intern Program. Tables showing actual numbers of interns reporting a particular
gain are balanced according to gender across the data set. Small variations in the numbers of
observations offered by men as compared to women show that, for example, women offered
more and repeated comments on peer collegiality and expressed a strong sense of belonging to a
community more often than men, while men offered more observations than women concerning
opportunities for closer interaction with their supervisors (see Table 7). However, Table 8 shows
that interns’ citing these gains were balanced by gender. Appendix A provides an overview of
actual numbers of interns reporting a particular gain by type of internship and by gender.
Virtually all observations were balanced across type of internship and gender.
To get a big picture of the number of interns taking away gains from the SPS Summer Intern
Program, I looked at the number of gains codes used in coding individual interns’ journal entries
as well as the total number of gains observations coded (see Appendices B and C). We find that
two women, both in a science research internship were the “highest gainers”: Lindsay Windsor
(2005) and Kacey Meaker (2005) cited the highest number of gains and offered the most gains
observations, accounting for 26% of all interns’ gains observations. An additional six interns
came out as “high gainers” and accounted for 36% of all gains observations (see Figure 4).
Given the range of gains cited (11 as a minimum and 48 as the maximum), these interns’ journals
contained half or more of all gains codes used. Thus, four women (two science research and two
science education outreach/policy interns) and four men (also two science research and two
science education outreach/policy interns) show that gains for interns are balanced according to
type of internship and gender.
Figure 4. Gains codes used per journal, total number of gains observations coded, and
percent of all gains observations, by intern.
INTERN
Lindsay Windsor, Science research, 2005
Kacey Meaker, Science research, 2006
Melissa Hanafee, Science education outreach/policy, 2003
Bridger Anderson, Science research, 2005
Matt Hall, Science education outreach/policy, 2005
Justin Stimatze, Science research, 2003
Matthew Shanks, Science education outreach/policy, 2004
Stacey Elizabeth, Science education outreach/policy, 2003
Kibrom Tewolde, Science education outreach/policy, 2004
Ann Deml, Science education outreach/policy, 2006
Alex Brown, Science research, 2006
Heather Lunn, Science education outreach/policy, 2004
Eva Wilcox, Science research, 2002
Christine Zaruba, Science research, 2004
Brent Janus, Science research, 2002
Kathryn Peek, Science research 2002
Joseph York, Science research, 2004
Rebecca Keith, Science education outreach/policy, 2005
Jason Tabeling, Science education outreach/policy, 2002
Mark Lentz Policy/ Outreach 2001
TOTAL OBSERVATIONS
85
TOTAL
GAINS
CODES
48
38
27
26
24
24
23
21
18
17
16
16
14
14
14
13
12
12
11
11
TOTAL
OBS.
123
113
56
47
65
63
60
40
43
70
54
33
27
22
17
18
14
13
16
14
908
% ALL
OBS
14%
12%
6%
5%
7%
7%
7%
4%
5%
8%
6%
4%
3%
2%
2%
2%
2%
1%
2%
2%
100%
Findings from varied analyses of the intern journal data set all show that benefits to interns’ were
similar regardless of type of internship or gender.
Discussion
As stated at the outset of this report, SPS provided no direction as to word limit and only broad
guidelines as to what interns should write about in their weekly journals, suggesting that “a
variety of science, policy and outreach-related activities” and other weekly or special events be
included. Without specific instruction of what or what not to include beyond this, interns’ journal
entries reflect a freeform data set. Thus while commonalities among interns’ journals concerning
weekly activities and structured events may be expected, what they record in regards to learning
gains is notable, as these observations are offered spontaneously, without prompting. It is an
important finding, then, that results from the qualitative analysis of a sample of intern journals
should show that almost 70% of interns’ observations described program outcomes
encompassing a broad range and variety of personal, intellectual and professional benefits,
demonstrating the multiple dimensions of student learning derived from the SPS Summer Intern
Program. Nonetheless, it is important to keep in mind that interns’ may very well have gained
benefits that they did not report. For instance, interns’ may indeed have made greater gains in
career clarification and in seeing the transfer of their learning to future coursework, but simply
did not record these insights in their journal entries. Thus, it is likely that at lease some intern
gains are under-reported.
The highest number of all observations reported in interns’ journals described gains in personal
growth as an outcome of participating in an SPS summer internship (20%). Ninety-five percent
of interns wrote about the numerous opportunities to explore Washington, DC and to take in the
wealth of learning the city has to offer. A large majority of journal entries (80%) also included
accounts of other personal time spent outside their internship, such as reading, shopping, and
going out in DC. Comments related to interns’ personal growth also described the strong
collegiality that developed between SPS interns in their time away from work. Two–thirds of
interns mentioned going places and doing things together with other SPS interns in their time off.
As well, nearly half of interns specifically noted their SPS summer internship as a wonderful
personal experience that helped them as young adults to discover themselves. Thus the largest
set of benefits discussed by interns in their journal entries reflect personal gains they took away
from their experience. In a recent report presenting outcomes from a Carleton College offcampus field research program in marine biology, personal growth also ranked first among
outcomes (Hunter, 2006). Personal gains are important because they speak to the goals of
educating students as well-rounded human beings and of helping students to develop as young
adults capable of participating in a complex world. Indeed, providing a holistic education that
meets the needs of the “whole” student is a longstanding tenet of education that is still viewed as
a central purpose of colleges and universities today (Dewey, 1933, 1938; Shor, 1987; Giroux,
1988; Freire, 1990; Boyer Report, 1998; Baxter Magolda, 1999, 2001, 2004). From SPS interns’
journal entries, it is clear that living in and exploring Washington, DC, as well as living closely
among a group of peers, strongly contributed to their personal growth.
The SPS Summer Intern Program is somewhat unique in that it offers two types of internships:
hands-on undergraduate research (UR) experience in the sciences and authentic professional
experience in science education outreach/policy work. In providing a UR experience in the
86
sciences and an internship in the field of science education and policy, it is interesting to
compare gains from the SPS Summer Intern Program with those identified by recent research
studies examining the benefits to students of UR programs (Ward, Bennett and Bauer, 2002;
Zydney, et al., 2002; Bauer and Bennett, 2003; Lopatto, 2004; Seymour, et al., 2004; Russell,
2005; Hunter, Laursen & Seymour, 2006) as findings from these studies provide extra framing
for interpreting results.
Ranking second in number of intern observations on program outcomes, a smaller percentage of
all observations described personal-professional gains—personal gains associated with their
hands-on professional work experience, including developing professional collegiality with work
peers and supervisors. Participants’ comments in this category emphasized the benefit of
professional collegiality built upon close interaction with other interns at their workplace. Gains
in professional collegiality were reported by 60% of interns. Sixty percent of interns also
mentioned opportunities for closer interactions with their supervisors. Nearly half mentioned
ways in which their supervisors acted in a collegial manner by supporting their learning, sharing
knowledge and experience, modeling professional practice, and offering good guidance.
Participating in and the development of a broader group collegiality were also noted in 55% of
interns’ journals. In these entries, interns related larger group activities both as part of their work,
i.e., organized tours, science education outreach events or attending events on Capitol Hill, as
well as more relaxed social interactions with SPS program staff. While a majority of interns
(55%) noted how happy and excited they were to get good results and were relieved and satisfied
to find their work activities successful, only a handful of interns’ (four) went further, expressing
gains in confidence due to their learning and sense of accomplishment. Intern’s personalprofessional gains demonstrate the positive affective gains associated with authentic professional
work experience. These gains support professional socialization and students’ identity
development as young professionals.
Close in number of observations to the personal-professional gains category, comments collected
in “thinking and working like a professional” described intellectual benefits derived from the
SPS Summer Intern Program. Overall, interns noted several types of intellectual gains. A
majority of interns (80%) described applied learning gains in terms of their active engagement in
authentic work and opportunities to integrate academic knowledge with field applications. Some
interns (eight) went further and mentioned their results fitting theoretical models, demonstrating
a higher-level intellectual gain from their experience. Four interns discussed another high-level
intellectual gain: participating in the design of their research or participating in lesson planning
and development for science education outreach activities. Sixty-five percent of interns also
described gains in new knowledge, as well as increased understanding of connections within and
between the sciences. These gains highlight interns’ applied learning, intellectual growth and
increased understanding of how professionals work by engaging in hands-on practice.
To meet the objective of developing collegiality among physics students and professionals in
physics and allied sciences, the SPS Summer Intern Program has specifically structured the
program to provide opportunities for interns to interact with professionals in varied fields and
work contexts. Attending congressional hearings and sessions with law- and policy makers as
well as intern-organized tours of their work sites enhanced understanding of professional life and
practice. As part of relating the activities of their internship, 65% of interns discussed
87
opportunities to meet with, talk with, and learn from politicians, science researchers, and science
education outreach and policy practitioners in authentic professional contexts. These
observations demonstrate the ways in which the half-day field trips to attend various
congressional hearings and tours of government research labs broadened interns’ exposure to
physics and allied science environments (reported by 55% of interns). Talking with their
supervisors and other professionals, learning about what professionals do in their work, gaining a
closer view of professionals balancing work life and personal life, and making connections with
important people in the field were program outcomes recorded in SPS intern journal entries.
Intern comments collected in the “becoming a professional” category conveyed (in almost equal
measures) increased understanding of the nature of professional work and the demonstration and
development of attitudes and behaviors viewed as character traits necessary for professional
work in the field. As with the above categories, these types of gains are evidence that interns’ are
developing as young professionals and that authentic learning experiences encourage their
professional socialization. These outcomes are viewed as important to students “becoming
professionals” and ensuring a future professional workforce.
Gains categories comprised of observations related to participants’ personal growth, personalprofessional gains, “thinking and working like a professional,” “enhanced preparation”
“becoming a professional,”—and, in much smaller numbers, career clarification and skills—
match those described by Seymour, et al. (2004) and Hunter, Laursen & Seymour (2006) in their
study to establish the benefits to students of undergraduate research experiences. Interns’
emphases on the personal, intellectual and professional growth that they experienced as a result
of program participation are similarly reported. Gains cited across these categories all document
the depth of participants’ engagement in their learning, and, again, reflect participants’ holistic
learning (Shor, 1987; Giroux, 1988; Freire, 1990; Boyer Report, 1998; Baxter Magolda, 1999,
2001, 2004). Importantly, these learning gains demonstrate program benefits that are consistent
with national science education policy objectives and are promoted by relevant national funding
organizations and institutions of higher education (Boyer Commission, 2002; National Science
Foundation, 2000, 2003a; National Research Council, 1999, 2000, 2003a, 2003b).
Comments comprising the category of “general internship elements” highlight the structural
elements of the SPS Summer Intern Program and inform understanding of the role of structural
elements in supporting interns’ success and in achieving program objectives. From their
accounts, it is clear that interns were participating in authentic work (95% of interns offered clear
descriptions of their active engagement in their projects and 75% of interns provided clear
accounts demonstrating conceptual and practical understanding of their work objectives and
assigned responsibilities). All interns reported group SPS field trips and opportunities to see a
variety of physics and allied science work environments. Nearly half mentioned attending
congressional hearings. Descriptions of engaging in authentic work, participating in group SPS
field trips and structured opportunities for interns to see a variety of work contexts, interns’ clear
understanding of project objectives and work responsibilities, and other structured activities (i.e.,
the SPS orientation session, safety trainings, or other informational meetings) show that the SPS
program structure is successful in supporting intern’s learning and in meeting stated program
objectives.
88
The majority (nearly 90%) of intern program evaluations were highly positive. Ninety percent of
interns described how much they were enjoying their internship work and 75% mentioned how
much they were enjoying themselves, what a great summer they were having, and how “time
was flying by.” Interns’ positive evaluations reflect and corroborate personal gains reported from
their SPS intern experience.
Overall, observations made by participants in science research vs. science education
outreach/policy internships and by men and women were similar in nature and in number.
Indeed, there is remarkable alignment in the balance of observations recorded by science
research vs. science education outreach/policy interns and between men’s and women’s
observations in every category across the data set. From analyses of the data set, it is evident that
the many benefits which interns described as outcomes of program participation were reported
equally by science research interns as by science education outreach/policy interns and by men
as by women.
Findings from the qualitative analysis of a sample of intern journal entries exploring the efficacy
of this type of program assessment as a tool for program evaluation document strong impacts on
participants’ personal, professional and intellectual development and provide empirical evidence
that the SPS program structure is well aligned with and supports the achievement of its program
objectives. Overwhelmingly positive program evaluations are testament to interns’ excellent
experiences with the SPS Summer Intern Program.
Conclusions
Observations recorded in intern journals support the conclusion that program objectives aimed at
encouraging and assisting students interested in physics to develop knowledge, competence
enthusiasm and social responsibility, interest in advance study and research in physics, and
collegiality among physics students and professionals in physics and allied sciences, are being
met. Evidence of many of the learning gains associated with program participation, i.e., personal
growth, personal-professional development, gains in intellectual understanding of how a
profession operates in hands-on practice, exposure to varied work contexts and possibilities (and
gaining connections to them), as well as increased understanding of the nature of professional
work, norms and practice and demonstrated attitudes and behaviors necessary to students’
continuing on in the profession, are benefits that coincide with research documenting the
beneficial outcomes of similar intensive, mentored learning experiences.
Collectively, intern observations on their personal growth, personal-professional benefits,
intellectual gains in “thinking and working like a professional,” enhanced understanding of and
preparation for advance study and workforce entry, increased understanding of the nature of
professional work, as well as the development of professional attitudes and behaviors, document
powerful program outcomes. Highly positive program evaluations of interns’ intensive,
experiential learning complement interns’ gains observations. Findings from the qualitative
analysis of a sample of SPS intern journals demonstrate a breadth of important personal,
intellectual and professional outcomes resulting from program participation in the SPS Summer
Intern Program.
89
Qualitative analysis of interns’ journals shows their efficacy as a tool for program assessment.
However, as previously stated, open-ended guidelines for interns’ journal entries likely means
that at least some gains are under-reported. Although intern journals are clearly useful as a
program assessment tool, there is a weakness in that they do not collect the same information
from every participant consistently, e.g., as a survey would. Too, analyzing this qualitative data
for the purposes of program evaluation is costly and time intensive.
A strong benefit of having conducted this qualitative analysis is that SPS now has a framework
upon which a grounded survey instrument that can query all participants about all gains, or other
issues, may be built. Indeed, qualitative research typically precedes survey development. Thus,
having identified the range and type of benefits interns report from program participation, SPS is
now in a good position to move forward in developing an instrument that will provide greater
consistency and accuracy of data to aid in evaluating program outcomes. Development of such
an instrument, might, in fact, serve as the basis of a future SPS summer intern opportunity.
References
Adhikari, N., & Nolan, D. (2002). “But what good came of it at last?”: How to assess the value
of undergraduate research. Notices of the AMS, 49(10): 1252-1257.
Alexander, B.B., Lyons, L., Pasch, J.E., & Patterson, J. (1996, June). Team approach in the first
research experience for undergraduates in botany/zoology 152: Evaluation report.
Madison, WI: University of Wisconsin-Madison, LEAD Center.
Alexander, B.B., Foertsch, J.A., & Daffinrud, S. (1998, July). The Spend a Summer with a
Scientist program: An evaluation of program outcomes and the essential elements of
success. Madison, WI: University of Madison-Wisconsin, LEAD Center.
Barlow, A., & Villarejo, M. (2004). Making a difference for minorities: Evaluation of an
educational enrichment program. Journal of Research in Science Teaching, 41(9): 861-881.
Bauer, K.W., & Bennett, J.S. (2003). Alumni perceptions used to assess undergraduate research
experience. The Journal of Higher Education, 74(2): 210-230.
Baxter Magolda, M.B. (2004). Evolution of a constructivist conceptualization of epistemological
reflection. Educational Psychologist, 39(1): 31-42.
---- (2001). Making their own way: Narratives for transforming higher education to promote
self-development. Sterling, VA: Stylus.
---- (1999). Creating contexts for learning and self-authorship: Constructive developmental
pedagogy. Nashville, TN: Vanderbilt University Press.
Boyer Commission on Educating Undergraduates in the Research University (2002).
Reinventing undergraduate education: Three years after the Boyer Report. S.S. Kenny
(chair). State University of New York-Stony Brook.
---- (1998) Boyer Commission on Educating Undergraduates in the Research University.
Reinventing undergraduate education: A blueprint for America’s research universities.
S.S. Kenny (chair). State University of New York-Stony Brook.
90
Dewey, J. (1938). How we think. Lexington, MA: Heath.
---- (1933). Experience and education. New York: Macmillan.
Foertsch, J.A., Alexander, B.B., & Penberthy, D.L. (1997a, June). Evaluation of the UWMadison’s summer undergraduate research programs: Final report. Madison, WI:
University of Wisconsin-Madison, LEAD Center.
Freire, P. (1990). Pedagogy of the oppressed. New York: Continuum.
Giroux, H. (1988). Schooling and the struggle for public life: Critical pedagogy in the modern
age. Minneapolis: University of Minnesota Press.
Hathaway, R., Nagda, B., & Gregerman, S. (2002). The relationship of undergraduate research
participation to graduate and professional educational pursuit: An empirical study. Journal of
College Student Development, 43(5): 614-631.
Hunter, A.-B., Laursen, S.L., and Seymour, E. (2006). “Becoming a scientist: The role of
undergraduate Research in students’ cognitive, personal, and professional development.
Published Online: 12 Oct 2006. DOI: 10.1002/sce.20173. Retrieved 10/13/2006 from:
http://www3.interscience.wiley.com/cgi-bin/jissue/108069556
Hunter, A.-B. (2006). Report on the qualitative analysis of five open-ended questions from the
Carleton College Off-campus Studies alumni survey of the Marine Biology Seminar.
Ethnography & Evaluation Research, CARTSS, University of Colorado, Boulder.
Lopatto, D. (2004a). Survey of Undergraduate Research Experiences (SURE): First findings.
Cell Biology Education, 3: 270-277.
Nagda, B.A., Gregerman, S.R., Jonides, J., von Hippel, W., & Lerner, J.S. (1998).
Undergraduate student-faculty research partnerships affect student retention. The Review
of Higher Education, 22(1): 55-72.
National Research Council. (1999). Transforming undergraduate education in science,
mathematics, engineering and technology, Committee on Undergraduate Science
Education, Center for Science, Mathematics, and Engineering Education. Washington,
DC: National Academy Press.
---- (2000). How people learn: Brain, mind, experience and school, expanded edition. In
Bransford, J.D., Brown, A.L., & Cocking, R.R. (Eds.), Committee on Developments
in the Science of Learning; and Donovan, M.S., Bransford, J.D., and Pellegrino, J.W.,
(Eds.), Committee on Learning Research and Educational Practice, Commission on
Behavioral and Social Sciences and Education. Washington, DC: National Academy
Press.
---- (2003a). BIO2010: Transforming undergraduate education for future research
biologists, Committee on Undergraduate Biology Education to Prepare Research
Scientists for the 21st Century, Board on Life Sciences. Washington, DC: National
Academy Press.
---- (2003b). Evaluating and improving undergraduate teaching in science, technology,
engineering and mathematics. In Fox, M.A., and Hackerman, N. (Eds.), Committee
on Recognizing, Evaluating, Rewarding and Developing Excellence in Teaching of
91
Undergraduate Science, Mathematics, Engineering, and Technology, Center for
Education, Division of Behavioral and Social Sciences and Education. Washington,
DC: National Academy Press.
National Science Foundation. (2000). NSF GPRA Strategic Plan, FY 2002-2006. NSF
Publication 0104. Retrieved March 25, 2005, from http://www.nsf.gov/od/gpra.
---- (2003a). Exploring the concept of undergraduate research centers: A report on the NSF
workshop, Division of Chemistry, Office of Special Projects, Office of
Multidisciplinary Activities, MPS Directorate. March 30-April 1, Arlington, VA.
---- (2003b). Enhancing research in the Chemical sciences at predominantly undergraduate
institutions. Report from the Undergraduate Research Summit, Bates College,
Lewiston, Maine, August 2-4.
QSR International. (2006). NVivo: A Program for the Computer-assisted Analysis of Text-Based
Data (Version 7.0). QSR International, Australia.
Russell, S. H. (2005, November). Evaluation of NSF support for Undergraduate Research
Opportunities: Survey of STEM graduates. Contributors C. Ailes, M. Hancock, J.
McCullough, J. D. Roessner, and C. Storey. (Draft Final Report to the NSF.) Menlo Park,
CA: SRI International. Retrieved 2/19/06 from http://www.sri.com/policy/csted/reports/.
Seymour, E., Hunter, A.-B., Laursen, S.L., and DeAntoni, T. (2004). Establishing the benefits of
research experiences for undergraduates in the sciences: First findings from a three-year
study. Science Education, 88(4): 493–534.
Shor, I. (1987). Critical teaching and everyday life. Chicago: University of Chicago Press.
Ward, C. Bennett, J., & Bauer, K. (2002) Content analysis of undergraduate research student
evaluations. Retrieved March 2005, from http://www.udel.edu/RAIRE.
Zydney, A.L., Bennett, J.S., Shahid, A., & Bauer, K.W. (2002a). Impact of undergraduate
research experience in engineering. Journal of Engineering Education, 91(2): 151-157.
92
APPENDIX A. Number of interns offering a particular observation, by type of internship experience and by gender.
Total N
Sources for
RESEARCH
Journals
Total N
Sources for
POLICY/
EDUC
OUTREACH
Journals
Total N
Sources for
RESEARCH
Journals
Total N
Sources for
POLICY/
EDUC
OUTREACH
Journals
Total N
Sources
for Men's
Journals
Total N
Sources
for
Women's
Journals
% N of
Sources
for Men's
Journals
% N of
Sources
for
Women's
Journals
TOTAL N
SOURCES
% N of
SOURCES
Group SPS professional field trips
meetings Opportunity to see other allied
fields environments
10
10
50%
50%
10
10
50%
50%
20
100%
Opportunities for tourist sightseeing
museums, etc.
10
9
50%
45%
10
9
50%
45%
19
95%
Describes policy outreach work tasks
Hands on work
9
10
45%
50%
10
9
50%
45%
19
95%
Enjoying, highly engaged in
research/policy outreach work;
Examples
Personal time away from research
policy outreach work
9
9
45%
45%
8
10
40%
50%
18
90%
9
7
45%
35%
9
7
45%
35%
16
80%
Expresses learning by doing Hands on
experience Applied learning
8
8
40%
40%
8
8
40%
40%
16
80%
Discusses purpose of research outreach
work Expresses understanding
8
7
40%
35%
7
8
35%
40%
15
75%
Time flying by, really enjoying self;
Great summer
8
7
40%
35%
7
8
35%
40%
15
75%
Peer collegiality, fooling around,
socializing in evening, helping each
other
New knowledge gains
Opportunity to integrate coursework
with hands on research Increased
understanding of connections/transfer
between/within sciences
Research/policy outreach work slow
going; Difficulties/mistakes with
instrumentation and producing
results/working with children
7
6
35%
30%
7
6
35%
30%
13
65%
7
8
6
5
35%
40%
30%
25%
5
6
8
7
25%
30%
40%
35%
13
13
65%
65%
7
6
35%
30%
7
6
35%
30%
13
65%
OBSERVATIONS
93
Opportunities to meet and talk with
important people discussing science
5
8
25%
40%
7
6
35%
30%
13
65%
Peer collegiality in general
Supervisor collegiality Opportunity for
closer interactions
6
6
6
6
30%
30%
30%
30%
5
7
7
5
25%
35%
35%
25%
12
12
60%
60%
Increased understanding of how science
research/policy/education outreach
works in applied practice
6
5
30%
25%
5
6
25%
30%
11
55%
Belonging to community: group SPS
social activities
7
4
35%
20%
6
5
30%
25%
11
55%
Excited that results are good/will be
publishable; Outreach work has gone so
well; Personal satisfaction with good
results produced
5
6
25%
30%
4
7
20%
35%
11
55%
Opportunity to see professional
working context; Increased knowledge
of physics and allied science
community, how science research
policy outreach work is done in practice
Time preparing poster for presentation
Gives presentation to internship group
Internship has been a wonderful
personal growth experience
2
9
10%
45%
5
6
25%
30%
11
55%
5
7
6
5
3
3
25%
35%
30%
25%
15%
15%
5
5
4
5
5
5
25%
25%
20%
25%
25%
25%
10
10
9
50%
50%
45%
Supervisor provides meaningful
interaction: shares knowledge,
experience, good guidance
More realistic understanding of science
and how professionals work in practice
5
4
25%
20%
5
4
25%
20%
9
45%
3
6
15%
30%
5
4
25%
20%
9
45%
Excitement at prospect of working with
real scientists; excited/enthusiastic
about ensuing internship
2
7
10%
35%
5
4
25%
20%
9
45%
Attended congressional hearing on NSF
budget Stem Cell How science is
funded argued
Parents, family, friends come to visit;
Some going to visit
3
6
15%
30%
3
6
15%
30%
9
45%
3
5
15%
25%
4
4
20%
20%
8
40%
Understanding results produced fit
theoretical models
7
1
35%
5%
3
5
15%
25%
8
40%
Opportunity to find out what hands on
work in this field is like
5
3
25%
15%
3
5
15%
25%
8
40%
Gives presentation to SPS intern group
5
3
25%
15%
5
3
25%
15%
8
40%
94
Attended orientation session at
beginning of summer
4
4
20%
20%
4
4
20%
20%
8
40%
Supervisor provides orientation to
intern
Learning interesting things not related
to internship
4
4
20%
20%
3
5
15%
25%
8
40%
3
4
15%
20%
3
4
15%
20%
7
35%
Novel personal experiences Really
wonderful
Knowledge gains that enhance
preparation for/transfer to advanced
study or workforce entry
4
3
20%
15%
2
5
10%
25%
7
35%
2
5
10%
25%
4
3
20%
15%
7
35%
Opportunities to see who, what personal
life of a scientist is like
4
3
20%
15%
2
5
10%
25%
7
35%
Going above and beyond, putting in
extra effort
5
2
25%
10%
4
3
20%
15%
7
35%
Working with computer software
programs
Likes location, setting; Washington, DC
is a nice place
4
3
20%
15%
4
3
20%
15%
7
35%
5
2
25%
10%
5
2
25%
10%
7
35%
Very strong sense of
community/belonging to a community
5
1
25%
5%
3
3
15%
15%
6
30%
Supervisor provides meaningful good
feedback to intern
2
4
10%
20%
3
3
15%
15%
6
30%
Great food
Supervisor provides reading
materials/background info for project
3
6
3
0
15%
30%
15%
0%
2
3
4
3
10%
15%
20%
15%
6
6
30%
30%
Supervisor is away
Peer collegiality working with other
intern
Career networking advice/help
provided by professional
5
1
1
4
25%
5%
5%
20%
2
1
4
4
10%
5%
20%
20%
6
5
30%
25%
2
3
10%
15%
2
3
10%
15%
5
25%
Gains personal view of who scientists
are as real people
3
2
15%
10%
1
4
5%
20%
5
25%
AIP representative to CNSF
Learned research design/Developed,
planned sci ed outreach activities
0
1
5
3
0%
5%
25%
15%
1
1
4
3
5%
5%
20%
15%
5
4
25%
20%
Trial and error is necessary in research
work
Understanding that
confronting/overcoming difficulties is
part of research
4
0
20%
0%
2
2
10%
10%
4
20%
2
2
10%
10%
2
2
10%
10%
4
20%
95
Gains in confidence Knowledge of
subject
Enhanced skills for advanced study or
entry to workforce
3
1
15%
5%
1
3
5%
15%
4
20%
1
3
5%
15%
2
2
10%
10%
4
20%
Working with new instrumentation
Excellent staff, excellent support
Opportunities for professional
networking NOT engaging
3
3
1
1
1
3
15%
15%
5%
5%
5%
15%
2
2
1
2
2
3
10%
10%
5%
10%
10%
15%
4
4
4
20%
20%
20%
With supervisor away intern has to
work independently
3
1
15%
5%
1
3
5%
15%
4
20%
Easy adjustment to internship re living
situation
2
2
10%
10%
2
2
10%
10%
4
20%
Learning as we go Supervisor and
intern feel way forward Unknown
future
Work peers invite intern to lunch off
site
Belonging to community at internship
Being taken seriously Active
participation exciting Feedback from
professionals encourages bonding to the
profession
Opportunities for professional
networking and career development
2
1
10%
5%
1
2
5%
10%
3
15%
2
1
10%
5%
2
1
10%
5%
3
15%
3
0
0
3
15%
0%
0%
15%
2
0
1
3
10%
0%
5%
15%
3
3
15%
15%
2
1
10%
5%
1
2
5%
10%
3
15%
References increased patience and care
with work tasks
1
2
5%
10%
1
2
5%
10%
3
15%
Increased interest in science, generally
Attended safety training meetings
Attended informational meetings
Group hiking trip good
When available supervisor gives good
guidance, but often is not available
3
3
1
2
2
0
0
2
1
1
15%
15%
5%
10%
10%
0%
0%
10%
5%
5%
1
1
2
1
1
2
2
1
2
2
5%
5%
10%
5%
5%
10%
10%
5%
10%
10%
3
3
3
3
3
15%
15%
15%
15%
15%
Good experience, overall, but
afternoons are SLOW going
1
2
5%
10%
1
2
5%
10%
3
15%
Peer group learning beneficial
improved presentation; general increase
in learning from constructive feedback
1
2
5%
10%
1
2
5%
10%
3
15%
REAL life learning Can not be learned
in classroom Active participation
2
1
10%
5%
0
3
0%
15%
3
15%
Long commute by subway to internship
3
0
15%
0%
2
1
10%
5%
3
15%
96
Research requires waiting, patience,
perseverance
1
1
5%
5%
1
1
5%
5%
2
10%
Sheer bad luck work effects results
Keeping good notes is important
Intern supervises another intern for
program outside SPS
2
1
2
0
1
0
10%
5%
10%
0%
5%
0%
1
2
1
1
0
1
5%
10%
5%
5%
0%
5%
2
2
2
10%
10%
10%
Making an original contribution is
EXCITING, feels thrill of discovery
2
0
10%
0%
0
2
0%
10%
2
10%
Learning "real life stuff," work world of
science in practice
2
0
10%
0%
0
2
0%
10%
2
10%
Intern recognizes that different info for
different audiences important in
presentations
Learning new techniques
Working with new software program
developed for analysis of data
2
0
10%
0%
0
2
0%
10%
2
10%
2
2
0
0
10%
10%
0%
0%
1
2
1
0
5%
10%
5%
0%
2
2
10%
10%
Web development skills
Opportunity to discover I LOVE
research!
Skills/knowledge gained during
internship will transfer to future
coursework
Attending conferences Mortarboard
Society AAPT
0
2
2
0
0%
10%
10%
0%
0
0
2
2
0%
0%
10%
10%
2
2
10%
10%
1
1
5%
5%
1
1
5%
5%
2
10%
1
1
5%
5%
1
1
5%
5%
2
10%
SPS "goody bags" are nice
Learning presentation skills helps
professional development
1
1
1
1
5%
5%
5%
5%
1
0
1
2
5%
0%
5%
10%
2
2
10%
10%
Living in university dorm room
Strange results present a mystery to be
unraveled
1
1
1
0
5%
5%
5%
0%
2
0
0
1
10%
0%
0%
5%
2
1
10%
5%
Expresses understanding the results
must be repeatable
1
0
5%
0%
0
1
0%
5%
1
5%
Supervisor is patient
Supervisor is cool, laid back
Supervisor is nice, understanding
Gains in confidence Sense of
accomplishment
Gains in confidence Knows
instrumentation way around lab
0
1
1
1
1
0
0
0
0%
5%
5%
5%
5%
0%
0%
0%
0
1
0
0
1
0
1
1
0%
5%
0%
0%
5%
0%
5%
5%
1
1
1
1
5%
5%
5%
5%
1
0
5%
0%
0
1
0%
5%
1
5%
97
Intern is aware/careful to maintain
personal life separate from professional
life
Learned to work and THINK
independently
Learned importance of balancing
personal and professional life
1
0
5%
0%
1
0
5%
0%
1
5%
1
0
5%
0%
0
1
0%
5%
1
5%
1
0
5%
0%
0
1
0%
5%
1
5%
Describes outreach work as "playtime"
Expresses "feeling like a scientist"
Answered difficult questions after
presenting
SPS interns offered jobs at place of
internship
Likes research, but AFFIRMS interest
in TEACHING
0
1
1
1
0
0
0%
5%
5%
5%
0%
0%
0
0
0
1
1
1
0%
0%
0%
5%
5%
5%
1
1
1
5%
5%
5%
1
0
5%
0%
0
1
0%
5%
1
5%
1
0
5%
0%
0
1
0%
5%
1
5%
Clarified area of interest, field of study
to pursue
1
0
5%
0%
0
1
0%
5%
1
5%
Considering new career ideas: web
development
0
1
0%
5%
1
0
5%
0%
1
5%
SPS is protective, provides good
supervision of interns
0
1
0%
5%
0
1
0%
5%
1
5%
Sometimes lonely; no one around at
work
Feels slightly misinformed about what
internship work would be
1
0
5%
0%
0
1
0%
5%
1
5%
0
1
0%
5%
0
1
0%
5%
1
5%
Wants MORE peer group interaction
Neg feeling about DC but redeemed by
seeing instance of niceness
0
0
1
1
0%
0%
5%
5%
0
1
1
0
0%
5%
5%
0%
1
1
5%
5%
Washington, DC is NOT a nice place;
people are rude
0
1
0%
5%
1
0
5%
0%
1
5%
Internship holds regular group meetings
Intensive learning
Different type of research experience
than in previous experience: different
learning experience
1
1
0
0
0
1
5%
5%
0%
0%
0%
5%
0
0
0
1
1
1
0%
0%
0%
5%
5%
5%
1
1
1
5%
5%
5%
Student sick Goes to ER
Family member passed away
Credit cards cancelled
1st research exp
2nd research exp
1
1
1
1
0
0
0
0
0
1
5%
5%
5%
5%
0%
0%
0%
0%
0%
5%
1
1
1
0
1
0
0
0
1
0
5%
5%
5%
0%
5%
0%
0%
0%
5%
0%
1
1
1
1
1
5%
5%
5%
5%
5%
98
Hopes outreach students have learned
about real scientists, not stereotypes
0
1
0%
5%
1
0
5%
0%
1
5%
Understanding different learning styles
in practice
0
1
0%
5%
0
1
0%
5%
1
5%
Observations of student learning gains
from education outreach work
0
1
0%
5%
0
1
0%
5%
1
5%
Peers in college SPS chapter tell about
intern experience; Motivate further
increased involvement
0
1
0%
5%
1
0
5%
0%
1
5%
Strong mentoring in college SPS
chapter is positive experience important
to intern's involve in SPS
0
1
0%
5%
1
0
5%
0%
1
5%
99
APPENDIX B: All men’s observations by category and type of internship.
Brent
Janus
Research
2002
Justin
Stimatze
Research
2003
Joseph
York
Research
2004
Bridger
Anderson
Research
2005
Alex
Brown
Research
2006
Mark
Lentz
Policy/
Outreach
2001
Jason
Tabeling
Policy/
Outreach
2002
Matthew
Shanks
Policy/
Outreach
2004
Kibrom
Tewolde
Policy/
Outreach
2004
Matt Hall
Policy/
Outreach
2005
TOTAL
OBS
MEN
1
1
1
8
10
1
1
4
8
10
45
Personal time away from research policy
outreach work
1
6
1
1
7
0
1
4
5
7
33
Peer collegiality, fooling around, socializing
in evening, helping each other
0
1
2
3
9
0
2
4
0
3
24
Parents, family, friends come to visit; Some
going to visit
0
0
0
2
0
0
1
1
10
0
14
Learning interesting things not related to
internship
0
0
0
0
0
1
0
1
0
4
6
Novel personal experiences Really wonderful
Internship has been a wonderful personal
growth experience
1
0
0
1
0
1
4
0
0
1
0
0
0
0
0
0
0
0
0
1
5
4
Expresses learning by doing Hands on
experience Applied learning
2
4
1
1
0
0
2
6
1
4
21
Increased understanding of how science
research/policy/education outreach works in
applied practice
1
1
0
1
0
2
0
4
0
0
9
Understanding results produced fit theoretical
models
1
2
0
0
1
0
0
0
0
0
4
Learned research design/Developed, planned
sci ed outreach activities
0
0
0
0
0
0
0
2
0
0
2
2
4
0
2
0
0
0
2
0
1
11
PARENT CATEGORIES
PROGRAM OUTCOMES
Personal growth
Opportunities for tourist sightseeing
museums, etc.
"Thinking and working like a
professional"
Application of knowledge and skills: gains in
understanding how science research is
conducted in practice
Increased knowledge
New knowledge gains
100
Opportunity to integrate coursework with
hands on research Increased understanding of
connections/transfer between/within sciences
1
8
0
2
2
0
0
1
1
0
15
0
4
2
1
3
0
2
5
1
0
18
Trial and error is necessary in research work
Learning as we go Supervisor and intern feel
way forward Unknown future
0
0
0
0
1
0
1
1
0
0
0
0
0
0
0
0
0
0
0
0
2
1
Research requires waiting, patience,
perseverance
0
0
0
0
0
0
0
1
0
1
2
Understanding that confronting/overcoming
difficulties is part of research
Sheer bad luck work effects results
Keeping good notes is important
Strange results present a mystery to be
unraveled
0
0
0
0
0
0
0
2
0
0
2
1
0
0
0
1
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
1
0
1
2
0
Expresses understanding the results must be
repeatable
0
0
0
0
0
0
0
0
0
0
0
0
3
1
2
10
0
0
0
2
7
25
Peer collegiality in general
Very strong sense of community/belonging to
a community
0
0
0
5
1
1
2
1
0
0
0
0
0
0
4
0
1
0
1
0
9
7
Peer collegiality working with other intern
Work peers invite intern to lunch off site
Intern supervises another intern for program
outside SPS
0
0
0
0
0
0
0
1
0
0
0
3
0
0
0
0
0
0
0
0
0
3
1
0
0
0
0
0
0
0
3
2
3
Belonging to community at internship
0
2
1
0
0
0
0
0
0
0
3
Supervisor Mentoring
Supervisor collegiality Opportunity for closer
interactions
0
3
0
1
1
1
0
2
3
5
16
Supervisor provides meaningful interaction:
shares knowledge, experience, good guidance
Supervisor provides meaningful good
feedback to intern
2
3
0
1
0
1
0
2
0
0
9
0
1
0
0
0
1
0
0
2
0
4
Supervisor is patient
0
0
0
0
0
0
0
0
0
0
0
Increased understanding of the realities of
professional work—
Research/policy outreach work slow going;
Difficulties/mistakes with instrumentation and
producing results/working with children
Personal-professional gains
Professional collegiality
Belonging to community: group SPS social
activities
101
Supervisor is cool, laid back
Supervisor is nice, understanding
0
0
0
0
0
0
1
0
0
0
0
0
0
0
0
0
0
0
0
0
1
0
Excited that results are good/will be
publishable; Outreach work has gone so well;
Personal satisfaction with good results
produced
0
1
0
0
0
0
2
3
1
0
7
Being taken seriously Active participation
exciting Feedback from professionals
encourages bonding to the profession
0
0
0
0
0
0
0
0
0
0
0
Gains in confidence Knowledge of subject
Gains in confidence Sense of accomplishment
Making an original contribution is
EXCITING, feels thrill of discovery
0
0
0
1
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
1
0
0
Gains in confidence Knows instrumentation
way around lab
0
0
0
0
0
0
0
0
0
0
0
0
2
0
2
1
2
1
0
1
5
14
More realistic understanding of science and
how professionals work in practice
1
0
0
0
0
1
0
5
2
1
10
Opportunity to see professional working
context; Increased knowledge of physics and
allied science community, how science
research policy outreach work is done in
practice
0
0
0
0
3
2
0
1
1
3
10
Opportunity to find out what hands on work in
this field is like
0
1
0
0
1
0
2
0
0
0
4
Knowledge gains that enhance preparation
for/transfer to advanced study or workforce
entry
0
0
0
0
0
0
1
1
1
2
5
Enhanced skills for advanced study or entry to
workforce
0
0
0
0
0
0
0
0
1
2
3
Opportunities for professional networking and
career development
0
0
0
0
2
0
0
0
0
0
2
Opportunities to see who, what personal life
of a scientist is like
0
0
0
0
1
0
0
0
0
1
2
Career networking advice/help provided by
professional
0
0
0
2
0
0
0
0
0
1
3
Learning "real life stuff," work world of
science in practice
0
0
0
0
0
0
0
0
0
0
0
Personal gains from professional work
Enhanced career preparation
Opportunities to meet and talk with important
people discussing science
102
Becoming a professional
Going above and beyond, putting in extra
effort
0
4
0
1
0
1
0
0
0
1
7
Excitement at prospect of working with real
scientists; excited/enthusiastic about ensuing
internship
1
3
0
0
0
1
0
1
1
0
7
Gains personal view of who scientists are as
real people
0
0
0
0
0
0
0
0
0
1
1
References increased patience and care with
work tasks
0
0
0
1
0
0
0
0
0
0
1
Intern recognizes that different info for
different audiences important in presentations
0
0
0
0
0
0
0
0
0
0
0
Intern is aware/careful to maintain personal
life separate from professional life
0
0
0
1
0
0
0
0
0
0
1
Learned to work and THINK independently
Learned importance of balancing personal and
professional life
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
Describes outreach work as "playtime"
Expresses "feeling like a scientist"
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
Skills
Working with computer software programs
Working with new instrumentation
Learning new techniques
Working with new software program
developed for analysis of data
1
0
0
1
0
0
0
0
0
0
0
0
0
1
1
0
1
0
0
1
0
0
0
0
0
1
0
0
0
0
0
0
1
0
0
0
1
0
0
0
4
2
1
2
Web development skills
Answered difficult questions after presenting
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
Career clarification and confirmation
Increased interest in science, generally
Opportunity to discover I LOVE research!
SPS interns offered jobs at place of internship
0
0
0
1
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
1
0
0
Likes research, but AFFIRMS interest in
TEACHING
0
0
0
0
0
0
0
0
0
0
0
Clarified area of interest, field of study to
pursue
0
0
0
0
0
0
0
0
0
0
0
Considering new career ideas: web
development
0
0
0
0
0
0
0
0
0
1
1
103
Enhanced educational experience
Skills/knowledge gained during internship
will transfer to future coursework
0
0
0
0
0
0
0
0
0
1
1
SUBTOTAL: PROGRAM OUTCOMES
17
63
14
47
54
14
16
60
43
65
393
3
4
3
6
4
1
4
7
5
9
46
Group SPS professional field trips meetings
Opportunity to see other allied fields
environments
1
3
3
1
5
2
1
2
5
5
28
Discusses purpose of research outreach work
Expresses understanding
2
3
1
0
1
2
0
0
1
1
11
Time preparing poster for presentation
Gives presentation to internship group
Gives presentation to SPS intern group
Attended congressional hearing on NSF
budget Stem Cell How science is funded
argued
Attended orientation session at beginning of
summer
0
0
0
0
3
1
0
0
2
1
2
0
0
1
2
0
0
0
3
0
0
0
0
0
0
0
0
0
1
0
1
2
1
1
1
1
2
1
0
2
9
5
9
5
0
1
1
0
0
0
0
0
1
1
4
AIP representative to CNSF
Attended safety training meetings
Attended informational meetings
Attending conferences Mortarboard Society
AAPT
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
1
1
1
1
0
0
0
0
0
0
0
0
0
1
0
0
0
0
0
0
0
0
0
1
1
2
1
0
4
4
3
1
0
0
3
4
3
22
0
3
2
1
2
0
1
3
2
3
17
0
3
1
1
0
1
0
0
0
2
8
0
0
0
0
0
0
1
0
0
0
0
0
0
0
0
0
1
0
0
0
2
0
1
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
1
0
2
0
0
0
0
4
2
1
1
0
GENERAL OBSERVATIONS
SPS general internship elements
Describes policy outreach work tasks Hands
on work
Program strengths Positive program
evaluations
Time flying by, really enjoying self; Great
summer
Enjoying, highly engaged in science
research/science education outreach/policy
work; Examples
Likes location, setting; Washington, DC is a
nice place
Great food
Excellent staff, excellent support
Group hiking trip good
SPS "goody bags" are nice
SPS is protective, provides good supervision
of interns
104
Structural elements of supervising
Supervisor provides orientation to intern
Supervisor provides reading
materials/background info for project
0
1
2
1
1
1
0
0
0
0
0
0
0
0
1
0
0
0
0
0
4
3
Internship holds regular group meetings
0
0
0
0
0
0
0
0
0
0
0
How learning occurs
Learning presentation skills helps professional
development
0
0
0
0
0
0
0
0
0
0
0
Peer group learning beneficial improved
presentation; general increase in learning from
constructive feedback
0
0
0
0
0
0
0
2
0
0
2
REAL life learning Can not be learned in
classroom Active participation
0
0
0
0
0
0
0
0
0
0
0
Intensive learning
Different type of research experience than in
previous experience: different learning
experience
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
1
0
1
Good experience, overall, but afternoons are
SLOW going
0
0
0
0
0
0
0
0
1
0
1
Sometimes lonely; no one around at work
0
0
0
0
0
0
0
0
0
0
0
Feels slightly misinformed about what
internship work would be
0
0
0
0
0
0
0
0
0
0
0
Wants MORE peer group interaction
Neg feeling about DC but redeemed by seeing
instance of niceness
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
1
0
0
0
0
0
1
0
0
0
0
0
0
0
0
0
1
1
0
0
0
0
0
0
0
1
0
0
1
0
0
1
0
0
0
0
0
1
1
0
0
0
0
0
0
0
0
0
0
2
1
Mixed program/internship evaluations
When available supervisor gives good
guidance, but often is not available
Negative program/internship evaluations
Opportunities for professional networking
NOT engaging
Washington, DC is NOT a nice place; people
are rude
Miscellaneous
Supervisor is away
With supervisor away intern has to work
independently
105
Easy adjustment to internship re living
situation
0
0
1
0
1
0
0
0
0
0
2
Long commute by subway to internship
Living in university dorm room
Student sick Goes to ER
Family member passed away
Credit cards cancelled
1st research exp
2nd research exp
Hopes outreach students have learned about
real scientists, not stereotypes
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
1
0
0
0
0
0
0
0
0
0
1
1
1
0
0
0
1
1
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
1
0
0
0
0
0
0
1
0
0
1
0
0
0
0
0
0
2
2
1
1
1
0
1
1
Understanding different learning styles in
practice
0
0
0
0
0
0
0
0
0
0
0
Observations of student learning gains from
education outreach work
0
0
0
0
0
0
0
0
0
0
0
Peers in college SPS chapter tell about intern
experience; Motivate further increased
involvement
0
0
0
0
0
1
0
0
0
0
1
Strong mentoring in college SPS chapter is
positive experience important to intern's
involve in SPS
0
0
0
0
0
1
0
0
0
0
1
SUBTOTAL: GENERAL
OBSERVATIONS
7
30
24
19
27
9
6
26
26
33
207
TOTALS
24
93
38
66
81
23
22
86
69
98
600
106
APPENDIX C: All women’s observations by category and type of internship.
PARENT CATEGORIES
Eva
Wilcox
Research
2002
Kathryn
Peek
Research
2002
Christine
Zaruba
Research
2004
Lindsay
Windsor
Research
2005
Kacey
Meaker
Research
2006
Melissa
Hanafee
Policy/
Outreach
2003
Stacey
Elizabeth
Sude
Policy/
Outreach
2003
Heather
Lunn
Policy/
Outreach
2004
Rebecca
Keith
Policy/
Outreach
2005
Ann Deml
Policy/
Outreach
2006
TOTAL
OBS
WOMEN
Personal growth
Opportunities for tourist sightseeing museums,
etc.
1
1
3
7
6
5
0
6
1
11
41
Personal time away from research policy
outreach work
1
0
2
4
11
3
0
3
0
11
35
Peer collegiality, fooling around, socializing in
evening, helping each other
0
0
3
6
17
4
0
0
1
12
43
Parents, family, friends come to visit; Some
going to visit
0
0
0
2
2
1
0
1
0
0
6
Learning interesting things not related to
internship
0
1
0
2
3
1
0
0
0
0
7
Novel personal experiences Really wonderful
Internship has been a wonderful personal
growth experience
0
0
0
0
1
1
0
1
2
1
1
0
0
0
1
1
0
0
1
1
6
5
Expresses learning by doing Hands on
experience Applied learning
3
1
0
11
3
4
5
1
2
0
30
Increased understanding of how science
research/policy/education outreach works in
applied practice
0
1
0
6
1
3
1
2
0
0
14
Understanding results produced fit theoretical
models
4
0
2
2
1
0
1
0
0
0
10
Learned research design/Developed, planned
sci ed outreach activities
0
0
0
1
0
0
3
0
1
0
5
2
4
3
3
0
0
9
4
5
4
4
3
2
2
2
2
1
0
0
0
28
22
"Thinking and working like a professional"
Application of knowledge and skills: gains in
understanding how science research is
conducted in practice
Increased knowledge
New knowledge gains
Opportunity to integrate coursework with
hands on research Increased understanding of
connections/transfer between/within sciences
107
Increased understanding of the realities of
professional work—
Research/policy outreach work slow going;
Difficulties/mistakes with instrumentation and
producing results/working with children
2
0
0
2
7
0
2
0
1
1
15
Trial and error is necessary in research work
Learning as we go Supervisor and intern feel
way forward Unknown future
2
0
0
0
0
0
0
1
2
0
0
0
0
0
0
0
0
0
0
2
4
3
Research requires waiting, patience,
perseverance
0
0
0
1
1
0
0
0
0
0
2
Understanding that confronting/overcoming
difficulties is part of research
0
0
0
2
0
0
0
0
0
0
2
Sheer bad luck work effects results
Keeping good notes is important
Strange results present a mystery to be
unraveled
0
0
0
0
0
0
0
0
0
0
0
1
1
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
1
0
1
Expresses understanding the results must be
repeatable
1
0
0
0
0
0
0
0
0
0
1
0
0
1
1
3
1
0
0
0
11
17
Peer collegiality in general
Very strong sense of community/belonging to
a community
1
0
0
0
2
1
2
0
4
4
2
0
0
0
3
0
1
0
0
7
15
12
Peer collegiality working with other intern
Work peers invite intern to lunch off site
Intern supervises another intern for program
outside SPS
0
0
0
0
0
0
0
0
1
1
0
0
0
4
0
1
0
0
1
0
0
0
0
0
0
0
0
1
0
0
4
4
1
Belonging to community at internship
Supervisor Mentoring
Supervisor collegiality Opportunity for closer
interactions
0
0
0
0
1
0
0
0
0
0
1
0
0
1
2
1
2
0
0
1
0
7
Supervisor provides meaningful interaction:
shares knowledge, experience, good guidance
0
0
0
1
2
2
4
0
0
0
9
Supervisor provides meaningful good
feedback to intern
0
0
0
1
0
2
0
0
0
1
4
Supervisor is patient
Supervisor is cool, laid back
Supervisor is nice, understanding
Personal gains from professional work
0
0
0
0
0
0
0
0
0
0
0
1
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
1
0
0
1
0
1
Personal-professional gains
Professional collegiality
Belonging to community: group SPS social
activities
108
Excited that results are good/will be
publishable; Outreach work has gone so well;
Personal satisfaction with good results
produced
3
0
1
4
2
0
2
2
1
0
15
Being taken seriously Active participation
exciting Feedback from professionals
encourages bonding to the profession
0
0
0
0
0
3
2
0
1
0
6
Gains in confidence Knowledge of subject
Gains in confidence Sense of accomplishment
Making an original contribution is
EXCITING, feels thrill of discovery
0
0
0
1
0
0
0
0
0
1
3
2
0
0
1
1
0
0
0
0
0
0
0
0
0
0
0
0
0
0
3
3
3
Gains in confidence Knows instrumentation
way around lab
0
0
0
1
0
0
0
0
0
0
1
0
0
0
5
1
4
2
2
1
0
15
More realistic understanding of science and
how professionals work in practice
0
0
0
4
2
1
3
0
0
0
10
Opportunity to see professional working
context; Increased knowledge of physics and
allied science community, how science
research policy outreach work is done in
practice
0
0
0
1
0
1
2
1
1
3
9
Opportunity to find out what hands on work in
this field is like
0
1
0
1
1
0
1
4
0
0
8
Knowledge gains that enhance preparation
for/transfer to advanced study or workforce
entry
0
1
0
4
0
0
1
0
0
0
6
Enhanced skills for advanced study or entry to
workforce
0
0
0
5
0
0
1
0
0
0
6
Opportunities for professional networking and
career development
0
0
0
1
0
0
0
0
0
4
5
Opportunities to see who, what personal life of
a scientist is like
0
1
0
1
1
1
0
0
0
1
5
Career networking advice/help provided by
professional
0
0
0
1
0
1
1
0
0
0
3
Learning "real life stuff," work world of
science in practice
0
0
0
1
1
0
0
0
0
0
2
Enhanced career preparation
Opportunities to meet and talk with important
people discussing science
Becoming a professional
109
Going above and beyond, putting in extra
effort
0
2
0
4
4
0
0
0
0
0
10
Excitement at prospect of working with real
scientists; excited/enthusiastic about ensuing
internship
0
0
0
0
0
1
2
1
0
1
5
Gains personal view of who scientists are as
real people
0
1
2
0
2
1
0
0
0
0
6
References increased patience and care with
work tasks
0
0
0
0
0
0
1
1
0
0
2
Intern recognizes that different info for
different audiences important in presentations
1
0
0
1
0
0
0
0
0
0
2
Intern is aware/careful to maintain personal
life separate from professional life
0
0
0
0
0
0
0
0
0
0
0
Learned to work and THINK independently
Learned importance of balancing personal and
professional life
0
0
0
0
0
0
0
0
1
1
0
0
0
0
0
0
0
0
0
0
1
1
Describes outreach work as "playtime"
Expresses "feeling like a scientist"
0
0
0
0
0
0
0
1
0
0
0
0
1
0
0
0
0
0
0
0
1
1
Skills
Working with computer software programs
Working with new instrumentation
Learning new techniques
Working with new software program
developed for analysis of data
0
1
0
0
0
0
0
0
1
0
0
0
0
2
2
0
5
0
0
0
2
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
8
3
2
0
Web development skills
Answered difficult questions after presenting
0
1
0
0
0
0
0
0
0
0
1
0
0
0
0
0
0
0
1
0
2
1
Career clarification and confirmation
Increased interest in science, generally
Opportunity to discover I LOVE research!
SPS interns offered jobs at place of internship
Likes research, but AFFIRMS interest in
TEACHING
0
0
0
0
0
0
0
1
0
0
0
0
2
3
0
0
1
1
3
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
3
4
3
1
Clarified area of interest, field of study to
pursue
0
0
0
1
0
0
0
0
0
0
1
Considering new career ideas: web
development
0
0
0
0
0
0
0
0
0
0
0
Enhanced educational experience
110
Skills/knowledge gained during internship will
transfer to future coursework
0
0
0
1
0
0
0
0
0
0
1
SUBTOTAL: PROGRAM OUTCOMES
27
18
22
123
113
56
40
33
13
70
515
3
0
1
7
8
3
5
2
3
3
35
Group SPS professional field trips meetings
Opportunity to see other allied fields
environments
1
1
2
8
9
3
1
2
2
3
32
Discusses purpose of research outreach work
Expresses understanding
3
3
0
2
4
1
2
3
2
0
20
Time preparing poster for presentation
Gives presentation to internship group
Gives presentation to SPS intern group
Attended congressional hearing on NSF
budget Stem Cell How science is funded
argued
1
1
1
1
0
0
0
1
0
2
0
0
3
2
1
1
2
2
0
0
1
0
1
1
0
0
0
0
0
0
0
1
0
1
0
1
3
0
0
0
10
8
3
6
Attended orientation session at beginning of
summer
0
0
0
1
1
0
1
0
0
1
4
AIP representative to CNSF
Attended safety training meetings
Attended informational meetings
Attending conferences Mortarboard Society
AAPT
0
0
0
0
0
0
0
0
0
1
0
0
0
0
0
0
0
2
0
0
1
0
1
0
1
0
0
0
1
0
0
0
1
0
0
0
0
0
0
2
4
3
1
2
Time flying by, really enjoying self; Great
summer
1
0
3
3
1
2
0
4
3
8
25
Enjoying, highly engaged in research/policy
outreach work; Examples
2
2
1
5
3
1
2
7
2
3
28
Likes location, setting; Washington, DC is a
nice place
0
2
0
2
0
0
0
0
0
0
4
Great food
Excellent staff, excellent support
Group hiking trip good
SPS "goody bags" are nice
SPS is protective, provides good supervision
of interns
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
1
1
0
0
0
1
0
1
1
0
1
0
0
0
0
0
1
0
0
0
0
0
0
0
0
0
0
0
0
0
4
0
1
0
1
7
2
2
1
1
GENERAL OBSERVATIONS
SPS general internship elements
Describes policy outreach work tasks Hands
on work
Program strengths Positive program
evaluations
111
Structural elements of supervising
Supervisor provides orientation to intern
Supervisor provides reading
materials/background info for project
0
0
0
1
1
0
1
0
0
2
1
0
1
0
0
0
0
0
2
0
6
3
Internship holds regular group meetings
0
0
0
1
0
0
0
0
0
0
1
How learning occurs
Learning presentation skills helps professional
development
0
0
0
3
0
2
0
0
0
0
5
Peer group learning beneficial improved
presentation; general increase in learning from
constructive feedback
0
0
0
1
0
1
0
0
0
0
2
REAL life learning Can not be learned in
classroom Active participation
0
0
0
1
1
1
0
0
0
0
3
Intensive learning
Different type of research experience than in
previous experience: different learning
experience
0
0
0
0
0
0
2
0
0
0
0
1
0
0
0
0
0
0
0
0
2
1
0
0
0
1
2
0
0
0
0
0
3
Good experience, overall, but afternoons are
SLOW going
0
0
1
0
0
0
0
0
0
1
2
Sometimes lonely; no one around at work
Feels slightly misinformed about what
internship work would be
0
0
0
0
0
0
0
0
1
0
0
0
0
0
0
1
0
0
0
0
1
1
Wants MORE peer group interaction
Neg feeling about DC but redeemed by seeing
instance of niceness
0
0
0
0
0
0
0
0
0
0
0
0
0
0
1
0
0
0
0
0
1
0
0
0
0
1
0
0
0
0
1
1
3
0
0
0
0
0
0
0
0
0
0
0
0
1
2
0
1
1
0
0
0
0
5
Mixed program/internship evaluations
When available supervisor gives good
guidance, but often is not available
Negative program/internship evaluations
Opportunities for professional networking
NOT engaging
Washington, DC is NOT a nice place; people
are rude
Miscellaneous
Supervisor is away
112
With supervisor away intern has to work
independently
0
1
1
0
0
0
1
0
0
0
3
Easy adjustment to internship re living
situation
0
0
0
0
0
0
0
0
1
1
2
Long commute by subway to internship
Living in university dorm room
Student sick Goes to ER
Family member passed away
Credit cards cancelled
1st research exp
2nd research exp
Hopes outreach students have learned about
real scientists, not stereotypes
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
1
0
0
0
0
1
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
1
0
0
0
0
1
0
0
Understanding different learning styles in
practice
0
0
0
0
0
0
1
0
0
0
1
Observations of student learning gains from
education outreach work
0
0
0
0
0
0
1
0
0
0
1
Peers in college SPS chapter tell about intern
experience; Motivate further increased
involvement
0
0
0
0
0
0
0
0
0
0
0
Strong mentoring in college SPS chapter is
positive experience important to intern's
involve in SPS
0
0
0
0
0
0
0
0
0
0
0
SUBTOTAL: GENERAL
OBSERVATIONS
14
12
15
50
42
23
17
22
17
34
246
TOTALS
41
30
37
173
155
79
57
55
30
104
761
113
Download