December 7, 2011 Shared Values and Value Conflicts: A

advertisement
Shared Values and Value Conflicts:
A Framework forIdentifying Values of Interest for Multiple
Stakeholders in the Design of New Technologies
December 7, 2011
by
Jes A. Koepfler
Graduate Research Associate
Information Policy & Access Center
College of Information Studies
University of Maryland, College Park
Shared Values and Value Conflicts: A Framework for Identifying Values of Interest for Multiple
Stakeholders in the Design of New Technologies
Abstract
This study developed and deployed a set of value statements, called portraits, to apply and test a
framework for identifying values of interest for multiple stakeholders engaged in a value-centered design
process. Participants completed a set of contextualized value portraits and follow-up questions using a
web-based questionnaire disseminated through Twitter (n=132). The correlation analyses used to apply
and test the framework showed significant relationships between all stakeholders and the value of
broadmindedness and between several stakeholders and spirituality, indicating potential shared values of
interest. Potentially divergent or conflicting values of interest included wealth and equality (associated with
those who had experienced homelessness), and identity and connectedness (associated with those who
had donated money to an organization related to homelessness in the last twelve months). These findings
are a first step towards designing and testing a framework for identifying values of interest in the service of
multi-stakeholder design, using the social context of homelessness and the communication context of
Twitter as an initial case study. The framework and its associated research instruments contribute to a
growing number of tools to support values researchers and designers in operationalizing and explicating
values for design.
Keywords
Homelessness, social services, values in design, informal communication, multiple stakeholders, Twitter
Introduction
Values, or “guiding principles of what people consider important in life” (Cheng & Fleischmann,
2010), are criteria that people use to evaluate their behaviors, respond to people they encounter, and make
judgments about events. They help explain certain behaviors like charitable giving (Bennett, 2002). They
also shape the technologies we create and guide our information behaviors and practices (Fleischmann,
2006, 2007; Friedman & Nissenbaum, 1996; Shilton, 2010). Web-supported information and
communication tools facilitate different forms of value expression and value support for diverse users and
their associated stakeholder groups, including the homeless. One of the first of these types of tools in the
United States, the Public Electronic Network (PEN), was created in 1989 in Santa Monica, CA. By the mid1990s PEN had more than 85,000 Santa Monica residents registered to it, of which at least 200 were
individuals experiencing homelessness (Van Tassel, 1996). Homeless resident, Donald Paschal, reflected
on the value of PEN, evoking values of equality, identity, and participation, among others:
…No one on PEN knew that I was homeless until I told them. After I told them, I was still
treated like a human being. To me, the most remarkable thing about the PEN community is
that a city councilmember and a pauper can coexist, albeit not always in perfect harmony,
but on an equal basis. I have met, become friends with, or perhaps adversaries with,
people I would otherwise not know of – even if I were homed. (Donald Paschal, homeless
resident, PEN, 1996)
A growing body of research in information science and human computer interaction emphasizes
theses values and key stakeholders for the design of new informal communication tools like social media,
shelter-based communication systems, and mobile technologies (Koepfler & Fleischmann, 2012; Le Dantec
et al. 2010; Woelfer et al., 2011). In these studies, values often emerge ad hoc in relation to the social
J. A. Koepfler
1
Shared Values and Value Conflicts: A Framework for Identifying Values of Interest for Multiple
Stakeholders in the Design of New Technologies
context of homelessness and the communication context of the technology of interest. In this paper, I
provide a framework for identifying values of interest a priori for the purposes of multi-stakeholder, valuescentered design, and apply that framework in the social services domain within an informal communication
context. I test the framework using a set of contextualized value portraits deployed through a web-based
questionnaire on Twitter to generate values of interest, or shared values and conflicting values that may be
considered for the design of future technologies.
I have organized the rest of the paper as follows. In the background section, I provide an overview
of the contemporary literatures on homelessness, values in research and design, and Twitter as an informal
communication context emphasizing the areas where these literatures converge. Next, I describe how each
component of the framework emerged from prior research and illustrate the points of intersection between
each component. In the methods section, I describe the tools and procedures used to apply and test the
framework and the measures I used to study contextualized values. I then show how the results of the
analysis support the framework by identifying values of interest among the stakeholder groups in the social
services domain. I then discuss how the design of the study may have influenced the findings, and suggest
approaches that could allow future research to overcome these limitations. I conclude by discussing the
implications of the framework and the values portraits as tools for value-centered design in other social and
communication contexts.
Background
Homelessness and technology
Each year roughly 3.5 million people in the United States experience homelessness (National Law
Center on Homelessness and Poverty, 2007). Since the 2008 economic downturn and home foreclosure
crisis, rates of homelessness have increased (Sermons & Witte, 2011). The McKinney-Vento Homeless
Assistance Act (United States Code, in Title 42, Chapter 119, Subchapter I, 1986) defines a homeless
person as an individual who may be sheltered or unsheltered, doubled-up or in transition, living in cars or
campers, and experiencing homelessness episodically or chronically. The Act has resulted in programs for
shelter, food, healthcare, and transitional housing, helping many Americans regain housing stability
(National Coalition for the Homeless, 2006). One weakness of the Act is that it responds primarily to
symptoms of homelessness rather than its causes or effects, leaving a gap in services for homelessness
prevention or social support for individuals who have exited homelessness, or who might be unwilling to
access social services. Online communities supported by informal communication tools, like Twitter,
provide unique opportunities to bridge this gap.
Though individuals experiencing homelessness lack certain types of material resources, research
shows that many individuals access web-based services through mobile devices, personal computers, and
public computer labs in libraries and other public spaces. A national study found that 44% of people in
households below the poverty line accessed the Internet at public libraries (Becker et al., 2010). A
quantitative study in Philadelphia (Eyrich-Garg, 2010) and a qualitative study in Atlanta (Le Dantec &
Edwards, 2008) found that many homeless individuals (both sheltered and unsheltered) had mobile phones
that they used to connect with family, friends, and social service providers. Possession of mobile devices
was also found to increase perceptions of safety and security among homeless young people (Woelfer et
al., 2011; Woelfer & Hendry, 2011). Additionally, a recent study with homeless youth in New York (Daniels,
Under Review) and another with homeless adults in Atlanta (Le Dantec, 2008), highlighted mobile devices
and Internet access as a basic human need on par with food and shelter, which were often easier to access
than cell phone minutes.
J. A. Koepfler
2
Shared Values and Value Conflicts: A Framework for Identifying Values of Interest for Multiple
Stakeholders in the Design of New Technologies
These studies shift not only how we think about homelessness in the 21st century, but also how we
conceptualize basic human needs and the impact that information and communication tools and broadband
access can have in empowering and supporting the values of individuals associated with homelessness.
Values in research and design for technologies that support homelessness
Though values research has not yet focused explicitly on the impact that experiences of
homelessness might have on personal values and subsequent behaviors, studies have shown that factors
such as traumatic experiences, economic hardship, social class, and unemployment can affect an
individual’s values (Feather, 1975, 1985, 1992; Inglehart, 1997). Feather (1985) found that the explanations
people gave for events such as poverty and unemployment could be understood as both a product of an
individual’s internal value system as well as the effects of one’s larger social context channeled through
family, school, or other sources of influence. Inglehart (1997) found that people who suffered from
economic hardship and social upheaval attributed more importance to power and security values than
those who lived in relative comfort and safety.
Values also shape and are shaped by our information behaviors and technology adoption practices
(Friedman & Freier, 2004; Friedman & Nissenbaum, 1996). An individual who prioritizes connectedness
and participation above other values may gravitate more readily towards an online tool that affords ease of
connections with a low barrier to entry. Design approaches that incorporate values promote an awareness
of values throughout the technology design process for all of the stakeholders involved (Friedman, 1997;
Friedman & Kahn, 1992; Friedman, Kahn, & Borning, 2006; Friedman & Nissenbaum, 1996). Information
science and human-computer interaction researchers have explored values both to design systems for and
with individuals experiencing homelessness, and to study the role of information and communication tools
in homelessness experiences from the perspective of multiple stakeholders. For example, Le Dantec and
colleagues (Le Dantec, Christensen et al., 2010; Le Dantec, Farrell et al. 2010) employed values in the
design of a Community Resource Messenger at an emergency homeless shelter for single mothers. In their
design process, they emphasized the values of both the homeless mothers and the social service providers
at the shelter in the development of this context-specific informal communication tool. Further, Woelfer,
Hendry and colleagues (Hendry et al., 2011; Woelfer & Hendry, 2010) considered the values of homeless
young people (aged 13-25) and shelter staff members while a community technology center was integrated
into a homeless shelter in Seattle, WA. They found that stakeholder values emerged from two social
contexts: life on the street and work in the technology center.
Informal communication tools, homelessness, and values
Microblogging is a type of online informal communication in which individuals broadcast short textbased messages to a network of individuals (real or perceived) (Zhao & Rosson, 2009). Research has
shown that informal communication plays a unique role in different social contexts. For example, in a
workplace environment, informal communication has supported collaborative work and office culture by
maintaining connections and a sense of belonging between co-workers (Kraut et al., 1993; Whittaker et al.,
1994; Nardi, 2005). Twitter (founded in 2006) is currently the most popular microblogging tool in the United
States. It enables a unique type of informal communication in the form of 140-character posts, called
tweets. Through tweets and other syntax (the at-mention and at-reply [@], retweet [RT], hashtag [#]) Twitter
users share and seek information and resources as well as express attitudes, opinions, and beliefs about a
topic (i.e. values) (Java et al., 2007).
Twitter works on most devices through wireless, 3G (third generation mobile telecommunications),
and even SMS (short message service) technologies. Due to its low barriers to entry, Twitter provides a
space for multiple social groups to coexist, creating the potential for discourse to evolve in ways that might
J. A. Koepfler
3
Shared Values and Value Conflicts: A Framework for Identifying Values of Interest for Multiple
Stakeholders in the Design of New Technologies
not otherwise occur in offline contexts (Marwick & boyd, 2011). Zhao & Rosson (2009) suggest that the
informal communication that happens on a site like Twitter may increase the formation of weak ties
(Granovetter, 1973) and thus the sharing and gaining of novel information especially valuable to individuals
trying to exit homelessness.
A number of web-based projects related to homelessness (e.g. Invisible People,
www.invisiblepeople.tv; STREATS, www.streats.tv; Underheard in New York, www.underheardinny.com)
have begun to harness the potential of informal communication. One such project, called We Are Visible
(www.wearevisible.com), encourages individuals experiencing or who have experienced homelessness to
use Twitter to self-advocate, find social support, and help others. A Twitter user experiencing
homelessness reflects on the same potential for Twitter to support individuals experiencing homelessness
as Donald Paschal did for PEN nearly 15 years ago:
Before we got involved in social media, we felt no one cared we were homeless. I got mad
and went to Twitter just to vent my frustrations. We soon met people, some homeless and
some not, who all seemed to have one thing in common: they did care. For the first time in
months, I felt we had a voice. This was a huge boost. Through Twitter, one person set up
food being delivered to us. …we found a friend who made a flyer for us asking people if
they had work, which has led to one job so far. I believe everyone can benefit from social
media, and we try to help others in our area connect and have a voice too.
(@alleycat22469, homeless individual on Twitter, We Are Visible, 2010)
These projects highlight the ways in which the context of informal communication can support the
values of individuals experiencing homelessness and other associated stakeholders. In the sections that
follow, I propose a framework for bringing these concepts together more explicitly and then take a first step
towards testing and validating that framework.
A Framework for Identifying Values of Interest
Values of interest
I define values of interest as key values that emerge among diverse groups of stakeholders during
a value-centered design process, which have the potential to dramatically shape or alter group practice
and/or the resulting design products. Values of interest may be shared values that serve as boundary
objects for design team members to coalesce around, like privacy in Shilton’s study (2010). Shared values
provide a common ground and help to initiate conversations about values in design teams, what Shilton
calls “values levers”. Values of interest may also be conflicting values, or values that diverge among the
stakeholders. They may be values for which stakeholders hold different points of view, such as honesty in
Fleischmann and Wallace’s study (2010), or values that some groups prioritize more than others, such as
wealth and identity in Koepfler and Fleischmann’s study (2012). Because these values emerge from the
interactions of several stakeholders, designers are often forced to tackle them as they arise, which may
slow down the design process or affect group cohesion in the design team. I propose a framework for
identifying values of interest among multiple stakeholders to help identify what those shared and conflicting
values might be at the start of a design project. With such knowledge, designers may be able to utilize
values proactively for design efforts rather than reacting to them.
I have identified three intersecting components to the framework – key stakeholders in the domain
of interest, values associated with the communication context, and values associated with the social
context – based on three exploratory studies that examined the intersection of homelessness, values, and
J. A. Koepfler
4
Shared Values and Value Conflicts: A Framework for Identifying Values of Interest for Multiple
Stakeholders in the Design of New Technologies
informal communication. In the sections that follow, I briefly summarize each study and how it contributes to
the framework illustrated in Figure 1 at the end of this section.
Key stakeholders in the domain of interest
In Study 1 (Koepfler & Hansen, 2012), my collaborator and I used social network analysis to
identify key stakeholders related to homelessness in an online Twitter network called @WeAreVisible (see
www.wearevisible.com for a detail description of this project). We analyzed the public Twitter profiles of
each node in the network to determine how the individuals in it self-identified. We found eleven types of
stakeholders: Homeless/Formerly Homeless, Homeless Advocate, Celebrity, Do-gooder, Service Provider,
Non-profit Generalist, Social Media Enthusiast, Support Organization, Social Worker, Librarian, and
Researcher. To determine which groups among these were key stakeholders, we analyzed the network
structure using a clustering algorithm, which determined groups based on their underlying patterns of social
ties (follower/following relationships) rather than their formal group memberships. The analysis showed
three main clusters with five key stakeholder groups: 1) a small, dense cluster of Homeless/Formerly
Homeless individuals sparsely connected to a 2) second larger cluster of Support Organizations and
Homeless Advocates, which were both connected to a third even larger cluster comprised mainly of Social
Media Enthusiasts and Do-gooders.
The cluster analyses and stakeholder group attributes raised interesting questions about
participation in this multi-stakeholder community. What was sustaining the denseness of the clusters at a
social level? What were the patterns of communication supporting the between-group connections and how
might design or social interventions make those inter-group ties stronger? Study 1 highlights the
importance of identifying key stakeholders related to the domain of interest and the technological context of
interest. It also identifies a salient value related to the informal communication context, which we built upon
in Study 2.
Values associated with the communication context
In Study 2 (Koepfler & Fleischmann, 2011), my collaborator and I used thematic analysis to study
values in a corpus of tweets. In particular, we were interested in whether an existing values inventory,
called the Meta-Inventory of Human Values (MIHV; Cheng & Fleischmann, 2010), was an appropriate
framework for assessing values in informal communication. The MIHV is a holistic values framework that
integrates values and definitions from twelve value inventories (Bernthal, 1962; Bird & Waters, 1987; Crace
& Brown, 1995; England, 1967; Friedman et al., 2006; Jurkiewicz & Giacalone, 2004; Kahle et al., 1988;
McDonald & Gandz, 1991; Ravlin & Meglino, 1987; Rokeach, 1973; Scott, 1965; Schwartz, 1994).
Specifically, Cheng & Fleischmann (2010) identified sixteen meta-values that appeared in at least five of
the twelve inventories – achievement, wealth, helpfulness, competence, security, identity, spirituality,
broadmindedness, justice, innovation, equality, honesty, intelligence, responsibility, freedom, and social
order – and discarded concepts that appeared four or fewer times. (For detailed definitions of each of these
values, please see additional works by these authors, e.g. Cheng et al., 2010; Cheng & Fleischmann,
Under Review). The authors then developed and tested the framework using a corpus of formal
proceedings from the Net neutrality debate (Cheng, et al., 2010, Under Review). Their studies showed that
the meta-inventory was robust within this formal communication context.
For our study, we applied the MIHV to tweets to determine if all sixteen of the inventory’s values
occurred and to see if additional values emerged as a result of the context shift from formal to informal. The
results showed that all of the values appeared, and that two additional values emerged with equal salience
– connectedness (referred to as sense of belonging (Kahle et al., 1988) or belonging (Schwartz, 1994;
Crace & Brown, 1995) and comfort (also referred to as a comfortable life (Rokeach, 1973)). In addition to
J. A. Koepfler
5
Shared Values and Value Conflicts: A Framework for Identifying Values of Interest for Multiple
Stakeholders in the Design of New Technologies
participation from Study 1, Study 2 highlights additional values related to the informal communication
context. We referred to this new set of values as the Meta-Inventory of Human Values for Informal
Communication (MIHV-IC) and deployed it in Study 3 using content analysis.
Values associated with the social context
In Study 3 (Koepfler & Fleischann, 2012), we were interested in using the MIHV-IC to determine
whether values in informal communication were expressed differently based on one’s social context. For
this study, we compared a corpus of tweets from individuals who self-identified as homeless or formerly
homeless to a corpus of tweets from individuals who did not identify as associating with homelessness. We
analyzed 5,313 tweets from 32 individuals and found significant differences between the two corpuses for
wealth, helpfulness, identity, spirituality, broadmindedness, justice, equality, responsibility, and freedom. In
every case, tweets from the homeless or formerly homeless individuals expressed these values more often
than the tweets from the comparison group. These findings make up the third component of the framework
and highlight a set of values to consider within the social context of homelessness.
Framework for Identifying Values of Interest
From these studies and the literature that supports them, I propose a framework for identifying
values of interest among multiple stakeholders in a value-centered design process, illustrated in Figure 1,
below.
KEY STAKEHOLDER GROUPS from the issue/domain of interest VALUES OF INTEREST VALUES of the COMMUNICATION CONTEXT VALUES of the SOCIAL CONTEXT Figure 1. Framework for identifying values of interest in multi-stakeholder design
This framework implies that there are areas of intersection between the salient values of the social
context, in this case, individuals who have or are currently experiencing homelessness, and the salient
values associated with the communication context, in this case, informal communication on Twitter. It also
suggests relationships between the key stakeholders related to the domain of interest (i.e. social services)
and the salient values of the social and communication contexts. What emerge from these intersections are
J. A. Koepfler
6
Shared Values and Value Conflicts: A Framework for Identifying Values of Interest for Multiple
Stakeholders in the Design of New Technologies
values of interest, comprised of values that are shared between stakeholders as well as values that are
conflicting or divergent. In the following sections, I describe a first step towards applying and testing this
framework using contextualized value portraits disseminated as part of a web-based survey.
Applying and Testing the Framework
Methods
To apply and test the framework for identifying values of interest, I developed and deployed a set
of value statements, called contextualized value portraits (described in more detail in the Measures section
below), using a web-based questionnaire hosted on SurveyGizmo (www.surveygizmo.com) from
September 24 to October 12, 2011.
Recruitment
I used an integrated sampling strategy, combining purposive and viral sampling approaches
(Plowright, 2011) to recruit participants for the study. I use the term viral as opposed to snowball, chain, or
reputational sampling to describe more accurately the ways in which the survey could spread through
online informal communication on Twitter. For example, in each recruitment tweet, I included a request for
individuals to re-tweet the message to their own networks and used a variety of hashtags (e.g. #homeless,
#socialissues, #tcot, #libertarian). I used this approach to gather individuals outside of my personal network
and to target Twitter users who might have a stake in the issue of homelessness. I sent a total of 150 direct
messages and 145 at-mentions during the study period. I offered participants one of twenty-five, five-dollar
Amazon.com gift cards in a randomized drawing to complete the survey.
Due to the sampling approaches, an exact response rate was difficult to calculate. I used bitly
(www.bitly.com), a URL shortener and redirection service that provides tracking to serve as a proxy for
response rate. Bitly counts the number of clicks a link receives and ignores clicks from spambots and
crawlers (which services like SurveyGizmo do not account for). It does not account for multiple clicks by the
same user, however. During the study period, the survey link received 580 clicks. After clicking on the link,
a summary page appeared with information including purpose of the study for research, anticipated time
required to take the survey, details about the incentive, and other logistical information. A consent form
appeared on the next screen for participants who chose to proceed from that point. Individuals indicated
their consent to participate in the study by clicking “I agree” at the bottom of the page and proceeding to the
beginning of the survey. From the consent form, 199 participants completed all or part of the survey (34%
proxy response rate).
Sample
This paper considers a subsample of respondents who indicated that they used Twitter and then
completed the contextualized value portraits and subsequent demographic and stakeholder characteristics
questions (n=132). The survey also asked additional questions related to values (the Schwartz Portrait
Value Questionnaire, 2007), demographics (military experience), social media use, and Twitter access and
behaviors, which were not included in the current study.
Table 1 presents a summary of the demographics for this sample. Demographic information was
not available for non-responders; therefore, it is not clear whether a self-selection bias exists regarding
survey participation. When I compare the demographics of this study to information about Twitter users
more generally (Smith, 2011), this sample appears to be representative with regard to age and education
level, but is skewed in terms of gender (more females) and ethnicity (fewer Hispanics and African
Americans).
J. A. Koepfler
7
Shared Values and Value Conflicts: A Framework for Identifying Values of Interest for Multiple
Stakeholders in the Design of New Technologies
Table 1. Summary of demographics for sample (n=132)
Demographic
% (n)
Age
M=33.8 years, SD=9, Min=19 to Max=64
Gender
Female
68% (90)
Male
32% (42)
Ethnicity
Caucasian
78% (103)
Hispanic
8% (10)
Asian
5% (6)
African American
4% (5)
Native American
3% (4)
Prefer not to answer
4% (5)
Missing data
4% (5)
Education level
Graduate degree or higher
55% (72)
College (4-year degree)
30% (39)
College (2-year degree) or some college
9% (12)
High school or some high school
2% (3)
Note. Some columns may total greater than 100% due to multiple responses and/or rounding error.
Measures
Contextualized Value Portraits
Cheng and Fleischmann (2010) suggested that the MIHV was suitable for use in both content
analysis and survey methods, but the framework has only been tested using content analysis to date (e.g.
Cheng, et al., 2011; Koepfler & Fleischmann, 2011, 2012). The contextualized value portraits developed to
test the framework in this paper are a first step towards validating the inventory for use in survey methods.
I created the contextualized value portraits, modeling Schwartz’s Portrait Values Questionnaire
(PVQ; Schwartz, 2007). The PVQ includes short verbal portraits of different people. Each portrait describes
a person’s goals, aspirations, or wishes, which point implicitly to the importance of a single value type. I
based the language of aspirations and behaviors in my portraits on examples found in the thematic and
content analyses in Study 2 and Study 3. I developed portraits that would reflect the overlapping nature of
the social and communication contexts in the framework by adding language about Twitter to contextualize
them.
Before responding to the portraits, I asked survey participants to indicate their gender identity so
that the portrait items they saw would be worded with gender-specific pronouns in line with Schwartz’s
approach. For each portrait, a respondent determined how much s/he was or was not similar to the person
described on a scale from 1-6, where 1 = not like me at all and 6 = very much like me. The respondents
compared the portrait to themselves rather than themselves to the portrait in order to encourage a focus on
the value-relevant aspects of the task. This approach prevents participants from thinking about the larger
number of self-characteristics s/he might have, inadvertently overlooking the similarity of values (Schwartz,
2007). Schwartz’s statements use three different sentence structures. For the portraits I developed, I
adopted only one sentence structure for consistency across statements, because there has been no testing
J. A. Koepfler
8
Shared Values and Value Conflicts: A Framework for Identifying Values of Interest for Multiple
Stakeholders in the Design of New Technologies
to determine if the difference in structural formulations affects responses. Table 2 lists the portraits for each
value, which were randomly presented to participants on one page of the survey.
Table 2. Contextualized values portraits
Portrait
Values of the social context
It is important to him to have money and nice things. He promotes his work through Twitter to make
money or gain resources. [wealth]
It is important to him that everyone be treated equally. He wants justice for everybody, even for people
he doesn't know on Twitter. [equality]
It is important to him to follow people on Twitter who are different from him. Even when he disagrees with
them, he still wants to see different points of view from their tweets. [broadmindedness]
It is important to him to help people who seek information and resources on Twitter. He wants to help
others find what they need. [helpfulness]
It is important to him to be open and honest about his identity on Twitter. He understands who he is and
how he is perceived by others. [identity]
It is important to him to express his religious or spiritual beliefs on Twitter. He is comfortable using
religious language in his tweets. [spirituality]
Values of the communication context
It is important to him to stay in touch with his friends and family online. He tries to make and maintain
new friendships through Twitter. [connectedness]
It is important to him to contribute his ideas and ensure that his voice is heard. He tweets his own
thoughts and re-tweets the thoughts of people he agrees with. [participation]
It is important to him to live in a comfortable environment. He acknowledges both positive and negative
experiences in his environment through Twitter. [comfort]
Note. Participants were asked to indicate their gender, which changed the pronouns used in the portraits.
Scale: 1-6, where each point included a text anchor ranging from 1 = not like me at all and 6 = very much
like me.
Stakeholder groups
After completing the values portraits, I asked participants to respond to a series of questions about
their stakeholder associations to homelessness, approximating the types of key stakeholders that emerged
in Study 1. Participants indicated whether they had worked for, volunteered for, and/or donated money or
goods to an organization associated with issues of homelessness and poverty within the last twelve
months. They then indicated whether or not they had experienced homelessness in their lifetime and were
asked follow-up questions about the recentness and frequency of that experience if they had.
The questions related to homelessness in survey used the temporal framing of one’s lifetime with
the logic that homelessness is the type of traumatic experience that might have a greater impact on one’s
values over time as suggested by the work of Feather (1985) and Inglehart (1997) and would likely
increase their stake in the issue of homelessness. The questions regarding other stakeholder associations
used the temporal framing of the “last twelve months”, because this frame is more appropriate for shortterm behaviors like donating, and the recent nature of such activities would likely increase one’s stake in
the issue of homelessness at that time. I envisioned a multi-stakeholder design team that included
individuals who were both homeless and formerly homeless along with individuals who were currently or
recently engaged in the other stakeholder activities described above, similar to those who might label
themselves as Advocates and Do-gooders in Study 1.
J. A. Koepfler
9
Shared Values and Value Conflicts: A Framework for Identifying Values of Interest for Multiple
Stakeholders in the Design of New Technologies
Analysis
I exported the data from the web survey into SPSS 17.0 for data management and analysis. To
determine relationships between the two sets of values and the stakeholder characteristics, I conducted
point-biserial correlations. A point-biserial correlation is a nonparametric statistic that identifies relationships
between a discrete-dichotomous variable (i.e. yes or no responses to the stakeholder association
questions) and a rank-order variable (i.e. the interval scale used in the portraits) (Corder & Foreman, 2009).
Due to the number of statistical tests required to test these hypotheses which may increase Type I errors
across the study, I chose to use a more conservative α=.01. In order to maintain comparisons between
prior studies and this one, I also report findings at α=.05, but note that these findings are less robust and
refer to them as potential trends.
Results
The framework for identifying values of interest considers relationships between social and
communication context values and key stakeholders in a domain of interest. Table 3 presents the
distribution of each stakeholder association and a detailed description of the survey respondents who
indicated that they had ever experienced homelessness. It is interesting to note that more than half of the
participants who had experienced homelessness experienced it more than once, and had experienced it
since the 2008 economic crisis.
I also note that these groups are not mutually exclusive, which is why I refer to them as stakeholder
associations. I am emphasizing that these are characteristics of one’s stake in the issue of homelessness
and account for the possibility that individuals may have one or many associations to the issue. For
example, of the individuals who reported working for an organization related to homelessness or poverty in
the last year, six of them had experienced homelessness at some point in their lives. Thirteen of the people
who had volunteered for such an organization in the last year had experienced homelessness. The same
was true for people who indicated that they had donated goods (19 people indicated also experiencing
homelessness) and people who indicated that they had donated money (14 people had experienced
homelessness). Survey participants had anywhere from zero to five associations with the issue of
homelessness with the average being close to two (M=1.87, SD=1.26).
J. A. Koepfler
10
Shared Values and Value Conflicts: A Framework for Identifying Values of Interest for Multiple
Stakeholders in the Design of New Technologies
Table 3. Summary statistics of stakeholder associations (n=132)
Demographic
% (n)
Stakeholder associations
Donated goods to a social service organization
80% (106)
Donated money to a social service organization
41% (54)
Volunteered for a social service organization
30% (39)
Experienced homelessness
16% (21)
Worked for a social service organization
11% (15)
No stakeholder relationship to homelessness
11% (15)
Missing data
5% (6)
Experienced homelessness more than once
Yes
57% (12)
No
29% (6)
Prefer not to answer
10% (2)
Missing data
5% (1)
Most recent experience with homelessness
Currently homeless
10% (2)
Since the 2008 economic crisis (2008-2011)
43% (9)
Prior to the 2008 economic crisis (1995-2007)
20% (4)
Before 1995
10% (2)
Prefer not to answer
10% (2)
Missing data
10% (2)
Note. Columns may total greater than 100% due to multiple responses and/or rounding error.
Although the overlap between the stakeholder associations limited the types of statistical tests that
could be conducted, it provided a rich picture of stakeholder relationships to homelessness than would
have been possible if I had asked participants to try to identify with one stakeholder group over another.
Correlation analyses, however, were appropriate for this data, and were useful for identifying potential
values of interest, which the framework suggests should emerge from the consideration of the various
stakeholders and the values of the social and communication contexts. Specifically, I tested the following
assumptions of the framework:
1. There will be values that show positive relationships to some stakeholder associations,
indicating salient values of interest
2. There will be values that show positive relationships across stakeholder associations,
indicating shared values
3. There will be values that show positive relationships to some stakeholder associations but
not others, indicating conflicting values
To test these three assumptions, I conducted one-tailed point-biserial correlations for each stakeholder
association and each of the values in the social context of homelessness and in the communication context
of Twitter. Table 4 summarizes the results of the correlation analyses. Overall, the strength of the
correlations were small, but they were in the anticipated direction (i.e. positive) and point to several values
of interest.
J. A. Koepfler
11
Shared Values and Value Conflicts: A Framework for Identifying Values of Interest for Multiple
Stakeholders in the Design of New Technologies
First, five of the six values associated with homelessness (wealth, identity, spirituality,
broadmindedness, and equality) showed significant positive correlations (p<.01) with at least one of the
stakeholder associations. One of the three informal communication values (connectedness) showed
significant positive correlations (p<.01) with one of the stakeholder association categories. These values
are all salient to the sample of individuals that participated in the survey (assumption 1).
Broadmindedness had statistically significant positive correlations with individuals who indicated
that they had volunteered or worked for an organization associated with homelessness or poverty in the
last twelve months, and positive trends (p<.05) for the other three associations. The fact that at least some
positive relationship emerged among all five groups highlights broadmindedness as a potential shared
value among stakeholders associated with homelessness (assumption 2). Spirituality might also be a
potential shared value among three of the five stakeholder groups (donated money, volunteered, and
experienced homelessness).
Wealth and equality were positively associated with those who had experienced homelessness, but
no other groups, and identity and connectedness were associated with those who had donated money to
an organization related to homelessness in the last twelve months, but no other groups, pointing to
potential conflicting values (assumption 3).
Table 4. Relationships between values and stakeholder associations (n=1261)
Donated goods (n=106)
.23**
Volunteered for (n=39)
Worked for (n=15)
Participation
Connectedness
Comfort
Equality
.15*
Donated money (n=54)
Experienced homelessness
(n=21)
Broadmindedness
Spirituality
Identity
Helpfulness
Values associated with homelessness
Wealth
Stakeholder association
Values associated
with informal
communication
.31**
.19*
.19*
.21*
.19*
.28**
.28**
.21*
.15*
.21**
.18*
.21**
.19*
.28**
Notes. *p<.05, **p<.01. Potential shared values are green. Potential divergent or conflicting values are in
red. Degrees of freedom for all of the tests was 124. Six of the survey participants who completed the
portraits did not complete the stakeholder questions, resulting in n=126 for the analysis.
J. A. Koepfler
12
Shared Values and Value Conflicts: A Framework for Identifying Values of Interest for Multiple
Stakeholders in the Design of New Technologies
Discussion
Though value priorities are understood to be trans-situational (Schwartz, 2007), the salience of
certain values in groups will be mediated by social and technological contexts, which have implications for
design. When designing web-based communication tools for complex issues like homelessness, it is
necessary to explore how stakeholder associations to the research domain influence the salience of
particular values and to take into account these different contexts. Previous research in the social services
domain has used qualitative approaches tailored to the specific design group to accomplish these goals,
but these approaches may be difficult to scale up or to replicate in other environments. The contextualized
value portraits I developed for this study offer a starting point for engaging values in design of large-scale or
distributed informal communication systems. An example of such a system might be deploying a
Community Resource Messenger, like the one developed by Le Dantec and colleagues (2008, 2010,
2011), in shelters across the state of Georgia or along the entire southeast coastal region of the United
States. Another example could be developing a tool that aggregates real-time updates through tweets
regarding social services and other information and resources. As government funding becomes
increasingly scarce, such approaches may become more desirable for effectively allocating resources and
facilitating communication and information exchange among stakeholders in this domain. Ensuring that the
values of interest of the key stakeholders involved are addressed at the outset, will facilitate the success of
such systems and design teams.
The findings also provide preliminary empirical evidence for accepting the major components of the
proposed framework. Using the social context of homelessness, the communication context of Twitter, and
key stakeholder associations in the social services domain as an initial case study, I tested the major
assumptions of the framework and identified values of interest. Though the specific values of interest
identified by the analysis are limited to the study sample and are not generalizable to a broader population,
we can consider how they might occur in real-life design scenarios. For example, broadmindedness
emerged as a shared value among the stakeholders associated with homelessness. Knowing that this is a
potential shared value ahead of time enables designers to proactively use this value as a “lever” to “pry
open” discussions about values in the design process (Shilton, 2011). Team leaders can explicitly state that
this value is core to the group’s interactions and success and initiate it as a design requirement in the
system.
Additionally, knowing about conflicting values is also useful. Value conflicts are a natural part of the
design process yet they can have major impacts on the resulting design of systems (Fleischmann &
Wallace, 2010). Conflicts may arise around competing values or they may arise when different
stakeholders prioritize certain values that are less relevant to other stakeholders, such as wealth, equality,
identity, and connectedness identified by this study. Team leaders could guide the design team through
exercises that raise these issues at the start of a design project in order to get potential conflicts out in the
open and leverage those discussions for innovations in the design of the system. In this way, the
contextualized value portraits along with the framework for identifying values of interest become precursors
to using other tools, such as Envisioning Cards (http://www.envisioningcards.com/), which intend to raise
awareness of long-term and systemic ethical issues and values in design (Nathan et al., 2008). Identifying
values of interest allows designers to select appropriate envisioning cards for the design team and the
intended design product.
Finally, values of interest can also help team leaders bring together their design teams. Creating
diversity in design teams is often based on demographic characteristics, but determining values of interest
can help team leaders recruit individuals with a diversity of values, or, conversely, ensure that the design
partners they select all have at least one common value among them.
J. A. Koepfler
13
Shared Values and Value Conflicts: A Framework for Identifying Values of Interest for Multiple
Stakeholders in the Design of New Technologies
Limitations & Future Work
There are several limitations of this study that could be addressed through future research. First,
one significant limitation is that I used only single-item portraits to measure each value in order to keep the
length of the survey to a minimum. This decision sacrificed construct validity for increased response rate
and survey completion. Future work should consider developing multiple-item portraits for the values
associated with homelessness and informal communication. Further, I contextualized the portraits within
the informal communication context of Twitter based on patterns of communication and value expression
from Study 3 (Koepfler & Fleischmann, 2012). A portrait can only account for so much of that context. One
participant highlighted just one of the challenges related to this issue in the open comments section of the
survey:
I actively use Twitter from multiple accounts, for multiple purposes (I have an academic
account and a sports account…). My answers hold true for both, but you may want to
consider how to address users with multiple accounts.
In addition to multiple Twitter accounts, Twitter is a medium that allows users to move fluidly between
communication contexts. Further research is needed to examine the role that multiple user accounts,
multiple social media identities, and context-switching between communication tools has on the user
experience and how users navigate those spaces in light of their values. Finally, Twitter is just one of many
tools that support informal communication. Additional research in other informal communication contexts,
including Facebook, Tumblr, and personal blogs, should be used to further vet the framework proposed in
this paper.
Second, the stakeholder groups used for comparison were relatively small and skewed due to the
sampling procedures that were necessary for data collection. The distribution of individuals who did and did
not have certain stakeholder associations (“yes” responses versus “no” responses in each category) were
unequal. As dichotomous distributions become more unequal they constrain the potential strength of
statistical correlations that one can find with the dependent variable. Larger samples from individuals with
the characteristics of interest might support additional correlation analyses as well as other tests, such as
exploratory factor analysis, to determine which of the variables associated with homelessness along with
other demographic and psychographic variables account for the greatest amount of variance. Findings from
such studies would contribute to validating existing components of the framework and potentially adding
new elements for consideration.
Lastly, values are incredibly complex and difficult to study as is the issue of homelessness (Catton,
1954). I do not intend to make light of that fact in this paper. The survey method I used with the
contextualized value portraits shows the relationships between values and different stakeholder
associations to homelessness, which otherwise could not be identified through other methods like content
analysis. This finding highlights the importance of mixed-methods research for the study of values more
generally. Triangulating methods and combining them with qualitative studies could shed light on the many
factors that are co-occurring in these contexts.
CONCLUSION
In this paper, I proposed a framework for identifying values of interest for multi-stakeholder, valuecentered design projects. I applied the framework to a specific design scenario consisting of values related
to homelessness (wealth, helpfulness, identity, spirituality, broadmindedness, and equality), values related
to informal communication (comfort, connectedness, and participation), and the stakeholders that were
relevant to the combination of both of those contexts. I developed and deployed a set of contextualized
J. A. Koepfler
14
Shared Values and Value Conflicts: A Framework for Identifying Values of Interest for Multiple
Stakeholders in the Design of New Technologies
value portraits to test the assumptions of the framework. The findings provided preliminary empirical
support for the major components of the framework and offered several implications for using values in the
design of information and communication systems. The importance of designing such systems in this way
can perhaps best be summarized by revisiting the PEN project and Donald Paschal, who explains:
On PEN, I have been helped, rebuffed, scorned, criticized, considered, and in most cases,
respected – as a human. PEN is a great equalizer. There are no homeless or homed
unless we say we are. We are not one happy family; like most families, we squabble. On
any topic, no one can accuse PENners of agreeing fully. But we are communicating, and
that is a start. (Donald Paschal, homeless resident in Santa Monica, CA, 1996)
From Donald’s perspective being present at the stakeholder table and opening up the lines of
communication, regardless of whether or not values and opinions conflict, is what matters most.
[word count: 7,194]
Acknowledgements
I would like to thank the members of my committee for their guidance and feedback throughout this
research process – Drs. Kenneth R. Fleischmann, Katie Shilton, and June Ahn. I would also like to thank
James R. Koepfler, Jeffrey DiScala, and Christopher Mascaro for reviewing early drafts of this work.
References
Becker, S., Crandall, M. D., Fisher, K. E., Kinney, B., Landry, C., & Rocha, A. (2010). Opportunity for all:
How the American public benefits from Internet access at U.S. libraries. Washington, D.C.: Institute
for Museum and Library Services.
Bennet, R. (2003). Factors underlying the inclination to donate to particular types of charity. International
Journal of Nonprofit and Voluntary Sector Marketing 8(1), 12-29.
Bernthal, W. F. (1962). Value perspectives in management decisions. Journal of the Academy of
Management, 5(3), 190-196.
Bird, F. & Waters, J. A. (1987). The nature of managerial moral standards. Journal of Business Ethics, 6(1),
1-13.
Catton, W. R., Jr. (1954). Exploring techniques for measuring human values. American Sociological
Review, 19(1), 49-55.
Cheng, A. -S., & Fleischmann, K. R. (2010). Developing a meta-inventory of human values. Proceedings of
the American Society for Information Science and Technology 47(1), 1-10.
Cheng, A. -S., Fleischmann, K. R., Wang, P., Ishita, E., & Oard, D. (Under Review). When innovation
meets wealth: A content analysis of human values in the Net neutrality debate.
Cheng, A. -S., Fleischmann, K. R., Wang, P., Ishita, E., & Oard, D. (2010). Values of stakeholders in the
Net neutrality debate: Applying content analysis to telecommunications policy. Proceedings of the
43rd Hawai'i International Conference on System Sciences, (Honolulu, HI, Jan. 5-8, 2010), 1-10.
Corder, G. W. & Foreman, D. I. (2009). Comparing variables of ordinal or dichotomous scales: Spearman
rank-order, point-biserial, and biserial correlations. In Nonparametric statistics for non-statisticians.
Hoboken, NJ: John Wiley & Sons, Inc., 122-154.
Crace, R. K. & Brown, C. (1995). Life values inventory. Minneapolis: National Computer Systems.
Daniels, J. (Under Review). ‘It helps keep me sane’: Mobile phone use by homeless LGBTQ youth in New
York City.
J. A. Koepfler
15
Shared Values and Value Conflicts: A Framework for Identifying Values of Interest for Multiple
Stakeholders in the Design of New Technologies
England, G. W. (1967). Personal value systems of American managers. Academy of Management Journal,
10, 53-68.
Eyrich-Garg, K. (2010). Mobile phone technology: A new paradigm for the prevention, treatment, and
research of the non-sheltered “street” homeless. Journal of Urban Health, 87(3), 365-380.
Feather, N. T. (1975). Values and income level. Australian Journal of Psychology, 27, 23-30.
Feather, N. T. (1985). Attitudes, values, and attributions: Explanations of unemployment. Journal of
Personality and Social Psychology, 48(4), 876-889.
Feather, N. T. (1992). Expectancy-value theory and unemployment effects. Journal of Occupational and
Organizational Psychology, 65, 315-330.
Flanagan, M., & Nissenbaum, H. (2007). A game design methodology to incorporate activist themes.
Proceedings of CHI 2007 conference. San Jose, CA. 28 April-3 May, 2007.
Fleischmann, K. R. (2006). Boundary objects with agency: A method for studying the design-use interface.
The Information Society, 22(2), 77-87.
Fleischmann, K. R. (2007). Digital libraries with embedded values: Combining insights from LIS and
Science and Technology Studies. Library Quarterly, 77(4), 409-427.
Fleischmann, K. R., Oard, D. W., Cheng, A. -S., Wang, P., & Ishita, E. (2009). Automatic classification of
human values: Applying computational thinking to information ethics. Proceedings of the American
Society for Information Science and Technology 46(1), 1-10.
Fleischmann, K. R., & Wallace, W. A. (2010). Value conflicts in computational modeling. IEEE Computer
Society (July), 57-63.
Friedman, B. (Ed.). (1997). Human values and the design of computer technology. New York: Cambridge
University Press.
Friedman, B., & Freier, N. (2004). Value sensitive design. In K. E. Fisher, S. Erdelez, and E. F. McKechnie
(Eds.). Theories of information behavior: A researcher's guide. Medford, NJ: Information Today,
368-372.
Friedman, B., & Kahn, P. H., Jr. (1992). Human agency and responsible computing: Implications for
computer system design. Journal of Systems Software, 17, 7–14.
Friedman, B., Kahn, P. H., Jr., & Borning, A. (2006). Value sensitive design and information systems. In P.
Zhang and D. Galletta (eds.), Human-computer interaction in management information systems:
Foundations. Armonk, NY: M. E. Sharpe, 348-372.
Friedman, B. & Nissenbaum, H. (1996). Bias in computer systems. ACM Transactions on Information
Systems, 14(3), 330-347.
Granovetter, M.D. 1973. The Strength of Weak Ties. American Journal of Sociology, 78 (6), 1360-1380.
Hendry, D.G., Woelfer, J.P., Harper, R., Bauer, T., Fitzer, B., and Champagne, M. (2011). How to integrate
digital media into a drop-in for homeless young people for deepening relationships between youth
and adults. Children and Youth Services Review, 33(5), 774-782.
Inglehart, R. (1997). Modernization and postmodernization: Cultural, economic, and political change in 43
societies. Princeton, NJ: Princeton University Press.
Java, A., Song, X., Finin, T. & Tseng, B. (2007). Why we twitter: Understanding microblogging usage and
communities. Proceedings of the 13th ACM SIGKDD International Conference on Knowledge
Discovery and Data Mining.
Jurkiewicz, C. L. & Giacalone, R. A. (2004). A value framework for measuring the impact of workplace
spirituality on organizational performance. Journal of Business Ethics, 49(2), 129-142.
Kahle, L. R., Poulos, B., & Sukhdial, A. (1988). Changes in social values in the United States during the
past decade. Journal of Advertising Research, 28, 35-41.
J. A. Koepfler
16
Shared Values and Value Conflicts: A Framework for Identifying Values of Interest for Multiple
Stakeholders in the Design of New Technologies
Koepfler, J. A., & Fleischmann, K. R. (2011). Classifying values in informal communication: Adapting the
meta-inventory of human values for tweets. Proceedings of the 74th Annual Meeting of the
American Society for Information Science and Technology (New Orleans, LA Oct. 7-12, 2011), 1-4.
Koepfler, J. A., & Fleischmann, K. R. (2012). Studying the values of hard-to-reach populations: Content
analysis of Tweets by the 21st century homeless. Proceedings of the 2012 iConference, (Toronto,
ON, Feb. 7-12, 2012), 1-8.
Koepfler, J. A., & Hansen, D. L. (2012). We Are Visible: Technology-mediated social participation in a
Twitter network for the homeless. Proceedings of the 2012 iConference (Toronto, ON, Feb. 7-12,
2012), 1-2.
Kraut, R., Fish, R., Root, R. & Chalfonte, B. (1993). Informal communication in organizations: Form,
function, and technology. Proceedings of the annual conference on computer supported
cooperative work.
Le Dantec, C. A. (2008). Life at the margins: Assessing the role of technology for the urban homeless.
Interactions, October/November, 25-27.
Le Dantec, C. A., Christensen, J. E., Bailey, M., Farrell, R. G., Ellis, J. B., Danis, C. M., Kellogg, W. A., &
Edwards, W. K. (2010). A tale of two publics: Democractizing design at the margins. Proceedings
of the conference on Designing interactive systems. New York: ACM, 11–20.
Le Dantec, C. A., & Edwards, W. K. (2008). Designs on dignity: perceptions of technology among the
homeless. Proceedings of the twenty-seventh annual SIGCHI conference on Human factors in
computing systems. New York: ACM, 627-636.
Le Dantec, C. A. & Edwards, W. K. (2010). Across boundaries of influence and accountability: The multiple
scales of public sector information systems. Proceedings of the annual conference on Human
factors in computer (CHI '10). ACM, New York, NY, USA, 2010, 113–122.
Le Dantec, C. A., Farrell, R. G., Christensen, J. E., Bailey, M., Ellis, J. B., W. A. Kellogg, W. A., & Edwards,
W. K. (2010). Publics in practice: Ubiquitous computing at a shelter for homeless mothers.
Proceeding of the twenty-ninth annual SIGCHI conference on Human factors in computing
systems. New York: ACM, 1687–1696.
Marwick, A. & boyd, d. (2011). I Tweet honestly, I Tweet passionately: Twitter users, context collapse, and
the imagined audience. New Media & Society, 13, 96-113.
McDonald, P., & Gandz, J. (1991). Identification of values relevant to business research. Human Resource
Management, 30(2), 217-236.
Nardi, B.A. 2005. Beyond bandwidth: Dimensions of connection in interpersonal Communication. Journal of
Computer Supported Cooperative Work 14(2), 91-130.
Nathan, L. P., Friedman, B., Klasnja, P., Kane, S. K., & Miller, J. K. (2008). Envisioning systemic effects on
persons and society throughout interactive system design. In Proceedings of the 7th ACM
Conference on Designing Interactive Systems. New York, NY: ACM Press, 1-10.
National Coalition for the Homeless. (2006). McKinney-Vento Act. Available at:
www.nationalhomeless.org/publications/facts/McKinney.pdf
National Law Center on Homelessness and Poverty. (2007). Homelessness counts. Available at:
http://www.endhomelessness.org/content/article/detail/1440.
Plowright, D. (2011). Using Mixed Methods: Frameworks for an Integrated Methodology. London: Sage
Publications Ltd.
Ravlin, E. C., & Meglino, B. M. (1987). Effect of values on perception and decision making: A study of
alternative work value measures. Journal of Applied Psychology, 72, 666-673.
Rokeach, M. (1973). The nature of human values. New York: Free Press.
J. A. Koepfler
17
Shared Values and Value Conflicts: A Framework for Identifying Values of Interest for Multiple
Stakeholders in the Design of New Technologies
Schwartz, S. H. (1994). Are there universal aspects in the structure and contents of human values? Journal
of Social Issues, 50(4), 19-45.
Schwartz, S. H. (2007). Value orientations: measurement, antecedents and consequences across nations.
In R. Jowell, C. Roberts, C. Fitzgerald, & G. Eva (Eds.), Measuring attitudes cross-nationally:
Lessons from the European Social Survey, London: Sage Publications Ltd., 169-203
Scott, W. A. (1965). Values and organizations: A study of fraternities and sororities. Chicago: Rand
McNally.
Sermons, M. W. & Witte, P. (2011). State of homelessness in America: A research report on
homelessness. Washington, D.C.: National Alliance to End Homelessness.
Shilton, K. (2010). Technology development with an agenda: Interventions to emphasize values in design.
Proceedings of the American Society for Information Science and Technology, 47(1), 1-10.
Shilton, K. (2011). Building values into the design of pervasive mobile technologies. Unpublished doctoral
dissertation, University of California, Los Angeles. Available at http://ssrn.com/abstract=1866783.
Smith, A. (2011). 13% of online adults use Twitter: Half of Twitter users access the service “on the go” via
mobile phone. Pew Internet & American Life Project. Available at:
http://pewinternet.org/~/media//Files/Reports/2011/Twitter%20Update%202011.pdf
Van Tassel, J. (1996). Yakety-yak, do talk back!: PEN, the nation's first publicly funded electronic network,
makes a difference in Santa Monica. In Rob Kling (Ed.) Computerization and controversy, 2nd Ed.
Orlando, FL: Academic Press, Inc., 547-551.
Woelfer, J.P., and Hendry, D.G. (2010). Homeless young people's experiences with information systems:
Life and work in a community technology center. Proceeding of the twenty-eighth annual SIGCHI
conference on Human factors in computing systems. New York: ACM Press, 1291-1300.
Woelfer, J.P., & Hendry, D.G. (2011). Homeless young people and living with personal digital artifacts.
Proceeding of the twenty-ninth annual SIGCHI conference on Human factors in computing
systems. New York: ACM Press, 1697-1706.
Woelfer, J.P., Iverson, A., Hendry, D.G., Friedman, B., & Gill, B. (2011). Improving the safety of homeless
young people with mobile phones: Values, form and function. Proceeding of the twenty-ninth
annual SIGCHI conference on Human factors in computing systems. New York: ACM Press,
1707-1716.
Zhao, D., & Rosson, M. B. (2009). How and why people Twitter: The role that microblogging plays in
informal communication at work. Proceedings of GROUP ’09 (May 10-13, 2009).
J. A. Koepfler
18
Download