Reverse Time-Inconsistency Serdar Sayman Ayşe Öncüler April 2006 _____________________________________________________________________________ Serdar Sayman Assistant Professor of Marketing Koç University Rumeli Feneri Yolu, Istanbul, 34450, Turkey Phone: +90 (212) 338 1616 Fax: +90 (212) 338 1653 E-mail: ssayman@ku.edu.tr Ayşe Öncüler Assistant Professor of Decision Sciences INSEAD Boulevard de Constance, Fontainebleau, 77305, France Phone: +33 (0) 1 60 724511 Fax: +33 (0) 1 60 746716 E-mail: ayse.onculer@insead.edu This research is supported by funds from Koç University, INSEAD, and KÜMPEM. Authors thank seminar participants at the Marketing Science Conference 2005 Atlanta, ESA 2005 Montreal and SPUDM 2005 Stockholm for their comments, and Demir Çilingir for his contributions at various stages of this research. Abstract Individuals preferring a particular future option may change their preference in favor of another one as time progresses -- a behavior referred to as dynamic or time-inconsistency. Previous empirical findings on time-inconsistent preferences consistently points to the case where decision-makers prefer a later (and superior / larger) future prospect over an earlier (and inferior / smaller) one at the outset, but switch their choice to the smaller prospect when the options become more imminent. In this paper, we provide evidence for time-inconsistency in the other direction: preferring a smaller-earlier temporal payoff over a larger-later one at the beginning, but choosing to wait for the latter as both payoffs draw nearer. We use the term reverse time inconsistency to designate this behavior. This intertemporal preference pattern, to our knowledge, has not been explicitly identified before. Our findings from a number of empirical studies suggest that reverse time-inconsistency occurs in a variety of contexts. The results show that the extent of reverse time-inconsistency depends on payoff sizes and delay times. Furthermore, we also provide some evidence on gender differences. Key Words: Time Inconsistency, Dynamic Inconsistency, Time Preference 1 Introduction Individuals preferring a particular future option may change their preference in favor of another option as time progresses (e.g. Hoch and Loewenstein 1991, Loewenstein 1996). For instance, a prospective dieter may decide to eat a chocolate bar (possibly with a feeling of guilt) even though she had earlier decided to go on a diet. There has been an extensive investigation of time-inconsistent preferences in the behavioral literature (see Frederick et al. 2002 for a comprehensive review). Empirical evidence regarding such time-inconsistent preferences consistently points to the case where decision-makers prefer a later (and superior / larger) future prospect over an earlier (and inferior / smaller) one at the outset, but switch their choice to the smaller prospect when the options become more imminent. In this paper, we provide evidence for time-inconsistency in the other direction: preferring a smaller-earlier temporal payoff over a larger-later one at the beginning, but choosing to wait for the latter as both payoffs draw nearer. This intertemporal preference pattern, to our knowledge, has not been explicitly identified before. We will use the term “reverse time-inconsistency” to denote this behavior. Our findings from four empirical studies suggest that reverse time-inconsistency, like timeinconsistency, is indeed a common behavior under various contexts. Our studies involve: (i) both hypothetical and real payoffs; and (ii) cases where participants spend effort for the payoffs (loyalty programs) and cases with effortless payoffs. The results show that the extent of reverse timeinconsistency depends on payoff sizes and delay times. Furthermore, we also provide some evidence on gender differences. The paper is planned as follows: The next section involves a brief discussion of the background research on time-inconsistent preferences. We then present our findings from four empirical studies followed by a discussion of possible causes or explanations for reverse time-inconsistency. The paper ends with a summary and concluding remarks. Background Time-inconsistency (or dynamic inconsistency), a concept first introduced by Strotz (1955), falls 2 under the broader line of preference reversal research and it implies non-stationarity of preferences. For example, one may prefer $12 in 31 days over $10 in 30 days; but $10 today is preferred over $12 tomorrow. Discounted Utility Theory (DUT), the standard economic model of choice over time, assumes that preferences between two temporal payoffs do not depend on the point of time the evaluation is made (Samuelson 1937; Koopmans 1960; Fishburn and Rubinstein 1982). In other words, if payoffs are delayed by the same amount of time, the preference ordering should not be affected. This discounting behavior is modeled by an exponential function, where the discount rate does not change with delay time. However, this framework has been systematically challenged as a descriptive model. Studies such as Thaler (1981) and Benzion et al. (1989) suggest that although individuals prefer an earlier payoff to a delayed one, sensitivity to time delay progressively decreases; that is, the discount rate is not constant. Hyperbolic discounting has been proposed and modeled in the literature (e.g. Ainslie 1975; Mazur 1987; Hernnstein 1981; Loewenstein and Prelec 1992) as a discount function that can capture time-inconsistent preferences. Under hyperbolic discounting, the discounted value of a temporal payoff falls sharply for small delays but then it flattens out. In other words, there is less discounting (a higher discount factor, or a lower discount rate per period) for a given time interval if the interval is temporally remote. Hence, in the above example, hyperbolic discounting can account for the shift in the preferences because the per-period discount rate moving from 30 days to 31 days is smaller than the rate moving from today to tomorrow. There are a few explanations for the decreasing sensitivity towards time delay. One possibility is that a time interval, if it is evaluated relatively, would be perceived as smaller when it is temporally further away. Hence, the difference between 30 and 31 days would be perceived as smaller than the difference between today and tomorrow. This is related to the Weber’s law, or psychophysics of time (see Keren and Roelofsma 1995). Another explanation is that discounting reflects the implicit uncertainty in obtaining the payoff in the future (Keren and Roelofsma 1995). This uncertainty increases rapidly for the near future, and then the rate of increase diminishes. A third possibility is impulsive decision-making and lack of self-control (Ainslie 1975; Rachlin and Green 1972; Green et al. 1981). If impulsivity plays a role 3 in preference or choice, one would overweigh a smaller-imminent payoff relative to a larger-later one, even though she had planned to wait for the latter earlier on. Emotions and visceral factors such as cravings may also play a role in triggering such impulsive or myopic decisions (Loewenstein 1996). It has been argued that even exponential discounting could account for time-inconsistency if discounting is not independent of the payoff size (see Green et al. 1981; Kirby and Marakovic 1996; Kirby 1997). These studies involve exponential discounting, as suggested by DUT, but smaller amounts are discounted more than larger amounts.1 Such a discounting implies that when both small and large payoffs are brought forward, the small payoff would become relatively more attractive. With this background in mind, we hope to contribute to the literature by providing evidence for a time-inconsistency of a different direction. Previous literature on time- inconsistency focuses mainly on one direction: preferring a larger-later reward to a smaller-sooner one when both outcomes are in distant future, but then switching to the smaller-sooner reward when the outcomes become less remote (e.g. Green et al. 1981, Green et al. 1994, Kirby and Hernnstein 1995). Our experimental results indicate that there exists some situations where a smaller-earlier temporal payoff may be preferred over a larger-later one at the outset, but the larger payoff becomes more attractive as both payoffs draw nearer. We designate this behavior as reverse time-inconsistency. In the next section we present our empirical findings on this phenomenon. We conducted four studies: Studies 1 and 3 involve payoffs within the context of loyalty programs, and Studies 2 and 4 use neutral monetary payoffs. Studies 1 and 2 employ cross-sectional designs; Studies 3 and 4 use longitudinal data with real payoffs. The design specifics of the four studies are summarized in Figure 1. ----- Insert Figure 1 about here ---- 1 This may be explained by the psychophysics of the waiting effort -- for smaller amounts, the return has to be substantial to make the wait attractive (Thaler 1981). 4 Empirical Studies Study 1 Method. Our first study involves two choice experiments with 97 and 100 student participants from INSEAD and Koç University, respectively. Participants answered questions regarding rewards offered by hypothetical loyalty programs. The rewards were based on accumulated purchases; hence, the payoffs required (hypothetical) effort. In exchange for participation we offered students in INSEAD and Koç University a chance to win $100 and $70 gift checks respectively. There were additional sections, unrelated to our study, in the survey booklets. Design and Stimuli. We will only describe the details of the session run at INSEAD because the two sessions are almost identical in structure and stimulus. The experiment involves two hypothetical loyalty program vignettes: (a) Local supermarket Porcupine offers a $10 check if the buyer makes $100 worth of purchases. The reward is $25 for a cumulative purchase of $200. Gift checks can be used at any Porcupine store. (b) Subjects’ favorite movie theater offers one free ticket after purchasing three tickets; or two free tickets after five tickets. The order of the vignettes is counter-balanced across subjects. There is no time limit for either of the loyalty programs, and a shopper receiving a reward can pursue additional reward(s) afterwards. Furthermore, purchases can be recorded by using the student ID (smart) cards, and there is no additional effort or cost associated with the programs. Our experimental manipulation is the timing of the reward choice: (i) Students in the “distant” condition are told that the loyalty program starts today. They are then asked to indicate whether they would prefer to receive the $10 check or the $25 check after the corresponding purchase volume. Similarly, for the movie theater vignette, they indicate their choices between one and two free tickets. (ii) Students in the “immediate” condition are told to assume that the program started a few weeks ago, and the sales clerk informs them that they have completed $100 worth of purchases. They are asked whether they would prefer to receive the $10 check immediately, or wait for the $25 check after completing a total of $200 purchases. For the movie theater loyalty program, they are told to assume that they are buying their third ticket today, and that they have a choice between receiving a free ticket today or two free 5 tickets later. Reward choice timing is a between-subjects manipulation. In addition to the choice questions, we also asked the gender of the participants in both groups. There were 47 participants, with 25 females and 22 males, in the “distant” condition, compared to 50 participants, with 30 females and 20 males, in the “immediate” condition. Regarding the session run at Koç University, the supermarket vignette was slightly different: the local supermarket Migros offers a $3 check if consumer spends a total of $30, and $7.5 if spending reaches $60.2 There were 50 participants (26 females and 24 males) in the “distant” condition; and 50 (28 females and 22 males) in the “immediate” case. Results and Discussion. Before presenting our findings, we note that prior research suggests that there may be gender differences in time preferences. Although studies such as Kirby and Marakovic (1995) and Harrison et al. (2002) report no gender differences in discounting behavior, others indicate a gender difference albeit small and domain specific (Bjorklund and Kipp 1996; Silverman 2003). For instance, Kirby and Marakovic (1996) find that females discount future payoffs less than males do, suggesting that women are generally better in delaying gratification and resisting temptation or impulsivity. In a recent study, McLeish and Oxoby (2005) report that males switch to smaller-immediate payoff faster than females. Hence, there may be some gender differences in time-inconsistency. We will consider gender as a factor in our analysis of the empirical data regarding reverse time-inconsistency (RTI hereafter), or time-inconsistency (TI hereafter) thereof. ---- Insert Table 1a and Table 1b about here ---- Table 1a and 1b present the findings from the two experimental sessions. For brevity purposes, the tables only describe the options SS (smaller-sooner reward) and LL (larger-later reward) in the 2 The figures were stated in local currency terms; at the time of the experiment, one US Dollar was about 1.35 New Turkish Lira. 6 “distant” rewards condition. In the corresponding “immediate” case, subjects have already spent $100 and they are to choose between receiving $10 (SS option) or receiving $25 after spending $100 more (LL option). For instance, the upper panel of Table 1a indicates that 48% of the female participants in the “distant” supermarket rewards condition preferred to wait for the larger-later reward LL, compared to 20% in the “immediate” case. Hence, a smaller ratio of female subjects preferred to wait when the rewards were closer in time, indicating a TI behavior. The difference is significant with p 0.05 (2 test, df = 1). For the movie theater loyalty program presented in the lower panel, 72% of females chose to wait when both rewards were distant, but only 50% did so when the smaller reward was immediate. This again indicates TI (p 0.10). For the male participants, on the other hand, there is strong evidence of RTI in the case of supermarket loyalty program: 32% of males preferred to wait when rewards were distant, 85% chose to wait when the smaller reward was immediate (difference significant with p 0.01). In the movie theater scenario, the percentages directionally indicate RTI even though the difference is not statistically significant. When we look at the aggregate data over all subjects, the corresponding percentages are not significantly different from each other-- that is, neither TI nor RTI is evident on average. Our findings from the session at Koç University, presented in Table 1b, are directionally similar to the above; however, none of the differences between the corresponding percentages is significant. Hence, there is no statistical evidence of TI or RTI. Taken together, Table 1a and 1b indicate that the incidence of RTI or TI may depend on the context (type of program, size of the rewards, cultural setting) and on the individual (gender differences). There is one issue worth noting: In this particular design, rewards are based on consumer effort or spending. Hence, what we are measuring may not be time preference per se. Study 2 presented below focuses on (neutral) monetary payoffs to be received over time, without requiring any effort or spending. Study 2 Method. There were three experimental sessions in Study 2. Two of these were conducted at Koç University and the third one at INSEAD, with 130, 116, and 67 subjects in each session respectively. 7 Subjects answered choice questions regarding hypothetical monetary payoffs. We varied the relative sizes of the payoffs across the experimental sessions and the payoff-delay time combinations within a session. Participants from Koç University were offered a chance to win a $50 gift check of a department store; in INSEAD the survey was part of a larger survey and the prize was an MP3 player. Design and Stimuli. The introduction of the survey stated that the questions were intended to measure the individual preferences for payoffs over time. Participants then answered eight questions involving choices between two temporal payoffs (details can be seen in Tables 2a, 2b, and 2c below). Similar to our first study, we used a between-subjects design. For instance, subjects in the “distant” condition were asked to indicate their preference between receiving “$7 in 1 day” versus “$10 in 3 days”; whereas in the corresponding “immediate” case, the choice was between “$7 today” versus “$10 in 2 days”. In both conditions, the order of the questions was randomized -- picked from one of the predetermined versions. We also noted in the introduction that there were no right or wrong answers, and each question should be considered independently. After the choice questions, we also asked the gender of the participants. ---- Insert Table 2a, Table 2b, and Table 2c about here ---- Results and Discussion. As in the first study, the tables describe the options SS and LL for the “distant” rewards condition; in the corresponding “immediate” condition, SS is immediate and LL is brought forward. Study 2a, conducted at Koç University, involved 70 subjects in the “distant” rewards condition (32 female and 38 male), and 60 subjects in the “immediate” condition (29 female and 31 male). The results were quite robust in the direction of RTI for both payoff pairs. Except for the pairs where SS was to be received in two weeks and LL in four weeks, we observed RTI in all cases (p values are given in Table 2a). This finding holds for both genders and for the overall subject group. Study 2b was also run at Koç University. The relative sizes of payoffs were modified in order to provide further evidence on the range of payoff-delay combinations for which RTI or TI is pertinent. 8 There were 59 subjects in the “distant” condition (26 female and 33 male) and 57 subjects in the “immediate” case (26 female and 31 male). We again observed a strong evidence for RTI, as given in Table 2b, for all three subject groups. A third session (Study 2c) was run at INSEAD. The size of the SS and LL rewards were modified further in this treatment. We had 33 subjects in the “distant” condition (16 female and 17 male) and 34 subjects in the “immediate” condition (15 female and 19 male). Although the number of subjects in each experimental cell was not large, we still obtained significant differences between the corresponding percentages (see Table 2c). In general, women exhibited RTI, while men behaved predominantly in the other direction. All subjects taken together, for smaller payoffs with short delays, evidence is in the direction of RTI, but not significant; for larger payoffs and / or long delays there is evidence for TI. Study 3 Most of the empirical work in intertemporal choice involves cross-sectional designs (rather than longitudinal), where the front-end delay in attaining a reward is manipulated in a single session to demonstrate time inconsistency (see Read 2004 for a comparative analysis of the two methods). Longitudinal studies, which elicit preferences in a real-time setting, are quite scarce in the literature. Harrison et al. (2002) conducted a large-scale field experiment in Denmark over several months in order to elicit discount rates at different points in time. They report no evidence for TI, except for a particular segment of the general subject pool (students). In another recent study that compares longitudinal to cross-sectional designs, Airoldi et al. (2005) found that cross-sectional design overestimates dynamic inconsistency. Another experimental design issue is the use of real versus hypothetical payoffs. Most intertemporal choice experiments use hypothetical rewards for practical reasons-- to have flexibility over the magnitude of payoffs and over the time horizon. Bohm (1994) provides evidence that an incentivecompatible design can reduce the extent of preference reversal. Evidence in intertemporal choice literature is mixed: Some studies report no significant difference in discounting behavior with respect to 9 hypothetical and real rewards (Johnson and Bickel 2002; Read et al. 2005), whereas some others show that real rewards are discounted more heavily than hypothetical ones (Kirby 1997). Study 1 and 2 presented above involve cross-sectional designs and hypothetical payments, without any incentive-compatible payment structure. In order to examine whether these design issues would indeed influence the extent of RTI and/or TI, we conducted two additional studies, Study 3 and 4, which induce incentive compatibility through real payments. In addition, both are longitudinal studies conducted with respective subject panels. Method. Study 3 is a within-subject field experiment conducted on INSEAD campus. In association with the campus café, a loyalty program was initiated. 47 customers were willing to join the loyalty program (20 female and 27 male). At the outset, each customer was asked to state their preference between two rewards offered by the program; later preferences were elicited from actual reward redemptions. Contrary to Study 1, data is obtained from individuals who actually chose to participate in the program.3 Design and Stimuli. The café offered a two-level reward program: customers could receive a free croissant when they bought 10 croissants or two free croissants after 15 croissants. At the beginning of the experiment, the participating customers were given patronage cards, bearing ID numbers and were asked to indicate their preference between the two promotion levels. During the following few weeks, they showed these cards when making a croissant purchase, and the purchases were recorded on the card by means of a stamp. A research assistant at the café counter kept track of the participating customers’ purchase times on a half-hour basis. The experiment lasted 6 weeks, and once the free croissant(s) were given, the program ended for that customer.4 3 Dhar and Simonson (2003) provide evidence that choice proportions of two options may differ when subjects are provided with a “no-choice” option. 4 None of the subjects bought more than one croissant at a time. Individual purchase dates and times can be obtained from the authors. 10 ---- Insert Table 3 about here ---- We note that because the measurements are from the same set of subjects, we use the McNemar’s 2 test (Siegal and Castellan 1998). The results in Table 3 show that the majority of the female participants exhibit RTI. Although men show a tendency for TI, the difference is not significant. At the aggregate level, there is evidence for RTI: 51% of the participants indicated a preference for LL at the outset, compared to 72% when SS became imminent. When we analyze the data at the individual level, there were 9 customers (all male) who preferred LL at the beginning but then received the SS when they could, indicating TI. There were 19 customers who exhibited RTI behavior, of which 14 are female and 5 are male. The remaining 19 customers, 6 females and 13 males, were time consistent (either chose SS or LL at the beginning, and received the corresponding reward later on). Study 4 Method. In Study 4, as in the previous study, we employed a within-subject longitudinal design with real payments. The experiment was conducted at INSEAD. 38 student participants (17 female, 21 male) stated their preferences between different pairs of temporal monetary payoffs. When the smaller-earlier payoff was due, they were asked to state their choices again. The questionnaire was similar to the one in Study 2 but with an addition of incentive compatibility condition since all payments were done in real. Design and Stimuli. Subjects were students of a negotiations analysis course at INSEAD. The first phase of the longitudinal study was conducted in a class meeting. During this first meeting, participants answered 6 choice questions (vignettes) with monetary payoffs. The six temporal payoffs are presented in Table 4. The choice pairs were the same ones as in Study 2, except for the 2 weeks-4 weeks case.5 The subjects were told that one payoff level (€7 - €10 or €20 - €25) would be chosen randomly, and each of the three delay scenarios would be played out for real. When the SS option in each delay scenario became imminent, subjects were asked to indicate their preference between SS and LL again. In order to minimize 5 Because of practical limitations, we were not able to employ the 2 weeks-4 weeks case. 11 any concerns of consistency on the part of the subjects, they were told that the previous records were not taken into consideration. After the subjects indicated their choice between SS and LL, payments were made, if applicable. This was repeated for all three scenarios on the respective days, starting from the initial experimental day. ---- Insert Table 4 about here ---- Results and Discussion. As in Study 1 and 2, Table 4 only describes the option pairs for when the payoffs were “distant”. For the payoff pair €7- €10, there is evidence for RTI at the aggregate level in the first two delay scenarios: 29% of the subjects preferred LL in the “distant” conditions, compared to 71% and 58% in the “immediate” conditions. Females and males have similar tendencies; however the evidence is weak for males. Another observation is that the proportion of subjects preferring to wait for LL in the “immediate” condition decreases as the interval between SS and LL increases. For the payoff pair €20€25, we observe RTI for all subjects group when the delay interval is two days. For longer delays, there is no evidence in either direction of time inconsistency. Looking at individual data, 32% of the subjects were consistently showing RTI for both payoff pairs and for all three delay options; 18% were constantly exhibiting TI, and 21% of the subjects were time-consistent in all of their choices. The remaining 29% exhibited different behaviors in different payoff-delay conditions. General Discussion for Studies 1 - 4 Although Studies 1 through 4 provide substantial evidence for RTI, a simple generalization regarding the incidence of RTI or TI does not seem to avail itself. Rather, our results suggest that the extent of time-inconsistency in either direction depends on the context and the decision makers’ characteristics. More specifically, delay times of the payoffs, type and size of the payoffs, and gender altogether influence the direction of time inconsistency: 12 When payoffs are framed as loyalty program rewards (hence requiring effort), gender, type and size of the rewards, and incentive compatibility affect the extent of TI or RTI. Male participants are inclined to exhibit RTI and females exhibit TI when loyalty rewards are hypothetical (Study 1). However, in the case of real rewards (Study 3), RTI seems to be more relevant for females and TI for males. We should note that Study 3 differs from Study 1 both in terms of incentive compatibility and the nature of the reward (croissants versus supermarket coupons/movie tickets); hence, this interpretation is not without reservation. Nevertheless, one key finding from Studies 1 and 3 is that even though RTI / TI is exhibited by males and/or females, it may be overlooked when only the aggregate data is considered in the data analysis. Studies 2 and 4 indicate that, in the case of neutral monetary rewards (requiring no effort per se), the relative size of SS and LL payoffs and the time interval between them affect the degree of RTI and TI. When the size of the payoffs in options SS and LL are relatively close to one another (e.g. $7-$10 or $20-$25, as opposed to $4-$10 or $10-$25), RTI is more likely to occur, especially when the payoff is hypothetical. When the SS reward is relatively smaller than the LL reward, there is a lower tendency for RTI. The main conclusion suggested by these findings is that intertemporal preferences are richer than previously recognized in the literature. In particular, some individuals may exhibit RTI (or TI) in a variety of settings, but we fail to notice this behavior while examining only the (sample) averages. As a next step we will discuss some possible explanations that may account for our findings regarding RTI. 1. Utility from Delayed Consumption. One related issue is the additional utility derived from savoring (Loewenstein 1987). It is possible that savoring about a payoff or a consumption experience may lead individuals to defer the consumption when it is imminent. There are no clear guidelines as to what type of products or payoffs are likely to yield such a utility; in our case, croissants may be such a product. However, this account fails to explain why individuals do not prefer (derive additional utility from savoring) the larger-later payoff to begin with. 13 2. Effort Uncertainty. A second possible account is that at the outset some individuals may not be sure whether they could exert the effort or patience for the larger-later payoff, and hence, smaller-earlier payoff seems more feasible. However, when the smaller-earlier payoff is due, the extra effort required for the larger-later payoff appears to be more reasonable, compared to what it has taken until then. For instance, after having bought 10 croissants and qualifying for a free one, the additional 5 croissant purchases needed for two free croissants may be perceived as easily doable. Our empirical work above provides two pieces of evidence against the effort explanation. For one, subjects exhibited RTI for effortless payoffs as well (Studies 2 and 4). Yet, one can still argue that the passage of time per se triggers some form of mental effort or cost at the outset, which may be disregarded later on (similar to the lack of a sunk time cost effect, as discussed in Soman 2003). Second, we observed RTI for hypothetical payoffs in cross-sectional designs (Studies 1 and 2). However, even for hypothetical payoffs, there may be some perceived or imagined effort linked to temporal investments (Soman 2004). Hence, our empirical analysis does not quite rule out the effort explanation altogether. A further examination of this problem should measure the perceived / imagined effort (or any mental cost of waiting). 3. Affect. A third possible explanation is that our findings may reflect affective responses rather than deliberate or analytical responses. That is, RTI may occur due to the relative affective salience (evaluability) of information and individual characteristics (see Slovic et al. 2002a, 2002b for a discussion of affective decision making). It is possible that a payoff may be weakly evaluable when it is immediate, making it less attractive compared to a very close, but not immediate, payoff. Slovic et al. (2002a) report a study where a simple gamble with only one possible gain was rated as less attractive than the same gamble with an additional small loss. A similar finding was reported in Fetherstonhaugh et al. (1997): a life saving equipment was rated higher when subjects were told that it could save 98% of the passengers than the case of saving all passengers. The relevance of such an affective mechanism in intertemporal choice could be examined by looking at the condition where the delay time for the smaller payoff is very short, for instance one day, rather than immediate. We ran a follow-up study at INSEAD to examine the role of affect in RTI behavior (Study 5). 14 Participating students received a flat payment. We used $20-$25 as the payoff pair and three delay time pairs (3 days-1 week, 1 week-2 weeks, and 2 weeks-4 weeks) from Study 2a. In addition to the “distant” and “immediate” conditions, a “tomorrow” condition is included where SS payoff is to be received in one day. The “tomorrow” condition involves 1 day-5 days, 1 day-8 days, and 1 day-15 days as the delay times -- that correspond to the respective cases in the “immediate” and “distant” conditions. 81 subjects answered all nine choice questions. ---- Insert Table 5 about here ---- If difficulty of evaluating immediacy plays a role in RTI, then the preference for the LL option should be larger for the case of “immediate” SS condition than for the “tomorrow” and “distant” SS conditions -- preference for LL in the tomorrow and distant conditions may possibly be similar. The results are summarized in Table 5. Percentages for “immediate” are larger than those for “tomorrow” across all groups and delay times, but in only two cases the differences are significant. In addition, percentages are significantly larger for the “tomorrow” condition than for the “distant” condition in six cases. Therefore, affect seems have some role in the RTI behavior, but it is limited. We note that our within-subjects design is a stronger test; a between-subjects design may offer further evidence. 4. Form of Discounting. Finally, RTI may be associated with a discounting function of a particular characteristic. We noted earlier that TI behavior can be captured by a hyperbolic discount function. Hyperbolic discounting is characterized by heavier discounting of outcomes that are temporally close to the current period, compared to distant ones. In contrast, RTI indicates a lower discounting for temporally close outcomes. The intuition is as follows: In RTI, the smaller payoff is preferred when it is temporally close to the current period (compared to the distant larger payoff); but as the smaller payoff becomes immediate and the larger payoff becomes close, the larger payoff is preferred. Lower discounting of outcomes that are close to the present indicates a discount function that has a smaller slope at first than later, and then presumably the slope decreases again. A reverse-S form has these characteristics; it is 15 illustrated in Figure 2 below vis-à-vis hyperbolic and exponential forms. In the Appendix we show that a reverse-S shape discounting function can accommodate RTI. ---- Insert Figure 2 about here ---- It has been long known that the inferred shape of the discount function varies with the elicitation technique (e.g. Ainslie 1975). In order to further investigate the reverse-S form discounting suggested by the choice tasks in Studies 1-4, we elicited individual discount functions also by using valuation / matching tasks. In two studies run at Koç University, presented below, subjects reported the future values for which they were indifferent with the corresponding present values. The first study, based on hypothetical payments, was part of a booklet of surveys. There were 120 student participants. Unfortunately we do not have data regarding the gender of the subjects, because the survey was part of a project unrelated to the current paper. We asked subjects to state future amounts that would be as attractive as $10 today.6 The time delays used were 1 week, 2 weeks, 4 weeks, and 6 months. Corresponding discount factors were plotted as a graph, and we examined each subject’s discount function visually. For benchmarking purposes, we also included exponential discounting curves (for a few discount factors), as well as an exponential curve fitted to the subject’s discounting data, on the graph. From the 120 discounting curves, 18 resemble reverse-S shape, 77 hyperbolic, and 9 exponential. 16 subjects had discounting curves that were difficult to label or data was not usable (missing data, valuations less than $10 etc.). The second study uses an incentive compatible scheme. 60 student subjects (38 female, 22 male) received a monetary payment at the end of the experiment. The study involves a web-based interface, and data was collected in one session in a computer lab. Subjects were asked to provide the smallest future 6 Our decision to use “delayed value of an immediate reward” rather than “immediate value of a delayed reward” was based on a pretest; in a paper-pencil test, we had found that the latter led to much unusable data. 16 amounts they would accept in the future, instead of receiving a set of present amounts. There were 21 valuation questions using combinations of three present payoffs ($6, $13, and $21) and seven delay times (1 day, 2 days, 3 days, 4 days, 1 week, 2 weeks, and 4 weeks). We used an incentive-compatibility scheme adapted from Kirby and Marakovic (1995). At the end of experiment, subjects were paid either their stated future valuation or the present payoff for one of the questions chosen randomly. Whether the particular subject received the future or present amount was determined through an auction -- in order to eliminate the temptation to state large future figures. Participants’ stated future valuations were entered as bids to an auction. The participant who stated the smallest future amount was to receive that amount in due time, and the other participants received the present amount.7 After the valuation questions, subjects completed an unrelated survey. This second part provided us the additional time needed for all subjects to finish our main study before any of them claimed the payoff. Payments were made for “present payoff $6 - future payoff in 1 week” combination.8 In terms of data analysis, as in the hypothetical payments study, we examined the discount functions of each subject for each payoff separately. For $6, 8 out of 60 subjects had a reverse-S shape discount function. There were 19 functions that resembled hyperbolic, and 8 resembled exponential curves. Data from 25 subjects was either not useful (valuations less than $6, etc.) or could not be categorized. There were a number of curves with significant ups and downs. This may be due to the fact that the question order was randomized; and unlike the previous hypothetical payments survey, subjects were not able to see and adjust their valuations for different future times. For $13, there were 13 subjects with reverse-S discounting, 15 with hyperbolic, and 9 with exponential forms. Data from 23 subjects was 7 Theoretically, revealing true preferences is the optimal strategy in the second-price auction. The reason for using a first-price auction is that it is easier to explain to the participants. In any case, efficiency loss compared to secondprice auction is small when number of participants is high, and we are interested in the shape of the discount function (relative valuations of future payoffs). 8 We actually paid a round figure (in local currency terms) higher than $6. 17 not useful or not categorized. For $21, there were 10 reverse-S, 14 hyperbolic, and 8 exponential discount functions; and data from 28 subjects was not useful or not categorized. Over all the payoffs ($6, $13, and $21), the proportion of females with reverse-S-like discounting was slightly higher, but not significantly different, than of the corresponding males.9 To summarize, our incentive compatible study also provides evidence that a portion of individuals do exhibit reverse-S discounting. To summarize the discussion on possible explanations for RTI, we observed that reverse-Sshaped discounting is not an exception and can potentially explain the observed RTI behavior. In addition, affect seems to have some role in RTI, but the evidence limited. Finally, effort uncertainty as an explanation needs further investigation. Conclusion The main contribution of the current paper is that it is the first study that defines reverse timeinconsistency explicitly as a new anomaly in intertemporal choice. Sholten and Read (2005) observed this behavior in a subset of their participants, and classified it as an anomalous inconsistency pattern. Airoldi et al (2005) report that, if anything, people become more impatient over time (a behavior that we label as the RTI behavior) rather than becoming patient (implying TI). In a recent elicitation study which introduces time-tradeoff sequences as a new method to measure intertemporal preferences (that does not require any knowledge about the utility function), Attema et al. (2006) observed increasing impatience initially and then constant discounting. In our study, we provide extensive empirical evidence that RTI is indeed a robust phenomenon, rather than a one-time experimental artifact. We also explored possible explanations for this behavior; affect and reverse-S shape discounting seem to contribute to RTI -- and there is evidence that individual discount functions are in fact quite diverse. Our findings have potential implications for decision makers. For instance, a bank may allow 9 When we look at the aggregate of all subjects, hyperbolic discounting seems to prevail for each payoff, and the overall level of discounting seems to decrease with increasing payoff size. No difference was observed between females and males. 18 (and offer incentives when profitable) its customers to extend the term of a deposit account when the original due time approaches. For loyalty programs with multiple reward levels, changing preferences when consumers qualify for smaller rewards may have implications for planning the reward redemption process or program profitability. In terms of future research directions, more evidence on RTI would be much insightful; in particular, regarding the context where it is more or less likely to be observed. For instance, gender differences in temporal preferences seem to require further research. In addition, we did a preliminary of investigation of whether RTI can be explained by the shape of the discounting function. Future research may consider a more detailed measurement of discount function (with more time points), and a comparison of discounting forms elicited by different methods from the same subjects -- although such an approach may have practical difficulties. Finally, future research may examine other possible explanations of the RTI behavior. 19 Table 1a Results from Study 1a - INSEAD Percent preferring to wait for LL in “distant” vs. “immediate” conditions Females Option pairs (for “distant”) N=25 Males n=30 n=22 n=20 Total n=47 n=50 SS: $10 after spending $100 LL: $25 after spending $200 48% 20% b 32% 85% a 40% 46% SS: 1 ticket after 3 tickets LL: 2 tickets after 5 tickets 72% 50% c 32% 51% 48% NOTE: 45% a: difference is significant with p < 0.01; b: with p < 0.05; c: with p < 0.10. Table 1b Results from Study 1b - Koç University Percent preferring to wait for LL in “distant” vs. “immediate” conditions Females Males Total Option pairs (for “distant”) N=26 n=28 SS: $3 after spending $30 LL: $7.5 after spending $60 50% 46% 37% 45% 44% 46% SS: 1 ticket after 3 tickets LL: 2 tickets after 5 tickets 42% 43% 50% 59% 46% 50% NOTE: None of the pairwise differences is significant. n=24 n=22 n=50 n=50 20 Table 2a Results from Study 2a - Koç University Percent preferring to wait for LL in “distant” vs. “immediate” conditions Option pairs (for “distant”) Females Males Total n=32 n=29 n=38 n=31 n=70 n=60 SS: $7 in 1 day LL: $10 in 3 days 38% 72% a 32% 81% a 34% 77% a SS: $7 in 3 days LL: $10 in 1 week 19% 45% b 18% 42% b 19% 43% a SS: $7 in 1 week LL: $10 in 2 weeks 3% 28% a 11% 26% c 7% 27% a SS: $7 in 2 weeks LL: $10 in 4 weeks 6% 11% 9% SS: $20 in 1 day LL: $25 in 3 days 44% 72% b 26% 84% a 34% 78% a SS: $20 in 3 days LL: $25 in 1 week 19% 52% a 16% 71% a 17% 62% a SS: $20 in 1 week LL: $25 in 2 weeks 6% 38% a 8% 29% b 7% 33% a 3% 5% 4% 13% c SS: $20 in 2 weeks LL: $25 in 4 weeks NOTE: 14% 14% a: difference is significant with p < 0.01; b: with p < 0.05; c: with p < 0.10. 10% 13% 12% 21 Table 2b Results from Study 2b - Koç University Percent preferring to wait for LL in “distant” vs. “immediate” conditions Option pairs (for “distant”) Females Males Total n=26 n=26 n=33 n=31 n=59 n=57 SS: $6 in 1 day LL: $10 in 3 days 38% 96% a 48% 100% a 44% 98% a SS: $6 in 3 days LL: $10 in 1 week 46% 69% c 48% 84% a 47% 77% a SS: $6 in 1 week LL: $10 in 2 weeks 27% 62% b 18% 65% a 22% 63% a SS: $6 in 2 weeks LL: $10 in 4 weeks 15% 18% 35% c 17% 35% c SS: $20 in 1 day LL: $30 in 3 days 50% 92% a 67% 97% a 59% 95% a SS: $20 in 3 days LL: $30 in 1 week 52% 88% a 52% 81% b 47% 84% a SS: $20 in 1 week LL: $30 in 2 weeks 31% 81% a 39% 94% a 36% 88% a SS: $20 in 2 weeks LL: $30 in 4 weeks 23% 62% a 21% 68% a 22% 65% a NOTE: 35% a: difference is significant with p < 0.01; b: with p < 0.05; c: with p < 0.10. 22 Table 2c Results from Study 2c - INSEAD Percent preferring to wait for LL in “distant” vs. “immediate” conditions Females Males Total Option pairs (for “distant”) n=16 n=15 n=17 n=19 n=33 n=34 SS: $4 in 3 days LL: $10 in 1 week 63% 100% a 82% 73% 79% SS: $4 in 1 week LL: $10 in 2 weeks 38% 87% a 76% 47% c 58% 65% SS: $4 in 2 weeks LL: $10 in 1 month 6% 60% a 71% 37% b 39% 47% SS: $4 in 1 month LL: $10 in 2 months 6% 33% c 76% 11% a 42% 21% c SS: $10 in 3 days LL: $25 in 1 week 81% 93% 94% 63% b 88% SS: $10 in 1 week LL: $25 in 2 weeks 63% 80% 94% 37% a 79% 56% b SS: $10 in 2 week LL: $25 in 1 month 44% 73% c 82% 16% a 64% 41% c 6% 53% a 76% 5% a 42% SS: $10 in 1 month LL: $25 in 2 months NOTE: a: difference is significant with p < 0.01; b: with p < 0.05; c: with p < 0.10. 63% 76% 26% 23 Table 3 Results from Study 3 Percent preferring LL (2 croissants) when: “joining the program” vs. “completing 10 purchases” Females Males Total n=20 n=27 n=47 25% 95% a NOTE: 70% 56% a: difference is significant with p < 0.01; c: with p < 0.10. 51% 72% c 24 Table 4 Results from Study 4 Percent preferring to wait for LL in “distant” vs. “immediate” conditions Option pairs (for “distant”) Females Males Total n=17 n=21 n=38 SS: €7 in 1 day LL: €10 in 3 days 24% 76% b 33% 67% c 29% 71% a SS: €7 in 3 days LL: €10 in 1 week 18% 59% b 38% 57% 29% 58% b SS: €7 in 1 week LL: €10 in 2 weeks 18% 29% 38% 43% 29% SS: €20 in 1 day LL: €25 in 3 days 41% 59% 29% 57% 34% 58% c SS: €20 in 3 days LL: €25 in 1 week 35% 29% 29% 33% 32% 32% SS: €20 in 1 week LL: €25 in 2 weeks 29% 18% 29% 29% 29% 24% NOTE: a: difference is significant with p < 0.01; b: with p < 0.05; c: with p < 0.10. 37% 25 Table 5 Results from Follow-Up Study 5 Percent preferring to wait for LL in “distant” vs. “tomorrow” vs. “immediate” conditions Option pairs (for “distant”) Females Males Total n=34 n=47 n=81 SS: €20 in 3 days LL: €25 in 1 week 24% 32% 41% 23% a 51% b 64% 23% a 43% a 54% SS: €20 in 1 week LL: €25 in 2 weeks 6% b 26% 32% 11% b 26% 9% a 26% 32% SS: €20 in 2 weeks LL: €25 in 4 weeks 3% 18% 6% 5% b 13% 17% NOTE: 12% a: difference is significant with p < 0.01; b: with p < 0.05. 15% 32% 17% 26 Figure 1 Overview of Experimental Designs Cross-Sectional Longitudinal Loyalty Program Study 1 Study 3 Neutral Payoff Study 2 Study 4 Figure 2 Illustrative Discount Functions discounted 1 reverse-S w exponential hyperbolic 0 delay period 27 Appendix Consider a decision maker who faces a choice between receiving a payoff R1 in period t1 and payoff R2 in period t2, where R1 R2. Figure A1 RTI and Reverse-S Discounting (t2 t1) (t1) (t2) t2 t1 0 t1 t2 t Assume that the discounting function (t) is such that in period t = 0 she prefers to receive R1: U(R1) (t1) U(R2) (t2) U(R1) U(R2) (t2) / (t1) (A1) When R1 is immediate, that is t = t1, she would compare: U(R1) and U(R2) (t2 t1) She may change here preference to receiving R2 in t2 t1 periods from that time point only if (t2) / (t1) (t2 t1) If the reverse-S discounting function is such that (t) is steeper in [t1, t2] than in [0, t1], then (t2) / (t1) could be notably less than 1, and (t2 t1) could be close to 1. In other words, (t2) / (t1) (t2 t1) could be satisfied. 28 References Ainslie, G., (1975), “Specious Reward: A Behavioral Theory of Impulsiveness and Impulse Control,” Psychological Bulletin, 82(4), p. 463-496. Airoldi, M., Read D., and Frederick, S., (2005), “Longitudinal Dynamic Inconsistency”, Oral Presentation at SPUDM 20, Stockholm, Sweden. Attema, A.E., Bleichrodt, H., Rohde, K.I.M, Wakker, P.P., (2006), “Time-Tradeoff Sequences for Quantifying and Visualising the Degree of Time Inconsistency, Using only Pencil and Paper,” Working Paper, Erasmus University. Benzion, U., Rapoport, A., and Yagil, J., (1989), “Discount Rates Inferred from Decisions: An Experimental Study,” Management Science, 35(3), p. 270-284. Bohm, P., (1994), “Time Preference and Preference Reversal among Experienced Subjects: The Effect of Real Payments”, Economic Journal, 104(427), p. 1370-1378. Bjorklund, D.F., and Kipp, K., (1996), “Parental Investment Theory and Gender Differences in the Evolution of Inhibition Mechanisms,” Psychological Bulletin, 120(2), p. 163-188. Dhar, R., and Simonson, I., (2003), “The Effect of Forced Choice on Choice,” Journal of Marketing Research, 40(2), p. 146-160. Fetherstonhaugh, D., Slovic, P., Johnson, S.M., and Friedrich, J., (1997), “Insensitivity to the Value of Human Life: A Study of Psychophysical Numbing,” Journal of Risk & Uncertainty, 14(3), p.283300. Fishburn, P.C., and Rubinstein, A., (1982), “Time Preference,” International Economic Review, 23(3), p. 677-694. Frederick, S., Loewenstein, G.F., and O’Donoghue, T., (2002), “Time Discounting and Time Preference: A Critical Review,” Journal of Economic Literature, 40(2), p. 351-401. Green, L., Fisher, E.B., Perlow, S., and Sherman, L., (1981), “Preference Reversal and Self Control: Choice as a Function of Reward Amount and Delay,” Behaviour Analysis Letters, 1(1), p. 43-51. 29 Green, L., Fry, A.F., Myerson, J., (1994), “Discounting of Delayed Rewards: A Life-Span Comparison,” Psychological Science, 5(1), p. 33-36. Harrison, G.W., Lau, M.I., and Williams, M.B., (2002), “Estimating Individual Discount Rates in Denmark: A Field Experiment,” The American Economic Review, 92(5), p. 1606-1617. Herrnstein, R.J., (1981), “Self-Control as Response Strength”, in C.M. Bradshaw, E. Szabadi and C.F. Lowe, eds. Quantification of Steady-State Operant Behavior, Elsevier/North-Holland, Amsterdam. Hoch, S.J., Loewenstein, G.F., (1991), “Time-Inconsistent Preferences and Consumer Self-Control,” Journal of Consumer Research, 17(4), p. 492-507. Johnson, M.W., and Bickel, W.K., (2002), “Within-Subject Comparison of Real and Hypothetical Money Rewards in Delay Discounting,” Journal of the Experimental Analysis of Behavior, 77(2), p. 129146. Keren, G., and Roelofsma, P., (1995), “Immediacy and Certainty in Intertemporal Choice,” Organizational Behavior and Human Decision Processes, 63(3), p.287-297. Kirby, K.N., (1997), “Bidding on the Future: Evidence against Normative Discounting of Delayed Rewards,” Journal of Experimental Psychology: General, 126(1) March, p. 54-70. Kirby, K.N. and Herrnstein, R.J., (1995), “Preference Reversals Due to Myopic Discounting of Delayed Reward,” Psychological Science, 6(2), p.83-89. Kirby, K.N., and Marakovic, N.N., (1995), “Modeling Myopic Decisions: Evidence for Hyperbolic Delay-Discounting within Subjects and Amounts,” Organizational Behavior & Human Decision Processes, 64(1), p. 22-30. Kirby, K.N., and Marakovic, N.N., (1996), “Delay-Discounting Probabilistic Rewards: Rates Decrease as Amounts Increase,” Psychonomic Bulletin & Review, 3(1), p.100-104. Koopmans, T.C., (1960), “Stationary Ordinal Utility and Impatience,” Econometrica, 28(2), p. 287-309. Loewenstein, G.F., (1987), “Anticipation and the Valuation of Delayed Consumption,” Economic Journal, 97(387), p. 666-684. 30 Loewenstein, G.F., (1996), “Out of Control: Visceral Influences on Behavior,” Organizational Behavior and Human Decision Processes, 65(3), p. 272-292. Loewenstein, G.F., and Prelec, D., (1992), “Anomalies in Intertemporal Choice: Evidence and an Interpretation,” Quarterly Journal of Economics, 107(2), p. 573-597. Mazur, J.E., (1987), “An Adjusting Procedure for Studying Delayed Reinforcement,” in M.L. Commons, J.E. Mazur, J.A. Nevin, and H. Rachlin, eds. Quantitative Analyses of Behavior: The Effect of Delay and Intervening Events on Reinforcement Value, v5, p. 55-73, Lawrence Erlbaum Assoc., New Jersey. McLeish, K.N., and Oxoby R.J., (2005), “Gender, Affect and Intertemporal Consistency: An Experimental Approach,” Working Paper, University of Calgary. Rachlin, H., and Green, L., (1972), “Commitment, Choice and Self-Control,” Journal of the Experimental Analysis of Behavior, 17(1), p. 15-22. Read, D., (2004), “Intertemporal Choice,” in D. Koehler and N. Harvey, eds. The Blackwell Handbook of Judgment and Decision Making, Blackwell, Oxford. Read, D., Frederick, S., Orsel, B., and Rahman, J., (2005), “Four Score and Seven Years from Now: The Date/Delay Effect in Temporal Discounting,” Management Science, 51(9), p. 1326-1335. Samuelson, P.A., (1937), “A Note on Measurement of Utility,” Review of Economic Studies, 4(2), p. 155161. Scholten, M., and Read, D., (2005), “Discounting by Intervals: A Generalized Model of Intertemporal Choice,” Working Paper, Instituto Superior de Psicologia Aplicada. Siegal, S., and Castellan, N.J., (1998), Nonparametric Statistics for the Behavioral Sciences, McGrawHill, New York. Silverman, I.W., (2003), “Gender Differences in Delay of Gratification: A Meta-Analysis,” Sex Roles, 49(9/10), p. 451-463. 31 Slovic, P., Finucane, M., Peters, E., and MacGregor, D.G., (2002a), “The Affect Heuristic,” in T. Gilovich, D. Griffin, Dale, and D. Kahneman eds. Heuristics and Biases: The Psychology of Intuitive Judgment, Cambridge University Press, New York. Slovic, P., Finucane, M., Peters, E., and MacGregor, D.G., (2002b), “Rational Actors or Rational Fools: Implications of the Affect Heuristic for Behavioral Economics,” Journal of Socio-Economics, 31(4), p. 329-342. Soman, D., (2003), “Prospective and Retrospective Evaluations of Experiences: How You Evaluate an Experience Depends on When You Evaluate It,” Journal of Behavioral Decision Making, 16(1), p. 35-52. Soman, D., (2004), “The Effect of Time Delay on Multi-Attribute Choice,” Journal of Economic Psychology, 25(2), p. 153-175. Strotz, R.H., (1955), “Myopia and Inconsistency in Dynamic Utility Maximization,” Review of Economic Studies, 23(3), p. 165-180. Thaler, R., (1981), “Some Empirical Evidence on Dynamic Inconsistency,” Economics Letters, 8(3), p. 201-207.