Review article 363 The role of the aversive effects of drugs in self-administration: assessing the balance of reward and aversion in drug-taking behavior Andrey Verendeev and Anthony L. Riley Since the first experimental demonstration that a drug of abuse supports instrumental behavior, drugs have been discussed in the context of their rewarding effects, which are assumed to drive and maintain drug-taking behavior. Indeed, drug reward has been fundamental in the formulation of most models of drug use, abuse, and addiction. Over the last several decades, however, drugs of abuse have been increasingly recognized as complex pharmacological compounds producing multiple stimulus effects, not all of which are rewarding. The aversive effects of such drugs, for example, have been described by a number of researchers working in the field, although few attempts have been made to investigate the role of these aversive effects in drug taking. The present paper offers a historical perspective on the view that drugs of abuse are complex pharmacological compounds with multiple stimulus effects. In doing so, we argue that the discussion of drug reward only may be insufficient in accounting for drug taking and we present evidence for the theoretical position that both the rewarding and the aversive effects of drugs should be taken into consideration in ongoing attempts to model drug-taking behavior. The present review summarizes several decades of research characterizing the aversive effects of major drugs of abuse, as well as more recent studies seeking to assess directly the role of drug aversion in drug taking. Behavioural c 2013 Wolters Kluwer Health | Pharmacology 24:363–374 Lippincott Williams & Wilkins. Drugs as rewarding stimuli of a desire to re-experience the drug-induced euphoria associated with initial drug taking, a desire that results from neuroplastic changes that accompany chronic drug taking. The physical dependence model stresses the role of withdrawal relief associated with drug taking in dependent individuals. The incentive-sensitization model argues that chronic drug taking is a function of the psychological process of incentive salience wherein certain internal and external stimuli associated with the drug use become extremely salient, resulting in an increased desire for the drug. Finally, the opponentprocess model assumes that chronic drug taking is associated with the lowering of a hedonic set point and is maintained by removal of the consequent dysphoria produced by the absence of the drug. For all models, it is clear that reward plays important roles in the initiation and maintenance of drug taking and is instrumental in the transition from use to abuse. Drug addiction is a developing disorder that is characterized by a progression from initial experimentation and nonproblem use to loss of control over the amount, frequency, and/or duration of drug intake. This escalation from controlled to compulsive use is believed to be mediated by specific drug-induced neurobiological changes that mark the shift to pathophysiology that underlies compulsive drug seeking (reviewed in Koob and Le Moal, 2006). Moreover, this transition to chronic use is likely to be modulated by a host of genetic and environmental factors that contribute toward the vulnerability to drug dependence. In a recent discussion of human drug taking, Meyer and Quenzer (2005) describe four basic models (positive reinforcement, physical dependence, incentive sensitization, and opponent process) that address the transition from drug use to drug abuse. For all four models, drug taking is initiated and temporarily maintained by the drug’s positively rewarding effects, although other sources of reward (e.g. anxiety reduction) may also be involved. With long-term maintenance and escalation, however, the models assume different processes. For the positive reinforcement model, drug use is a function of the previous history of reinforcement of drug-taking behavior, which presumably is driven by the development c 2013 Wolters Kluwer Health | Lippincott Williams & Wilkins 0955-8810 Behavioural Pharmacology 2013, 24:363–374 Keywords: addiction, conditioned place preference, conditioned taste aversion, drug aversion, drug reward, self-administration Psychopharmacology Laboratory, Department of Psychology, American University, Washington, District of Columbia, USA Correspondence to Andrey Verendeev, PhD, Psychopharmacology Laboratory, Department of Psychology, American University, 4400 Massachusetts Ave NW, Washington, DC 20016, USA E-mail: andrey.verendeev@gmail.com Received 3 March 2013 Accepted as revised 31 May 2013 Given the importance of the rewarding effects of drugs, it is not surprising that these effects have been well characterized in terms of their behavioral, neuroanatomical, and neurochemical effects (Koob and Le Moal, 2006). Great advances have been made in our understanding of such effects and their relationship with drug vulnerability, abuse, and addiction. Although this relationship is more complicated than initially assumed (Wise and Bozarth, DOI: 10.1097/FBP.0b013e32836413d5 Copyright © Lippincott Williams & Wilkins. Unauthorized reproduction of this article is prohibited. 364 Behavioural Pharmacology 2013, Vol 24 No 5&6 1987), characterization of the mechanisms that mediate reward has been fundamental in our understanding of drug use and abuse. It should be noted, however, that drugs of abuse are complex pharmacological compounds with multiple stimulus effects, not all of which are rewarding (Wise et al., 1976; Stolerman, 1992; Koob and Le Moal, 2006; Verendeev and Riley, 2012). For example, the aversive effects of drugs of abuse have also been increasingly recognized (Goudie, 1979; Gaiardi et al., 1991; Riley, 2011; Verendeev and Riley, 2012). These aversive effects have been well described for all major classes of drugs of abuse (Verendeev and Riley, 2012) and have been found to occur independent of the drugs’ rewarding effects (Cunningham et al., 2009; Verendeev and Riley, 2011, 2012). Despite being well described, however, the nature of these aversive effects remains to be determined (see below; Verendeev and Riley, 2012). It has been suggested by several authors that drug taking may be a function of the relative balance between drug reward and aversion (Stolerman and D’Mello, 1981; Gaiardi et al., 1991; Riley and Simpson, 2001; Riley, 2011; for a discussion of the interaction of drug reward and aversion in the repeated use of plant-derived drugs, see Hagen et al., 2009). If so, the discussion of drug use and abuse necessitates the examination of both of these drug effects, their interaction, and the different factors impacting them. In the present paper, we present evidence in support of the inclusion of the aversive effects of drugs in discussions of drug use and abuse. In so doing, we summarize several decades of research characterizing the aversive effects of drugs of abuse, as well as more recent studies seeking to assess directly the role of drug aversion in drug taking. Aversive effects of drugs of abuse Garcia et al. (1955), in a paper published in Science, reported that rats avoid consumption of a preferred saccharin solution if its initial consumption was followed by exposure to ionizing radiation. This required only one pairing of the taste and radiation exposure, was dose dependent (i.e. higher levels of gamma radiation resulted in greater suppression of intake), and appeared to be quite robust (i.e. rats persisted in taste avoidance for at least 30 days despite continuous exposure to both water and the saccharin solution). Termed a conditioned taste aversion (CTA), this phenomenon was interpreted in classical conditioning terms; specifically, the taste (CS) was paired with the radiation-induced nausea (US), resulting in a conditioned avoidance (CR) of the taste on a subsequent exposure. According to early interpretations, CTA was a specialized form of learning that allowed organisms to quickly recognize and reliably avoid potentially poisonous substances (see Freeman and Riley, 2009 and Verendeev and Riley, 2012 for a review of the history of CTA as well as discussion of the unique nature of this phenomenon). Shortly after CTA was described in irradiated animals, a number of reports showed similar effects using other treatments, both pharmacological (e.g. well-known poisons and toxins; Garcia and Ervin, 1968; Freeman and Riley, 2009) and nonpharmacological (e.g. full body rotation; Braun and McIntosh, 1973). Quite surprisingly, a number of drugs of abuse, known for their rewarding effects, were also found to support CTA learning. For example, Goudie et al. (1978) administered rats a novel saccharin solution to drink, followed by an injection of a drug vehicle or one of four doses of cocaine (5, 10, 20, or 36 mg/kg intraperitoneally). This taste–drug pairing was repeated for several trials, after which the subjects were presented with the saccharin on a taste-avoidance test. Cocaine induced avoidance of saccharin in a dosedependent manner (cf. Garcia et al., 1955), with the lowest dose (5 mg/kg) being ineffective in producing an avoidance and the largest dose producing the greatest suppression of saccharin consumption. Moreover, suppression was greater after several conditioning trials than after a single pairing (at least for the two largest doses tested; see Fig. 1). Although cocaine was one of the first drugs for which CTAs were characterized (see also Ferrari et al., 1991; Glowa et al., 1994), the list of drugs that can support taste-avoidance learning includes all major drugs of abuse: amphetamine (Cappell and LeBlanc, 1971; Carey and Goodall, 1974; Booth et al., 1977; Verendeev and Riley, 2011), morphine (White et al., 1977; Riley et al., 1978; Bechara and van der Kooy, 1985; Verendeev and Riley, 2011), heroin (Grigson et al., 2000; Davis et al., 2009), nicotine (Etscorn, 1980; Kumar et al., 1983; Iwamoto and Williamson, 1984; Etscorn et al., 1986; Pescatore et al., 2005; Rinker et al., 2008), ethanol (Cappell et al., 1973; Cunningham, 1979; Roma et al., 2006), caffeine (White and Mason, 1985; Steigerwald et al., 1988; Brockwell et al., 1991; Vishwanath et al., 2011), tetrahydrocannabinol (Corcoran et al., 1974; Kay, 1975; Fischer and Vail, 1980; Parker and Gillies, 1995), MDMA (Lin et al., 1994; Albaugh et al., 2011), and various hallucinogens (Cappell and LeBlanc, 1971; De Beun et al., 1993; Parker, 1993, 1996) (for a bibliography of psychoactive substances that can support taste avoidance learning, see http://www.ctalearning.com). Factors affecting the aversive effects of drugs The ability of drugs of abuse to support CTA learning suggested that drugs had some intrinsic aversive properties. It is important to note, however, that these properties were not fixed, but were a function of a number of experimental and subject variables. For example, as discussed above, Goudie et al. (1978) reported that the magnitude of suppression of intake of Copyright © Lippincott Williams & Wilkins. Unauthorized reproduction of this article is prohibited. Balance of reward and aversion Verendeev and Riley 365 Fig. 1 16 Saline 14 5 Mean intake(g) 12 10 10 8 of different factors. Although aversions can be impacted by a wide variety of factors, it is important to note that the vast majority of drugs induce aversions across a wide variety of parametric conditions in almost all organisms tested (including humans; see Garb and Stunkard, 1974; Klosterhalfen and Klosterhalfen, 1985; Logue, 1985; Garcia and Riley, 1998; Freeman and Riley, 2009; see also Reilly and Schachtman, 2009). Reward and aversion: independent effects 20 6 36 4 2 Water 1 day 5 2 3 4 Trial Mean (±SEM) saccharin consumption over three saccharin–cocaine pairings and the final taste avoidance test (trial 4) of rats injected with one of the four doses of cocaine (5, 10, 20, or 36 mg/kg) or a drug vehicle (saline control). Adapted with permission from Fig. 1 of Goudie et al. (1978). a flavored solution paired with cocaine injections was dependent on both the dose (higher doses resulted in greater suppression) and the number of conditioning trials (more flavor–drug pairings resulted in greater suppression; although see Siegel et al., 1995). Route of administration was also important. For example, Riley et al. (1978) found moderate, albeit significant, suppression following intraperitoneal morphine. Later studies found that morphine administered subcutaneously resulted in a much more robust suppression (see, for example, Lancellotti et al., 2001; Verendeev and Riley, 2011; see also Ferrari et al., 1991 for a direct comparison between intraperitoneal and subcutaneous cocaine to produce CTA). Other factors reported to influence the ability of drugs to produce aversive effects were age, sex, drug history, and strain. For example, adolescent rats appear less sensitive to the aversive effects of drugs compared with adult rats (reviewed in Schramm-Sapyta et al., 2009). Male rats appear more responsive to the aversive effects of drugs than female rats, as evidenced by their ability to acquire CTAs faster (Chambers et al., 1981; Sherrill et al., 2011a). Drug history weakens the ability of drugs of abuse to produce CTA, which implies that previous drug exposure attenuates the aversive effects of drugs (reviewed in Riley and Simpson, 2001). Finally, the ability of drugs to produce CTA differs across different strains of rats and mice (Cunningham et al., 2009; Riley et al., 2009). All these reports suggested that the aversive effects of drugs of abuse are not static, but can be influenced by a number The finding that drugs that were reliably self-administered by animals and able to produce place preferences (see Tzschentke 2007), also supported CTA learning presented a conundrum (Gamzu, 1977; White et al., 1977; Goudie, 1979; Hunt and Amit, 1987). How could drugs that are rewarding in both rats and humans also produce avoidance of taste stimuli with which they were paired? One simple solution for this dilemma was to argue that any specific drug may have both rewarding and aversive effects, but that these effects are dependent on the specific parameters under which they are examined. Indeed, Cappell and LeBlanc (1971), in a study assessing the ability of amphetamine to induce CTA, did just this and pointed to the ‘gross and obvious’ (p. 355) differences between the experimental procedures measuring drug reward and aversion that could potentially explain the apparent paradox. However, this argument met with some criticism when it was reported that a drug could produce both rewarding and aversive effects under the same experimental conditions. For example, Wise et al. (1976) presented rats with a novel saccharin solution to drink and allowed them to self-administer 0.5 mg/kg apomorphine for a single session. They found that individual rats both selfadministered intravenous apomorphine and subsequently avoided the saccharin solution. Moreover, there was a strong relationship between the two: individual rats that self-administered the most apomorphine showed the greatest avoidance of saccharin intake. The authors were led to conclude that drugs of abuse exert multiple stimulus effects, both positive and negative. They noted: ‘These data, then, demonstrate for the first time that the same drug injection can be both positive reinforcing and aversive. The demonstration of both properties in the same animals, in the same test session, rules out arguments that differences in paradigms can account for the fact that in one paradigm a drug seems aversive while in the other paradigm the same drug seems reinforcing. Thus it must be concluded that injections of abused drugs do not represent simple positive pharmacological stimuli; rather, drug injections must be viewed as compound stimuli with both positive and negative elements’ (Wise et al., 1976, p. 1274). In a related study, White et al. (1977) trained rats to run down a straight alley for food available in a goal box. Copyright © Lippincott Williams & Wilkins. Unauthorized reproduction of this article is prohibited. 366 Behavioural Pharmacology 2013, Vol 24 No 5&6 Immediately after consumption, rats were injected with one of the two doses of morphine sulfate (9 or 15 mg/kg) and returned to the empty goal box for 50 min. Over trials, rats increased their running speed to reach the goal box, but decreased the amount of food consumed. Similar to Wise et al. (1976), this study showed that a drug of abuse produced both rewarding and aversive effects in the same animal and by the same drug injection, as indicated by the increase in running speed and decrease in food consumption, respectively (see also Reicher and Holman, 1977; Sherman et al., 1980; for more recent reports, see Ettenberg and Geist, 1991, 1993; Simpson and Riley, 2005; Verendeev and Riley, 2011). Although both effects are produced, their temporal nature is unknown. Indeed, from work with ethanol and cocaine, the specific timing of these two responses differs, suggesting that they are drug specific (see, for example, Cunningham et al., 1997; Ettenberg et al., 1999). Nature of drug aversion The ability of drugs of abuse to produce drug reward and drug aversion under the same conditions suggested to some investigators a functional relationship between the two. According to these authors (Hunt and Amit, 1987; Grigson, 1997), the ability of drugs of abuse to produce drug aversion depended on their ability to produce drug reward. That is, rather than being dichotomous, which might suggest some differences in the underlying mechanisms, the aversive effects of drugs of abuse were interpreted in the context of their rewarding effects. In this context, two possible mechanisms for drug aversion have been suggested: drug novelty (Hunt and Amit, 1987) and reward comparison (Grigson, 1997; see Verendeev and Riley, 2012, for a full discussion of these and other interpretations). According to the drug novelty hypothesis of Hunt and Amit (1987), the rewarding effects of drug administration provide a novel discriminative state for the animal, which, although positively reinforcing under most conditions (i.e. self-administration and place preference conditioning), may have aversive effects when paired with a novel taste solution. These authors acknowledge the regulated homeostatic state of the animal and argue that disruption of homeostasis (by a drug’s rewarding effects) serves as a negative punishing effect within the CTA procedure. The rewarding and suppressing effects of drugs, therefore, are not dichotomous but share a common discriminative profile, and their ability to serve as either positively reinforcing or negatively punishing depends on the conditions of the experimental manipulation. The second hypothesis, according to which drugs of abuse suppress taste consumption because of their rewarding effects, has been proposed more recently by Grigson (1997) and is known as reward comparison (see Flaherty, 1996). According to the reward comparison hypothesis, when presented with two rewarding stimuli (e.g. a taste and a drug), ‘[r]ats decrease intake of a gustatory CS y because the rewarding properties of the gustatory stimulus pale in comparison to those of the impending drug of abuse’ (Grigson, 1997, p.134). In other words, CTA is not a measure of drug aversion, but instead a measure of drug reward. Although interesting, these two hypotheses are not well supported by evidence. If, according to these positions, drug reward and drug aversion are not separate but dependent on each other (as drug aversion is a function of drug reward for both of the above-mentioned positions), the ability of a drug to produce reward and the ability of the drug to produce aversion should covary. Moreover, manipulations should affect the two in a similar and a consistent manner. For example, Hunt and Amit (1987) argued that pharmacological manipulations that block the rewarding effects of drugs also attenuate their suppressing effects (see also Sklar and Amit, 1977). Although there is some evidence to support this position (e.g. pimozide, a dopamine receptor antagonist, has been shown to attenuate amphetamine and cocaine self-administration as well as amphetamine-induced and cocaine-induced CTAs), several other studies show that some pharmacological manipulations affect a drug’s rewarding and aversive effects differentially. Further, Simpson and Riley (2005) examined the effects of morphine pre-exposure on morphine-induced place preference and taste avoidance in the same subjects. They found that pre-exposure to morphine enhanced place preference but attenuated taste avoidance, a result incompatible with the position that drug reward and aversion are mediated by the same mechanism. Similar dissociations of drug reward and drug aversion have been found in other studies that examined this phenomenon in the same subjects (Martin et al., 1988; Gaiardi et al., 1991) or in separate groups of subjects (LeBlanc and Cappell, 1974; Cappell et al., 1975; Dacanay and Riley, 1982; Domjan and Siegel, 1983; Riley et al., 1984; Harris and Aston-Jones, 2003; He et al., 2004; Manzanedo et al., 2005). In addition to pre-exposure and pharmacological treatments, the rewarding and aversive effects of drugs can be dissociated using a number of other manipulations. For example, adolescent rats are more sensitive to the rewarding effects, but less sensitive to the aversive effects of drugs than adult rats (see above; see also Schramm-Sapyta et al., 2009 for a review). Lesion data also show that drug reward and aversion are anatomically dissociable. Sellings et al. (2008), for instance, found that 6-OHDA lesions of the nucleus accumbens medial shell, but not core, attenuated nicotine-induced place preference, whereas lesions of the nucleus accumbens core, but not the medial shell, blocked nicotine-induced taste avoidance (see Verendeev and Riley, 2012 for a review of the role of reward in the mediation of taste avoidance). Copyright © Lippincott Williams & Wilkins. Unauthorized reproduction of this article is prohibited. Balance of reward and aversion Verendeev and Riley 367 First, we found that individual subjects differed considerably in their sensitivity to the rewarding and aversive effects of both morphine and amphetamine. Individual subjects were sensitive to the rewarding effects of drugs but not to their aversive effects and vice versa, or, individual subjects were sensitive to both or neither of these effects. Second, we found no relationship between the ability of either drug to produce a place preference and its ability to produce a taste avoidance (see Fig. 2). Specifically, animals were divided into high and low responders for all conditions and the relationships between the change in saccharin consumption and change in time spent on the DPS were analyzed. We found only one significant relationship between the two in any of the conditions: animals administered 5 mg/kg amphetamine that showed the strongest aversions were less likely to show an increase (or showed an actual decrease) in the time spent on the DPS (a relationship opposite to what would be expected if a drug’s aversive effects depended on its rewarding effects). Apart from this single significant relationship out of 16 possible, it seems to be the case that the ability of a drug to produce drug aversion is not dependent on the drug’s ability to produce drug reward. If taste avoidance produced by drugs of abuse is not mediated by their rewarding effects, what then is the nature of the drugs’ aversive effects? Several hypotheses have been put forward, but none has proved conclusive (see Verendeev and Riley, 2012 for a full discussion of these positions as well as their criticisms). One recent account of a drug’s aversive effects was summarized recently by Parker et al. (2009). Termed the ‘conditioned fear’ hypothesis, this position argues that drugs upset the tight homeostatic state of the animal, resulting in conditioned fear of the drug-associated internal state (for a summary, see Verendeev and Riley, 2012). Although Fig. 2 r = 0.031; P = 0.897 300 Change in time spent on the DPS (s) In a recent test of the relationship between drug reward and drug aversion, we (Verendeev and Riley, 2011) examined the relationship between the ability of two different classes of drugs (an opiate and a psychostimulant) to produce drug reward and drug aversion in the same animal. Using the combined CTA/conditioned place preference (CPP) procedure (cf. Simpson and Riley, 2005), we assessed the relationship between morphineinduced and amphetamine-induced place preference and taste avoidance in individual subjects at two different doses (5 and 10 mg/kg morphine and 3 and 5 mg/kg amphetamine). Specifically, rats were given a novel saccharin solution to drink, injected with a drug, and placed in the CPP apparatus. We then examined the change from baseline in saccharin consumption (decrease from baseline in saccharin consumption indicated avoidance) and change from baseline in the time spent on the drug-paired side (DPS) of the CPP apparatus (increase in the time spent of the DPS indicated preference). 200 100 0 −100 −15 −10 0 −5 Change in saccharin consumption (ml) 5 Lack of relationship between the rewarding and aversive effects of morphine. Correlational analysis of the relationship between change in the time spent on the drug-paired side (DPS) and change in saccharin consumption for animals injected subcutaneously with 5 mg/kg morphine. Visual analysis shows considerable individual variability in sensitivity to both the rewarding and the aversive effects of morphine. Included in the graph are Pearson’s r, the P value, and the line of best fit for the given relationship. See also Verendeev and Riley (2012). supported by a number of observations, it is yet to be determined what exactly is disrupted by the drug injection, which may be drug specific (e.g. psychostimulant anxiogenesis vs. alcohol toxicity). It is important to note, in this context of the nature of the aversive effects of drugs, that the suppression of intake induced by such effects does not necessarily support the position that an aversion is produced to the drug-associated taste. In fact, it has been suggested that the term ‘taste aversion’ may inaccurately describe the ability of drugs of abuse to produce suppression of consumption of taste stimuli. Comparing the ability of emetic agents and rewarding drugs to produce conditioned aversive responses to a taste CS, Parker and colleagues found that drugs of abuse, unlike classical toxins, do not produce conditioned aversive reactions, although both produce conditioned suppression of a taste CS at comparable magnitude (Parker, 1995). This led her to conclude that the term ‘conditioned taste aversion’ was inappropriately applied to describe druginduced suppression and that the term ‘conditioned taste avoidance’ should be used instead (see Verendeev and Riley, 2012, for a more detailed discussion of this). Impact of drug aversion on drug taking Irrespective of the exact nature of the aversive effects of drugs, on which there is no current consensus, it is clear Copyright © Lippincott Williams & Wilkins. Unauthorized reproduction of this article is prohibited. 368 Behavioural Pharmacology 2013, Vol 24 No 5&6 that the positive rewarding and negative aversive effects of drugs are independent processes. If drugs of abuse produce both rewarding and aversive effects, it follows that to better understand drug vulnerability in both rats and humans, it is necessary to understand both effects and the interplay between them. Indeed, it has been suggested by several authors that drug taking may be a function of the relative balance between drug reward and aversion (Stolerman and D’Mello, 1981; Gaiardi et al., 1991; Riley and Simpson, 2001; see also Riley et al., 2009), with the drug’s aversive effects serving as a limiting factor in drug taking. If so, successful modeling of drug-taking behavior (both problem and nonproblem use) should take into account the relative input of both rewarding and aversive effects of drugs as well as different factors that affect these two properties. If drug use is a function of the balance between drug reward and drug aversion, one would expect that knowing the relative strength of these two effects would enable direct predictions of drug intake. Although it is often not feasible to know the relative contributions of a drug’s rewarding and aversive effects to the overall drug experience, which may vary from one individual to another (see Verendeev and Riley, 2011), it is nonetheless possible to examine the role of drug reward and drug aversion in drug taking. One way to do this is by studying the effects of different manipulations that differentially impact a drug’s rewarding and aversive effects and subsequently examine these manipulations in relation to drug selfadministration. Here, we will focus on two examples of such an approach: drug history and genetic models. Drug history Drug history has been examined in animal models in the context of US pre-exposure. In a standard procedure, animals are administered a drug (US) before conditioning: in other words, the animal is no longer drug-naive when its rewarding and aversive effects are subsequently examined. The effects of drug history within US preexposure are a function of the number of pre-exposure sessions, the dose of the drug used during drug preexposure, and the interval between drug pre-exposure and subsequent conditioning (Riley and Simpson, 2001). The effects of previous drug experience are then examined in comparison with animals that receive no such experience with the drug (i.e. drug-naive). Using the CPP design as a measure of drug reward and the CTA design as a measure of drug aversion, such drug experience (i.e. US pre-exposure) impacts the rewarding and aversive effects of drugs differentially. We will consider the effects of drug history on drug reward first. In an attempt to examine whether previous drug exposure produces tolerance or sensitization to the rewarding effects of drugs, Lett (1989) administered repeated injections of amphetamine, morphine, or cocaine to rats before place preference conditioning with these drugs. The following parameters were varied for pre-exposure (dose and the number of pre-exposure sessions) and CPP conditioning (dose and the number of conditioning trials), respectively: amphetamine – 1.5 mg/kg (six injections) and 1.5 mg/kg (three trials); morphine – 5 mg/kg (five injections) and 5 mg/kg (one trial); and cocaine – 20 mg/kg (10 injections) and 2.5 mg/kg (three trials). Lett (1989) reported that whereas animals treated with either amphetamine or cocaine during conditioning showed place preferences for the DPS of the CPP apparatus, animals with previous amphetamine or cocaine experience, respectively, showed significantly enhanced place preferences compared with animals with no drug pre-exposure (see Fig. 3). Rats with no morphine pre-exposure showed no significant place preference, a finding that was attributed to the use of a single drug–place pairing. Interestingly, animals that received previous morphine exposure did show a significant place preference, which suggested that the rewarding effects of morphine were also enhanced by drug preexposure under this condition as well (see Fig. 3). Subsequent research with these compounds confirmed that drug history enhances the rewarding effects of amphetamine (Nocjar and Panksepp, 2002), morphine (Gaiardi et al., 1991; Shippenberg et al., 1996; Simpson and Riley, 2005), and cocaine (Shippenberg and Heidbreder, 1995), as well as other drugs of abuse (Shoaib et al., 1994). Interestingly, similar enhancing effects of drug preexposure on the rewarding effects of drugs were found when different drugs were used for pre-exposure and conditioning. For example, in addition to examining within-drug effects, Lett (1989) examined the effects of morphine pre-exposure on amphetamine and cocaine place preferences as well as the effects of amphetamine on morphine-induced CPP. Morphine (5 mg/kg) was found to enhance the rewarding effects of both amphetamine (1.5 mg/kg) and cocaine (2.5 mg/kg), and amphetamine (1.5 mg/kg) was found to enhance the rewarding effects of morphine (1 mg/kg), as evidenced by significant increases in the percent time spent on the DPS in drug-experienced versus drug-naive animals (Lett, 1989). Although some subsequent research has extended these findings to other drug interactions (Hutchison and Riley, 2012), other studies have failed to do so (Le Pen et al., 1998; Busse et al., 2005). Although US pre-exposure has been found to enhance the rewarding effects of drugs (at least when examined within the same drug), its effects on the aversive effects of drugs are opposite, that is, such pre-exposure attenuates the ability of drugs to produce taste avoidance. The attenuating effects of US pre-exposure on the ability of drugs of abuse to condition CTAs have been well documented (see Riley and Simpson, 2001 for a review; see also Hall, 2009). For example, Riley and Diamond (1998) examined the effects of previous cocaine exposure Copyright © Lippincott Williams & Wilkins. Unauthorized reproduction of this article is prohibited. Balance of reward and aversion Verendeev and Riley 369 Fig. 3 Fig. 4 Drug history Time spent on the DPS (%) A 60 ∗ C M ∗ 20 ∗ 40 20 0 Saccharin consumption (ml) No drug history on cocaine-induced CTAs. Animals were administered cocaine (32 mg/kg) injections every fourth day for a total of five injections before conditioning with cocaine (at the same dose). The authors reported that in drug-naive animals, cocaine produced a robust suppression of intake of the drug-paired solution; however, cocaine did not exert an effect in the cocaine pre-exposed animals (see Fig. 4). Similar effects of US pre-exposure on the aversive effects of drugs (i.e. attenuation) have been reported for other drugs examined under similar conditions (see Riley and Simpson, 2001 for a comprehensive review). The ability of exposure to one drug in attenuating CTAs induced by another has also been examined extensively within the US preexposure literature (Cappell et al., 1975; Goudie and Thornton, 1975; Vogel and Nathan, 1976; Gamzu, 1977; Brown et al., 1979; Switzman et al., 1981; Ton and Amit, 1983; Bienkowski et al., 1998; Hutchison et al., 2010; Rinker et al., 2011). Unlike CPP, where the results are mixed, the attenuating effects of cross-drug pre-exposure seem to be more robust within the CTA preparation. It is important to note here that the effects of drug history on the rewarding and aversive effects of drugs can be subject to a number of different manipulations and are likely dependent on a number of different factors. Earlier, we mentioned that the aversive effects of drugs are not fixed and can be influenced by different experimental and subject variables. It is likely that these same variables can also influence the effects of drug history on drug reward and drug aversion; some effects of this kind have been reported (see Riley and Simpson, 2001; Tzschentke, 2007 for a more detailed discussion). WC CW WW 15 10 5 0 1 Sensitization of the rewarding effects of drugs by drug history. Conditioned place preference was measured by %time spent on the drug-paired side (DPS) in subjects receiving amphetamine (A), morphine (M), or cocaine (C) with no history (open bars) and a previous history (dark bars). *Significant differences between the subjects with or without drug history. See text for further details. Reproduced with permission from Table 3 of Lett (1989). CC 2 3 Trials 4 5 Attenuation of the aversive effects of cocaine by cocaine history. Mean (±SEM) saccharin consumption by groups receiving saccharin–cocaine (groups CC and WC) or saccharin–water (groups CW and WW) pairings during taste avoidance conditioning. The first letter in the group designation refers to the drug received during pre-exposure, that is, cocaine (C) or water (W); the second letter refers to the drug received during conditioning, that is, C or W. See Riley and Diamond (1998) for more detail. Adapted with permission from Fig. 1 of Riley and Diamond (1998). Another important caveat to mention is that most studies that examined the effects of drug pre-exposure on subsequent place preference or taste avoidance conditioning did so in separate animals and across different studies. To evaluate the effects of drug history on drug reward and drug aversion more directly, these assessments should be performed in the same animals and under the same parametric conditions. Recently, Simpson and Riley (2005) examined the effects of morphine preexposure on morphine-induced place preference and taste avoidance in the same subjects. Rats were first administered subcutaneous injections of 5 mg/kg morphine every other day for a total of five injections. They were then trained in a combined CTA/CPP procedure (see above), wherein a single injection of morphine (1 or 5 mg/kg) was administered to condition both a place preference and a taste avoidance. Both preferences and aversions were conditioned and, similar to what has been reported in between-subject analyses, pre-exposure to morphine enhanced place preference and attenuated taste avoidance within the same subjects. If drug history enhances the rewarding effects of a drug and attenuates its aversive effects, the resulting overall drug experience should be shifted toward a relative increase in its perceived rewarding effects. On the basis of the view that drug taking is a function of the balance between drug reward and drug aversion, we might expect that previous drug history will result in increased drug taking. Several lines of evidence support this position. For example, Rodd-Henricks et al. (2002) examined the effect Copyright © Lippincott Williams & Wilkins. Unauthorized reproduction of this article is prohibited. 370 Behavioural Pharmacology 2013, Vol 24 No 5&6 of ethanol exposure early in life on ethanol selfadministration in adulthood and found that drug history increased drug taking later in life. Specifically, adolescent rats were either allowed free access to a 15% ethanol solution for 30 days or received no such exposure. In adulthood, drug-experienced and drug-naive rats were allowed to self-administer 15% ethanol in a choice (ethanol vs. water) procedure. Following acquisition, rats were also compared in extinction as well as reacquisition of responding for ethanol. Compared with drug-naive animals, rats with a previous history of ethanol exposure acquired self-administration faster. Moreover, drug-experienced rats showed a greater resistance to extinction (i.e. higher rates of responding when ethanol was no longer available) as well as greater responding for ethanol during reacquisition. These findings are consistent with the above-mentioned view that drug history alters the balance between drug reward and drug aversion in such a way as to make drug taking more probable (i.e. enhanced rewarding effects, attenuated aversive effects). Similar results have been reported with ethanol (Siciliano and Smith, 2001; Pascual et al., 2009; Sherrill et al., 2011b). Genetic models Another way to study the role of drug reward and drug aversion in drug taking is to examine these effects in selectively bred mouse and rat lines (Crabbe, 2002) as well as inbred strains of these species (see Riley et al., 2009). Selectively bred lines share the common phenotype of interest (such as sensitivity to either rewarding or aversive effects of a drug or high or low propensity for drug self-administration) by virtue of selective breeding over a number of generations. Inbred strains, however, are more genetically homogeneous as a result of successive uninterrupted full-sibling matings (Beck et al., 2000). Multiple selectively bred lines and inbred strains of mice and rats are available, and these have been indispensable in studies of drug use and abuse. The use of these genetic models in relation to the relative roles of drug reward and aversion in drug intake has usually focused on examination of the relative sensitivity of the selected line or inbred strain to either the rewarding or aversive effects in relation to drug taking. In other words, if two particular lines or strains have been described in terms of their sensitivity to the rewarding effects of a drug (usually measured by CPP) or to the aversive effects of a drug (measured by CTA), they would be compared for their propensity for drug taking. Conversely, if two particular lines or strains were described in terms of their drug consumption (either high or low), their relative sensitivities to both the rewarding and the aversive effects would subsequently be compared. In mice, several selectively bred lines have been used to examine the relationship between ethanol consumption and the sensitivity to either the rewarding or the aversive effects of ethanol. For example, Phillips et al. (2005) used short-term selective breeding to create mouse lines different in their free choice ethanol consumption or ethanol-induced conditioned taste avoidance. After four generations of selective breeding, high-drinking mice (i.e. greater ethanol self-administration) showed greater ethanol-induced CPP compared with low-drinking mice. In contrast, mice selectively bred for greater sensitivity to the aversive effects of ethanol (as evidenced by their greater suppression of a drug-paired saccharin solution) showed reduced ethanol consumption when given the opportunity to consume 10% ethanol and had a lower overall ethanol preference ratio than did mice selectively bred for weaker sensitivity to the aversive effects of the drug. Similar results have been reported in another study that selectively bred mice for high and low ethanol preference (Chester et al., 2003): mice that showed higher ethanol preference showed attenuated taste avoidance to 2 and 4 g/kg ethanol compared with those of mice with low ethanol preference. One of the most widely used inbred mouse strains is the C57BL/6J (C57) mouse, which has been noted for its high level of ethanol consumption (see Cunningham et al., 2009). When compared with other strains, such as the DBA/2J (DBA) mouse, which shows low levels of ethanol consumption, the C57 strain consistently consumes more ethanol (Horowitz and Whitney, 1975; Risinger and Cunningham, 1992, 1995, 1998). When these two strains are compared for their sensitivity to ethanol, DBA mice show consistently greater CTAs than C57 mice at various doses of ethanol (Horowitz and Whitney, 1975; Risinger and Cunningham, 1992, 1995, 1998; see also Balknap et al., 1978). Selected lines of rats also support the above-mentioned work with ethanol. For example, Froehlich et al. (1988) reported that ethanol-preferring rats that consumed more ethanol than ethanol-nonpreferring rats showed reduced taste avoidance when conditioned with 1 g/kg ethanol than their nonpreferring counterparts. In a related study, University of Chile, low-ethanol-drinking rats consumed less ethanol than high-ethanol-drinking rats, and showed greater sensitivity to the aversive effects of ethanol, evidenced by significant ethanol-induced CTA at 1.5 g/kg (which was not evident in high-drinking rats) and stronger ethanol-induced CTA at 2 g/kg than their highdrinking controls (Quintanilla et al., 2001). The selectively bred Wistar Kyoto (WKY) strain, which consumes less ethanol than Marshall (M520) rats, acquired taste avoidance at a lower dose than M520 rats (i.e. they showed higher sensitivity to the aversive effects of ethanol; Cannon and Carrell, 1987). Although the above-mentioned rat strains have been used to document the relative sensitivities to drugs of abuse, primarily ethanol, the major work in rats in relation to drug use is with the Fischer (F344) and Lewis (LEW) inbred rat Copyright © Lippincott Williams & Wilkins. Unauthorized reproduction of this article is prohibited. Balance of reward and aversion Verendeev and Riley 371 strains. F344 and LEW rats, which differ in a number of behavioral and physiological characteristics (most notably in the regulation of the hypothalamic–pituitary–adrenal axis, wherein F344 rats are significantly more reactive to various physical and psychological stressors than LEW rats), have also been reported to differ in their sensitivity to the rewarding and aversive effects of drugs of abuse as well as in their self-administration (see Kosten and Ambrosio, 2002). Assessment of differences between these strains in their responsivity to the rewarding and aversive effects of drugs in relation to self-administration provides further support for the position that both drug reward and drug aversion should be considered in the analysis of drug-taking behavior. Specifically, F344 rats have been described to be less sensitive to the rewarding effects of morphine (as measured by CPP; Guitart et al., 1992; although see Davis et al., 2007) and more sensitive to its aversive effects (as measured by CTA; Lancellotti et al., 2001) than LEW rats. When these two strains are compared in morphine self-administration, F344 rats consistently take less morphine than LEW rats (Ambrosio et al., 1995). When examined with cocaine, however, the results are less straightforward. Specifically, LEW rats show a greater CTA response than F344 rats (Glowa et al., 1994; Grigson and Freet, 2000), but selfadminister cocaine to a greater degree than F344 rats (Kosten et al., 1997; although see Haile and Kosten, 2001; Haile et al., 2005; Freeman and Riley, 2009 for a discussion of how the aversive effects of cocaine may limit the escalation of cocaine self-administration). Although these results appear inconsistent with the position that a drug’s aversive effects limit drug taking, it is important to emphasize that drug taking is a function of the balance between drug reward and drug aversion. Therefore, even though LEW rats are more sensitive to the aversive effects of cocaine than F344 rats (see above), LEW rats also appear to be much more sensitive to the rewarding effects of cocaine, as evidenced by the fact that LEW rats show more robust cocaine-induced place preference compared with the F344 strain (Guitart et al., 1992). This pattern of differential sensitivity to both the rewarding and the aversive effects of cocaine in LEW and F344 rats further underlies the importance of considering the relative sensitivity to both the rewarding and the aversive effects of drugs rather than sensitivity to either of these effects alone. Balance of reward and aversion So far, we have described studies in separate groups of animals and comparisons across separate studies. Although mostly consistent with the position that drug use is a function of both the rewarding and the aversive effects of drugs, for more conclusive support, the role of drug reward and aversion in drug self-administration should be assessed in the same animals. If drug taking is a function of both its rewarding and aversive effects, drug intake should reflect the relative contribution of these effects. To date, no published work exists on such assessments of reward, aversion, and self-administration in the same animal. Preliminary data from our laboratory using the combined CTA/CPP procedure, followed by drug self-administration suggest that rats most sensitive to the aversive effects of morphine (as measured by CTA) self-administer less morphine than rats least sensitive to its aversive effects (Verendeev et al., 2012). Although supportive of the position that the balance of reward and aversion is important in (and predictive of) drug self-administration, such analysis awaits critical evaluation and replication. Conclusion This and other studies show that drugs of abuse are not simple stimuli that produce only rewarding effects. Rather, drugs of abuse are complex pharmacological compounds that produce both positive rewarding and negative aversive effects. In this paper, we have attempted to show that both of these effects should be taken into account in our attempts to model drug-taking behavior, and we have provided evidence from drug history and selectively bred mouse and rat strains, as well as from recent work directly assessing the role of drug reward and aversion in drug taking, that support this position. If this view is correct, drug self-administration should no longer be simply viewed only as a function of drug reward. The aversive effects of drugs should be taken into consideration in our attempts to understand drug use, abuse, and addiction. Acknowledgements Conflicts of interest There are no conflicts of interest. References Albaugh DL, Rinker JA, Baumann MH, Sink JR, Riley AL (2011). Rats preexposed to MDMA display attenuated responses to its aversive effects in the absence of persistent monoamine depletions. Psychopharmacology (Berl) 216: 441–449. Ambrosio E, Goldberg SR, Elmer GI (1995). Behavior genetic investigation of the relationship between spontaneous locomotor activity and the acquisition of morphine self-administration behavior. Behav Pharmacol 6:229–237. Balknap JK, Coleman RR, Foster K (1978). Alcohol consumption and sensory threshold differences between C57BL/6J and DBA/2J mice. Physiol Psychol 6:71–74. Bechara A, van der Kooy D (1985). Opposite motivational effects of endogenous opioids in brain and periphery. Nature 314:533–534. Beck JA, Lloyd S, Hafezparast M, Lennon-Pierce M, Eppig JT, Festing MFW, et al. (2000). Geneologies of mouse inbred strains. Nat Genet 24:23–25. Bienkowski P, Piasecki J, Koros E, Stefanski R, Kostowski W (1998). Studies on the of the nicotinic acetylcholine receptors in the discriminative and aversive stimulus properties of ethanol in the rat. Eur Neuropharmacol 8:79–87. Booth DA, Pilcher CW, D’Mello GD, Stolerman IP (1977). Comparative potencies of amphetamine, fenfluramine and related compounds in taste aversion experiments in rats. Br J Pharmacol 61:669–677. Braun JJ, McIntosh HJ (1973). Learned taste aversions induced by rotational stimulation. Physiol Psychol 1:301–304. Brockwell NT, Eikelboom R, Beninger RJ (1991). Caffeine-induced place and taste conditioning: production of dose-dependent preference and aversion. Pharmacol Biochem Behav 38:513–517. Brown ZW, Amit Z, Smith B, Rockman G (1979). Disruption of taste aversion learning by pretreatment with diazepam and morphine. Pharmacol Biochem Behav 10:17–20. Copyright © Lippincott Williams & Wilkins. Unauthorized reproduction of this article is prohibited. 372 Behavioural Pharmacology 2013, Vol 24 No 5&6 Busse GD, Lawrence ET, Riley AL (2005). The effects of alcohol preexposure on cocaine, alcohol and cocaine/alcohol place conditioning. Pharmacol Biochem Behav 81:459–465. Cannon DS, Carrell LE (1987). Rat strain differences in ethanol self-administration and taste aversion learning. Pharmacol Biochem Behav 28:57–63. Cappell H, LeBlanc AE (1971). Conditioned aversion to saccharin by single administrations of mescaline and D-amphetamine. Psychopharmacologia 22:352–356. Cappell H, LeBlanc AE, Endrenyi L (1973). Aversive conditioning by psychoactive drugs: effects of morphine, alcohol and chlordiazepoxide. Psychopharmacologia 29:239–246. Cappell H, LeBlanc AE, Herling S (1975). Modification of the punishing effects of psychoactive drugs in rats by previous drug experience. J Comp Physiol Psychol 89:347–356. Carey RJ, Goodall EB (1974). Amphetamine-induced taste aversion: a comparison of d- versus l-amphetamine. Pharmacol Biochem Behav 2:325–330. Chambers KC, Sengstake CB, Yoder RL, Thornton JE (1981). Sexually dimorphic acquisition of a conditioned taste aversion in rats: effects of gonadectomy, testosterone replacement and water deprivation. Physiol Behav 27:83–88. Chester JA, Lumeng L, Li TK, Grahame NJ (2003). High- and low-alcoholpreferring mice show differences in conditioned taste aversion to alcohol. Alcohol Clin Exp Res 27:12–18. Corcoran ME, Bolotow I, Amit Z, McCaughran JA Jr. (1974). Conditioned taste aversions produced by active and inactive cannabinoids. Pharmacol Biochem Behav 2:725–728. Crabbe JC (2002). Genetic contributions to addiction. Annu Rev Psychol 53:435–462. Cunningham CL (1979). Flavor and location aversions produced by ethanol. Behav Neural Biol 27:362–367. Cunningham CL, Okorn DM, Howard CE (1997). Interstimulus interval determines whether ethanol produces conditioned place preference or aversion in mice. Anim Learn Behav 25:31–42. Cunningham CL, Gremel CM, Groblewski PA (2009). Genetic influences on conditioned taste aversion. In: Reilly S, Schachtman TR, editors. Conditioned taste aversion: behavioral and neural processes. New York: Oxford University Press. pp. 387–421. Dacanay RJ, Riley AL (1982). The UCS preexposure effect in taste aversion learning: tolerance and blocking are drug specific. Anim Learn Behav 10: 91–96. Davis CM, Roma PG, Dominguez JM, Riley AL (2007). Morphine-induced place conditioning in Fischer and Lewis rats: acquisition and dose-response in a fully biased procedure. Pharmacol Biochem Behav 86:516–523. Davis CM, Rice KC, Riley AL (2009). Opiate-agonist induced taste aversion learning in the Fischer 344 and Lewis inbred rat strains: evidence for differential mu opioid receptor activation. Pharmacol Biochem Behav 93:397–405. De Beun R, Rijk HW, Broekkamp CLE (1993). Cross-familiarisation conditioned taste aversion procedure as a method to reveal stimulus resemblance between drugs: studies on the 5-HT1A agonist 8-OHDPAT. Psychopharmacology (Berl) 112:121–128. Domjan M, Siegel S (1983). Attenuation of the aversive and analgesic effects of morphine by repeated administration – different mechanisms. Physiol Psychol 11:155–158. Etscorn F (1980). Sucrose aversions in mice as a result of injected nicotine or passive tobacco smoke inhalation. Bull Psychon Soc 15:54–56. Etscorn F, Moore GA, Hagen LS, Caton TM, Sanders DL (1986). Saccharin aversions in hamsters as a result of nicotine injections. Pharmacol Biochem Behav 24:567–570. Ettenberg A, Geist TD (1991). Animal model for investigating the anxiogenic effects of self-administered cocaine. Psychopharmacology (Berl) 103: 455–461. Ettenberg A, Geist TD (1993). Qualitative and quantitative differences in the operant runway behavior of rats working for cocaine and heroin reinforcement. Pharmacol Biochem Behav 44:191–198. Ettenberg A, Raven MA, Danluck DA, Necessary BD (1999). Evidence for opponent-process actions of intravenous cocaine. Pharmacol Biochem Behav 64:507–512. Ferrari CM, O’Connor DA, Riley AL (1991). Cocaine-induced taste aversions: effect of route of administration. Pharmacol Biochem Behav 38: 267–271. Fischer GJ, Vail BJ (1980). Preexposure to delta-9-THC blocks THC-induced conditioned taste aversion in rats. Behav Neural Biol 30:191–196. Flaherty CF (1996). Incentive relativity. New York: Cambridge University Press. Freeman KB, Riley AL (2009). The origins of conditioned taste aversion learning: a historical analysis. In: Reilly S, Schachtman TR, editors. Conditioned taste aversion: behavioral and neural processes. New York: Oxford University Press. pp. 9–33. Froehlich JC, Harts J, Lumeng L, Li TK (1988). Differences in response to the aversive properties of ethanol in rats selectively bred for oral ethanol preference. Pharmacol Biochem Behav 31:215–222. Gaiardi M, Bartoletti M, Bacchi A, Gubellini C, Costa M, Babbini M (1991). Role of repeated exposure to morphine in determining its affective properties: place and taste conditioning studies in rats. Psychopharmacology (Berl) 103:183–186. Gamzu E (1977). The multifaceted nature of taste-aversion inducing agents: is there a single common factor? In: Barker LM, Best MR, Domjan M, editors. Learning mechanisms in food selection. Waco, TX: Baylor University Press. pp. 477–509. Garb JL, Stunkard AJ (1974). Taste aversions in man. Am J Psychiatry 131:1204–1207. Garcia J, Kimeldorf DJ, Koelling RA (1955). Conditioned aversion to saccharin resulting from exposure to gamma radiation. Science 122:157–158. Garcia J, Ervin FR (1968). Gustatory-visceral and telereceptor-cutaneous conditioning: adaptation in internal and external milieus. Commun Behav Biol Part A:389–415. Garcia J, Riley AL (1998). Conditioned taste aversions. In: Greenberg G, Haraway MM, editors. Comparative psychology: a handbook. New York: Garland Publishing Inc; pp. 549–561. Glowa JR, Shaw AE, Riley AL (1994). Cocaine-induced conditioned taste aversions: comparisons between effects in LEW/N and F344/N rat strains. Psychopharmacology (Berl) 114:229–232. Goudie AJ, Thornton EW (1975). Effects of drug experience on drug induced conditioned taste aversions: studies with amphetamine and fenfluramine. Psychopharmacologia 44:77–82. Goudie AJ, Dickins DW, Thornton EW (1978). Cocaine-induced conditioned taste aversions in rats. Pharmacol Biochem Behav 8:757–761. Goudie AJ (1979). Aversive stimulus properties of drugs. Neuropharmacology 18:971–979. Grigson PS (1997). Conditioned taste aversions and drugs of abuse: a reinterpretation. Behav Neurosci 111:129–136. Grigson PS, Freet CS (2000). The suppressive effects of sucrose and cocaine, but not lithium chloride, are greater in Lewis than in Fischer rats: evidence for the reward comparison hypothesis. Behav Neurosci 114:353–363. Grigson PS, Twining RC, Carelli RM (2000). Heroin-induced suppression of saccharin intake in water-deprived and water-replete rats. Pharmacol Biochem Behav 66:603–608. Guitart X, Beitner-Johnson D, Marby DW, Kosten TA, Nestler EJ (1992). Fischer and Lewis rat strains differ in basal levels of neurofilament proteins and their regulation by chronic morphine in the mesolimbic dopamine system. Synapse 12:242–253. Hagen EH, Sullivan RJ, Schmidt R, Morris G, Kempter R, Hammerstein P (2009). Ecology and neurobiology of toxin avoidance and the paradox of drug reward. Neuroscience 160:69–84. Haile CN, Kosten TA (2001). Differential effects of D1-and D2-like compounds on cocaine self-administration in Lewis and Fischer 344 inbred rats. J Pharmacol Exp Ther 299:509–518. Haile CN, Zhang XY, Carroll F, Kosten TA (2005). Cocaine self-administration and locomotor activity are altered in Lewis and F344 inbred rats by RTI 336, a 3-phenyltropane analog that binds to the dopamine transporter. Brain Res 1055:186–195. Hall G (2009). Preexposure to the unconditioned stimulus in nausea-based aversion learning. In: Reilly S, Schachtman TR, editors. Conditioned taste aversion: behavioral and neural processes. New York: Oxford University Press. pp. 58–73. Harris GC, Aston-Jones G (2003). Enhanced morphine preference following prolonged abstinence: association with increased Fos expression in the extended amygdala. Neuropsychopharmacology 28:292–299. He S, Li N, Grasing K (2004). Long-term opiate effects on amphetamine-induced dopamine release in the nucleus accumbens core and conditioned place preference. Pharmacol Biochem Behav 77:327–335. Horowitz GP, Whitney G (1975). Alcohol-induced conditioned aversion: genotypic specificity in mice (Mus musculus). J Comp Physiol Psychol 89:340–346. Hunt T, Amit Z (1987). Conditioned taste aversion induced by self-administered drugs: paradox revisited. Neurosci Biobehav Rev 11:107–130. Hutchison MA, Albaugh DL, Riley AL (2010). Exposure to alcohol during adolescence alters the aversive and locomotor-activating effects of cocaine in adult rats. Pharmacol Biochem Behav 97:370–376. Hutchison MA, Riley AL (2012). Ethanol exposure during either adolescence or adulthood alters the rewarding effects of cocaine in adult rats. Pharmacol Biochem Behav 101:458–464. Copyright © Lippincott Williams & Wilkins. Unauthorized reproduction of this article is prohibited. Balance of reward and aversion Verendeev and Riley 373 Iwamoto ET, Williamson EC (1984). Nicotine-induced taste aversion: characterization and preexposure effects in rats. Pharmacol Biochem Behav 21: 527–532. Kay EJ (1975). Aversive effects of repeated injections of THC in rats. Psychol Rep 37:1051–1054. Klosterhalfen S, Klosterhalfen W (1985). Conditioned taste aversion and traditional learning. Psychol Res 47:71–94. Koob GF, Le Moal M (2006). Neurobiology of addiction. Amsterdam/Boston: Elsevier/Academic Press. Kosten TA, Miserendino MJ, Haile CN, DeCaprio JL, Jatlow PI, Nestler EJ (1997). Acquisition and maintenance of intravenous cocaine self-administration in Lewis and Fischer inbred rat strains. Brain Res 778:418–429. Kosten TA, Ambrosio E (2002). HPA axis function and drug addictive behaviors: insights from studies with Lewis and Fischer 344 inbred rats. Psychoneuroendocrinology 27:35–69. Kumar R, Pratt JA, Stolerman IP (1983). Characteristics of conditioned taste aversion produced by nicotine in rats. Br J Pharmacol 79:245–253. Lancellotti D, Bayer BM, Glowa JR, Houghtling RA, Riley AL (2001). Morphineinduced conditioned taste aversions in the LEW/N and F344/N rat strains. Pharmacol Biochem Behav 68:603–610. LeBlanc AE, Cappell H (1974). Attenuation of punishing effects of morphine and amphetamine by chronic prior treatment. J Comp Physiol Psychol 87: 691–698. Le Pen G, Duterte-Boucher D, Daoust M, Costentin J (1998). Pre-exposure to alcohol does not sensitize to the rewarding effects of cocaine. Neuroreport 9:2887–2891. Lett BT (1989). Repeated exposures intensify rather than diminish the rewarding effects of amphetamine, morphine, and cocaine. Psychopharmacology (Berl) 98:357–362. Lin HQ, McGregor IS, Atrens DM, Christie MJ, Jackson DM (1994). Contrasting effects of dopaminergic blockade on MDMA and d-amphetamine conditioned taste aversions. Pharmacol Biochem Behav 47:369–374. Logue AW (1985). Conditioned food aversion learning in humans. Ann N Y Acad Sci 443:316–329. Manzanedo C, Aguilar MA, Rodriguez-Arias M, Minarro J (2005). Sensitization to the rewarding effects of morphine depends on dopamine. Neuroreport 16:201–205. Martin GM, Bechara A, van der Kooy D (1988). Morphine preexposure attenuates the aversive properties of opiates without preexposure to the aversive properties. Pharmacol Biochem Behav 30:687–692. Meyer JS, Quenzer LF (2005). Psychopharmacology: drugs, the brain, and behavior. Sunderland, MA: Sinauer Associates. Nocjar C, Panksepp J (2002). Chronic intermittent amphetamine pretreatment enhances future appetitive behavior for drug-and natural-reward: interaction with environmental variables. Behav Brain Res 128:189–203. Parker LA (1993). Taste reactivity responses elicited by cocaine-, phencyclidine-, and methamphetamine-paired sucrose solutions. Behav Neurosci 107: 118–129. Parker LA (1995). Rewarding drugs produce taste avoidance, but not taste aversion. Neurosci Biobehav Rev 19:143–157. Parker LA, Gillies T (1995). THC-induced place and taste aversions in Lewis and Sprague–Dawley rats. Behav Neurosci 109:71–78. Parker LA (1996). LSD produces place preference and flavor avoidance but does not produce flavor aversion in rats. Behav Neurosci 110: 503–508. Parker LA, Limebeer CL, Rana SA (2009). Conditioned disgust, but not conditioned taste avoidance, may reflect conditioned nausea in rats. In: Reilly S, Schachtman TR, editors. Conditioned taste aversion: behavioral and neural processes. New York: Oxford University Press. pp. 92–113. Pascual M, Boix J, Felipo V, Guerri C (2009). Repeated alcohol administration during adolescence causes changes in the mesolimbic dopaminergic and glutamatergic systems and promotes alcohol intake in the adult rat. J Neurochem 108:920–931. Pescatore KA, Glowa JR, Riley AL (2005). Strain differences in the acquisition of nicotine-induced conditioned taste aversion. Pharmacol Biochem Behav 82:751–757. Phillips TJ, Broadbent J, Burkhart-Kasch S, Henderson C, Wenger CD, McMullin C, Cunningham CL (2005). Genetic correlational analyses of ethanol reward and aversion phenotypes in short-term selected mouse lines bred for ethanol drinking or ethanol-induced conditioned taste aversion. Behav Neurosci 119:892–910. Quintanilla ME, Callejas O, Tampier L (2001). Differences in sensitivity to the aversive effects of ethanol in low-alcohol drinking (UChA) and high-alcohol drinking (UChB) rats. Alcohol 23:177–182. Reicher MA, Holman EW (1977). Location preference and flavor aversion reinforced by amphetamine in rats. Anim Learn Behav 5:343–346. Reilly S, Schachtman TR (2009). Conditioned taste aversion: behavioral and neural processes. New York: Oxford University Press. Riley AL, Jacobs WJ, LoLordo VM (1978). Morphine-induced taste aversions: a consideration of parameters. Physiol Psychol 6:96–100. Riley AL, Dacanay RJ, Mastropaolo JP (1984). The effect of morphine preexposure on the acquisition of morphine-induced taste-aversions – a nonassociative effect. Anim Learn Behav 12:157–162. Riley AL, Diamond HF (1998). The effects of cocaine preexposure on the acquisition of cocaine-induced taste aversions. Pharmacol Biochem Behav 60:739–745. Riley AL, Simpson GR (2001). The attenuating effects of drug preexposure on taste aversion conditioning: generality, experimental parameters, underlying mechanisms and implications for drug use and abuse. In: Mowrer RR, Klein SB, editors. Contemporary learning theory. 2nd ed. Hillsdale, NJ: Lawrence Erlbaum Associates. pp. 505–559. Riley AL, Davis CM, Roma PG (2009). Strain differences in taste aversion learning: implications for animal models of drug abuse. In: Reilly S, Schachtman TR, editors. Conditioned taste aversion: behavioral and neural processes. New York: Oxford University Press. pp. 226–261. Riley AL (2011). The paradox of drug taking: the role of the aversive effects of drugs. Physiol Behav 103:69–78. Rinker JA, Busse GD, Riley AL (2008). An assessment of sex differences in nicotine-induced conditioned taste aversions. Pharmacol Biochem Behav 88:427–431. Rinker JA, Hutchison MA, Chen SA, Thorsell A, Heilig M, Riley AL (2011). Exposure to nicotine during periadolescence or early adulthood alters aversive and physiological effects induced by ethanol. Pharmacol Biochem Behav 99:7–16. Risinger FO, Cunningham CL (1992). Genetic differences in ethanolinduced hyperglycemia and conditioned taste aversion. Life Sci 50: PL113–PL118. Risinger FO, Cunningham CL (1995). Genetic differences in ethanol-induced conditioned taste aversion after ethanol preexposure. Alcohol 12: 535–539. Risinger FO, Cunningham CL (1998). Ethanol-induced conditioned taste aversion in BXD recombinant inbred mice. Alcohol Clin Exp Res 22: 1234–1244. Rodd-Henricks ZA, Bell RL, Kuc KA, Murphy JM, McBride WJ, Lumeng L, Li TK (2002). Effects of ethanol exposure on subsequent acquisition and extinction of ethanol self-administration and expression of alcohol-seeking behavior in adult alcohol-preferring (P) rats: I. Periadolescent exposure. Alcohol Clin Exp Res 26:1632–1641. Roma PG, Flint WW, Higley JD, Riley AL (2006). Assessment of the aversive and rewarding effects of alcohol in Fischer and Lewis rats. Psychopharmacology (Berl) 189:187–199. Schramm-Sapyta NL, Walker QD, Caster JM, Levin ED, Kuhn CM (2009). Are adolescents more vulnerable to drug addiction than adults? Evidence from animal models. Psychopharmacology (Berl) 206:1–21. Sellings LH, Baharnouri G, McQuade LE, Clarke PB (2008). Rewarding and aversive effects of nicotine are segregated within the nucleus accumbens. Eur J Neurosci 28:342–352. Sherman JE, Pickman C, Rice A, Liebeskind JC, Holman EW (1980). Rewarding and aversive effects of morphine: temporal and pharmacological properties. Pharmacol Biochem Behav 13:501–505. Sherrill LK, Berthold C, Koss WA, Juraska JM, Gulley JM (2011a). Sex differences in the effects of ethanol pre-exposure during adolescence on ethanol-induced conditioned taste aversion in adult rats. Behav Brain Res 225:104–109. Sherrill LK, Koss WA, Foreman ES, Gulley JM (2011b). The effects of pre-pubertal gonadectomy and binge-like ethanol exposure during adolescence on ethanol drinking in adult male and female rats. Behav Brain Res 216:569–575. Shippenberg TS, Heidbreder CH (1995). Sensitization to the conditioned rewarding effects of cocaine: pharmacological and temporal characteristics. J Pharmacol Exp Ther 273:808–815. Shippenberg TS, Heidbreder CH, Lefevour A (1996). Sensitization to the conditioned rewarding effects of morphine: pharmacology and temporal characteristics. Eur J Pharmacol 299:33–39. Shoaib M, Stolerman IP, Kumar RC (1994). Nicotine-induced place preferences following prior nicotine exposure in rats. Psychopharmacology (Berl) 113:445–452. Siciliano D, Smith RF (2001). Periadolescent alcohol alters adult behavioral characteristics in the rat. Physiol Behav 74:637–643. Siegel S, Parker LA, Moroz I (1995). Morphine-induced taste avoidance is attenuated with multiple conditioning trials. Pharmacol Biochem Behav 50:299–303. Copyright © Lippincott Williams & Wilkins. Unauthorized reproduction of this article is prohibited. 374 Behavioural Pharmacology 2013, Vol 24 No 5&6 Simpson GR, Riley AL (2005). Morphine preexposure facilitates morphine place preference and attenuates morphine taste aversion. Pharmacol Biochem Behav 80:471–479. Sklar LS, Amit Z (1977). Manipulations of catecholamine systems block the conditioned taste aversion induced by self-administered drugs. Neuropharmacology 16:649–655. Steigerwald ES, Rusiniak KW, Eckel DL, O’Regan MH (1988). Aversive conditioning properties of caffeine in rats. Pharmacol Biochem Behav 31:579–584. Stolerman IP, D’Mello GD (1981). Oral self-administration and the relevance of conditioned taste aversions. In: Thompson T, Dews PB, McKim WA, editors. Advances in behavioral pharmacology. Hillsdale, NJ: Lawrence Erlbaum. pp. 169–214. Stolerman IP (1992). Drugs of abuse: behavioural principles, methods and terms. Trends Pharmacol Sci 13:170–176. Switzman L, Fishman B, Amit Z (1981). Pre-exposure effects of morphine, diazepam, and delta9-THC on the formation of conditioned taste aversions. Psychopharmacology (Berl) 74:149–152. Ton JMNC, Amit Z (1983). Symmetrical effect of pre-exposure between alcohol and morphine on conditioned taste aversion. Life Sci 33:665–670. Tzschentke TM (2007). Measuring reward with the conditioned place preference (CPP) paradigm: update of the last decade. Addict Biol 12:227–462. Verendeev A, Riley AL (2011). Relationship between the rewarding and aversive effects of morphine and amphetamine in individual subjects. Learn Behav 39:399–408. Verendeev A, Riley AL (2012). Conditioned taste aversion and drugs of abuse: history and interpretation. Neurosci Biobehav Rev 36:2193–2205. Verendeev A, Tunstall BJ, Kearns DN, Riley AL (2012). A limiting role of drug aversion in morphine self-administration. Society for neuroscience abstracts. Washington, DC: Society for Neuroscience. Vishwanath JM, Desko AG, Riley AL (2011). Caffeine-induced taste aversions in Lewis and Fischer rat strains: differential sensitivity to the aversive effects of drugs. Pharmacol Biochem Behav 100:66–72. Vogel JR, Nathan BA (1976). Reduction of learned taste aversions by pre-exposure to drugs. Psychopharmacology (Berl) 49:167–172. White BC, Mason FD (1985). Caffeine-induced taste aversion and mimetic responses. Pharmacol Biochem Behav 23:515–518. White N, Sklar L, Amit Z (1977). The reinforcing action of morphine and its paradoxical side effect. Psychopharmacology (Berl) 52:63–66. Wise RA, Yokel RA, DeWit H (1976). Both positive reinforcement and conditioned aversion from amphetamine and from apomorphine in rats. Science 191:1273–1275. Wise RA, Bozarth MA (1987). A psychomotor stimulant theory of addiction. Psychol Rev 94:469–492. Copyright © Lippincott Williams & Wilkins. Unauthorized reproduction of this article is prohibited.