Stochastic models of evolution driven by Spatial Heterogeneity R Group H , Utrecht University, Department of Biology, Theoretical Biology Three research lines 1. Bacterial growth 2. Stochastic models of evolutio Physiology of bacterial during steadystate exponential growth: • Bulk properties highly predictable1 • Heterogeneous environments • Non-Poissonian mutation processes • yet huge cell-to-cell fluctuations2 3 (The evolution of) fratricide in Streptococcus pneumoniae 1 You et al (2013), 2 Kiviet et al (2014), Outline I. Evolutionary population genetics basic notions and two examples II. Evolution in heterogeneous environments A. The staircase model many connected compartments Intermezzo: B. The source-sink model The ramp model: continuous space Classical theoretical population genetics Founders: • Ronald A. Fisher (1890 – 1962) • Sewall B.S. Wright (1889 – 1988) • John B.S Haldane (1892 – 1964) Some of the fundamental questions: • How do stochastic forces interfere with (natural) selection? • What determines the time scales of evolution? • Migration, sexual reproduction, linkage? • How do social interactions evolve? (cooperation, competition, spite, …) Example 1: Continuous-time Moran1 process death Structure of the model: • population of N individuals • stochastic reproduction … • … coupled to death of random individual • fitness = reproduction rate “selection coefficient” What is its fixation probability? 1 P. Moran (1958) time Question: Assume that fitness of red mutant is 1 + s times that of the blue ones. reproduction In physics language, this Moran model is… • a continuous-time Markov process • a one-step process with two absorbing boundaries • described by a Master equation with transition rates: π−π ππ,π+1 = 1 + π π π π ππ,π−1 = π − π π (Here, π is the number of red individuals.) Calculating the mutation-fixation probability: Determine the “splitting probabilities” for initial condition: ππ (0) = πΏπ,1 Mutation-fixation probability For small s: πfix π , π π−1 π ≈1+ + π(π 2 ). πfix 0, π 2 Conclusion: • Selection has a negligible effect unless (ππ ) is of order 1. • Selection is a stronger force in larger populations. Example 2: The wave of advance of a beneficial mutation • Population in 1D space • Mutation occurs carrying selection coefficient s • How rapidly does this mutation spread? • Mean-field (Fisher-KPP) equation1: “logistic growth” ππ π2π = π π 1 − π/πΎ + π· 2 . ππ‘ ππ₯ “carrying capacity” • Compact initial distributions π’(π₯, 0) converge to traveling wave front with speed π£0 = 2 π π·. 1 Fisher, The genetical theory of natural selection (1930) • R.A. Example of a pulled front. Outline I. Evolutionary population genetics basic notions and two examples II. Evolution in heterogeneous environments A. The staircase model many connected compartments Intermezzo: B. The source-sink model The ramp model: continuous space Mutations can affect a species’ range Biotic and abiotic factors vary in space They limit a species range Mutations that extend one’s range can be successful, even if they confer no benefit within the original range Illustration: Giraffes and Trees Usual population genetics models Scenario considered here Relevant for resistance and virulance evolution Evolution of drug / antibiotic resistance (heterogeneities in body or between individuals) Evolution of virulence (ability of an organisms to invade a host’s tissue) A. The staircase model Many connected compartments Landscape: Processes and rates: Mutants (increasing resistance) Mutation πf ο ο πb Migration ο π ο π Death πΏ ο ο 0 Logistic growth above staircase Compartments (increasing drug level) πΎπ ππ ο οο πΎπ ππ = π(1 − ππ /πΎ) Simulations (kinetic Monte Carlo) Adaptation is fast and shows two regimes At the front, only 2x2 tiles matter Intermezzo: A source–sink model Two patches Source-sink model: two somewhat isolated patches Wild type cannot reproduce in patch 2 Mutant can. Logistic reproduction: πΎππ ππ ππ = π 1 − πΎ Death rate πΏ Mutant has no advantage in patch 1!! How long does it take before the population adapts? Monte Carlo simulations again show two regimes Mean first arrival time calculation Collapse on master curve: We find: ππ≈ π Γ π 2 Γ π +1 2 where π ≈ π(πΏ + π) πf πΎ π ≈ 2(πΏ + π) Two regimes: mutation- and migrationlimited Mutation-limited regime: if πf πΎ βͺ πΏ + π: Migration-limited regime: if πf πΎ β« πΏ + π: πΏ/π π≈ πf πΎ π≈ π/2π πf πΎ Path faster than path This means: Adaptation usually originates as a neutral mutation in patch 1 (“Dykhuizen–Hartl effect”) Cost of adaptation... genotypes Assume that the mutant has a fitness defect in patch 1 Does this suppress adaptation? Cost negligible unless 0 patches π β³ π πΏ ½ Even when π/πΏ = 10−2 we need π β³ 0.1, which is a large cost. ...is relevant only if it is large. Back to the staircase: At the front, source-sink dynamics Theory very similar to source-sink model explains rate of propagation of the staircase model Cost of adaptation hardly affects rate (Simulations, and theory similar to source-sink model.) Defeating the Superbugs –2012 B. The ramp model Continuous space & quantitative traits Is there such a thing as a ‘just right’ gradient? Many traits are continuous Many biological characteristics are, for all practical purposes, continuous, due to the involvement of many genes, e.g.: • • • • • • fat content in plants body size skin color neck length minimal inhibitory concentration … Continuous “ramp” model Individuals: • diffuse in real space, • diffuse in trait space (mutation), • die, • reproduce logistically when above the ramp. Result: Population wave front that expands above the line. Q: What is the asymptotic speed of that wave? Q: In particular: how does it depend on the slope π? Large density: deterministic, ‘mean-field’ treatment ππ‘ π = π·x ππ₯π₯ π + π·y ππ¦π¦ π + π π 1 − π dπ¦ π» π¦ − ππ₯ − πΏ π, πΎ Numerical solutions indeed show a propagating pulse. What is its asymptotic speed? Define: π£π¦ = rate of adaptation π£π₯ = rate of invasion trait value π¦ (Similar to Fisher-KPP wave!) position π₯ Asymptotic speed can be calculated analytically Using theory of front propagation into unstable states: πΏ = 0, π πΏ = 0.1 π πΏ = 0.5 π πΏ = 0.7 π π£π¦ π π£y = 2 π − πΏ π·x π·y π2 π·y + π·x π2 Numerical solutions confirm this. Adaptation rate increases monotonously with slope a. No (finite) optimal slope?? Van Saarloos, “Front propagation into unstable states” Physics Reports 386 (2003) 29-222 Beyond the mean field: stochastic simulations • Individuals diffusing randomly in continuous space. • Stochastic death • Stochastic reproduction at logistic rate: π 1− π Ω π₯π − π₯ πΎ π»(π¦ − π π₯), where Ω(π) is a Gaussian interaction kernel with variance π 2 . π¦ π¦=ππ₯ π₯ The simulation challenge: Properties of the system: • the reproduction rate of each organism depends on the location of every organism in the system; • each organism diffuses in continuous space and time; • therefore rates fluctuate rapidly in time. Problems: • Cannot use a standard Gillespie algorithm • Discrete time steps: require recalculation of interaction kernel for each individual at each time step The “Weep” Algorithm: exact, event-driven simulation of time-, location- and density-dependent reaction rates The main idea: • Add a dummy reaction to the system. (I’ll imagine the organisms “weep”.) • Choose the rate of the dummy process πw such that the total rate becomes constant for each organism: πw = π π πw = π, Ω π₯π − π₯ , πΎ (above the ramp) below the ramp so that πtot ≡ πb + πw + πd = π + πΏ = is constant. (The organisms tend to weep when conditions are tough.) The “Weep” Algorithm: exact, event-driven simulation of time-, location- and density-dependent reaction rates Then determine next reaction: 1. When? Draw next-reaction time π‘ + Δπ‘ (as in Gillespie). 2. Where? Update the coordinates of all individuals. (Greens function of diffusion for time Δπ‘). 3. Who? Pick a random individual π. 4. What? Choose death with probability πΏ/πtot . If it is not killed, it either reproduces or weeps. • If π¦π < π π₯π , it weeps. • If π¦π > π π₯π , calculate πw for organism π only. π It reproduces with probability b , and weeps π +π b otherwise. 5. Repeat. w Discrete, stochastic simulations Low density (πΎ = 10) High density (πΎ = 500) Stochastic simulations do show an optimum The optimal slope is: π≈ π·y π·x What’s wrong with the mean field equation? • In “pulled” fronts, the leading edge determines the speed. • There, the density becomes arbitrarily small; fractions of individuals reproduce exponentially. • In this case, this leads to qualitatively misleading results. In the stochastic simulation, we’re waiting for unlikely mutations/migrations to occur. • Stochastic system does converge to mean-field equation, but not uniformly in π. Take-away messages 1. In the presence of environ- 2. This is mental gradients, adaptation relevant for the and range expansion can go evolution hand in hand. of drug resistance and virulence. 3. 4. A fitness cost has little effect. This mode of adaptation can be fast. 5. The dynamics show two regimes: a mutation-limited and a migration-limited one. 6. An optimal gradient exists – for any finite carrying capacity. Be careful with mean-field limit! Acknowledgements Hwa lab at the UC San Diego: Terence Hwa J. Barrett Deris Department of Bionanoscience, TU Del Cees Dekker Veni Grant (2012)