Chapter 18 Statistical mechanics of classical systems 18.1 The classical canonical partition function When quantum effects are not significant, we can approximate the behavior of a system using a classical representation. Here, we derive the expressions for the partition functions in such cases. We will consider a single-component system composed of sphericallysymmetric, single-particle molecules. For the canonical partition function, the discrete version in general is, , , = = all at , DOF for exp − DOF for … (18.1) all DOF DOF for where is an index running over all microstates of the system and the sums indicate exhaustive enumeration of all possible values for each degree of freedom (DOF) of each particle. For a classical system of structureless particles, each microstate involves 6 degrees of freedom—the 3 positions and 3 momenta for each particle. These variables are continuous, rather than discrete. We rewrite the summation over microstates as an integral over these variables: , , ~ … !" ,# " $ %! %! … %! %# %# … %# (18.2) Here, we have replaced the energy with the Hamiltonian function. The quantities # and ! are the vectors of all positions and momenta, respectively. The notation %! indicates %&' %&( %&) such that the integral over %! for one particle is actually a three-dimensional integral. A similar case exists for %#. Therefore, the total number of integrals is 6 . We say that this is a 6 -dimensional integral. We must first discuss the limits of integration: • • For each momentum variable, the limits are −∞ < & < ∞. In other words, the momenta can take on any real value. These degrees of freedom and the associated integrals are unbounded. For each position variable, the values it can take on depend on the volume of the container into which it was placed. For a cubic box of side length ,, one has 0 < . < ,. Therefore these position variables are bounded and the integrals are 1 definite. The limits of the position integrals also introduce a dependence of the partition function on . • Does the specific shape of the container matter? For large homogeneous systems, this integral is independent of the container shape, for the same average density. The reason is that any unusual container shape can be broken down and approximated by a number of smaller subsystems of the same density that are each cubic in size, in a pixilated fashion. Each pixel can still be large enough to be considered macroscopic in size, which means that boundary interactions between it and neighboring pixels are very small. Therefore, the net properties of the whole system are simply the sum of those of the small pixels, which is insensitive to how they are arranged (the overall shape). Notice that the classical partition function is not dimensionless, as it has units of /momentum56 × /distance56 owing to the integrand variables (%!’s and %#’s). This means that we can never calculate absolute values of purely classical partition functions, since the value would change depending on what units we used. Instead, we can only compute ratios of partition functions, or differences in free energies, since these quantities are dimensionless. This result mirrors our considerations of the third law of thermodynamics, where we found that a classical description is inadequate for providing an absolute entropy. The general rule is that: In a purely classical description, where we have continuous degrees of freedom in the form of atomic positions and momenta, we cannot compute absolute values of partition functions. Instead, we can only compute ratios of a partition function at different states. In reality, we know that the world is not classical, but behaves quantum-mechanically. In the high-temperature limit, however, quantum systems behave like classical ones. Therefore, we typically introduce a correction factor into the classical canonical partition function to make it agree with the quantum behavior in the high-temperature limit. This correction factor looks like: , , = ℎ6 1 ! … !" ,# " $ %! %! … %! %# %# … %# (18.3) Here, ℎ is simply Planck’s constant, and ! is the quantum correction for indistinguishable particles, which is the general case for nearly all of matter. Notice that the factor of ℎ provides a natural metric that makes the canonical partition function dimensionless, since ℎ has units of /momentum5 × /distance5. This correction means that we can use the classical approximation at high temperatures to compute absolute partition functions. Since they must integrate to a value of one, the correction also applies to the microstate probabilities: 2 ℘ ! ,# = exp/− A ! , # ℎ6 ! , , 5 (18.4) We can simplify the partition function further since we know that the total energy is the sum of potential and kinetic energies: A ! ,# =B ! +D # (18.5) This enables us to write: , , = ℎ6 1 ! E F !" $ %! %! … %! G E H #"$ %# %# … %# G (18.6) Here, we are abbreviating the multidimensional integrals with a single integral sign for simplicity. We were able to make this separation of the kinetic and potential energy parts because the kinetic energy depends only on the momenta, and the potential energy only on the positions. Therefore, the exponentials can be factored using the properties of integrals that I J K L %J%L = E I J %JG E K L %LG (18.7) With the separation above, we can simplify the kinetic energy term, since we know that B ! 1 2N = O &O,' + &O,( + &O,) $ (18.8) Substituting into the kinetic energy integral: F !" $ ∑ RSV WSV WSV Z P T T,U T,X T,Y %! %! %! … %! = =E =\ ] SV P [,U P ] %& ,' G × … × E SV 6 %&^ %! … %! SV P ",Y %& ,) G (18.9) The last line in this equation comes from the fact that all of the 3 integrals are identical, for identical particles. We have also indicated the limits explicitly. The integral can be evaluated analytically. The result is: F !" $ %! %! … %! = _ So, the total canonical partition function becomes: 3 2`N 6 a (18.10) , , 1 2`N = _ a ! ℎ 6 H #"$ %# %# … %# (18.11) The combination of the constants in front is a familiar grouping for us. Recall, it is related ⁄ to the thermal de Broglie wavelength, Λ = ℎ ⁄2`Ncd . Simplifying, we arrive at our final expression: , , = f , , where f ≡ Λ 6 ! H #"$ %# %# … %# (18.12) Here we introduced a new variable f , , , which is called the configurational partition function. That is, f only depends on the positional part of the degrees of freedom and the potential energy function. All particles with the same mass will have identical contributions from their kinetic degrees of freedom (the momenta), but may have distinct modes of interacting which will result in different contributions from the configurational part. Importantly, The kinetic and potential energy contributions to the canonical partition function are separable. The kinetic contribution can be evaluated analytically, and for simple spherical particles, it gives the thermal de Broglie wavelength. Thus, the task of evaluating the properties of a classical system actually amounts to the task of evaluating the configurational partition function f. In general, this is a complicated task, since the multidimensional integral over the 3 positions is nontrivial to evaluate in the general case, owing to the complex functionality of typical potential energy functions. A significant body of statistical mechanics is devoted to developing good expansion and perturbation techniques that can be used to approximate the configurational integral. Note that in the special case of identical non-interacting classical particles, where the potential energy function is separable between all of the particles, one can write: , , = i ! where i ≡ Λ 1 6 j # %# (18.13) where i is the single-particle partition function and k gives the potential energy of a single particle. EXAMPLE 18.1 Show that the quantum-corrected classical partition function gives the correct free energy for an ideal gas. For an ideal gas, D l = 0. Therefore, f , , = = m 4 %l %l … %l The total canonical partition function is: , , = n =_ a 6 n ! 6 The second line makes use of Stirling’s approximation. Using o = −cd p o = − cd p _ n 6 , we find: a − cd This is the same result we found in the previous lectures on ideal gases, where we computed q = cd p r using quantum mechanics and used a Legendre transform to find o. 18.2 Microstate probabilities for continuous degrees of freedom The canonical partition function enables us to compute the probabilities of every microstate in the system. Therefore, we can compute all sorts of microscopic properties that were not accessible from a purely macroscopic perspective. Let’s consider one particular microstate N. The microstate N is specified by a set of values for all of the classical degrees of freedom, !P , #P . The probability that the system will visit this microstate is given by: ℘ !P , #P = t !" ,# " " !" s ,#s $ %! %! … %! %# %# … %# (18.14) There is a subtle difference between this microstate probability and what we obtained for a discrete system. Here, since the momenta and positions are continuous, we have to talk about differential probabilities. That is, ℘ !P , #P %! … %! %# … %# is proportional to the differential probability that the system is at a microstate that lies between & ,' − %& ,' ⁄2 and & ,' + %& ,' ⁄2, & ,( − %& ,( ⁄2 and & ,( + %& ,( ⁄2, and so on and so forth. In other words, the probability corresponds to a microstate within a differential element %! … %! %# … %# around the phase space point !P , #P . In general, for probabilities for a continuous function, ℘ J, L for continuous variables J, L is defined such that ℘ J, L %J%L gives the differential probability that J and L lie within an infinitesimally small region %J centered around Jand %L centered around L. Therefore, ℘ J, L has dimensions of /J5 /L5 and ℘ J, L %J%L is dimensionless. In this sense, ℘ J, L is called a probability density since it gives probability per unit of J and L. Just as the sum of the probabilities of all microstates in a discrete system must equal one, the integral of all differential probabilities in a classical system must equal unity: 5 ℘ ! ,# %! … %! %# … %# = 1 (18.15) Here, the limits of the integrals are the same as those mentioned above for the canonical partition function. Returning to the probability for microstate N, we can rewrite the expression by separating into kinetic and potential energy contributions: ℘ !P , #P = t F !" H #" F !" s$ "$ H #s (18.16) %! %! … %! %# %# … %# Notice that we can factor the exponentials and the integrals in the same way that we did before, to obtain: ℘ !P , #P = u t F !" F !" s$ %! %! … %! vu t H #" "$ H #s %# %# … %# v (18.17) Each of these two energy terms is itself a probability dependent on the Boltzmann factor, with a normalization in the denominator. Thus, we can treat a classical canonical system as composed of two “subsystems” of which one entails the kinetic degrees of freedom and the other the configurational degrees of freedom. Importantly, this equation suggests that the joint probability of one set of momenta and one configuration is given by the product of the two separate probabilities, ℘ ! ,# =℘ ! ℘ # (18.18) The important concept is the following: In the canonical ensemble, the configurational and kinetic contributions to the partition function are completely separable. The total partition function can be written as a product of partition functions for these two kinds of degrees of freedom. Moreover, the probability distribution of atomic configurations is independent of the distribution of momenta. The former depends only on the potential energy function, and the latter only on the kinetic energy function. If we are interested in only the distribution of the momenta, we can use the analytical integrals performed above for the kinetic energy to find that: ℘ ! = ℎ6 Λ F !" $ 6 (18.19) This expression gives the probability with which a particular set of momenta for all atoms will be attained by the system at any one random instant in time. On the other hand, if we 6 are interested distribution of the atomic configurations, ℘ l momenta, the considerations above show that: ℘ # = f , regardless of the set of H #"$ (18.20) , , You can think of this expression as giving the probability that particular sets of # — particular atomic configurations—are visited by the system. Notice that nothing remains in this equation that has anything to do with the kinetic energy. That is, everything here depends on the potential energy. In other words, there is a complete separation of the probability distributions of momenta and of spatial configurations. These degrees of freedom do not “interact with” or influence each other. The likelihood of the system visiting a particular configuration of atomic positions is completely independent of the velocities of each atom in that configuration. Let’s compare the two kinds of degrees of freedom side by side, writing out the kinetic distribution over all momenta: property contribution to total partition function probability distribution kinetic F !" $ %! %! … %! ℘ ! = t configurational F !" H #"$ ℘ # F !" $ = %! %! … %! t H #" %# %# … %# H #"$ %# %# … %# 18.3 The Maxwell-Boltzmann distribution Here, we will find the distribution of velocities of particles at a given temperature. This distribution is called the Maxwell-Boltzmann distribution. From above, we have: ℘ ! = ℎ6 Λ F !" $ 6 (18.21) Let’s focus on particle number 1 and one component of its momentum, & ,' . We want to find just the distribution of ℘ & ,' , not the joint distribution of all of the momenta. We have to think of this as finding the probability that we will see a particular value of & ,' regardless of the values of momenta of all the other components and particles. How do we do this? Well, if we were going to find the probability that & ,' has a value of zero, we would need to enumerate all of the microstates where & ,' = 0 and sum up their 7 probabilities. Here, though, our degrees of freedom are continuous and therefore the sum corresponds to an integral. Therefore, we can say in general that, Given a joint probability density ℘ J, L, w , the probability density of a specific value of J, regardless of the values of L and w, is given by integrating the distribution over the variables not of interest, ℘ J = t t ℘ J, L, w %L%w. As expected, the dimensions of ℘ J are /J5 since the dimensions of ℘ J, L, w are /J5 /L5 /w5 and the integral adds dimensions of /L5/w5. Given these general considerations, the expression for the probability of any value of & ℘ & ,' $ = ℘ ! %& ,( %& ,) %! … %! ,' is: (18.22) In other words, we integrate the microstate probability over all of the other 6 − 1 degrees of freedom, not including & ,' . This integral is easy to perform: ℘ & ,' $ = = Λ Λ ℎ6 ℎ6 6 6 ∑ RSV WSV WSV Z P T T,U T,X T,Y %& ,( %& ,) %! V S[,U P E P SV %&G 6 … %! (18.23) In the second line, we factor out the part of the exponential which is due to & ,' , and the remaining integral can be factored into 3 − 1 identical one-dimensional integrals involving the other momenta. Some additional simplification shows that: ℘ & ,' $ = = Λ Λ ℎ6 ℎ6 6 V S[,U P 6 V S[,U P Λ ℎ6 6 (18.24) Since there is no difference between any of the particles or of the momentum components, we can say that in general the probability that a particle will have a particular momentum at is given by: ℘ &' = 2`Ncd exp x− &' y 2Ncd (18.25) This is the Maxwell-Boltzmann distribution for one component of momentum for a particle. Equivalent expressions are found for &( and &) . There are a number of discussion points with regards to this equation: • ℘ &' is a probability density, since &' is continuous. That means that the quantity ℘ &' %&' gives the differential probability that any particle has one of its components of momentum in the range &' − %&' ⁄2 to &' + %&' /2. 8 • A momentum component & can vary between negative and positive infinity. • The distribution is Gaussian in momentum. • The peak of the distribution lies at &' = 0, about which it is symmetric. That is, there is no net momentum in either direction. • As the temperature is decreased, the peak probability at &' = 0 increases. • Therefore t W] ℘ ] &' %&' = 1. This result applies to any system, since we have said nothing about the potential energy function in the system. It also applies to any density, because the final distribution is independent of the system volume. The canonical distribution of atomic momenta given by the MaxwellBoltzmann expression is universal, depending only on the mass of the individual molecules and the temperature of the system. It is independent of the potential energy function and of the density. A plot of this distribution in fictitious units at several temperatures is shown here: 0.9 P(p) 0.8 T = 2.0 0.7 T = 1.0 0.6 T = 0.7 0.5 T = 0.5 0.4 0.3 0.2 0.1 0 -3 Importantly, the ℘ &' interpretations, -2 -1 0 1 2 3 p distribution can take on two different but equivalent ℘ &' gives the probability that, at a random instant in time, a given particle will have an J-component of momentum &' . Alternatively, for a system with a very large number of particles, ℘ &' gives the distribution of &' over all of the particles at any instant in time. Both interpretations are equivalent at equilibrium. The average kinetic energy of the system can be evaluated using the computed momentum distribution. There are 3 momenta that can contribute kinetic energy. These momenta 9 are independent because the kinetic energy is a linear sum of individual momentum component terms, and thus the partition function is factorable in each. We can therefore write: 1 〈& ,' 〉 + 〈& ,( 〉 + ⋯ + 〈& 2N 3 〈& 〉 = 2N ' W] 3 = & ℘ &' %&' 2N ] ' 〈B〉 = ,) 〉$ (18.26) In the second line, we simplify the expression since all of the & averages must be the same (there is no difference between particles or components). Substituting in the expression for ℘ &' and simplifying, we find that: 〈B〉 = 3 c 2 d (18.27) In plain words, the average kinetic energy is proportional to number of particles and to the temperature. Importantly, we find that At constant temperature for a monatomic system, the average kinetic energy is only a function of the number of particles and the temperature, regardless of the nature of the atoms (their mass or interactions) or the density. We could compute the instantaneous kinetic energy for a number of snapshots of the system, taken randomly in time. We could then find the average kinetic energy. Using the above equation, this would allow us to find an estimate of the temperature. Thus, we say that the average kinetic energy is an estimator of the temperature. What about the distribution of the speed of a molecule, ~? The speed is defined as a positive number, and is the absolute value of the velocity vector for each particle. We can write the speed of a molecule at any point in time as ~= 1 •& + &( + &) N ' (18.28) The joint distribution of the three components of a particle’s momentum vector is the product of the individual distributions, since the momenta are independent (they are linearly additive in the kinetic energy function). Therefore, 10 ℘ &' , &( , &) $ = ℘ &' ℘ &( $℘ &) &' + &( + &) y 2Ncd 6 ! exp x− y 2Ncd 6 = 2`Ncd = 2`Ncd exp x− (18.29) We want to integrate out the orientational component of this distribution to represent the absolute value of the momentum. Letting &' = |&| sin • cos ‚, &( = |&| sin • sin ‚, and &) = |&| cos •: ℘ |&|, •, ‚ = 2`Ncd 6 exp x− |&| y & sin • 2Ncd (18.30) |&| y 2Ncd (18.31) Here, the probability distribution acquired a term & sin • because of the equivalence of the differential probabilities ℘ &' , &( , &) $%&' %&( %&) = ℘ |&|, •, ‚ %|&|%•%‚. Integrating over the angular part, 6 ℘ |&| = 4` 2`Ncd & exp x− Swapping ~ for |&|, we arrive finally at the distribution of speeds: 6 N N~ ℘ ~ = 4` _ a ~ exp x− y 2`cd 2cd (18.32) A sample plot with fictitious units at different temperatures is shown below: 1.4 T = 2.0 1.2 T = 1.0 1 T = 0.7 T = 0.5 0.8 P(v) 0.6 0.4 0.2 0 0 0.5 1 1.5 2 2.5 3 v The average velocity at a given temperature is: 〈~〉 = 8cd ~℘ ~ %~ = _ a `N 11 (18.33) Thus we see that, at a given temperature, the average velocity we would expect from a particle depends monotonically on the temperature. This relationship, however, only applies to the average velocity. In reality, at constant temperature, the Maxwell-Boltzmann distribution shows that particles are distributed in velocity. This does not mean that some particles have lower temperature than others, however, since it is the entire system that has been coupled to the bath. Therefore, The velocity of a molecule is not a measure of its temperature. Instead, the average velocity of all molecules, or of a single molecule over long periods of time, provides an estimator of the temperature. The temperature is not an intrinsic property of a molecule, but an aggregate, statistical property of the bath. The notion of a temperature, therefore, is inherently a property of very large systems of molecules. 18.4 The pressure in the canonical ensemble Earlier we found that, in the canonical ensemble, the average kinetic energy and molecular speed are related to the temperature, and provide an estimator for it. What about the pressure? Is there some way to relate a microscopic average to the pressure? Recall that the Helmholtz free energy is given by o = −cd ln . We also know from macroscopic thermodynamics that † = − %o⁄% . Combining these two equations, we arrive at a relationship between the canonical partition function and the pressure: †= Recall that cd is given by: = Substituting this expression: % _ a % ‡, (18.34) f , , Λ 6 ! (18.35) cd %f _ a f % ‡, cd % = f % †= H #"$ %# %# … %# (18.36) Therefore, the pressure only depends on the configurational part of the partition function. It is independent of the kinetic degrees of freedom. Taking the derivative of the configurational integral above requires some careful consideration. Recall that, for the positional degrees of freedom, the associated limits of the integral depend on the system volume. That is, the integral is performed over all 12 positions available in a volume . For a cubic box, each particle’s x-component can vary between 0 and , = ⁄6 , etc. Therefore, we need to take the derivative of an integral where the derivative variable is part of the limit. To properly take the derivative, we need to remove ⁄6 from the integral limits. We can do this by a change of variable. We non-dimensionalize each particle coordinate by ⁄6 ⁄6 the size of the box, introducing the new coordinates ˆ ,' = J , ˆ ,( = L , and so on. After we make this substitution, each integral runs between the values 0 and 1, since these are the limits on ˆ. We have: †= cd % f % H [⁄‰ Š " $ %Š %Š … %Š (18.37) term comes from the fact that we did 3 changes of variables, each of which The term gave a single ⁄6 factor. Here, we have also rewritten the potential energy function using the new non-dimensionalized coordinates. However, since the potential energy depends on the real positions, and not the scaled positions alone, we must scale back to real coordinates: The prefactor ⁄6 D # ,# ,…,# = D ,Š , ,Š , … , ,Š =D scales each component of Š . ⁄6 Š $ (18.38) Taking the derivative, we need to use the chain rule because there are two terms involving : †= cd f E H [⁄‰ Š " $ − %D _ a % H [⁄‰ Š " $ G %Š %Š … %Š (18.39) Factoring out the common terms and returning the non-dimensionalized coordinates to the normal ones, we obtain: cd %D H #"$ E − _ aG %# %# … %# f % cd 1 1 %D H #"$ = %# %# … %# − _ a f f % cd 1 %D H #"$ = − _ a %# %# … %# f % †= H #"$ %# %# … %# (18.40) To compute the derivative of the potential energy function with respect to volume, we must take the derivative at fixed scaled positions Š : 13 %D # , # , … , # % = %D ⁄6 Š , %D %J %ˆ = %J %ˆ ,' % = −I ,' $ + −I = 1 3 ,) $ ⁄6 ⁄6 ⁄6 % ,' Š ,…, + ⋯+ $ _−J 1 3 $ _−w ŒO ⋅ #O 1 3 ⁄6 Š $ %D %w %ˆ %w %ˆ ,) % ‹ 6a ‹ 6a +⋯ ,) (18.41) Here we have introduced the force, given by the derivative of the potential energy function with respect to position, ŒO = −%D/%#O . The final result shows that the potential energy derivative with respect to volume involves a sum of the force on each particle in a dotproduct with its position. Notice that this sum depends on the particular atomic configuration. Returning to the original expression for the pressure, we obtain: †= cd − 1 3 f R ŒO ⋅ #O Z H #"$ %# %# … %# (18.42) Notice, however, that the integral can be rewritten as a sum over the configurational probabilities by bringing the factor of f inside: †= cd Therefore, we can write finally: − 1 3 †= R cd ŒO ⋅ #O Z ℘ # − 1 Ž 3 %# %# … %# ŒO ⋅ #O • (18.43) (18.44) Here, we are simply taking the average over all configurations according to the canonical probabilities ℘ # . That average sum over forces times positions is called the internal virial, and is often denoted by the symbol •: •≡ ŒO ⋅ #O (18.45) The expression for the pressure above shows that it relates to an average over forces and positions of particles. If there are no potential energies, and hence no forces, then the virial is zero. In this case, the above expression shows that the pressure simply reduces to the ideal gas pressure. 14 18.5 The classical microcanonical partition function For a classical system, the microcanonical partition function requires some special treatment. Recall that one way of writing it for discrete systems is: Ω , , = DOF for DOF for … DOF for ’ all DOF “ (18.46) This equation says that we run through all possible values of the degrees of freedom and count a value of 1 each time we find a microstate that has the same energy as the specified energy. For classical systems, we can’t count 1 for each microstate since there are an infinite number of them and Ω would diverge. Instead, when we change the sums to integrals we have to change the Kronocker delta function to a Dirac delta function: Ω , , = ℎ6 1 ! … ’/A ! , # − 5 %! %! … %! %# %# … %# (18.47) Again, the limits on the integrals are the same as those discussed for the canonical version. Here, we have already added the quantum correction, following the approach for the canonical ensemble. Loosely speaking, the Dirac delta function can be thought of as having the properties: ’/J5 = ” ] ∞ 0 J=0 otherwise ’/J5%J = 1 (18.48) ] In simple terms, the Dirac delta function is infinitely peaked around the point where it’s argument is zero. In the microcanonical partition function, it “selects out” those configurations that have the same energy as the specified energy. It can be shown that evaluating the multidimensional integral with the delta function is the same as finding the 6 dimensional area in the space of all of the degrees of freedom where the energy equals specified energy. The microcanonical partition function is not separable into kinetic and potential energy components in the same way that the canonical one is. It is also not separable in a simple way for independent molecules. Moreover, due to difficulties in working with the Dirac delta function, it is almost always much easier to compute rather than Ω for a classical system. Therefore, we will not focus further on the form of Ω in classical systems. 15