Harmonic oscillator in Classical Statistical Mechanics

1) The total Hamiltonian and full phase space

We split the world into a small system S and a huge bath B. The total Hamiltonian is

Htot(q,p,{qi,pi})=HS(q,p)+HB({qi,pi})+Hint(q,{qi}),

where, as an example, for a 1-D harmonic oscillator

HS(q,p)=p22m+12kq2.

The full microstate is a single point Γ=(q,p,{qi,pi}) in the huge phase space (dimension 2(1+N) if N bath particles).

Every coordinate xk in Γ evolves deterministically (Hamiltonian equations):

dxkdt={xk,Htot},

and if we consider an ensemble (infinitely many copies) we describe it by the phase-space density ρtot(Γ,t). Conservation of probability gives the Liouville equation:

ρtott+{ρtot,Htot}=0,

which is a continuity equation.
Liouville's theorem implies the flow is incompressible in phase space: volumes are preserved. If ρtot(Γ,0)=δ(ΓΓ0) it stays a delta moving along the trajectory Γ(t). I intuitively understand this, but it needs clarification.


2) We only care about the small system — integrate out the bath

We define the reduced density for the subsystem

ρS(q,p,t)=dΓBρtot(q,p,ΓB,t),

where dΓB denotes integration over all bath degrees of freedom. This is the precise mathematical statement of “I don’t know (and don’t want) the bath”. It is a marginal distribution.

If you integrate the Liouville equation over ΓB you get an evolution equation for ρS that depends on bath-system correlations. Symbolically,

tρS={HS,ρS}+(terms coming from Hint,ρtot).

That extra term prevents a closed, simple deterministic equation for ρS unless you make further approximations.


3) Extra physical assumptions allow closure

To replace the complicated coupling term with something manageable we usually make several assumptions (not listed here) in such a way that we obtain a simple equation (master equation) for ρS. The general structure is:

ρSt={HS,ρS}+D[ρS],

where D is a dissipative (non-Hamiltonian) operator that encodes friction and noise.

Indeed, we sometimes assume some equilibrium (like thermal equilibrium at temperature T) in such a way that ρS gets time-independent. For example, in the case of the harmonic oscillator the thermal equilibrium hypothesis lead to the stationary Boltzmann distribution

ρS(q,p)eβHS(q,p),β=1kT.

4) Intuition for why irreversibility appears

5) Average energy

For a general thermal equilibrium system we have this.

In the particular case of the harmonic oscillator in thermal equilibrium we have, due to the equipartition theorem, that

E=kT.

6) Entropy

Two different entropy notions are useful and often confused:

SG(t)=kBdΓρtot(Γ,t)lnρtot(Γ,t).

Under Liouville evolution SG is constant in time (the flow is incompressible).
But for a harmonic oscillator in thermal equilibrium, the entropy for the "small system" can be seen to satisfy

dE=TdS

(see entropy#Example). Then,

SS=dET=kdTT=klnT+C

We can take C=lnT0 and then

SS=kln(TT0).

This can be worked out (see "What is Entropy" by J. Baez) to

SS=kln(kTω)+k.