FIG.11 · ENTROPY & TIME

MICROSTATES AND MACROSTATES

You never see ten heads — there's only one way to do it and a hundred others not to.

§ 01

Ten coins on the table

Toss ten coins. Count the heads. You will almost always get four, five, or six; you will almost never get ten. Nothing in the laws of physics forbids ten heads — each coin is fair, each sequence HHHHHHHHHH and HTHTHHTHTH is exactly as likely as any other. The asymmetry is not about the sequences. It is about how many sequences belong to each count.

The exact arrangement of all ten coins — this one heads, that one tails, in order — is a Microstate. The thing you actually bothered to record, "five heads," is a Macrostate. A single macrostate is a label for an entire family of microstates that look the same from the outside. And those families are wildly unequal in size:

Ω(N,k)=(Nk)=N!k!(Nk)!\Omega(N,k) = \binom{N}{k} = \frac{N!}{k!\,(N-k)!}

The number of microstates in a macrostate is its Multiplicity (Ω) Ω\Omega. For ten coins, "ten heads" has Ω=(1010)=1\Omega = \binom{10}{10} = 1, while "five heads" has Ω=(105)=252\Omega = \binom{10}{5} = 252. You see five-ish heads not because the universe prefers it, but because there are two hundred and fifty-two ways to be five and only one way to be ten. Thermodynamics is this single idea, scaled up to 102310^{23} coins.

§ 02

A microstate for a real gas

Replace coins with molecules. A microstate of a gas is a complete specification of every molecule's position and velocity — all six numbers, (x,y,z,vx,vy,vz)(x, y, z, v_x, v_y, v_z), for each of the 1024\sim 10^{24} molecules in a mole. It is a single point in a phase space of 6×10246 \times 10^{24} dimensions, and it is utterly inaccessible: no instrument can read it, and it changes completely on the timescale of a molecular collision, 1013\sim 10^{-13} seconds.

A macrostate, by contrast, is what a laboratory can measure: the pressure PP, the volume VV, the temperature TT, the number of particles NN. Four numbers, give or take, standing in for 102410^{24}. The entire project of statistical mechanics is to connect the two — to explain the handful of macroscopic numbers as the overwhelmingly probable consequence of counting the microscopic ones.

The leap of faith that makes the bridge stable is deferred to Ludwig Boltzmann's formula in the next topic. Here we only need to learn to count.

§ 03

The multiplicity Ω

Multiplicity is the engine of the whole subject, so it is worth being concrete about what it counts. For the two-state problem — heads/tails, spin up/down, left-half/right-half — a macrostate is fixed by saying how many of the NN objects are in the first state. The count of microstates is then the binomial coefficient (Nk)\binom{N}{k}, the number of ways to choose which kk of the NN objects are in that state.

Multiplicities grow with terrifying speed. Twenty coins: "ten heads" has (2010)=184,756\binom{20}{10} = 184{,}756 microstates; "twenty heads" still has exactly one. A hundred coins: the central macrostate has (10050)1.01×1029\binom{100}{50} \approx 1.01 \times 10^{29}. The factorials in Ω\Omega outrun every other quantity in physics — which is precisely why entropy, their logarithm, is so well-behaved.

§ 04

The fundamental postulate

What licenses us to count microstates as though each were equally likely? A single assumption, the load-bearing wall of statistical mechanics:

It looks innocent, almost like a definition of ignorance, and in a sense it is — it says we have no reason to favour one accessible microstate over another, so we favour none. But its consequences are not innocent at all. If every microstate is equally probable, then the probability of a macrostate is just its share of the total microstate count:

P(macrostate)=Ω(macrostate)Ωtotal,P(N,k)=12N(Nk)P(\text{macrostate}) = \frac{\Omega(\text{macrostate})}{\Omega_{\text{total}}}, \qquad P(N,k) = \frac{1}{2^N}\binom{N}{k}

The probability of finding kk of NN molecules on the left is the multiplicity of that split divided by 2N2^N, the total over all splits. Everything thermodynamic — why heat flows from hot to cold, why gases fill their containers, why the entropy of an isolated system can only grow — is this equation, read for systems too large to ever fluctuate appreciably.

§ 05

Why we always see large Ω

Suppose one macrostate has Ω=1020\Omega = 10^{20} microstates and a competitor has Ω=10\Omega = 10. With every microstate equally likely, the system spends a fraction 10/(1020+10)101910/(10^{20}+10) \approx 10^{-19} of its time in the second. Not zero — just so close to zero that you would wait many ages of the universe to catch it there. The low-multiplicity macrostate is not forbidden. It is overwhelmed.

The coin histogram below makes the overwhelming visible. Toss NN fair coins thousands of times and tally the heads count; the bars pile up into a bell. Slide NN upward and watch the peak sharpen — and notice the crucial subtlety: the bell does not get narrower in absolute terms. Its width grows. What collapses is the width relative to the mean.

FIG.11a — Toss N fair coins, over and over, and histogram the heads count (cyan bars). The amber curve is the Gaussian limit √(2/πN)·exp(−2(k−N/2)²/N) that the binomial collapses onto. Drag N from 10 to 1000: the absolute width √N/2 grows, but the relative width 1/√N shrinks, so the distribution tightens around N/2. Reset clears the tally.
loading simulation

The bell is no accident. For large NN the binomial (Nk)/2N\binom{N}{k}/2^N converges — this is the de Moivre–Laplace theorem, the oldest instance of the central limit theorem — to a Gaussian centred at N/2N/2 with standard deviation

σ=N/4=N2,σk=1N.\sigma = \sqrt{N/4} = \frac{\sqrt{N}}{2}, \qquad \frac{\sigma}{\langle k\rangle} = \frac{1}{\sqrt{N}}.

The mean number of heads is N/2N/2; the typical fluctuation about it is N/2\sqrt{N}/2. The ratio of the two — the size of a relative deviation you should expect to see — falls off as 1/N1/\sqrt{N}.

§ 06

The two-box gas

Now drop the coins and let molecules bounce. The box below is a single container, notionally split down the middle, with nothing physical stopping a molecule from crossing. The live histogram records how many molecules sit in the left half, frame after frame. The macrostate "kk on the left" again has multiplicity (Nk)\binom{N}{k}, peaked at k=N/2k = N/2.

FIG.11b — N molecules bounce freely in a box split at the centre line; the histogram on the right tallies the left-half occupancy over time. For N = 10 the fraction swings wildly between 0.2 and 0.8 — small numbers fluctuate. Slide N to 500 and the histogram welds itself to ½, because the relative spread is 1/(2√N). No wall enforces the even split; it simply has overwhelmingly the most microstates.
loading simulation

Watch the small-NN gas and you will see the second law fail, briefly and constantly: now sixty per cent on the left, now thirty, a visible breeze of fluctuation. This is not a flaw in the simulation; it is real physics. A box of ten molecules genuinely does un-mix itself every few seconds. The reason we never see a roomful of air rush into one corner is purely a matter of size. For N=1023N = 10^{23}, the relative fluctuation 1/(2N)1/(2\sqrt{N}) is about 101210^{-12} — a deviation of one part in 101110^{11} would already be a once-in-the-history-of-the-cosmos event. The arrow of the second law is sharp not because the underlying rule is strict, but because the numbers are large.

§ 07

What's next — from counting to entropy

We now have a microscopic quantity, the multiplicity Ω\Omega, that grows when a system spreads into more configurations and that pins large systems to their most probable macrostate. It behaves exactly as entropy behaves: it increases, it is maximal at equilibrium, it is a property of the macrostate rather than the microstate. The resemblance is not a coincidence.

In 1877 Ludwig Boltzmann wrote down the bridge in a single line — S=klogWS = k \log W — and turned the entropy of heat-over-temperature into a count of arrangements. From there it is a short step to the deepest statement of all: that the arrow of time itself is just multiplicity, increasing.