Phase transitions through the lense of Ising models#

A. bit of history: Ising model and phase transitions#

1895 Pierre Curie in his doctoral thesis studies types of magnetism, discovers

  • The effect of temperature

  • A phase transition happening at the Curie point

  • The phenomenon occurs at the atomic scale

1920 Lenz introduces a lattice model for ferromagnetism

  • Lenz argued that “atoms are dipoles which turn over between two positions”:

  • in a quantum-theoretical treatment they would by and large occupy two distinct positions.

1920 Lenz suggests a project to his PhD student who comes up with a 1D model of spin lattice

  • Each square represents spin state either +1 or -1

  • Only nearest-neighbouring spins interact

1924 Ernst Ising PhD thesis. Conlcusion: No phase transition!?

  • Ising finds no phase transition in dimension 1

  • Dismisses the models as too simplistic and mathemtical. Wrongly concluded that there is no phase transition in all dimensions.

  • Leaves science to teach college physics.

  • The paper was widely discussed (Pauli, Heisenberg, Dirac, …) with a consensus that it is oversimplified.

1936 Rudolf Peierels: Unexpectedly proves that in dimension 2 the Lenz-Ising model undergoes a phase transition!!!

  • reignites the interest in Ising models

  • His perhaps more influential work: 1940 memorandum with Otto Frisch often credited with starting the Manhattan project

1941 Kramers-Wannier calculate critical Temperature

1944 Onsager solves 2D Ising model, analytically

  • Widely regarded as one tour de force of theoretical physics.

  • Partition function, magnetization and other quantities derived

  • Larse Onsager was trained as a chemists. Many other Chemists, most notably Ben Widom contributed to theory of phase transition.

1944- Ising model becomes a household system for studying phase tranistions

  • From 1944 widely studied in mathematical physics, with many results by different methods:

  • Regained prominence in physics, used in biology, chemistry, economics, computer science…

1970s Renomralization Group (RG) theory is developed by Kenneth Wilson (Nobel Prize 1982)

  • The Curie critical point is universal and hence translation, scale and rotation invariant.

  • Ideas of Renormalizeation, scale invariance, universality and coarse graining widely enter into statistical mechanics.

1985 Conformal Field Theory

Ising models: The H atom of phase transitions#

\[\boxed{H([s])= \sum_{\langle ij \rangle} J_{ij}s_i s_j - \mu B \sum_i s_i}\]

\[\boxed{Z=\sum_{[s]}e^{-H([s])/k_B T}}\]

1st order vs 2nd order phjase transition#

Analogy with fluid phase transitions#

Critical Phenomena: Correlation length diverges#

Critical Phenomena: Universaility at critical points#

Thermodynamics of magnetic systems#

For magnetic systems placed under external field \(B\) the change in internal energy consists of an extra term of work done by the external field to displace mangetization \(M\)

\[dU = TdS + B dM\]

A free energy as a function of intensive variables can be written down following legendre transform:

\[dF = -SdT - M dB\]
  • Magnetization and Entropy can now be linked to derivatives of free energy

\[M = - \Big( \frac{\partial F}{\partial B} \Big)_{T}\]
\[S = - \Big(\frac{\partial F}{\partial T}\Big)_{B}\]

Fluctuations, correlations and susceptibilities#

  • Heat capacity \(C_v\)

Heat capacity is again the familiar expression established in our treatment of canonical ensemble.

\[ C_v(T) = \Big (\frac{\partial E}{\partial T} \Big )_V= \frac{1}{k_B T^2} \big(\langle E^2 \rangle-\langle E \rangle^2 \big) \]
  • Susceptibility \(\chi\)

Magnetic susceptibility quantifies response of the ssytem to the variation of magnetic field.

\[\chi(T)=\Big (\frac{\partial M}{\partial B} \Big )_T= \frac{1}{k_B T} \big(\langle M^2 \rangle-\langle M \rangle^2 \big) \]
  • Correlation function \(c(i,j)\) and correlation length

At high temperatures, spins on an ising lattice point up and down randomly. While at low temperatures, all spins tend to align. To quantify the degree of alignment, we can define a quantity named correlation length \(\xi\), which can be defined mathematically through correlation function \(c(i,j)\)

\[c(i,j)=\langle s_i-\langle s_i\rangle\rangle \langle s_j-\langle s_j\rangle\rangle\]

Some notable applications of Ising models.#

  1. Ferromagnetism The Ising model is the scalar version of the three-dimensional ‘Heisenberg model’ :

  2. Binary alloys and lattice gases Each lattice site is occupied either by an atom A or B. Nearest neighbour interac- tions are \(\epsilon_{AA}\), \(\epsilon_{BB}\) and \(\epsilon_{AB}\). We identify \(A\) with \(s_i = 1\) and B with \(S_i = −1\). The Hamiltonian then is: \(H = − ∑ J_{ij}s_is_j \langle i,j\rangle\) with \(J_{ij} = \epsilon_{AB} − 0.5(\epsilon_{AA} + \epsilon_{BB})\). Thus the Ising model describes order-disorder transitions in regard to composition.

  3. Spin glasses now each bond is assigned an individual coupling constant J and they are drawn from a random distribution. E.g. one can mix ferromagnetic and anti-ferromagnetic couplings. This is an example for a structurally disordered system, on top of which we can have a thermal order-disorder transition.

  4. Conformations in biomolecules a famous example is the helix-coil transition from biophysics. \(s_i\) a hydrogen bond in a DNA-molecules is closed; \(s_i\) = −1 the bond is open. The phase tran- sition is between a straight DNA-molecule (helix) and a coiled DNA-molecule. Other examples are the oxygen-binding sites in hemoglobin, chemotactic recep- tors in the receptor fields of bacteria, or the molecules building the bacterial flag- ellum, which undergos a conformational switch if the flagellum is rotated in the other direction (switch from run to tumble phases).

  5. Neural networks representing the brain \(s_i = 1\) a synapse is firing, \(s_i = −1\) it is resting. The Hopfield model for neu- ral networks is a dynamic version of the Ising model and Boltzmann machines recognise handwriting by using the Ising model.

  6. Spread of opinions or diseases Spread of opinions, rumours or diseases in a society; these kinds of models are used in socioeconomic physics. If nearest neighbour coupling is sufficiently strong, the system gets ‘infected’.

The Peierls argument for presence/absence of phase transitions in 1D, 2D and 3D#

Starting around 1933, Peierls published scaling arguments why a phase transition should occur in 2D as opposed to 1D

No phase transition in 1D at T>0#

1D case Start with 1D chain of all spin up configuration and create an isalnd of oposite spins.

\[++++++++++++++++++++\]
\[++++++{\bf \boxed{-}----\boxed{-}}++++++++\]
  • Energy cost is:

\[\Delta E = 2 \cdot 2J =4J \]
  • Entropy cost is:

\[\Delta S = k_B log \frac{N(N-1)}{2} \approx 2k_B log N \]
  • Free Energy differnece:

\[\Delta F = 4J - 2k_B T log N < 0 \]

Thus free energy for \(N\gg1\) is always negative for any finite temperature. It is always favorable to create grain boundaries due to entropic reasons.
Phase transition in 1D cannot occur at finite temperature!

Phase transition in 2D at \(T>0\) realizable#

In 2D and 3D introducing isalnd of spins creates a surface spins sproportional to linear size of the island L which is now a macroscopic quantitiy comparable to N

  • Energy cost is:

\[\Delta E = L \cdot 2J\]
  • Entropy cost using a crude estimate of random walk on cubic lattice is:

\[\Delta S = k_B log 3^L = k_B L log 3\]
  • Free Energy differnece:

\[\Delta F = L (2J -2k_B T log 3)\]
\[T > T_c = \frac{2J}{k_Blog 3}\]