Physics:Theoretical physics

Theoretical physics is a branch of physics that uses mathematical models and abstractions of physical objects and systems to explain and predict natural phenomena.[1] It is, in the broadest sense, the attempt to say why things happen the way they do, not merely to record that they do. This is in contrast to experimental physics, which tests and refines those explanations through direct measurement and observation. In practice, the two feed each other constantly: a theoretical prediction suggests an experiment, and an unexpected experimental result sends theorists back to the drawing board.
The scope of theoretical physics is enormous. It ranges from the behaviour of quarks and elementary particles at scales far smaller than an atom to the large-scale structure of the universe itself. Where direct experimentation is impossible or simply not yet feasible, theoretical physics advances understanding through mathematical reasoning and thought experiments. This is perhaps the thing that surprises people most about the field: some of its most important results have come from pure reasoning, long before any instrument could test them. General relativity, quantum mechanics, and the Standard Model of particle physics each originated primarily as theoretical constructions, only later confirmed by experiment.[2]
Physical theory

A physical theory is, at its core, a mathematical model of some set of physical phenomena. It gets judged on two main grounds: how well its predictions match what we already observe, and whether it can successfully predict new things that can then be tested. A theory that explains everything after the fact, but predicts nothing in advance, is unsatisfactory. Karl Popper made this point sharply in The Logic of Scientific Discovery: a scientific theory must be capable of being shown to be false by some possible observation. If no conceivable experiment could contradict it, it is not science in any meaningful sense.[3]
There is also a question of elegance, or economy. When two competing theories account for the same phenomena equally well, physicists generally prefer the simpler one. This instinct goes by the name Occam's razor, and while it is not a law of nature, it has a remarkable track record. Theories that unify large numbers of apparently separate phenomena under a single framework tend to be regarded as especially powerful. James Clerk Maxwell's demonstration in the nineteenth century that electricity, magnetism, and light are all manifestations of a single electromagnetic field is probably the clearest historical example of what unification looks like when it actually works.[4]
When a new theory supersedes an older one, it almost always contains the older theory as a limiting case. This is sometimes called the correspondence principle. The predictions of special relativity, for instance, reduce to those of Newtonian mechanics when velocities are small compared to the speed of light. Newton's laws are not wrong, exactly; they are a very good approximation within a certain domain. The older theory retains its practical usefulness long after it has been subsumed by something broader and more accurate.[5]
It is also worth being clear about what a physical theory is not. A mathematical proof establishes the truth of a conclusion given certain axioms, and that is that. A physical theory, however well-supported, remains permanently open to revision by future observations. That is not a weakness. It is the defining feature of a science that is actually trying to describe the world rather than merely exploring abstract structures.[6]
Methods and approaches
Theoretical physicists do not all work the same way, and it is worth separating out the main approaches rather than treating them as a single undifferentiated activity.
Some theorists focus on phenomenology: building mathematical descriptions that reproduce experimental data and point toward further measurement, often without deriving the model from deeper principles. It is a bit like fitting a curve to data points before you understand what the curve means. The Bohr model of the hydrogen atom and the early analyses of spectral lines by Johann Balmer and Johannes Rydberg are good historical examples. They worked, and they were useful, even though the underlying mechanism was not yet understood.[7]
Others construct model-based frameworks built around specific properties, such as internal consistency or compatibility with known symmetries, and then check whether the resulting theory matches observations. The Standard Model of particle physics was built this way during the 1960s and 1970s, combining quantum field theory with insights about the symmetries that govern the fundamental forces.[8]

A related strategy involves effective theories: frameworks that describe the behaviour of a system accurately within a particular range of energy scales or length scales, without necessarily providing a complete account of what is happening at a deeper level. This is widespread in both particle physics and condensed matter physics, and it is a practical response to the fact that fully general theories are often impossible to solve in realistic settings.[9]
Then there is the ambition of unification: finding frameworks that consolidate previously separate theories into a single coherent one. The electroweak unification of electromagnetism and the weak nuclear force, worked out by Sheldon Glashow, Abdus Salam, and Steven Weinberg in the 1960s, is the most recent fully successful example. The effort to incorporate gravity into a quantum framework has been going on for decades and remains, at the time of writing, unfinished.[10]
Finally, theoretical physics sometimes advances simply because someone notices that a piece of mathematics developed for entirely different reasons happens to describe a physical situation perfectly. This happens more often than one might expect, and it is genuinely strange.[11]
History
Ancient and medieval foundations
The attempt to account for natural phenomena in terms of physical principles, without invoking the supernatural, appears in ancient Greece at least as early as the sixth century BC. What we now call pre-Socratic philosophy was, in important respects, theoretical physics in its earliest form: an effort to identify general principles from which the behaviour of the natural world could be understood. Aristotle later synthesised much of this into a comprehensive account of motion, matter, and the cosmos. He was often wrong, but he was systematic, and his framework remained the dominant reference point in European and Islamic natural philosophy for well over a thousand years.[12]
During the medieval period, the eleventh-century scholar Ibn al-Haytham made advances in optics and articulated, earlier than most accounts acknowledge, the importance of checking theoretical claims against controlled observations. His work on the behaviour of light and the mechanism of vision was influential across Europe for centuries after his death.[13]
The Scientific Revolution
Things began to change rapidly in the sixteenth and seventeenth centuries. Nicolaus Copernicus proposed a heliocentric model of the solar system, which cut against centuries of received opinion. Johannes Kepler, working from Tycho Brahe's careful observational records, derived three precise mathematical laws describing planetary orbits. What is striking about Kepler's laws is not just that they fit the data, but that they gave theorists something concrete to explain. That invitation was taken up by Isaac Newton.[14]
Newton's Philosophiae Naturalis Principia Mathematica of 1687 is arguably the founding document of theoretical physics in the modern sense. From a small number of laws of motion and a universal law of gravitation, Newton derived the orbits of the planets, the behaviour of falling bodies, and the shape of the tides. More than that, he established a template: a compact set of mathematical principles from which a vast range of phenomena could be derived and, crucially, quantitatively predicted.[15]
The nineteenth century
The nineteenth century extended and deepened classical physics along several fronts. Joseph-Louis Lagrange, Leonhard Euler, and William Rowan Hamilton reformulated Newtonian mechanics in increasingly general mathematical terms, producing what are now called Lagrangian mechanics and Hamiltonian mechanics. These frameworks proved essential for the later development of both statistical mechanics and quantum mechanics, so the investment in abstraction paid off very handsomely indeed.[16]
The century's greatest theoretical achievement, in many physicists' view, was Maxwell's electromagnetic theory, which showed that electricity, magnetism, and light are aspects of a single field obeying four coupled differential equations. His equations predicted electromagnetic waves propagating at the speed of light, something that united optics with electromagnetism and, in retrospect, pointed directly toward special relativity. It is hard to overstate how large a conceptual step this was.[17]
Thermodynamics developed alongside, with Rudolf Clausius introducing the concept of entropy and giving a general statement of the second law. The development of statistical mechanics by Maxwell, Ludwig Boltzmann, and Josiah Willard Gibbs then provided a microscopic account of thermodynamic behaviour, connecting the observable bulk properties of matter to the mechanics of individual molecules. This was theoretical physics at its most satisfying: a bridge between two levels of description that had previously seemed entirely separate.[18]
The twentieth century
The early twentieth century brought two upheavals in the foundations of physics, and it is perhaps fair to say that neither has been fully absorbed even now, a hundred years later.
The special theory of relativity, published by Albert Einstein in 1905, resolved the conflict between Newtonian mechanics and electromagnetism by rethinking the concepts of space and time from scratch. The general theory of relativity, which followed in 1915, extended this to include gravity, describing it as the curvature of spacetime caused by the presence of mass and energy.[19] The theory predicted that light would be deflected as it passed near a massive object, a prediction confirmed during the solar eclipse of 1919. It also predicted the existence of black holes and gravitational waves, both subsequently observed, the latter only a century after the prediction was made.[20]
Quantum mechanics was developed during the 1920s, primarily through the work of Werner Heisenberg, Max Born, Pascual Jordan, Erwin Schrödinger, and Paul Dirac. It replaced the classical picture of particles with continuously defined positions and momenta with a framework in which physical quantities take discrete values and are described by probability amplitudes. Quantum mechanics accounts for the structure of atoms and molecules, the specific heat capacity of solids at low temperatures, the photoelectric effect, and an enormous range of other phenomena that classical physics could not explain.[21]
The synthesis of quantum mechanics with special relativity produced quantum field theory, in which particles are understood as excitations of underlying fields. Quantum electrodynamics, developed by Richard Feynman, Julian Schwinger, and Sin-Itiro Tomonaga in the late 1940s, achieved predictions of extraordinary precision. The Standard Model, completed during the 1960s and 1970s, extended this to the strong and weak nuclear forces and remains the most comprehensive account of elementary particles and their interactions yet achieved.[22]

Condensed matter physics saw equally important theoretical advances in the same period. The BCS theory of superconductivity, proposed by John Bardeen, Leon Cooper, and John Robert Schrieffer in 1957, explained the phenomenon in terms of electron pairing mediated by lattice vibrations and won its authors the Nobel Prize in Physics in 1972.[23]
Thought experiments
Einstein used thought experiments throughout his career. His early reflection on what an observer would perceive while travelling alongside a beam of light helped him identify the fundamental inconsistency between Newtonian mechanics and Maxwell's electromagnetism, and set him on the path toward special relativity.[24] The EPR paradox, put forward by Einstein, Boris Podolsky, and Nathan Rosen in 1935, was a thought experiment designed to argue that quantum mechanics must be incomplete. It provoked John Bell's derivation of inequalities that any locally realistic theory must satisfy, inequalities that subsequent experiments have consistently found quantum mechanics to violate.[25] Schrödinger's famous thought experiment involving a cat placed in a superposition of states was intended to highlight what he saw as an absurdity in the standard interpretation of quantum mechanics. Whatever one makes of that, it has continued to motivate research into the measurement problem for nearly ninety years.[26]
Relationship to mathematics
Joseph Fourier's work on heat conduction in the early nineteenth century led him to develop the theory of Fourier series, a fundamental branch of mathematical analysis, as a direct byproduct of trying to solve a physical problem.[27] The formulation of quantum mechanics in the 1920s drove the rigorous development of functional analysis and the theory of Hilbert spaces.
More recently, research in string theory and related areas has produced substantial new results in algebraic geometry and topology. An example is the discovery of mirror symmetry (string theory), which although nowadays is a major research topic in pure mathematics, originated from string theory compactifications of extra dimensions to Calabi–Yau manifolds. Mirror symmetry drew the attention of mathematicians when it was used to count the number of rational curves on a general quintic threefold.[28][29] String theoretic tools, including the No-ghost theorem and the mathematics of vertex operator algebras, were also used in the proof of monstrous moonshine.[30]
Perhaps the most philosophically striking aspect of this relationship is how often mathematics developed for purely internal reasons turns out to be exactly what physics needs. Bernhard Riemann's generalisation of geometry, worked out in the 1850s with no physical application in mind, turned out to be precisely the mathematical framework Einstein needed for general relativity half a century later. There was no particular reason it had to work out that way. Eugene Wigner described this pattern, in a celebrated 1960 paper, as "the unreasonable effectiveness of mathematics in the natural sciences," and the phrase has stuck because the phenomenon itself remains genuinely puzzling.[31]
Open problems
Theoretical physics in the early twenty-first century is not short of hard problems.
The most structurally significant is perhaps the incompatibility between general relativity and quantum mechanics. Both theories are extremely accurate within their respective domains, but they are mathematically incompatible in their standard formulations. A consistent theory of quantum gravity that reduces to both in the appropriate limits has not been achieved, despite sustained effort over many decades in approaches including string theory and loop quantum gravity.[32]
The Standard Model does not account for dark matter, which is inferred from gravitational observations to make up a large fraction of the mass in galaxies and galaxy clusters, but has not yet been detected through any other means. It also has nothing to say about dark energy, the term given to the apparent acceleration of the expansion of the universe, which remains unexplained. The origin of the matter-antimatter asymmetry in the observable universe, the detailed mechanism of cosmic inflation, and the nature of neutrino mass are among the other significant theoretical questions currently under active investigation.[33]
See also
- Experimental physics
- Mathematical physics
- Philosophy of physics
- List of theoretical physicists
- Timeline of developments in theoretical physics
References
- ↑ Longair, Malcolm S. (2003). Theoretical Concepts in Physics: An Alternative View of Theoretical Reasoning in Physics (2nd ed.). Cambridge University Press. pp. 1-4. ISBN 978-0521528788.
- ↑ Penrose, Roger (2004). The Road to Reality: A Complete Guide to the Laws of the Universe. Jonathan Cape. pp. 3-20. ISBN 978-0224044479.
- ↑ Popper, Karl R. (1959). The Logic of Scientific Discovery. Hutchinson. pp. 57-73.
- ↑ Longair, Malcolm S. (2003). Theoretical Concepts in Physics: An Alternative View of Theoretical Reasoning in Physics (2nd ed.). Cambridge University Press. pp. 157-190. ISBN 978-0521528788.
- ↑ Penrose, Roger (2004). The Road to Reality: A Complete Guide to the Laws of the Universe. Jonathan Cape. pp. 389-395. ISBN 978-0224044479.
- ↑ Weinberg, Steven (1992). Dreams of a Final Theory. Pantheon Books. pp. 90-93. ISBN 978-0679419235.
- ↑ Longair, Malcolm S. (2003). Theoretical Concepts in Physics: An Alternative View of Theoretical Reasoning in Physics (2nd ed.). Cambridge University Press. pp. 75-100. ISBN 978-0521528788.
- ↑ Weinberg, Steven (1995). The Quantum Theory of Fields, Volume I: Foundations. Cambridge University Press. pp. 1-19. ISBN 978-0521550017.
- ↑ Burgess, C. P. (2007). "Introduction to Effective Field Theory". Annual Review of Nuclear and Particle Science 57: 329-362. doi:10.1146/annurev.nucl.56.080805.140308.
- ↑ Weinberg, Steven (1967). "A Model of Leptons". Physical Review Letters 19: 1264-1266. doi:10.1103/PhysRevLett.19.1264.
- ↑ Penrose, Roger (2004). The Road to Reality: A Complete Guide to the Laws of the Universe. Jonathan Cape. pp. 311-320. ISBN 978-0224044479.
- ↑ Lloyd, G. E. R. (1968). Aristotle: The Growth and Structure of His Thought. Cambridge University Press. pp. 158-199. ISBN 978-0521094566.
- ↑ Sabra, A. I. (2003). "Ibn al-Haytham's Revolutionary Project in Optics: The Achievement and the Obstacle". The Enterprise of Science in Islam. MIT Press. pp. 85-118.
- ↑ Dreyer, J. L. E. (1953). A History of Astronomy from Thales to Kepler. Dover. pp. 331-412.
- ↑ Westfall, Richard S. (1980). Never at Rest: A Biography of Isaac Newton. Cambridge University Press. pp. 401-430. ISBN 978-0521274357.
- ↑ Penrose, Roger (2004). The Road to Reality: A Complete Guide to the Laws of the Universe. Jonathan Cape. pp. 471-491. ISBN 978-0224044479.
- ↑ Longair, Malcolm S. (2003). Theoretical Concepts in Physics: An Alternative View of Theoretical Reasoning in Physics (2nd ed.). Cambridge University Press. pp. 157-190. ISBN 978-0521528788.
- ↑ Brush, Stephen G. (1976). The Kind of Motion We Call Heat: A History of the Kinetic Theory of Gases in the 19th Century. North-Holland. pp. 186-244. ISBN 978-0444870094.
- ↑ Einstein, Albert (1915). "Die Feldgleichungen der Gravitation". Sitzungsberichte der Preussischen Akademie der Wissenschaften: 844-847.
- ↑ Penrose, Roger (2004). The Road to Reality: A Complete Guide to the Laws of the Universe. Jonathan Cape. pp. 455-470. ISBN 978-0224044479.
- ↑ Jammer, Max (1966). The Conceptual Development of Quantum Mechanics. McGraw-Hill. pp. 1-20.
- ↑ Weinberg, Steven (1995). The Quantum Theory of Fields, Volume I: Foundations. Cambridge University Press. pp. 1-19. ISBN 978-0521550017.
- ↑ Bardeen, J.; Cooper, L. N.; Schrieffer, J. R. (1957). "Theory of Superconductivity". Physical Review 108: 1175-1204. doi:10.1103/PhysRev.108.1175.
- ↑ Pais, Abraham (1982). Subtle is the Lord: The Science and Life of Albert Einstein. Oxford University Press. pp. 130-139. ISBN 978-0192806727.
- ↑ Bell, J. S. (1964). "On the Einstein Podolsky Rosen Paradox". Physics Physique Fizika 1: 195-200. doi:10.1103/PhysicsPhysiqueFizika.1.195.
- ↑ Schrödinger, E. (1935). "Die gegenwärtige Situation in der Quantenmechanik". Naturwissenschaften 23: 807-812. doi:10.1007/BF01491987.
- ↑ Penrose, Roger (2004). "9: Fourier decompositions and hyperfunctions". The Road to Reality: A Complete Guide to the Laws of the Universe. Jonathan Cape. ISBN 978-0224044479.
- ↑ Candelas, Philip; De La Ossa, Xenia C.; Green, Paul S.; Parkes, Linda (1991-07-29). "A pair of Calabi-Yau manifolds as an exactly soluble superconformal theory". Nuclear Physics B 359 (1): 21–74. doi:10.1016/0550-3213(91)90292-6. ISSN 0550-3213. https://www.sciencedirect.com/science/article/pii/0550321391902926.
- ↑ Morrison, David R. (1993). "Mirror Symmetry and Rational Curves on Quintic Threefolds: A Guide for Mathematicians". Journal of the American Mathematical Society 6 (1): 223–247. doi:10.2307/2152798. ISSN 0894-0347. https://www.jstor.org/stable/2152798.
- ↑ Borcherds, Richard E. (1992-12-01). "Monstrous moonshine and monstrous Lie superalgebras" (in en). Inventiones mathematicae 109 (1): 405–444. doi:10.1007/BF01232032. ISSN 1432-1297. https://doi.org/10.1007/BF01232032.
- ↑ Wigner, Eugene P. (1960). "The Unreasonable Effectiveness of Mathematics in the Natural Sciences". Communications on Pure and Applied Mathematics 13: 1-14. doi:10.1002/cpa.3160130102.
- ↑ Penrose, Roger (2004). The Road to Reality: A Complete Guide to the Laws of the Universe. Jonathan Cape. pp. 869-900. ISBN 978-0224044479.
- ↑ Weinberg, Steven (1989). "The Cosmological Constant Problem". Reviews of Modern Physics 61: 1-23. doi:10.1103/RevModPhys.61.1.
Further reading
- Feynman, Richard P.; Leighton, Robert B.; Sands, Matthew (1964). The Feynman Lectures on Physics. 3 vols.. Addison-Wesley.
- Landau, L. D.; Lifshitz, E. M. (1976). Course of Theoretical Physics. 10 vols.. Pergamon Press.
- Longair, Malcolm S. (2003). Theoretical Concepts in Physics (2nd ed.). Cambridge University Press. ISBN 978-0521528788.
- Penrose, Roger (2004). The Road to Reality: A Complete Guide to the Laws of the Universe. Jonathan Cape. ISBN 978-0224044479.
- Weinberg, Steven (1992). Dreams of a Final Theory. Pantheon Books. ISBN 978-0679419235.
External links
- MIT Center for Theoretical Physics
- How to Become a Good Theoretical Physicist, a resource compiled by Gerard 't Hooft
