Part 0 · The Toolkit — Chapter 0.2
Integration and Accumulation
The second half of calculus, and the one physics actually spends most of its time doing.
Chapter 0.1 answered how fast is this changing? This chapter answers the question pointing the other way: given the rate, what accumulated? You are handed a velocity and asked for a distance. You are handed a power and asked for an energy. You are handed a concentration and asked for a total exposure.
Those two questions look unrelated. One is about the behaviour of a function in an infinitesimal neighbourhood of a single point. The other is about a total swept out over a whole interval. The central result of this chapter is the Fundamental Theorem of Calculus, and it says they are the same question. That is not a convenience. It is the first appearance of a pattern that recurs at every level of this book, and by Chapter 0.7 it will have grown into Stokes' theorem, which is the single most reused structural fact in theoretical physics.
One practical warning while you're here. Physics is written in differential equations, so it is tempting to think differentiation is the main event. It isn't. The laws are differential. The answers are integrals. Newton's second law is a statement about a second derivative, but every actual trajectory is obtained by integrating it twice. Every observable in quantum field theory is an integral. You will differentiate a few hundred times in this book and integrate a few thousand.
Tools you'll need — Chapter 0.1, specifically the idea that a differentiable function is locally linear with an error that dies faster than the displacement. Everything below is that one fact, run in reverse or run in bulk.
1 · Accumulation: the integral as a limit of sums
Start with something you can picture. A car has velocity , which is not constant. How far does it travel between and ?
If were constant the answer would be and there would be no chapter. Since it isn't, do the only honest thing available. Chop the trip into short intervals, each of length . On a short enough interval the velocity barely changes, which is exactly the content of continuity. So on the -th interval the distance covered is close to for any inside it. Now add them up:
Geometrically each term is the area of a rectangle of height and width , so the sum is the area of a staircase drawn under the graph of . The approximation is bad for small and improves as the steps get finer, because the amount by which can wander inside one interval shrinks with the interval.
The definite integral is what (0.2.1) converges to. Written out properly, for a function on : choose a partition , write , define the mesh , and pick a tag in each cell. Then
whenever that limit exists.
1.1 · What "the limit exists" is doing here
As in Chapter 0.1, the escape clause is the interesting part. The demand in (0.2.2) is severe: there must be a single number such that every partition with small enough mesh, tagged any way you like, gives a sum within of . You do not get to choose convenient tags. A function that passes this test is called Riemann integrable.
Continuous functions on a closed bounded interval pass, and the reason is worth seeing because it is the only place in this chapter where compactness does real work. On a continuous function is uniformly continuous (⚑ Heine–Cantor, quoted): for any there is a single that works everywhere at once. So take any partition of mesh less than . Inside cell the values of all lie within of each other, so the largest possible sum and the smallest possible sum on that cell differ by at most . Adding up,
Every tagged sum is trapped between the upper and lower sums, and (0.2.3) squeezes that gap to zero. So all of them converge to the same number. Continuity was not decoration. It is the hypothesis that makes the definition work.
Now a function that fails. Let be when is rational and when it is irrational. Every interval, however short, contains both kinds of number. So on any partition you can tag entirely at rationals and get , or tag entirely at irrationals and get . The sums do not converge to anything. So is not Riemann integrable, at any mesh, ever.
In Chapter 4.3 we will throw (0.2.2) away and rebuild the integral from scratch (the Lebesgue integral), and the reason is visible already. Enumerate the rationals as and let be the function equal to at and elsewhere. Each is zero except at finitely many points, so each is perfectly Riemann integrable with . But pointwise, and is not Riemann integrable at all.
So the Riemann integral is not closed under limits of functions. Here is why that is fatal rather than merely untidy. The moment you want to treat functions as vectors in a space and ask whether a sequence of them converges, this definition lets you down. That is precisely what quantum mechanics requires, since a quantum state is a vector in a space of functions. Lebesgue's construction fixes exactly this, and gives into the bargain. For every function you will meet in the next three parts, the two integrals agree. You need the new one for the architecture, not for the answers.
1.2 · Why midpoint wins, and why you already knew
The figure showed midpoint tagging beating the other two by a whole power of . That is worth explaining, because the reason is one you already have from Chapter 0.1.
The left rule approximates on each cell by a constant, . Chapter 0.1 tells you the error in a constant approximation is first order in the cell width: drifts by about across the cell. Each cell therefore contributes an error of order , and there are of them, so the total error is order .
The midpoint rule also uses a constant, but it uses the value at the centre. That one change is the whole story. The linear part of , measured from the centre, is odd: it overshoots on the right of the midpoint by exactly as much as it undershoots on the left. Those two errors cancel exactly, not approximately. So the midpoint rule is, silently, as accurate as the best linear approximation on each cell. Its leading error is therefore the first thing linearisation misses, which is the quadratic term that Chapter 0.1 identified as the leftover. Cell error of order , times cells, gives .
This is worth internalising because the move recurs constantly: put your sample point where the linear error is antisymmetric and it cancels. It is the same reason odd moments of a Gaussian vanish in §4, the same reason a symmetric difference quotient is second-order accurate, and the same reason the leading correction in a saddle-point expansion (Chapter 5.4) is quadratic rather than linear.
Grind box — the error constants, exactly, so you can check them against the figure
Work on one cell of width and expand using Chapter 0.1's quadratic form.
Left rule. With the cell , the exact contribution is
while the estimate is . So the per-cell error (estimate minus truth) is . Sum over cells and recognise the leftover sum as another Riemann sum:
For the figure's on : , so . That is the number in the readout. The right rule is the same computation with the opposite sign, .
Midpoint. Expand about the centre and integrate symmetrically. The odd term integrates to zero:
using and . The estimate is , so the per-cell error is and
Here , so and . Also in the readout.
Trapezoid, and a bonus. Averaging the two endpoint values gives, after expanding both about , an estimate , hence a per-cell error of , which is exactly times the midpoint error. So the combination
annihilates the term identically. That is Simpson's rule, and it is not a lucky guess: it is the unique weighting that kills the leading error of two rules whose errors are in a known fixed ratio. Combining two approximations to cancel a known leading error is a manoeuvre with a name of its own, Richardson extrapolation, and you meet its physics incarnation in Chapter 5.11, where the "known leading error" is a divergence and cancelling it is renormalisation.
Accumulation is the reverse problem, and the one physics spends most of its time on. You are handed a rate and asked for a total: a velocity and asked for a distance travelled, a concentration and asked for a total exposure. The strategy is forced. Chop the interval into pieces short enough that the rate barely changes across each, treat it as constant there, add up the contributions, and ask what happens as the pieces are made finer.
The demand hidden in that last step is severe, and worth appreciating rather than reading past. It is not enough that some sensible way of chopping settles on a number. Every way of chopping has to settle, on the same number, wherever inside each piece you take your sample. A function taking one value at every fraction and a different value at every other number fails this completely, because the answer then depends entirely on where you looked.
There is a dividend hiding in where you take that sample. Put it at the centre of each piece and the drift overshoots on one side by exactly what it undershoots on the other, so the leading error cancels without anyone arranging it. Sampling where the error is antisymmetric is a manoeuvre worth recognising now, because the same cancellation does real work again before this chapter is out.
2 · The Fundamental Theorem, both halves, derived
Nothing so far connects (0.2.2) to derivatives. The definition is about areas and sums, while Chapter 0.1 was about local slopes. Watching those two collapse into one statement is the point of this section.
We take it in two halves, in the order they are usually needed. First we ask what happens when you differentiate an accumulation. Then we use the answer to evaluate an integral without summing anything at all.
2.1 · First half: differentiating an accumulation
Let be continuous on and define the accumulation function
is the total accumulated between the fixed left end and the moving right end . Ask Chapter 0.1's question about it: how fast does change as you slide ?
Push along by . The accumulation from to is the accumulation from to plus whatever the sliver from to contributes. That is nothing more than additivity of the sum in (0.2.2) over adjacent blocks of cells:
Now estimate the sliver. Because is continuous at , write where , and let
That last statement is the definition of continuity at , nothing more. Our goal now is to separate the sliver into a clean rectangle plus a leftover small enough to ignore, so split it in two:
The bound on the leftover follows straight from (0.2.2): every tagged sum for is at most times the total width , so the limit is too. Combining (0.2.5) and (0.2.7):
Let's look at what that last line is actually saying. It is literally Chapter 0.1's boxed equation: a value, plus something linear in , plus an error that dies faster than . The coefficient of here is . And Chapter 0.1 established that the coefficient with that property is unique, and that it is called the derivative. So we can read the derivative straight off:
No trickery, no area formulas, no pictures required. The sliver is a thin rectangle of height and width . The error you make by pretending it is exactly a rectangle is second order, so it dies. Same move as the corner square in the product rule, same move as everything in Chapter 0.1.
2.2 · Second half: evaluating an integral
(0.2.9) is a statement about a function you build by integrating. The version you actually compute with runs the other way. Suppose you can find any function with , and call such a function an antiderivative. Then and the of (0.2.4) have the same derivative, so their difference has a vanishing derivative:
That a function with vanishing derivative on an interval must be constant is not free. It comes from the mean value theorem, which is derived in the grind box below. We do not know the constant , and we do not need to, because our next move makes it cancel. Evaluate at both ends and subtract:
using , since an integral whose two limits coincide accumulates nothing. What is left is the formula you actually compute with, and it deserves a box of its own:
This is the reason you can compute integrals at all. The limit of sums in (0.2.2) is an infinite process with no obvious shortcut. (0.2.12) replaces it with two evaluations of a function you found by running the differentiation rules backwards. Every integral you have ever computed by hand was this theorem being spent.
Here is (0.2.12) read differently. Take a partition of and telescope:
Every interior value appears twice with opposite signs and cancels. Only the two endpoints survive. That is the entire mechanism: you add up local changes, the interior cancels in pairs, and what is left lives on the boundary.
So the Fundamental Theorem says a local quantity (the derivative, defined at each point) integrated over a region equals a global quantity evaluated only on the boundary of that region. In the notation of Chapter 0.7 this reads
and that equation, unchanged in form, is Stokes' theorem. Raise the dimension and the same cancellation of interior contributions gives Green's theorem, the divergence theorem, and the curl theorem. Chapter 0.7 proves they are one theorem wearing three costumes, and the costume you are wearing right now is the one-dimensional original. In Chapter 3.5 this is how a local conservation law gets converted into a statement about total energy in a region, and where that conversion fails in general relativity you get one of the deepest open problems in the subject. All of it is interior terms cancelling in pairs.
Grind box — the fine print: mean value theorem, and where fails
Zero derivative implies constant. First Rolle's theorem: if is continuous on , differentiable inside, and , then somewhere inside. Why: a continuous function on a closed bounded interval attains a maximum and a minimum. If both occur at the endpoints then is constant and any interior works. Otherwise there is an interior extremum at . There the difference quotient is approaching from one side and from the other, and since the derivative exists both one-sided limits equal it, forcing .
Now the mean value theorem. Given on , apply Rolle to
which satisfies . The conclusion reads . If then every such difference vanishes, so takes the same value everywhere: constant. That is the step used in (0.2.10).
Where the first half breaks. (0.2.9) used continuity of at the point . Drop it and the theorem drops with it. Take and . Then , which is perfectly continuous everywhere but has no derivative at , which is precisely Chapter 0.1's corner. The accumulation function exists. It just isn't differentiable where the integrand jumps.
Notice the direction of that asymmetry, because it matters later. Differentiating makes a function rougher: a corner in becomes a jump in . Integrating makes it smoother: a jump in becomes a mere corner in . This is why integral formulations of physical laws are better behaved than differential ones, why "weak solutions" of PDEs are defined by integrating against test functions, and why the Dirac delta of Chapter 0.9, an object with no pointwise meaning at all, is perfectly well defined the moment it appears inside an integral.
Fine print on the second half. (0.2.12) as derived assumed continuous, so that exists and . A slightly stronger version holds: if is merely Riemann integrable and happens to have some antiderivative , then still, by applying the mean value theorem to on each cell of a partition and recognising the result as a tagged Riemann sum. You will not need the stronger version, but you should know the weaker one has hypotheses.
Nothing so far has connected the two halves of calculus. One concerns how a function behaves in a vanishingly small neighbourhood of a point, the other a total swept out across a whole interval, and on the face of it they share no vocabulary. What emerges is that they are the same question, which is genuinely astonishing and does not become less so with familiarity.
The mechanism is easier than the statement. Let the right-hand end of an accumulation slide forward a little and ask what the total gains. It gains a thin sliver, and that sliver is a rectangle whose height is the rate at that end, plus an error that is second order and therefore dies. It is the corner-square argument of the last chapter in a different hat. So the accumulated total changes at a rate equal to the thing being accumulated.
Read the other way round, the theorem says something structural that will outlast the calculus. Cut a region into small pieces, add up the local change across each, and every interior contribution appears twice with opposite signs and cancels against its neighbour. Only the two ends survive. Local changes added up over a region equal something evaluated purely on that region's boundary, and that sentence, in higher dimensions and better clothes, is the structural fact this book returns to most often.
3 · Techniques, derived as reversed rules
Because of (0.2.12), integrating means recognising something as a derivative. Every differentiation rule from Chapter 0.1 therefore becomes an integration technique when read backwards. There are only two that matter, and one of them matters enormously.
3.1 · Substitution is the chain rule, reversed
Let and let be differentiable. The chain rule says
Now read (0.2.13) from right to left. It says that the awkward-looking product on its right-hand side has a known antiderivative, namely . An antiderivative is exactly what (0.2.12) asks for, so feed it in:
That is substitution, derived rather than asserted. Two things are worth noticing. First, the informal ritual "let , so " is a compressed way of writing exactly (0.2.14), and the licence to manipulate that way is the same licence Chapter 0.1 discussed under "one deliberate abuse". Second, the limits transform too. Forgetting that is the most common error in the entire technique. It is also why is zero: under both limits become , and any integral whose two limits coincide is zero. The symmetry argument and the substitution argument agree, as they must.
3.2 · Integration by parts is the product rule, reversed
Take the product rule , integrate both sides from to , and apply (0.2.12) to the left (whose integrand is manifestly a derivative):
We want the integral we cannot do sitting alone on one side, so move the other one across. That rearrangement is integration by parts:
Read (0.2.16) as an instruction rather than a formula: you may move a derivative from one factor onto the other, at the cost of a minus sign and a boundary term. That sentence is, without much exaggeration, the most-used manipulation in theoretical physics. It is not primarily a trick for computing . It is the mechanism by which:
- An action becomes a field equation. In Chapter 1.2 you vary and get a term proportional to , which is a variation of a derivative and cannot be set to zero independently. By parts moves the time derivative off and onto the coefficient, leaving everything multiplying alone. That single step is what turns "the action is stationary" into the Euler–Lagrange equation, and in Chapter 5.2 the identical step in four dimensions turns a field Lagrangian into a field equation. Every field equation in this book is produced by (0.2.16).
- An operator gets an adjoint. In Chapter 4.4, when boundary terms vanish. The minus sign is why is Hermitian and alone is not. The factor of exists to absorb the minus sign that (0.2.16) generates. That is the entire origin of the in the momentum operator.
- A derivative gets defined for objects that have none. The derivative of a distribution in Chapter 0.9 is defined by declaring (0.2.16) to hold.
Grind box — the bookkeeping, and why "the boundary term vanishes" is physics, not maths
Worked mechanics. . Choose and , so and . Then
The boundary term vanished at because beats , and at because beats . That is a check, performed, not an assumption. Choosing and the other way round gives , which is true and useless: the remaining integral is worse than the one you started with. The craft in by parts is entirely in choosing which factor gets differentiated. Pick the one that gets simpler.
The move that builds physics. Here is the Chapter 1.2 step, done now so it is not new later. Let and perturb the path . To first order,
The second term is stuck: is not independent of , it is its derivative. Use (0.2.16) with and , noting :
The boundary term dies because we only compare paths with the same endpoints, so . What is left is
and now is arbitrary and unconstrained, so demanding for all of them forces the bracket to vanish pointwise. That bracket is the Euler–Lagrange equation. Notice that by parts did all the work: it converted an unusable variation of a derivative into a usable variation of the coordinate.
The honest warning. In field theory you will constantly see with the boundary term "dropped". That is not a mathematical triviality. It is the physical assumption that the fields fall off fast enough at infinity. Sometimes they don't, and then the boundary term is the interesting object rather than the discarded one:
- In general relativity the Einstein–Hilbert action needs an explicit boundary term (the Gibbons–Hawking term) added by hand, precisely because the naive one does not vanish (Chapter 3.6).
- Boundary terms at a black hole horizon are where the entropy lives (Chapter 7.9).
- Topological terms in gauge theory are total derivatives, which is to say pure boundary, and they still change the physics. That is how the strong CP problem exists at all (Chapter 6.5).
So: drop boundary terms freely, but know each time that you have made a physical claim about what happens far away, and be ready to be asked to defend it.
Because an integral is evaluated by finding something whose rate of change is the integrand, integrating is not really a procedure. It is recognition, and the whole technique consists of reading the differentiation rules backwards. The chain rule read backwards is substitution; the product rule read backwards is integration by parts.
The second deserves to be read as an instruction rather than a formula. It says you may move a derivative off one factor and onto the other, and the price is a change of sign together with a term evaluated only at the two ends. Put that way it stops being a device for computing textbook integrals and becomes the manipulation theoretical physics leans on more than any other. It is the step that converts a statement that some total is stationary into an equation the system must obey at every point, which is where every field equation in this book comes from.
The term at the ends deserves attention of its own, because physicists discard it habitually. Doing so is not a piece of algebra. It is a claim that whatever you are describing is quiet enough far away for that contribution to vanish, and there are important situations where the claim is false and the discarded term is the interesting object. The entropy of a black hole is one of them.
4 · The Gaussian integral
We now derive the single most-used integral in this book. It appears in the normalisation of every quantum wave packet (Chapter 4.6) and in the free-particle propagator (Chapter 5.4). And this is not an overstatement: the entire perturbative expansion of quantum field theory consists of Gaussian integrals plus corrections (Chapter 5.7). Learn it once, properly.
First, does it even converge? For we have , so , and is finite. On the integrand is bounded by . So is finite and positive, and we are entitled to go looking for its value.
We cannot find it the usual way, because has no elementary antiderivative. The callout after §5 makes that precise, and it is a theorem rather than a failure of effort. So we do something that looks like cheating and isn't: square it.
Renaming the second dummy variable is free. Combining the two one-dimensional integrals into one two-dimensional integral is the real step, and it is legal because the integrand is positive (grind box). Now the point. The quantity is the squared distance from the origin, so the integrand depends only on distance. That is exactly the situation polar coordinates are for, and our next job is to find out what turns into when we change to them.
4.1 · The area element, derived
Set , , so . The one thing that needs care is what becomes. A cell of the polar grid runs from to and from to . Its area is the difference of two circular sectors, and a sector of radius and angle has area (that is what radian measure means):
That is exact, and the leftover in (0.2.19) is second order in the cell size, so it dies in the limit. This is the same corner-square argument as the product rule in Chapter 0.1, wearing a different hat. Hence . Chapter 0.6 will produce the same factor mechanically, as the Jacobian determinant. It is worth having seen it geometrically first, because the Jacobian is nothing but "how much a coordinate change stretches area", and here you can watch it stretch.
4.2 · The value
With the area element settled, we can make the substitution. The whole plane is covered by and , so
And that integral is elementary, because the stray factor of is exactly the that substitution wants: with , ,
So . We established at the start that , so we may take the positive square root, and the Gaussian integral is ours:
Let's pause on why this worked, because the mechanism is more useful than the answer. In one dimension has no elementary antiderivative. In two dimensions, after going polar, the integrand acquires a factor of from the area element, and does have one. The trick is not a trick about exponentials. It is the observation that the geometry of the plane supplies the missing factor. Nothing in the one-dimensional problem could have told you that was going to appear. It came from the angular integral, which is to say from the fact that a circle exists.
Grind box — is squaring the integral legal, and the polar limit
Two things were waved at in (0.2.18) and both are fine, but you should know why.
Turning a product of integrals into a double integral. ⚑ Quoted: this is Fubini's theorem, and for a non-negative integrand it holds with no extra hypotheses at all (that version is Tonelli's theorem). Our integrand is positive everywhere, so we are safe. For oscillatory integrands the same step can fail spectacularly, and in Chapter 5.4 the Gaussian we need is , which is purely oscillatory and does not decay at all. The standard repair is to give a small imaginary part, do the honest convergent integral, and take the limit at the end. That deformation has a name, the prescription, and it is not bookkeeping: it is what selects the causal propagator over the anticausal one.
The infinite region. Strictly, means a limit of integrals over expanding bounded regions, and one should check the answer does not depend on how you expand. Squares of side give where . Discs of radius give by the same polar computation. Since every disc of radius sits inside the square of side , which sits inside the disc of radius ,
and both ends go to . Squeezed. The answer is independent of the exhaustion, which for a positive integrand it always is.
4.3 · The general Gaussian
The Gaussian we meet in physics has a width, and usually a linear term as well, so let's generalise in two steps. First the width. For put , so , and the limits are unchanged because rescaling the whole line leaves it the whole line:
Now add a linear term, which is where it starts being useful. The move is to complete the square:
The last term is a constant as far as is concerned, so it comes out of the integral. The first is a shifted Gaussian, and shifting the integration variable over the whole real line changes nothing, since the whole line is what we integrate over either way. Hence
Commit (0.2.25) to memory. In Chapter 5.7 the variable becomes an entire field configuration, becomes a differential operator, and becomes an external source . With almost no change of shape, the formula becomes , the generating functional of a free quantum field theory. is the propagator, and it sits exactly where sits here.
4.4 · Differentiating under the integral sign
What about ? You could hunt for a substitution. Don't. Notice instead that appears in (0.2.23) as a parameter, and that differentiating the integrand with respect to it pulls down exactly the factor you want:
Suppose for the moment that we may swap the order of and . The grind box below shows that we may here, and shows what has to go wrong for the swap to fail. Granting it, differentiating both sides of (0.2.23) with respect to hands us an integral we never had to solve:
Nothing stops us doing that again. Each further derivative in brings down another factor of , so every even moment comes out for free:
while every odd moment vanishes because is an odd function integrated over a symmetric interval. That is the same cancellation that made the midpoint rule good in §1.2.
This technique deserves a name and a place in your hands: parameter differentiation (sometimes "Feynman's trick", though it long predates him). You introduce a parameter the original problem did not have, differentiate or integrate with respect to it, and trade a hard integral for an easy one plus some calculus. Problem 2 below is the cleanest possible example.
4.5 · The same number, two ways — and why the second way is quantum field theory
There is a second route to (0.2.27) that looks like a detour and is actually the whole of Chapter 5.7. Instead of differentiating with respect to , differentiate (0.2.25) with respect to the source . Since , each derivative in brings down one power of :
Do the left side from the closed form: , which at is . Same answer as (0.2.27). ✓
Now let's read what just happened structurally. We built a function of a source, . We then differentiated it with respect to the source and switched the source off, and out came an average of a power of the integration variable. Rename the generating functional, rename the field, rename "average of a power" a correlation function, and you have the working method of quantum field theory, in which every Feynman diagram is a term produced by differentiating enough times. The whole apparatus is (0.2.25) plus bookkeeping.
Grind box — when you may differentiate under the integral sign, and when you may not
The swap in (0.2.27) is a genuine hypothesis, not a formality. It is a statement that a limit (the derivative in ) commutes with another limit (the integral), and limits do not generally commute.
A concrete failure. Let for . Substituting ,
But for any fixed , as (the exponential beats the prefactor). So while . The mass has not vanished. It has escaped into an ever narrower, ever taller spike near the origin. Hold that image: it is the Dirac delta being born, and Chapter 0.9 makes it respectable.
The condition that saves us. The sufficient hypothesis (dominated convergence, proved properly in Chapter 4.3) is that the -derivative of the integrand be bounded, uniformly in near the point of interest, by a single fixed integrable function. Check it for our case: fix and let range over . Then
and the right-hand side is a fixed function of with finite integral (it is (0.2.27) itself, which we have just evaluated as finite). So the swap is justified for every , which is every case we care about. The moral is the book's general one: the manipulation is legal, and you should be able to say why on demand.
Here is an integral that cannot be done in the ordinary way, and the obstruction is a theorem rather than a shortage of ingenuity: the bell curve has no antiderivative among the usual functions. With no elementary route in, the section takes one that looks like sleight of hand and is not. Square the integral, so that one copy of the problem becomes two independent copies laid at right angles, and read the result as a single integral over a plane.
Why that helps is the part to keep. On the plane the integrand depends only on distance from the origin, and rewriting it in terms of distance and angle forces a factor of the distance into the patch of area, since a patch far out covers more ground than the same span of angle close in. That factor is exactly what the one-dimensional problem lacked. Geometry supplies what algebra could not, and the pi in the answer comes from the angular direction, which is to say from the existence of a circle. Nothing in the original problem could have warned you it was coming.
Learn this one properly, because an unreasonable quantity of physics rests on it. Attach a source to the exponent, differentiate with respect to the source, and you have in miniature the working method by which quantum field theory extracts every prediction it makes.
5 · Improper integrals, and when things diverge
Every integral in §4 ran to infinity, so we should be precise about what that means. An integral over an unbounded region is defined as a limit of integrals over bounded ones:
and it exists only if that limit does. The canonical test case is the power law, and it is worth doing once because it decides essentially every convergence question in physics.
For , (0.2.12) gives
and everything hinges on the sign of . If then , so and the integral converges to . If then and it diverges. The borderline has to be done separately because the antiderivative changes character: . So
The second half of (0.2.32) is the identical computation with the limit taken at the other end (), and it says something you should hold onto: the same integrand can fail at either end, and for opposite reasons. diverges at both. Nothing converges at both ends by being a pure power law. You need different behaviour in the two regimes, and that is why real physical answers always have a scale in them somewhere.
Which brings us to the payoff. The quantum corrections of Chapter 5.10 look like and diverge as the cutoff is removed. That is not a new pathology of quantum field theory. It is exactly (0.2.32) in momentum space, failing at the large- ("ultraviolet") end, with the small- ("infrared") end able to fail independently for the other reason. Renormalisation is the disciplined handling of that: such an integral was never a physical quantity on its own, and what you actually measure is a combination in which the divergence cancels and a finite, scale-dependent answer survives.
You have been computing definite integrals professionally for years. The area under the plasma concentration–time curve is one:
Take first-order elimination, . An antiderivative of is , so by (0.2.12) and (0.2.30),
With this gives , i.e. . That is the identity you use without thinking, now derived in three lines from the definition of an integral.
But the structural point is better than the formula. Define cumulative exposure . Then (0.2.9) says : concentration is the rate of accumulation of exposure. AUC is not "a summary statistic that happens to be an area". It is the accumulated quantity of which the measured concentration is precisely the derivative. That is why AUC, not , is the exposure metric that pairs with a clearance, and it is why Problem 3's infusion gives the same AUC as a bolus: the total accumulated is fixed by the total delivered and the rate constant, no matter how you schedule it.
Now the bridge, and it is a real one rather than a pun. In Chapter 1.2 the central object of all of classical and quantum physics is
the action: a single number obtained by accumulating a rate (the Lagrangian, in units of energy) over an entire history. Structurally that is your AUC, one number summarising a whole time course. The difference is what you do with it. AUC is a number you measure for the history that happened. The action is a number you compute for every history that might have happened, and the law of physics is that nature picks the history where is stationary. Chapter 1.2 makes that precise, and by then you will already know that the way you extract a law from an integral like that is integration by parts.
Differentiation is an algorithm. Hand me any function built from powers, exponentials, logs and trig functions by adding, multiplying, dividing and composing, and the rules of Chapter 0.1 will grind out its derivative mechanically, and the answer will be a function of the same kind. The class is closed.
Integration is not an algorithm, and the class is not closed. There is no procedure that antidifferentiates an arbitrary elementary function, because the antiderivative frequently is not an elementary function. The examples are not obscure:
none of which has an elementary antiderivative. ⚑ Quoted, not proved: this is a theorem (Liouville, 1835, with Risch later turning it into an actual decision procedure), not a confession that nobody has been clever enough. There is no answer to find.
Three consequences follow, and all of them shape this book. First, §4 was not evasion. Squaring and going to polar is the only way in, and note that it delivers the integral over the whole line and gives you nothing at all for , which has no closed form and never will. Second, the handful of integrals that can be done, meaning Gaussians and things reducible to Gaussians, therefore carry a wildly disproportionate load in theoretical physics. Third, and least comfortable: when you notice that Gaussians are everywhere in physics, part of the reason is genuinely physical (the central limit theorem of Chapter 0.9, and the fact that any smooth minimum looks quadratic, Chapter 0.3), and part of the reason is that Gaussians are what we can integrate. Perturbation theory in quantum field theory is, structurally, the practice of expanding around the one integral we can do. It is worth knowing which part of a formalism is nature and which part is our own limitations.
The infinity written at the top of these integrals is shorthand for a limit, and the limit is over ordinary integrals across larger and larger finite regions. Whether it exists is decided, in nearly every case a physicist meets, by comparison against a power law: a steep enough power converges at the far end, a mild enough one converges at the near end, and the two conditions pull in opposite directions.
That opposition has a consequence worth carrying. No pure power law behaves at both ends at once, so something must change character in between, which is why a genuine physical answer always has a scale buried in it. When quantum field theory produces a quantity that runs away at short distances, that is this same test failing at the far end rather than an exotic disease, and extracting a finite prediction anyway is what renormalisation means.
One honest admission to close on. Integration, unlike differentiation, is not an algorithm, and most functions have no antiderivative you can write down. The handful that can be integrated therefore carry far more weight than their number suggests, and part of the reason bell curves are everywhere is that they are what we can integrate. It is worth being able to say which parts of a formalism are nature and which are our own limitations.
6 · Worked examples
Two examples, each spending a different part of the chapter. The first turns an integral over an infinite region into a number you already know. The second gets an integral without ever doing it.
How fast must you throw something so that it never comes back?
Newton's gravitational force on a mass at distance from a body of mass has magnitude , directed inward. To move the mass from the surface out to against that force, you must supply work equal to the accumulated force-times-distance. That is exactly a definite integral, because the force is not constant along the way:
The integral converges because the exponent is , exactly the criterion of (0.2.32). This is not a technicality: it is the reason escape is possible at all. An infinite journey costs a finite amount of energy only because gravity weakens faster than . If gravity fell off as the integral would be -divergent and nothing could ever escape anything.
Now supply that energy from the kinetic energy the object starts with. Setting and solving,
For Earth, and m, giving , about . The mass cancelled, which is the equivalence principle showing up uninvited three parts early (Chapter 3.1).
One more thing to notice, because it is the Fundamental Theorem leaving a fingerprint on physical convention. The antiderivative is only defined up to a constant, and we chose the constant by taking the reference point at infinity. That choice is why gravitational potential energy is negative for bound objects. The constant is physically meaningless, since only differences of potential energy appear in (0.2.12). The convention still matters for reading signs off the page. In general relativity the same freedom is far less innocent: there, energy itself has no local definition, for reasons traceable to this ambiguity (Chapter 3.5).
For the normalised distribution , find .
First the normalisation. Demanding and using (0.2.23):
Now the second moment. By definition , and rather than attack that integral we use the parameter trick of §4.4. Write the normalisation identity with the parameter left visible,
and differentiate both sides with respect to . On the left, acting on the integrand brings down , and on the right it is one line of the power rule:
Therefore , and dividing by to normalise:
Sanity check against the form you know: the statistician's Gaussian is , i.e. , and the formula returns . ✓ The variance is the reciprocal of twice the exponent's coefficient, which is the sanest way to read a Gaussian: a big means a sharply peaked, narrow distribution.
Observe the economy. We never integrated . We differentiated a known answer with respect to a parameter that was sitting there anyway. In Chapter 5.7 this is done with a source rather than a coefficient (§4.5), the integration variable is a field, and the resulting "" is the propagator. Underneath, it is this calculation.
And it is about to be a physical prediction. In Chapter 4.6 a free particle in a Gaussian wave packet has , so its probability density is , which is the same shape with . The position uncertainty is therefore
Problem 4 computes the width of the same packet in momentum space and finds . Multiply: , independent of . That is the Heisenberg uncertainty relation, exactly saturated, and you will have derived it in Chapter 0.2 using nothing but a Gaussian integral and a derivative with respect to a parameter.
7 · Your turn
Four problems. The first two set integration by parts and parameter differentiation against each other on the same family of integrals, so you can see what each one costs. The third is a mass balance you already trust, redone as a boundary-term argument. The fourth builds most of the uncertainty principle out of this chapter alone.
Problem 1 · by parts twice, then all at once
Evaluate by integrating by parts twice, checking the boundary terms rather than assuming them. Then define and derive a reduction formula relating to , then solve it. Finally, write down the indefinite integral and verify it by differentiating.
Solution
The definite integral. Take , , so and . Then (0.2.16) gives
The boundary term: at the factor kills it, and as , decays faster than any power grows, so . (That claim is worth one line: write for , which follows from the series, so .) The boundary term is genuinely zero, checked.
Repeat on the survivor with , :
Hence .
Reduction formula. The same step with gives, for ,
With , iterating gives . Check: . ✓
This function of is the gamma function, , and the reduction formula you just derived is the reason interpolates the factorials to non-integer arguments, which is how dimensional regularisation in Chapter 5.10 gets away with computing integrals in dimensions.
Indefinite. Running by parts without limits (or just guessing a quadratic times and matching):
Check by the product rule: . ✓ Evaluating from to : , agreeing with the definite calculation.
Problem 2 · parameter differentiation, in its purest form
Show that for . Then, by differentiating times with respect to , obtain without integrating by parts even once. Check it against Problem 1.
Solution
The base integral. An antiderivative of is , so by (0.2.30) and (0.2.12),
The condition is where convergence lives. For the integrand does not decay and there is nothing to compute.
Differentiate. Each on the integrand brings down a factor :
On the right-hand side, differentiate repeatedly: , then , then , and in general , provable by induction in one line, since differentiating gives . Equating the two sides,
Check. Setting recovers from Problem 1, which was obtained by applications of integration by parts. Here it took one integral and a pattern in derivatives.
Legality. As in the grind box of §4.4, restrict to with . Then , a fixed integrable function, so the swap of and is justified. Note this is also a compact proof that , and that the whole family of " polynomial times exponential" integrals is generated by one seed and the power rule. That is the pattern to steal: find the seed integral with a parameter in it, then differentiate.
Problem 3 · AUC does not care about the schedule
A drug is given by constant-rate IV infusion at rate (mass per time) for a duration , then stopped. Elimination is first order with rate constant from a single compartment of volume , so the concentration obeys , where is during the infusion and after.
(a) Solve for during and after the infusion. (b) Compute and show it equals , identical to a bolus of the same total dose. (c) Then obtain the same result in two lines without solving the differential equation at all.
Solution
(a) During infusion, . The steady state is . Writing turns the equation into , whose solution (Chapter 0.1, §5) is . With we need , so for
After the infusion stops, elimination is pure first order from :
(b) Split the integral at . The tail is the Familiar-ground calculation: . The infusion phase:
Add them, writing :
since the total dose delivered is . Every trace of beyond the total dose cancelled exactly. Infuse it over a minute or over a week: same AUC.
(c) The two-line version, which is the point of the problem. Do not solve anything. Integrate the differential equation itself from to , using (0.2.12) on the left:
With the left side vanishes, and
No solution of the ODE, no case-splitting, no exponentials. This is the Fundamental Theorem doing exactly what the insight callout in §2 advertised: a local statement (the mass-balance differential equation, true at each instant) has been converted into a global conservation statement (everything that went in eventually came out) by integrating, with only boundary values surviving. It also shows that holds for any input schedule whatsoever, whether oral, infused, divided or erratic, provided elimination is linear. That robustness is not a pharmacological coincidence. It is a boundary-term argument.
Problem 4 · the Fourier transform of a Gaussian
Show that for
Do it by parameter differentiation in : differentiate under the integral sign, integrate the result by parts, and notice that you have obtained a differential equation for the answer. Then say what the result means about widths.
Solution
Define . From (0.2.23), .
Differentiate in . The integrand's -derivative is , dominated in absolute value by , which is integrable and independent of , so the swap is legal:
Integrate by parts. The factor is a derivative in disguise: . So take , and , in (0.2.16):
The boundary term vanishes because at both ends while stays bounded. That is checked, not assumed. What survives is
Solve. This is a first-order linear equation of exactly the kind in Chapter 0.1 §5, except that the rate is proportional to rather than constant. Separating, , so , i.e. . With :
(Cross-check: since by oddness, this is the real and complete content of , which is (0.2.25) with . The two agree, which is the first hint that (0.2.25) continues to hold for complex , and Chapter 5.4 makes that legitimate, once contour integration is on the table.)
What it means. This is the Fourier transform of a Gaussian, and it is a Gaussian, the only function shape that is its own transform. Now look at the widths. Reading off Worked example 2, a factor corresponds to a probability density with . The transform corresponds to a density with . Their product is
independent of . Squeeze the function in and its transform spreads in by exactly the reciprocal amount. That is what the width slider in §4's figure was showing you geometrically for a single Gaussian, now made into a statement relating two functions.
Chapter 0.9 proves the general inequality for any function, with equality only for Gaussians. That is the bandwidth theorem, a fact about waves that has nothing to do with quantum mechanics. Quantum mechanics then contributes one physical identification, (Chapter 4.6), and the same line reads . You have just done most of the work for the Heisenberg uncertainty principle, in a chapter about integration, using nothing but by parts and a derivative with respect to a parameter.
You have the integral as a limit of tagged sums ((0.2.2)), with an honest account of what has to be true for that limit to exist and a preview of why the definition gets replaced. You have both halves of the Fundamental Theorem derived from Chapter 0.1's linearisation, the first by observing that a thin sliver is a rectangle up to second order, the second by noticing that telescoped interior terms cancel and only the boundary survives. You have substitution and integration by parts as the chain and product rules run backwards, and you know that "the boundary term vanishes" is a physical claim. You can do the Gaussian integral in all three forms, and you can generate its moments by differentiating with respect to a parameter. And you know exactly when an improper integral converges, which is the same question as when a quantum field theory diverges.
Where this gets spent.
- The Fundamental Theorem → Chapter 0.7, where interior-cancellation becomes Green's, Stokes' and the divergence theorems. Then Chapter 3.5, where local conservation laws are integrated into global ones, and where the attempt sometimes fails, informatively.
- Integration by parts → Chapter 1.2, where it converts stationary action into the Euler–Lagrange equation. Chapter 5.2, where the identical step produces every classical field equation. Chapter 4.4, where it makes Hermitian and thereby makes momentum an observable.
- The Gaussian integral → Chapter 4.6 (normalising a wave packet), Chapter 5.4 (the free propagator, where the Gaussian is oscillatory and you meet the prescription), Chapter 5.7 (where all of perturbative QFT is (0.2.25) plus corrections).
- Parameter differentiation → Chapter 5.8, where differentiating with respect to a source is how every correlation function and every Feynman diagram is extracted from a generating functional.
- Convergence of improper integrals → Chapter 5.10, where the failure of (0.2.32) at large momentum is the ultraviolet divergence and renormalisation is what you do about it.
Next, Chapter 0.3 takes the observation that kept surfacing here, namely that the leftover error after linearising is quadratic, and after that cubic, and so on. Chapter 0.3 turns that into a systematic expansion, and it is the tool physicists reach for more often than any other, because almost nothing is solvable and almost everything is nearly solvable.