Fubini's theorem
Conditions for switching order of integration in calculus
From Wikipedia, the free encyclopedia
Fubini's theorem is a theorem in measure theory that gives conditions under which a double integral can be computed as an iterated integral, i.e. by integrating in one variable at a time. Intuitively, just as the volume of a loaf of bread is the same whether one sums over standard slices or over long thin slices, the value of a double integral does not depend on the order of integration when the hypotheses of the theorem are satisfied. The theorem is named after Guido Fubini, who proved a general result in 1907; special cases were known earlier through results such as Cavalieri's principle, which was used by Leonhard Euler.
More formally, the theorem states that if a function is Lebesgue integrable on a rectangle , then one can evaluate the double integral as an iterated integral: This formula is generally not true for the Riemann integral (however, it is true if the function is continuous on the rectangle; in multivariable calculus, this weaker result is sometimes also called Fubini's theorem).
Tonelli's theorem, introduced by Leonida Tonelli in 1909, is similar but is applied to a non-negative measurable function rather than to an integrable function over its domain. The Fubini and Tonelli theorems are usually combined and form the Fubini–Tonelli theorem, which gives the conditions under which it is possible to switch the order of integration in an iterated integral.
A related theorem is often called Fubini's theorem for infinite series,[1] although it is due to Alfred Pringsheim.[2] It states that if is a double-indexed sequence of real numbers, and if is absolutely convergent, then
History
A special case of Fubini's theorem for continuous functions on the product of closed, bounded subsets of real vector spaces was known to Leonhard Euler in the 18th century. In 1904, Henri Lebesgue extended this result to bounded measurable functions on a product of intervals.[3] Beppo Levi conjectured that the theorem could be extended to functions that are integrable rather than bounded,[4] and this was proven by Fubini in 1907.[5] In 1909, Leonida Tonelli gave a variation of the Fubini theorem that applies to non-negative functions rather than integrable functions.[6]
Product measures
If X and Y are measure spaces, there are several natural ways to define a product measure on the product X × Y.
In the sense of category theory, measurable sets in the product X × Y of measure spaces are the elements of the σ-algebra generated by the products A × B, where A is measurable in X, and B is measurable in Y.
A measure μ on X × Y is called a product measure if μ(A × B) = μ1(A)μ2(B) for measurable subsets A ⊂ X and B ⊂ Y and measures μ1 on X and μ2 on Y. In general, there may be many different product measures on X × Y. Fubini's theorem and Tonelli's theorem both require technical conditions to avoid this complication; the most common approach is to assume that all measure spaces are σ-finite, in which case there is a unique product measure on X × Y. There is always a unique maximal product measure on X × Y, where the measure of a measurable set is the inf of the measures of sets containing it that are countable unions of products of measurable sets. The maximal product measure can be constructed by applying Carathéodory's extension theorem to the additive function μ such that μ(A × B) = μ1(A)μ2(B) on the ring of sets generated by products of measurable sets. (Carathéodory's extension theorem gives a measure on a measure space that in general contains more measurable sets than the measure space X × Y, so strictly speaking, the measure should be restricted to the σ-algebra generated by the products A × B of measurable subsets of X and Y.)
The product of two complete measure spaces is not usually complete. For example, the product of the Lebesgue measure on the unit interval I with itself is not the Lebesgue measure on the square I × I. There is a variation of Fubini's theorem for complete measures, which uses the completion of the product of measures rather than the uncompleted product.
For integrable functions
Suppose X and Y are σ-finite measure spaces and suppose that X × Y is given the product measure (which is unique as X and Y are σ-finite). Fubini's theorem states that if f is X × Y integrable, meaning that f is a measurable function and then
The first two integrals are iterated integrals with respect to two measures, respectively, and the third is an integral with respect to the product measure. The partial integrals and need not be defined everywhere, but this does not matter as the points where they are not defined form a set of measure 0.
If the above integral of the absolute value is not finite, then the two iterated integrals may have different values .
The condition that X and Y are σ-finite is usually harmless because almost all measure spaces for which one wishes to use Fubini's theorem are σ-finite. Fubini's theorem has some rather technical extensions to the case when X and Y are not assumed to be σ-finite.[7] The main extra complication in this case is that there may be more than one product measure on X × Y. Fubini's theorem continues to hold for the maximal product measure but can fail for other product measures. For example, there is a product measure and a non-negative measurable function f for which the double integral of |f| is zero but the two iterated integrals have different values . Tonelli's theorem and the Fubini–Tonelli theorem () can fail on non σ-finite spaces, even for the maximal product measure.
Tonelli's theorem for non-negative measurable functions
Tonelli's theorem, named after Leonida Tonelli, is a successor of Fubini's theorem. The conclusion of Tonelli's theorem is identical to that of Fubini's theorem, but the assumption that |f| has a finite integral is replaced by the assumption that f is a non-negative measurable function.
Tonelli's theorem states that if (X, A, μ) and (Y, B, ν) are σ-finite measure spaces, while is a non-negative measurable function, then
A special case of Tonelli's theorem is in the interchange of the summations, as in , where axy are non-negative for all x and y. The crux of the theorem is that the interchange of order of summation holds even if the series diverges. In effect, the only way a change in order of summation can change the sum is when there exist some subsequences that diverge to +∞ and others diverging to −∞. With all elements non-negative, this does not happen in the stated example.
Without the condition that the measure spaces are σ-finite, all three of these integrals can have different values. Some authors give generalizations of Tonelli's theorem to some measure spaces that are not σ-finite, but these generalizations often add conditions that immediately reduce the problem to the σ-finite case. For example, one could take the σ-algebra on A × B to be that generated by the product of subsets of finite measure, rather than that generated by all products of measurable subsets, though this has the undesirable consequence that the projections from the product to its factors A and B are not measurable. Another way is to add the condition that the support of f is contained in a countable union of products of sets of finite measures. D. H. Fremlin gives some rather technical extensions of Tonelli's theorem to some non σ-finite spaces. None of these generalizations have found any significant applications outside of abstract measure theory, largely because almost all measure spaces of practical interest are σ-finite.[7]
Fubini–Tonelli theorem
Combining Fubini's theorem with Tonelli's theorem gives the Fubini–Tonelli theorem. Often just called Fubini's theorem, it states that if X and Y are σ-finite measure spaces, and if f is a measurable function, then Furthermore, if any one of these integrals is finite, then
The absolute value of f in the conditions above can be replaced by either the positive or the negative part of f; these forms include Tonelli's theorem as a special case as the negative part of a non-negative function is zero and so has finite integral. Informally, all these conditions say that the double integral of f is well defined, though possibly infinite.
The advantage of the Fubini–Tonelli over Fubini's theorem is that the repeated integrals of |f| may be easier to study than the double integral. As in Fubini's theorem, the single integrals may fail to be defined on a measure 0 set.
For complete measures
The versions of Fubini's and Tonelli's theorems above do not apply to integration on the product of the real line ℝ with itself with Lebesgue measure. The problem is that Lebesgue measure on ℝ × ℝ is not the product of Lebesgue measure on ℝ with itself, but rather the completion of this: a product of two complete measure spaces X and Y is not in general complete. For this reason, one sometimes uses versions of Fubini's theorem for complete measures: roughly speaking, one replaces all measures with their completions. The various versions of Fubini's theorem are similar to the versions above, with the following minor differences:
- Instead of taking a product X × Y of two measure spaces, one takes the completion of the product.
- If f is measurable on the completion of X × Y then its restrictions to vertical or horizontal lines may be non-measurable for a measure zero subset of lines, so one has to allow for the possibility that the vertical or horizontal integrals are undefined on a set of measure 0 because they involve integrating non-measurable functions. This makes little difference, because they can already be undefined due to the functions not being integrable.
- One generally also assumes that the measures on X and Y are complete, otherwise the two partial integrals along vertical or horizontal lines may be well-defined but not measurable. For example, if f is the characteristic function of a product of a measurable set and a non-measurable set contained in a measure 0 set then its single integral is well defined everywhere but non-measurable.
Proofs
Proofs of the Fubini and Tonelli theorems are necessarily somewhat technical, as they have to use a hypothesis related to σ-finiteness. Most proofs involve building up to the full theorems by proving them for increasingly complicated functions, with the steps as follows.
- Use the fact that the measure on the product is multiplicative for rectangles to prove the theorems for the characteristic functions of rectangles.
- Use the condition that the spaces are σ-finite (or some related condition) to prove the theorem for the characteristic functions of measurable sets. This also covers the case of simple measurable functions (measurable functions taking only a finite number of values).
- Use the condition that the functions are measurable to prove the theorems for positive measurable functions by approximating them by simple measurable functions. This proves Tonelli's theorem.
- Use the condition that the functions are integrable to write them as the difference of two positive integrable functions and apply Tonelli's theorem to each of these. This proves Fubini's theorem.
Riemann integrals
For Riemann integrals, Fubini's theorem is proven by refining the partitions along the x-axis and y-axis as to create a joint partition of the form [xi, xi+1] × [yj, yj+1], which is a partition over X × Y. This is used to show that the double integrals of either order are equal to the integral over X × Y.
Counterexamples
The following examples show how Fubini's theorem and Tonelli's theorem can fail if any of their hypotheses are omitted.
Failure of Tonelli's theorem for non σ-finite spaces
Suppose that X is the unit interval with the Lebesgue measurable sets and Lebesgue measure, and Y is the unit interval with all the subsets measurable and the counting measure, so that Y is not σ-finite. If f is the characteristic function of the diagonal of X × Y, then integrating f along X gives the 0 function on Y, but integrating f along Y gives the function 1 on X. So, the two iterated integrals are different. This shows that Tonelli's theorem can fail for spaces that are not σ-finite no matter which product measure is chosen. The measures are both decomposable, showing that Tonelli's theorem fails for decomposable measures (which are slightly more general than σ-finite measures).
Failure of Fubini's theorem for non-maximal product measures
Fubini's theorem holds for spaces even if they are not assumed to be σ-finite provided one uses the maximal product measure. In the example above, for the maximal product measure, the diagonal has infinite measure so the double integral of |f| is infinite, and Fubini's theorem holds vacuously.
However, if we give X × Y the product measure such that the measure of a set is the sum of the Lebesgue measures of its horizontal sections, then the double integral of |f| is zero, but the two iterated integrals still have different values. This gives an example of a product measure where Fubini's theorem fails.
This gives an example of two different product measures on the same product of two measure spaces. For products of two σ-finite measure spaces, there is only one product measure.
Failure of Tonelli's theorem for non-measurable functions
Suppose that X is the first uncountable ordinal, with the finite measure where the measurable sets are either countable (with measure 0) or the sets of countable complement (with measure 1). The (non-measurable) subset E of X × X given by pairs (x, y) with x < y is countable on every horizontal line and has countable complement on every vertical line. If f is the characteristic function of E then the two iterated integrals of f are defined and have different values 1 and 0. The function f is not measurable. This shows that Tonelli's theorem can fail for non-measurable functions.
Failure of Fubini's theorem for non-measurable functions
A variation of the example above shows that Fubini's theorem can fail for non-measurable functions even if |f| is integrable and both repeated integrals are well defined: if we take f to be 1 on E and –1 on the complement of E, then |f| is integrable on the product with integral 1, and both repeated integrals are well defined, but have different values 1 and –1.
Wacław Sierpiński demonstrated that assuming the continuum hypothesis, one can identify X with the unit interval I, so there is a bounded non-negative function on I × I whose two iterated integrals (using Lebesgue measure) are both defined but unequal.[8] The stronger versions of Fubini's theorem on a product of two unit intervals with Lebesgue measure, where the function is no longer assumed to be measurable but merely that the two iterated integrals are well defined and exist, are independent of the standard Zermelo–Fraenkel axioms of set theory with the axiom of choice (ZFC). The continuum hypothesis and Martin's axiom both imply that there exists a function on the unit square whose iterated integrals are not equal, while Harvey Friedman showed that it is consistent with ZFC that a strong Fubini-type theorem for [0, 1] does hold, and whenever the two iterated integrals exist they are equal.[9]
Failure of Fubini's theorem for non-integrable functions
Fubini's theorem tells us that (for measurable functions on a product of σ-finite measure spaces) if the integral of the absolute value is finite, then the order of integration does not matter; if we integrate first with respect to x and then with respect to y, we get the same result as if we integrate first with respect to y and then with respect to x. The assumption that the integral of the absolute value is finite is "Lebesgue integrability", and without it the two repeated integrals can have different values.
A simple example to show that the repeated integrals can be different in general is to take the two measure spaces to be the positive integers, and to take the function f(x, y) to be 1 if x = y, −1 if x = y + 1, and 0 otherwise. Then the two repeated integrals have different values 0 and 1.
Another example is as follows for the function
The iterated integrals have different values. The corresponding double integral does not converge absolutely (in other words the integral of the absolute value is not finite):
Fubini's theorem in multiplications of integrals
Product of two integrals
For the product of two integrals with lower limit zero and a common upper limit we have the following formula:
Proof
Let V(x) and W(x) are primitive functions of the functions v(x) and w(x) respectively, which pass through the origin:
Therefore, we have
By the product rule, the derivative of the right-hand side is
and by integrating we have:
Thus, the equation from the beginning we get:
Now, we introduce a second integration parameter y for the description of the antiderivatives V(x) and W(x):
By insertion, a double integral appears:
Functions that are foreign to the concerned integration parameter can be imported into the inner function as a factor:
In the next step, the sum rule is applied to the integrals:
And finally, we use Fubini's theorem
Calculation examples
Arcsine integral
Values of the inverse sine integral can be determined by exchanging the order of integration using Fubini's theorem. By expanding the integrand and swapping the integration variables, an elementary antiderivative can be found:
Dirichlet eta function
The Dirichlet series defines the Dirichlet eta function as follows:
The value can be proven using Fubini's theorem. The condition for absolute convergence required to exchange the sum and the integral is satisfied because . The evaluation proceeds as follows:
The integral of the product of the reciprocal function and the natural logarithm is a polylogarithmic integral. Fubini's theorem allows this to be evaluated by translating the integrand into a combination of rational fractions:
This method of calculating the integral was discovered by James Harper.[10]
Integrals of complete elliptic integrals
The improper integral of the complete elliptic integral of the first kind, , evaluates to twice the Catalan constant, . This can be shown using Fubini's theorem to relate the expression to the arctangent integral:
The same procedure applies to the complete elliptic integral of the second kind, :
Double execution for the exponential integral function
The Euler–Mascheroni constant, , emerges as the improper integral from zero to infinity of the product of the negative natural logarithm and the exponential decay function. It can also be represented as an improper integral of a related difference:
The equivalence of these two integrals can be shown by executing Fubini's theorem twice, relating both to the complementary exponential integral function:
The derivative of the complementary integral exponential function is:
Applying Fubini's theorem to the first integral form yields:
Applying Fubini's theorem to the intermediate integral connects it to the second form:
Normal distribution integral
Using the identity for the squaring of an integral:
The integral of the normal distribution can be evaluated:
Taking the square root yields:
Dilogarithm of one
Using a similar formula for the squaring of an integral over a finite bound:
This can be applied to the Basel problem:
For the Dilogarithm of one, this yields:
Legendre's relation
Using the generalized product formula:
The following integrals can be computed using incomplete elliptic integrals of the first and second kind as antiderivatives:
Inserting these two integrals into the product formula gives:
For the lemniscatic special case of Legendre's relation, this yields:
See also
- Cavalieri's principle – Geometrical concept relating area and volume − an early particular case
- Coarea formula – Mathematic formula − generalization to geometric measure theory
- Disintegration theorem – theorem in measure theory, a restricted converse to Fubini's theorem
- Fubini's theorem for distributions - version of Fubini's theorem for distributions, that is, generalized functions
- Kuratowski–Ulam theorem – analog of Fubini's theorem for arbitrary second countable Baire spaces
- Symmetry of second derivatives − analogue for differentiation
- Fubini's nightmare – Apparent violation of Fubini's theorem