## Countable Intersections and Unions of Sets: A Discussion on an Example in Williams “Probability with Martingales”

As homework for students, I recently set the task of understanding the Example/Warning in Section 1.11 of Williams’ book “Probability with Martingales“. I provide here my own ‘solution’ to this homework exercise. There is no need to refer to Williams’ book as the following is self-contained.

Let be the set of rational numbers between 0 and 1 inclusive; because the rational numbers are countable, they can be enumerated as . Define the sets . Here, is the open interval of width centred at the rational number , and intersecting it with the closed interval simply eliminates any “end effects” by keeping all sets within . For a fixed , note that monotonically decreases to as . In particular, .

Of interest is what the set looks like. A straightforward calculation shows , but do you think , or , or something else? Is ?

For any finite and , . Believing this to continue to hold in the limit as is a flawed argument for . (Note: normally, union and intersection cannot be interchanged, but here, the sets are decreasing in . In particular, .) To see the difference between the finite and infinite cases, note that being an element of means precisely that , such that . Here, a subscript adorns to emphasise that the choice of is allowed to depend on . That is an element of means precisely that , , . The key difference is that here, a single must work for all . In the finite case, the choice works for all . If is infinite though, there is no such thing as that could serve in place of .

A flawed argument for can be based on the denseness of rationals: every is the limit of a sequence of rational numbers, and since contains not only every rational number, but also a neighbourhood of every rational number, it “must” therefore contain all numbers in . It is insightful to understand where the flaw is. Let be an irrational number. Let be an increasing sequence of indices such that . **Whether depends on which is faster: the convergence of , or the convergence of .** To illustrate, assume that . (For pedants, interpret this equality as approximate equality; the difference between a rational and irrational number cannot exactly equal a rational number.) Then even though , the convergence is sufficiently slow that for all . (Note because .)

The pendulum swings back: perhaps then because no sequence can converge sufficiently quickly to an irrational number? To demonstrate that this is false, consider the following procedure for choosing to ensure that . It suffices to construct a sequence that converges quickly to because the remaining rational numbers can be assigned (in arbitrary order) to . Simply choose , for odd, to be a rational number within of . (This can always be arranged by taking sufficiently many terms in the decimal expansion of .) Then, no matter how large is chosen, when is an odd number greater than , hence .

The above has already demonstrated that limits cannot be interchanged; a sequence of rational numbers was constructed such that is in and hence . This is not the argument used by Williams, but being constructive in nature might mean it is a more transparent argument.

The higher-level argument in Williams’ book reveals more information about . Williams uses the Baire category theorem to deduce that must be uncountable, hence regardless of how are chosen. Furthermore, the Lebesgue measure of is easily shown to be zero, therefore, does not contain any open intervals, and in particular . (Proof: the Lebesgue measure of is at most . Since , the Lebesgue measure of is at most . As , this goes to zero, hence the measure of must be zero.)

For completeness, the fact that is uncountable will be derived. The trick is to consider the complement . If it can be shown that the complement is “too small” then must be uncountable. De Morgan’s law implies that . (Exercise: prove from first principles that .) Let . Since contains all the rational numbers, can contain only irrational numbers. In particular, does not contain any open interval. Each is open and hence is open. Thus, is a closed set not containing any open intervals. Such sets are called nowhere dense. Since is the countable union of nowhere dense sets, it is a meagre set. If is countable then it too would be meagre, and hence would be meagre. Yet , and is a Baire space, meaning meagre sets are “small”. In particular, the whole space cannot be meagre, a contradiction. Therefore, must be uncountable.

The conclusion then is that depends on the actual ordering of the rationals, yet regardless of how the rationals are ordered, will be an uncountable set of Lebesgue measure zero. In particular, .

## How the Jacobian can Detect Cusps and Self-intersections

Let be a subset of the plane defined by the vanishing of a smooth (that is, derivatives of all orders exist) function . For simplicity, it is assumed throughout that is not identically zero.

For example, if then the set is the unit circle. This can be readily visualised using the online Sage Notebook. Sign in to Sage, create a new worksheet, and type: var(‘x,y’); implicit_plot(x^2+y^2-1==0, (x, -2, 2), (y, -2, 2)); NOTE: WordPress automatically converts the first apostrophe in var(‘x,y’); from the correct to the incorrect `.

Next, try: var(‘x,y’); implicit_plot(x^3+y^3-x*y==0, (x, -2, 2), (y, -2, 2));

Note that this second example has a self-intersection; if one considers starting at one end of the line and walking to the other end, there will be a point that will be passed over twice, once when entering the loop and once upon exit.

Thirdly, try: var(‘x,y’); implicit_plot(x^3-y^2==0, (x, -2, 2), (y, -2, 2));

This third example has a cusp; if one endeavours to drive a car from the bottom end of the line to the top end, one will get stuck at the cusp with the car pointing to the left but the “road” continuing off to the right.

Roughly speaking, and as a good introduction to differential geometry, a (concrete) manifold is a subset of that does not contain cusps (that is, it is smooth) and does not contain self-intersections (that is, it is locally Euclidean). Regardless, it is interesting to ask how difficult it is to determine if the set has any cusps or self-intersections. The intuitive principle of driving a car along the curve to detect cusps or self-intersections may appear difficult to translate into a mathematical tool, especially for detecting self-intersections.

Note though that driving a car corresponds to a parametrisation of the curve: roughly speaking, constructing functions and such that for all . Finding a self-intersection is equivalent to finding a non-trivial () solution to and . This is a difficult “global” problem. However, the curve has been specified implicitly by , and perhaps the problem is not global but only local with respect to this implicit formulation?

Detecting cusps and self-intersections really is only a local problem with respect to , meaning that knowledge of what looks like anywhere except in a small neighbourhood of a point is irrelevant to determining whether there is a singularity or self-intersection at . This suggests considering a Taylor series of about the point of interest. [Technically, we would also want to be analytic if we are relying on a Taylor series argument, but we are focusing here on gaining a feel for the problem in the first instance.] It is also worth noting that this is also an example of “unhelpful intuition”; thinking of driving cars is a hindrance, not a help.

Choose a point lying on , that is, . Then where the dots denote higher-order terms. If either or is non-zero then contains a linear term, and the linear term dominates the behaviour of when is sufficiently close to . The linear equation describes a straight line; there can be no cusps or self-intersections. This argument can be made rigorous using the implicit function theorem, even when is not analytic: if for every point , either or is non-zero at , then contains no self-intersections or cusps. This result, stated more generally in terms of the rank of the Jacobian matrix, appears near the beginning in most differential geometry textbooks. Without the above considerations though, it may appear mysterious how the Jacobian can detect cusps and self-intersections. (The key point is not to think in terms of a parametrisation of the curve, but instead, break the space into neighbourhoods which are sufficiently small that it is possible to determine exactly what looks like. To belabour the point, if a point in is not in then it is not in .)

Textbooks generally do not mention explicitly though that if fails this “Jacobian test” then it may still be a manifold. The above makes this clear; if then it is necessary to examine higher-order terms before making any claims. As a simple example, fails the test at because both and are zero at the origin, yet is the straight line given equivalently by .

## Long versus Short Proofs

Proofs are very similar to computer programs. And just like computer programs, there are often many different ways of writing a proof. Sometimes the difference between proofs is great; one might be based on geometry while another on analysis. The purpose of this short note is to emphasise that different proofs are possible at the “simple” level too. While this may appear mundane, it is actually an important part of learning mathematics: once you have proved a result, spend a few minutes trying to simplify the proof. It will make the next proof you do easier. The two key messages are as follows.

- There is no substitute for experience when it comes to deriving proofs.
- Practicing on simple examples to find the “best” proof is training for being able even just to find a proof of a harder result.

For lack of a better on-the-spot example, consider the following problem. Let be an analytic function having a double zero at the origin and whose first derivative has at most linear growth: for some . What is the most general form of ?

## First Approach

A double zero at the origin means for some analytic function . Therefore and . Since $latex 2h(x) + xh'(x)$ is both analytic and bounded, it must be constant, by Liouville’s theorem. (Here, all analytic functions are entire because they are defined on the whole of the complex plane.) Solving the differential equation $latex 2h(x) + xh'(x) = c$ by substituting in the power series expansion shows that . [The general solution of $latex 2h(x) + xh'(x) = 0$ is where is an arbitrary scalar. The only general solution that is analytic is .] The conclusion is that the most general form of is for some complex scalar .

## Second Approach

The first approach is unattractive and unnecessarily complicated. Instead of starting with the double zero, start instead with the first derivative having a linear bound. (A standard generalisation of Liouville’s theorem is that an entire function with a linear bound must itself be linear. We will pretend here we do not know this fact.) If has a double zero at the origin then has a zero at the origin, therefore for some analytic . The linear bound together with Liouville’s theorem means is constant, that is for some scalar . Therefore must equal if it is to satisfy both and .

## What was the Difference?

The first approach expressed as while the second approach expressed as . Both approaches resulted in a differential equation, but the second approach resulted in the simpler differential equation . Underlying this example is that a “change of coordinates” can simplify a differential equation. Although both approaches could be made to work in this simple example, there are situations where some approaches are too difficult to follow through to completion.

One could argue that because the linear bound constraint is “harder” than the double-zero constraint, one should start with the linear bound constraint and not the double-zero constraint, and therefore be led to the simpler differential equation. Yet the real messages are as stated at the start:

- There is no substitute for experience when it comes to deriving proofs.
- Practicing on simple examples to find the “best” proof is training for being able even just to find a proof of a harder result.