Borel–Cantelli lemma

In probability theory, the Borel–Cantelli lemma is a theorem about sequences of events. In general, it is a result in measure theory. It is named after Émile Borel and Francesco Paolo Cantelli, who gave statement to the lemma in the first decades of the 20th century. A related result, sometimes called the second Borel–Cantelli lemma, is a partial converse of the first Borel–Cantelli lemma. The lemma states that, under certain conditions, an event will have probability of either zero or one. As such, it is the best-known of a class of similar theorems, known as zero-one laws. Other examples include Kolmogorov's zero–one law and the Hewitt–Savage zero–one law.

Let E₁,E₂,... be a sequence of events in some probability space. The Borel–Cantelli lemma states:

Here, "lim sup" denotes limit supremum of the sequence of events, and each event is a set of outcomes. That is, lim sup E_n is the set of outcomes that occur infinitely many times within the infinite sequence of events (E_n). Explicitly,

The theorem therefore asserts that if the sum of the probabilities of the events E_n is finite, then the set of all outcomes that are "repeated" infinitely many times must occur with probability zero. Note that no assumption of independence is required.

Suppose (X_n) is a sequence of random variables with Pr(X_n = 0) = 1/n² for each n. The probability that X_n = 0 occurs for infinitely many n is equivalent to the probability of the intersection of infinitely many [X_n = 0] events. The intersection of infinitely many such events is a set of outcomes common to all of them. However, the sum ∑Pr(X_n = 0) converges to π²/6 ≈ 1.645 < ∞, and so the Borel–Cantelli Lemma states that the set of outcomes that are common to infinitely many such events occurs with probability zero. Hence, the probability of X_n = 0 occurring for infinitely many n is 0. Almost surely (i.e., with probability 1), X_n is nonzero for all but finitely many n.

...
Wikipedia