# 2.1: Defining Probability

- Page ID
- 328

\( \newcommand{\vecs}[1]{\overset { \scriptstyle \rightharpoonup} {\mathbf{#1}} } \)

\( \newcommand{\vecd}[1]{\overset{-\!-\!\rightharpoonup}{\vphantom{a}\smash {#1}}} \)

\( \newcommand{\id}{\mathrm{id}}\) \( \newcommand{\Span}{\mathrm{span}}\)

( \newcommand{\kernel}{\mathrm{null}\,}\) \( \newcommand{\range}{\mathrm{range}\,}\)

\( \newcommand{\RealPart}{\mathrm{Re}}\) \( \newcommand{\ImaginaryPart}{\mathrm{Im}}\)

\( \newcommand{\Argument}{\mathrm{Arg}}\) \( \newcommand{\norm}[1]{\| #1 \|}\)

\( \newcommand{\inner}[2]{\langle #1, #2 \rangle}\)

\( \newcommand{\Span}{\mathrm{span}}\)

\( \newcommand{\id}{\mathrm{id}}\)

\( \newcommand{\Span}{\mathrm{span}}\)

\( \newcommand{\kernel}{\mathrm{null}\,}\)

\( \newcommand{\range}{\mathrm{range}\,}\)

\( \newcommand{\RealPart}{\mathrm{Re}}\)

\( \newcommand{\ImaginaryPart}{\mathrm{Im}}\)

\( \newcommand{\Argument}{\mathrm{Arg}}\)

\( \newcommand{\norm}[1]{\| #1 \|}\)

\( \newcommand{\inner}[2]{\langle #1, #2 \rangle}\)

\( \newcommand{\Span}{\mathrm{span}}\) \( \newcommand{\AA}{\unicode[.8,0]{x212B}}\)

\( \newcommand{\vectorA}[1]{\vec{#1}} % arrow\)

\( \newcommand{\vectorAt}[1]{\vec{\text{#1}}} % arrow\)

\( \newcommand{\vectorB}[1]{\overset { \scriptstyle \rightharpoonup} {\mathbf{#1}} } \)

\( \newcommand{\vectorC}[1]{\textbf{#1}} \)

\( \newcommand{\vectorD}[1]{\overrightarrow{#1}} \)

\( \newcommand{\vectorDt}[1]{\overrightarrow{\text{#1}}} \)

\( \newcommand{\vectE}[1]{\overset{-\!-\!\rightharpoonup}{\vphantom{a}\smash{\mathbf {#1}}}} \)

\( \newcommand{\vecs}[1]{\overset { \scriptstyle \rightharpoonup} {\mathbf{#1}} } \)

\( \newcommand{\vecd}[1]{\overset{-\!-\!\rightharpoonup}{\vphantom{a}\smash {#1}}} \)

\(\newcommand{\avec}{\mathbf a}\) \(\newcommand{\bvec}{\mathbf b}\) \(\newcommand{\cvec}{\mathbf c}\) \(\newcommand{\dvec}{\mathbf d}\) \(\newcommand{\dtil}{\widetilde{\mathbf d}}\) \(\newcommand{\evec}{\mathbf e}\) \(\newcommand{\fvec}{\mathbf f}\) \(\newcommand{\nvec}{\mathbf n}\) \(\newcommand{\pvec}{\mathbf p}\) \(\newcommand{\qvec}{\mathbf q}\) \(\newcommand{\svec}{\mathbf s}\) \(\newcommand{\tvec}{\mathbf t}\) \(\newcommand{\uvec}{\mathbf u}\) \(\newcommand{\vvec}{\mathbf v}\) \(\newcommand{\wvec}{\mathbf w}\) \(\newcommand{\xvec}{\mathbf x}\) \(\newcommand{\yvec}{\mathbf y}\) \(\newcommand{\zvec}{\mathbf z}\) \(\newcommand{\rvec}{\mathbf r}\) \(\newcommand{\mvec}{\mathbf m}\) \(\newcommand{\zerovec}{\mathbf 0}\) \(\newcommand{\onevec}{\mathbf 1}\) \(\newcommand{\real}{\mathbb R}\) \(\newcommand{\twovec}[2]{\left[\begin{array}{r}#1 \\ #2 \end{array}\right]}\) \(\newcommand{\ctwovec}[2]{\left[\begin{array}{c}#1 \\ #2 \end{array}\right]}\) \(\newcommand{\threevec}[3]{\left[\begin{array}{r}#1 \\ #2 \\ #3 \end{array}\right]}\) \(\newcommand{\cthreevec}[3]{\left[\begin{array}{c}#1 \\ #2 \\ #3 \end{array}\right]}\) \(\newcommand{\fourvec}[4]{\left[\begin{array}{r}#1 \\ #2 \\ #3 \\ #4 \end{array}\right]}\) \(\newcommand{\cfourvec}[4]{\left[\begin{array}{c}#1 \\ #2 \\ #3 \\ #4 \end{array}\right]}\) \(\newcommand{\fivevec}[5]{\left[\begin{array}{r}#1 \\ #2 \\ #3 \\ #4 \\ #5 \\ \end{array}\right]}\) \(\newcommand{\cfivevec}[5]{\left[\begin{array}{c}#1 \\ #2 \\ #3 \\ #4 \\ #5 \\ \end{array}\right]}\) \(\newcommand{\mattwo}[4]{\left[\begin{array}{rr}#1 \amp #2 \\ #3 \amp #4 \\ \end{array}\right]}\) \(\newcommand{\laspan}[1]{\text{Span}\{#1\}}\) \(\newcommand{\bcal}{\cal B}\) \(\newcommand{\ccal}{\cal C}\) \(\newcommand{\scal}{\cal S}\) \(\newcommand{\wcal}{\cal W}\) \(\newcommand{\ecal}{\cal E}\) \(\newcommand{\coords}[2]{\left\{#1\right\}_{#2}}\) \(\newcommand{\gray}[1]{\color{gray}{#1}}\) \(\newcommand{\lgray}[1]{\color{lightgray}{#1}}\) \(\newcommand{\rank}{\operatorname{rank}}\) \(\newcommand{\row}{\text{Row}}\) \(\newcommand{\col}{\text{Col}}\) \(\renewcommand{\row}{\text{Row}}\) \(\newcommand{\nul}{\text{Nul}}\) \(\newcommand{\var}{\text{Var}}\) \(\newcommand{\corr}{\text{corr}}\) \(\newcommand{\len}[1]{\left|#1\right|}\) \(\newcommand{\bbar}{\overline{\bvec}}\) \(\newcommand{\bhat}{\widehat{\bvec}}\) \(\newcommand{\bperp}{\bvec^\perp}\) \(\newcommand{\xhat}{\widehat{\xvec}}\) \(\newcommand{\vhat}{\widehat{\vvec}}\) \(\newcommand{\uhat}{\widehat{\uvec}}\) \(\newcommand{\what}{\widehat{\wvec}}\) \(\newcommand{\Sighat}{\widehat{\Sigma}}\) \(\newcommand{\lt}{<}\) \(\newcommand{\gt}{>}\) \(\newcommand{\amp}{&}\) \(\definecolor{fillinmathshade}{gray}{0.9}\)**Example 2.1** A "die", the singular of dice, is a cube with six faces numbered 1, 2, 3, 4, 5, and 6. What is the chance of getting 1 when rolling a die?

If the die is fair, then the chance of a 1 is as good as the chance of any other number. Since there are six outcomes, the chance must be 1-in-6 or, equivalently, 1=6.

**Example 2.2** What is the chance of getting a 1 or 2 in the next roll? 1 and 2 constitute two of the six equally likely possible outcomes, so the chance of getting one of these two outcomes must be 2=6 = 1=3.

**Example 2.3** What is the chance of getting either 1, 2, 3, 4, 5, or 6 on the next roll?

100%. The outcome must be one of these numbers.

**Example 2.4** What is the chance of not rolling a 2?

Since the chance of rolling a 2 is \( \frac {1}{6}\) or \(16.\bar {6}\)%, the chance of not rolling a 2 must be 100% -\(16.\bar {6}\)% = \(83.\bar {3}\)% or \( \frac {5}{6}\).

Alternatively, we could have noticed that not rolling a 2 is the same as getting a 1, 3, 4, 5, or 6, which makes up ve of the six equally likely outcomes and has probability \(\frac {5}{6} \).

**Example 2.5** Consider rolling two dice. If \( \frac {1}{6}^{th} \)of the time the rst die is a 1 and \( \frac {1}{6}^{th} \)of those times the second die is a 1, what is the chance of getting two 1s?

If \(16.\bar {6}\)% of the time the rst die is a 1 and \( \frac {1}{6}^{th} \) of those times the second die is also a 1, then the chance that both dice are 1 is \( \frac {1}{6} x \frac {1}{6}\) or \( \frac {1}{36}\).

## Probability

We use probability to build tools to describe and understand apparent randomness. We often frame probability in terms of a **random process **giving rise to an **outcome**.

\[ \text {Roll a die} \rightarrow \text {1, 2, 3, 4, 5, or 6} \]

\[ \text {Flip a coin} \rightarrow \text {H or T} \]

Rolling a die or ipping a coin is a seemingly random process and each gives rise to an outcome.

Probability

The **probability** of an outcome is the proportion of times the outcome would occur if we observed the random process an infinite number of times.

Probability is defined as a proportion, and it always takes values between 0 and 1 (inclusively). It may also be displayed as a percentage between 0% and 100%.

Probability can be illustrated by rolling a die many times. Let ^pn be the proportion of outcomes that are 1 after the rst n rolls. As the number of rolls increases, \( \hat {p}_n \) will converge to the probability of rolling a 1, p = \( \frac {1}{6}\). Figure 2.1 shows this convergence for 100,000 die rolls. The tendency of ^pn to stabilize around p is described by the **Law of Large Numbers**.

Law of Large Numbers

As more observations are collected, the proportion \( \hat {p}_n \) of occurrences with a particular outcome converges to the probability p of that outcome.

Occasionally the proportion will veer off from the probability and appear to defy the Law of Large Numbers, as \( \hat {p}_n \) does many times in Figure 2.1. However, these deviations become smaller as the number of rolls increases.

Above we write p as the probability of rolling a 1. We can also write this probability as

\[ \text {P (rolling a 1)} \]

As we become more comfortable with this notation, we will abbreviate it further. For instance, if it is clear that the process is "rolling a die", we could abbreviate P(rolling a 1) as P(1).

**Exercise 2.6** Random processes include rolling a die and flipping a coin. (a) Think of another random process. (b) Describe all the possible outcomes of that process. For instance, rolling a die is a random process with potential outcomes 1, 2, ..., 6.1

What we think of as random processes are not necessarily random, but they may just be too difficult to understand exactly. The fourth example in the footnote solution to Exercise 2.6 suggests a roommate's behavior is a random process. However, even if a roommate's behavior is not truly random, modeling her behavior as a random process can be useful.

TIP: Modeling a process as random

It can be helpful to model a process as random even if it is not truly random.

## Disjoint or Mutually Exclusive Outcomes

Two outcomes are called **disjoint **or **mutually exclusive **if they cannot both happen. For instance, if we roll a die, the outcomes 1 and 2 are disjoint since they cannot both occur. On the other hand, the outcomes 1 and "rolling an odd number" are not disjoint since both occur if the outcome of the roll is a 1. The terms disjoint and mutually exclusive are equivalent and interchangeable.

Calculating the probability of disjoint outcomes is easy. When rolling a die, the outcomes 1 and 2 are disjoint, and we compute the probability that one of these outcomes will occur by adding their separate probabilities:

\[ P ( 1 or 2) = P(1) + P(2) = \frac {1}{6} + \frac {1}{6} = \frac {1}{3} \]

What about the probability of rolling a 1, 2, 3, 4, 5, or 6? Here again, all of the outcomes are disjoint so we add the probabilities:

\[ \begin{align} \text {P (1 or 2 or 3 or 4 or 5 or 6)} &= P(1) + P(2) + P(3) + P(4) + P(5) + P(6) \\[5pt] &= \frac {1}{6} + \frac {1}{6} + \frac {1}{6} + \frac {1}{6} + \frac {1}{6} + \frac {1}{6} \\[5pt] &= 1 \end{align}\]

The **Addition Rule **guarantees the accuracy of this approach when the outcomes are disjoint.

^{1}Here are four examples. (i) Whether someone gets sick in the next month or not is an apparently random process with outcomes sick and not. (ii) We can generate a random process by randomly picking a person and measuring that person's height. The outcome of this process will be a positive number. (iii) Whether the stock market goes up or down next week is a seemingly random process with possible outcomes up, down, and no_change. Alternatively, we could have used the percent change in the stock market as a numerical outcome. (iv) Whether your roommate cleans her dishes tonight probably seems like a random process with possible outcomes cleans dishes and leaves dishes.

Addition Rule of disjoint outcomes

If A1 and A2 represent two disjoint outcomes, then the probability that one of them occurs is given by

\[ P (A_1 or A_2 ) = P (A_1) + P (A_2) \]

If there are many disjoint outcomes A1, ..., Ak, then the probability that one of these outcomes will occur is

\[ P (A_1) + P( A_2) + \dots + P (A_k) \label {(2.7)}\]

**Exercise 2.8** We are interested in the probability of rolling a 1, 4, or 5. (a) Explain why the outcomes 1, 4, and 5 are disjoint. (b) Apply the Addition Rule for disjoint outcomes to determine P(1 or 4 or 5).2

**Exercise 2.9** In the email data set in Chapter 1, the number variable described whether no number (labeled none), only one or more small numbers (small), or whether at least one big number appeared in an email (big). Of the 3,921 emails, 549 had no numbers, 2,827 had only one or more small numbers, and 545 had at least one big number. (a) Are the outcomes none, small, and big disjoint? (b) Determine the proportion of emails with value small and big separately. (c) Use the Addition Rule for disjoint outcomes to compute the probability a randomly selected email from the data set has a number in it, small or big.3

Statisticians rarely work with individual outcomes and instead consider sets or collections of outcomes. Let A represent the event where a die roll results in 1 or 2 and B represent the event that the die roll is a 4 or a 6. We write A as the set of outcomes f1, 2g and B = {4, 6}. These sets are commonly called events. Because A and B have no elements in common, they are disjoint events. A and B are represented in Figure 2.2.

The Addition Rule applies to both disjoint outcomes and disjoint events. The probability that one of the disjoint events A or B occurs is the sum of the separate probabilities:

\[ P(A or B) = P(A) + P(B) = \frac {1}{3} + \frac {1}{3} = \frac {2}{3} \]

**Exercise 2.10** (a) Verify the probability of event A, P(A), is \( \frac {1}{3}\) using the Addition Rule. (b) Do the same for event B.^{4}

2\(\clubsuit\) | 3\(\clubsuit\) | 4\(\clubsuit\) | 5\(\clubsuit\) | 6\(\clubsuit\) | 7\(\clubsuit\) | 8\(\clubsuit\) | 9\(\clubsuit\) | 10\(\clubsuit\) | J\(\clubsuit\) | Q\(\clubsuit\) | K\(\clubsuit\) | A\(\clubsuit\) |

2\(\diamondsuit\) | 3\(\diamondsuit\) | 4\(\diamondsuit\) | 5\(\diamondsuit\) | 6\(\diamondsuit\) | 7\(\diamondsuit\) | 8\(\diamondsuit\) | 9\(\diamondsuit\) | 10\(\diamondsuit\) | J\(\diamondsuit\) | Q\(\diamondsuit\) | K\(\diamondsuit\) | A\(\diamondsuit\) |

2\(\heartsuit\) | 3\(\heartsuit\) | 4\(\heartsuit\) | 5\(\heartsuit\) | 6\(\heartsuit\) | 7\(\heartsuit\) | 8\(\heartsuit\) | 9\(\heartsuit\) | 10\(\heartsuit\) | J\(\heartsuit\) | Q\(\heartsuit\) | K\(\heartsuit\) | A\(\heartsuit\) |

2\(\spadesuit\) | 3\(\spadesuit\) | 4\(\spadesuit\) | 5\(\spadesuit\) | 6\(\spadesuit\) | 7\(\spadesuit\) | 8\(\spadesuit\) | 9\(\spadesuit\) | 10\(\spadesuit\) | J\(\spadesuit\) | Q\(\spadesuit\) | K\(\spadesuit\) | A\(\spadesuit\) |

**Exercise 2.11** (a) Using Figure 2.2 as a reference, what outcomes are represented by event D? (b) Are events B and D disjoint? (c) Are events A and D disjoint?^{5}

**Exercise 2.12** In Exercise 2.11, you con rmed B and D from Figure 2.2 are disjoint. Compute the probability that either event B or event D occurs.^{6}

## Probabilities when events are not disjoint

Let's consider calculations for two events that are not disjoint in the context of a regular deck of 52 cards, represented in Table 2.3. If you are unfamiliar with the cards in a regular deck, please see the footnote.^{7}

**Exercise 2.13** (a) What is the probability that a randomly selected card is a diamond? (b) What is the probability that a randomly selected card is a face card?^{8}

**Venn diagrams** are useful when outcomes can be categorized as "in" or "out" for two or three variables, attributes, or random processes. The Venn diagram in Figure 2.4 uses a circle to represent diamonds and another to represent face cards. If a card is both a diamond and a face card, it falls into the intersection of the circles. If it is a diamond but not a face card, it will be in part of the left circle that is not in the right circle (and so on). The total number of cards that are diamonds is given by the total number of cards in the diamonds circle: 10 + 3 = 13. The probabilities are also shown (e.g. \( \frac {10}{52} = 0.1923\)).

**Exercise 2.14** Using the Venn diagram, verify P(face card) = \( \frac {12}{52} = \frac {3}{13} \).^{9}

Let A represent the event that a randomly selected card is a diamond and B represent the event that it is a face card. How do we compute P(A or B)? Events A and B are not disjoint { the cards J \( \diamondsuit\), Q\( \diamondsuit\), and K\( \diamondsuit\), fall into both categories - so we cannot use the

Addition Rule for disjoint events. Instead we use the Venn diagram. We start by adding the probabilities of the two events:

\[P(A) + P(B) = P( \diamondsuit) + P(face card) = \frac {12}{52} + \frac {13}{52} \]

However, the three cards that are in both events were counted twice, once in each probability. We must correct this double counting:

\[P(A or B) = P(face card or \diamondsuit) \]

\[= P(face card) + P( \diamondsuit) P(face card and \diamondsuit) \label{2.15}\]

\[= \frac {12}{52} + \frac {13}{52} - \frac { 3}{52} \]

\[= \frac {22}{52} = \frac {11}{26}\]

Equation \ref{2.15} is an example of the **General Addition Rule**.

General Addition Rule

If A and B are any two events, disjoint or not, then the probability that at least one of them will occur is

\[ P(A or B) = P(A) + P(B) -P(A and B) \label {(2.16)} \]

where P(A and B) is the probability that both events occur.

TIP: "or" is inclusive

When we write "or" in statistics, we mean "and/or" unless we explicitly state otherwise. Thus, A or B occurs means A, B, or both A and B occur.

**Exercise 2.17** (a) If A and B are disjoint, describe why this implies P(A and B) = 0. (b) Using part (a), verify that the General Addition Rule simpli es to the simpler Addition Rule for disjoint events if A and B are disjoint.^{10}

^{10}(a) If A and B are disjoint, A and B can never occur simultaneously. (b) If A and B are disjoint, then the last term of Equation (2.16) is 0 (see part (a)) and we are left with the Addition Rule for disjoint events.

**Exercise 2.18** In the email data set with 3,921 emails, 367 were spam, 2,827 contained some small numbers but no big numbers, and 168 had both characteristics. Create a Venn diagram for this setup.^{11}

**Exercise 2.19** (a) Use your Venn diagram from Exercise 2.18 to determine the probability a randomly drawn email from the email data set is spam and had small numbers (but not big numbers). (b) What is the probability that the email had either of these attributes?^{12}

## Probability Distributions

A **probability distribution **is a table of all disjoint outcomes and their associated probabilities. Table 2.5 shows the probability distribution for the sum of two dice.

Dice sum | 2 | 3 | 4 | 5 | 6 | 7 | 8 | 9 | 10 | 11 | 12 |
---|---|---|---|---|---|---|---|---|---|---|---|

Probability |
1/36 | 2/36 | 3/36 | 4/36 | 5/36 | 6/36 | 5/36 | 4/36 | 3/36 | 2/36 | 1/36 |

Rules for probability distributions

A probability distribution is a list of the possible outcomes with corresponding probabilities that satis es three rules:

- The outcomes listed must be disjoint.
- Each probability must be between 0 and 1.
- The probabilities must total 1.

**Exercise 2.20** Table 2.6 suggests three distributions for household income in the United States. Only one is correct. Which one must it be? What is wrong with the other two?13

Chapter 1 emphasized the importance of plotting data to provide quick summaries. Probability distributions can also be summarized in a bar plot. For instance, the distribution of US household incomes is shown in Figure 2.7 as a bar plot.14 The probability distribution for the sum of two dice is shown in Table 2.5 and plotted in Figure 2.8.

In these bar plots, the bar heights represent the probabilities of outcomes. If the outcomes are numerical and discrete, it is usually (visually) convenient to make a bar plot that resembles a histogram, as in the case of the sum of two dice. Another example of plotting the bars at their respective locations is shown in Figure 2.20 on page 96.

^{11}Both the counts and corresponding probabilities (e.g. 2659/3921 = 0.678) are shown. Notice that the number of emails represented in the left circle corresponds to 2659 + 168 = 2827, and the number represented in the right circle is 168 + 199 = 367.

^{12}(a) The solution is represented by the intersection of the two circles: 0.043. (b) This is the sum of the three disjoint probabilities shown in the circles: 0.678 + 0.043 + 0.051 = 0.772.

^{13}The probabilities of (a) do not sum to 1. The second probability in (b) is negative. This leaves (c), which sure enough satis es the requirements of a distribution. One of the three was said to be the actual distribution of US household incomes, so it must be (c).

^{14}It is also possible to construct a distribution plot when income is not arti cially binned into four groups. Continuous distributions are considered in Section 2.5.

Income range ($1000s) | 0-25 | 25-50 | 50-100 |
100+ |

(a) | 0.18 | 0.39 | 0.33 |
0.16 |

(b) | 0.38 | -0.27 | 0.52 |
0.37 |

(c) | 0.28 | 0.27 | 0.29 | 0.16 |

Table 2.6: Proposed distributions of US household incomes (Exercise 2.20).

## Complement of an Event

Rolling a die produces a value in the set {1, 2, 3, 4, 5, 6}. This set of all possible outcomes is called the sample space (S) for rolling a die. We often use the sample space to examine the scenario where an event does not occur.

Let D = f2, 3g represent the event that the outcome of a die roll is 2 or 3. Then the complement of D represents all outcomes in our sample space that are not in D, which is denoted by Dc = f1, 4, 5, 6g. That is, Dc is the set of all possible outcomes not already included in D. Figure 2.9 shows the relationship between D, Dc, and the sample space S.

**Exercise 2.21** (a) Compute \(P(D^c)\) = P(rolling a 1, 4, 5, or 6). (b) What is P(D) + \(P(D^c)\)?^{15}

**Exercise 2.22** Events A = {1, 2}and B = {4, 6}are shown in Figure 2.2 on page 71. (a) Write out what \(A^c\)and \(B^c\)represent. (b) Compute \(P(A^c)\) and \(P(B^c)\). (c) Compute P(A) + \(P(A^c)\) and P(B) + \(P(B^c)\).^{16}

A complement of an event A is constructed to have two very important properties: (i) every possible outcome not in A is in \(A^c\), and (ii) A and \(A^c\)are disjoint. Property (i) implies

\[P(A or A^c) = 1 \label {2.23}\]

That is, if the outcome is not in A, it must be represented in Ac. We use the Addition Rule for disjoint events to apply Property (ii):

\[P(A or A^c) = P(A) + P(A^c) \label {2.24}\]

Combining Equations (2.23) and (2.24) yields a very useful relationship between the probability of an event and its complement.

Definition: Complement

The complement of event A is denoted Ac, and Ac represents all outcomes not in A. A and Ac are mathematically related:

\[P(A) + P(A^c) = 1; i.e. P(A) = 1 - P (A^c) \label {2.25} \]

In simple examples, computing A or Ac is feasible in a few steps. However, using the complement can save a lot of time as problems grow in complexity.

^{15}(a) The outcomes are disjoint and each has probability 1/6, so the total probability is 4/6 = 2/3. (b) We can also see that P(D) = 1/6 + 1/6 = 1/3. Since D and D^{c} are disjoint, P(D) + P(D^{c}) = 1.

^{16}Brief solutions: (a) A = {3, 4, 5, 6} and B = {1, 2, 3, 5}. (b) Noting that each outcome is disjoint, add the individual outcome probabilities to get P(A^{c}) = 2/3 and P(B^{c}) = 2/3. (c) A and A^{c} are disjoint, and the same is true of B and B^{c}. Therefore, P(A) + P(A^{c}) = 1 and P(B) + P(B^{c}) = 1.

Exercise \(\PageIndex{1}\)

**Exercise 2.26** Let A represent the event where we roll two dice and their total is less than 12. (a) What does the event Ac represent? (b) Determine \(P(A^c)\) from Table 2.5 on page 74. (c) Determine P(A).^{17}

Exercise \(\PageIndex{1}\)

**Exercise 2.27** Consider again the probabilities from Table 2.5 and rolling two dice. Find the following probabilities: (a) The sum of the dice is not 6. (b) The sum is at least 4. That is, determine the probability of the event B = {4, 5, ..., 12}. (c) The sum is no more than 10. That is, determine the probability of the event D = {2, 3,..., 10}.^{18}

## Independence

Just as variables and observations can be independent, random processes can be independent, too. Two processes are **independent** if knowing the outcome of one provides no useful information about the outcome of the other. For instance, ipping a coin and rolling a die are two independent processes { knowing the coin was heads does not help determine the outcome of a die roll. On the other hand, stock prices usually move up or down together, so they are not independent.

Example 2.5 provides a basic example of two independent processes: rolling two dice. We want to determine the probability that both will be 1. Suppose one of the dice is red and the other white. If the outcome of the red die is a 1, it provides no information about the outcome of the white die. We rst encountered this same question in Example 2.5 (page 68), where we calculated the probability using the following reasoning: \( \frac {1}{6}^{th}\)of the time the red die is a 1, and \( \frac {1}{6}^{th}\) of those times the white die will also be 1. This is illustrated in Figure 2.10. Because the rolls are independent, the probabilities of the corresponding outcomes can be multiplied to get the nal answer: \( \frac {1}{6} \times \frac {1}{6} = \frac {1}{36} \). This can be generalized to many independent processes.

^{17}(a) The complement of A: when the total is equal to 12. (b) P(A^{c}) = 1/36. (c) Use the probability of the complement from part (b), P(A^{c}) = 1/36, and Equation (2.25): P(less than 12) = 1 - P(12) = 1 - 1/36 = 35/36.

^{18}(a) First find P(6) = 5/36, then use the complement: P(not 6) = 1 - P(6) = 31/36. (b) First find the complement, which requires much less effort: P(2 or 3) = 1/36 + 2/36 = 1/12. Then calculate P(B) = 1 - P(B^{c}) = 1 - 1/12 = 11/12. (c) As before, finding the complement is the clever way to determine P(D). First nd P(D^{c}) = P(11 or 12) = 2/36 + 1/36 = 1/12. Then calculate P(D) = 1 - P(D^{c}) = 11/12.

Example \(\PageIndex{1}\)

**Example 2.28**

What if there was also a blue die independent of the other two? What is the probability of rolling the three dice and getting all 1s?

The same logic applies from Example 2.5. If \( \frac {1}{36}^{th}\)of the time the white and red dice are both 1, then \( \frac {1}{6}^{th}\)of those times the blue die will also be 1, so multiply:

\[P(white = 1 \text{ and } red = 1 \text{ and } blue = 1) = P(white = 1) x P(red = 1) x P(blue = 1) \]

\[= \frac {1}{6} x \frac {1}{6} x \frac {1}{6} = \frac {1}{216}\]

Examples 2.5 and 2.28 illustrate what is called the Multiplication Rule for independent processes.

Multiplication Rule for independent processes

If A and B represent events from two different and independent processes, then the probability that both A and B occur can be calculated as the product of their separate probabilities:

\[P(A and B) = P(A) \times P(B) \label {(2.29)} \]

Similarly, if there are k events A1, ..., Ak from k independent processes, then the probability they all occur is

\[ P (A_1) x P (A_2) \times \dots x P (A_k)\]

Exercise \(\PageIndex{1}\)

About 9% of people are left-handed. Suppose 2 people are selected at random from the U.S. population. Because the sample size of 2 is very small relative to the population, it is reasonable to assume these two people are independent.

- (a) What is the probability that both are left-handed?
- (b) What is the probability that both are right-handed?
^{19}

**Solution**

(a) The probability the rst person is left-handed is 0:09, which is the same for the second person. We apply the Multiplication Rule for independent processes to determine the probability that both will be left-handed: \(0.09 \times 0.09 = 0.0081\).

(b) It is reasonable to assume the proportion of people who are ambidextrous (both right and left handed) is nearly 0, which results in P(right-handed) = 1 - 0.09 = 0.91. Using the same reasoning as in part (a), the probability that both will be right-handed is \(0.91 \times 0.91 = 0.8281\).

Exercise \(\PageIndex{1}\)

Suppose 5 people are selected at random.^{20}

- What is the probability that all are right-handed?
- What is the probability that all are left-handed?
- What is the probability that not all of the people are right-handed?

**Solution**

^{20}(a) The abbreviations RH and LH are used for right-handed and left-handed, respectively. Since each are independent, we apply the Multiplication Rule for independent processes:

\[P(all ve are RH) = P( first = RH, second = RH, \dots , fifth = RH)\]

\[= P( first = RH) \times P(second = RH) \times \dots \times P( fifth = RH)\]

\[= 0.91\times 0.91 \times 0.91\times 0.91\times 0.91 = 0.624\]

(b) Using the same reasoning as in (a), \(0.09 \times 0.09 \times 0.09 \times 0.09 \times 0.09 = 0.0000059\)

(c) Use the complement, P(all ve are RH), to answer this question:

\[P(not all RH) = 1 - P(all RH) = 1 - 0.624 = 0.376\]

Suppose the variables handedness and gender are independent, i.e. knowing someone's gender provides no useful information about their handedness and vice-versa. Then we can compute whether a randomly selected person is right-handed and female using the Multiplication Rule:

\[ P(right-handed and female) = P(right-handed) \times P(female)\]

\[= 0.91 \times 0.50 = 0:455\]

The actual proportion of the U.S. population that is female is about 50%, and so we use 0.5 for the probability of sampling a woman. However, this probability does differ in other countries.

Exercise \(\PageIndex{1}\)

Three people are selected at random.

- What is the probability that the first person is male and right-handed?
- What is the probability that the first two people are male and right-handed?.
- What is the probability that the third person is female and left-handed?
- What is the probability that the first two people are male and right-handed and the third person is female and left-handed?

**Solution**

Brief answers are provided. (a) This is the same as P(a randomly selected person is male and righthanded) = 0.455. (b) 0.207. (c) 0.045. (d) 0.0093.

Sometimes we wonder if one outcome provides useful information about another outcome. The question we are asking is, are the occurrences of the two events independent? We say that two events A and B are independent if they satisfy Equation \ref{2.29}.

Example \(\PageIndex{1}\)

If we shuffle up a deck of cards and draw one, is the event that the card is a heart independent of the event that the card is an ace?

The probability the card is a heart is \( \frac {1}{4}\) and the probability that it is an ace is \( \frac {1}{13}\). The probability the card is the ace of hearts is \( \frac {1}{52}\). We check whether Equation 2.29 is satisfied:

\[ P (\heartsuit) x P (ace) = \frac {1}{4} \times \frac {1}{13} = \frac {1}{52} = P ( \heartsuit and ace) \]

Because the equation holds, the event that the card is a heart and the event that the card is an ace are independent events.