Probability is a measure that is associated with how certain we are of outcomes of a particular experiment or activity. An experiment is a planned operation carried out under controlled conditions. If the result is not predetermined, then the experiment is said to be a chance experiment. Flipping one fair coin twice is an example of an experiment.
A result of an experiment is called an outcome. The sample space of an experiment is the set of all possible outcomes. Three ways to represent a sample space are: to list the possible outcomes, to create a tree diagram, or to create a Venn diagram. The uppercase letter S is used to denote the sample space. For example, if you flip one fair coin, \(S = \{\text{H, T}\}\) where \(\text{H} =\) heads and \(\text{T} =\) tails are the outcomes.
An event is any combination of outcomes. Upper case letters like \(\text{A}\) and \(\text{B}\) represent events. For example, if the experiment is to flip one fair coin, event \(\text{A}\) might be getting at most one head. The probability of an event \(\text{A}\) is written \(P(\text{A})\).
Definition: Probability
The probability of any outcome is the long-term relative frequency of that outcome. Probabilities are between zero and one, inclusive (that is, zero and one and all numbers between these values).
\(P(\text{A}) = 0\) means the event \(\text{A}\) can never happen.
\(P(\text{A}) = 1\) means the event \(\text{A}\) always happens.
\(P(\text{A}) = 0.5\) means the event \(\text{A}\) is equally likely to occur or not to occur. For example, if you flip one fair coin repeatedly (from 20 to 2,000 to 20,000 times) the relative frequency of heads approaches 0.5 (the probability of heads).
Equally likely means that each outcome of an experiment occurs with equal probability. For example, if you toss a fair, six-sided die, each face (1, 2, 3, 4, 5, or 6) is as likely to occur as any other face. If you toss a fair coin, a Head (\(\text{H}\)) and a Tail (\(\text{T}\)) are equally likely to occur. If you randomly guess the answer to a true/false question on an exam, you are equally likely to select a correct answer or an incorrect answer.
To calculate the probability of an event A when all outcomes in the sample space are equally likely, count the number of outcomes for event \(\text{A}\) and divide by the total number of outcomes in the sample space. For example, if you toss a fair dime and a fair nickel, the sample space is \(\{\text{HH, TH, HT,TT}\}\) where \(\text{T} =\) tails and \(\text{H} =\) heads. The sample space has four outcomes. \(\text{A} =\) getting one head. There are two outcomes that meet this condition \(\text{\{HT, TH\}}\), so \(P(\text{A}) = \frac{2}{4} = 0.5\).
Suppose you roll one fair six-sided die, with the numbers {1, 2, 3, 4, 5, 6} on its faces. Let event \(\text{E} =\) rolling a number that is at least five. There are two outcomes {5, 6}. \(P(\text{E}) = \frac{2}{6}\). If you were to roll the die only a few times, you would not be surprised if your observed results did not match the probability. If you were to roll the die a very large number of times, you would expect that, overall, \(\frac{2}{6}\) of the rolls would result in an outcome of "at least five". You would not expect exactly \(\frac{2}{6}\). The long-term relative frequency of obtaining this result would approach the theoretical probability of \(\frac{2}{6}\) as the number of repetitions grows larger and larger.
Definition: Law of Large Numbers
This important characteristic of probability experiments is known as the law of large numbers which states that as the number of repetitions of an experiment is increased, the relative frequency obtained in the experiment tends to become closer and closer to the theoretical probability. Even though the outcomes do not happen according to any set pattern or order, overall, the long-term observed relative frequency will approach the theoretical probability. (The word empirical is often used instead of the word observed.)
It is important to realize that in many situations, the outcomes are not equally likely. A coin or die may be unfair, or biased. Two math professors in Europe had their statistics students test the Belgian one Euro coin and discovered that in 250 trials, a head was obtained 56% of the time and a tail was obtained 44% of the time. The data seem to show that the coin is not a fair coin; more repetitions would be helpful to draw a more accurate conclusion about such bias. Some dice may be biased. Look at the dice in a game you have at home; the spots on each face are usually small holes carved out and then painted to make the spots visible. Your dice may or may not be biased; it is possible that the outcomes may be affected by the slight weight differences due to the different numbers of holes in the faces. Gambling casinos make a lot of money depending on outcomes from rolling dice, so casino dice are made differently to eliminate bias. Casino dice have flat faces; the holes are completely filled with paint having the same density as the material that the dice are made out of so that each face is equally likely to occur. Later we will learn techniques to use to work with probabilities for events that are not equally likely.
The "OR" Event
An outcome is in the event \(\text{A OR B}\) if the outcome is in \(\text{A}\) or is in \(\text{B}\) or is in both \(\text{A}\) and \(\text{B}\). For example, let \(\text{A} = \{1, 2, 3, 4, 5\}\) and \(\text{B} = \{4, 5, 6, 7, 8\}\). \(\text{A OR B} = \{1, 2, 3, 4, 5, 6, 7, 8\}\). Notice that 4 and 5 are NOT listed twice.
The "AND" Event
An outcome is in the event \(\text{A AND B}\) if the outcome is in both \(\text{A}\) and \(\text{B}\) at the same time. For example, let \(\text{A}\) and \(\text{B}\) be {1, 2, 3, 4, 5} and {4, 5, 6, 7, 8}, respectively. Then \(\text{A AND B} = {4, 5}\).
The complement of event \(\text{A}\) is denoted \(\text{A'}\) (read "A prime"). \(\text{A'}\) consists of all outcomes that are NOT in \(\text{A}\). Notice that
\[P(\text{A}) + P(\text{A′}) = 1. \nonumber\]
For example, let \(\text{S} = \{1, 2, 3, 4, 5, 6\}\) and let \(\text{A} = {1, 2, 3, 4}\). Then, \(\text{A′} = {5, 6}\) and \(P(A) = \frac{4}{6}\), \(P(\text{A′}) = \frac{2}{6}\), and
The conditional probability of \(\text{A}\) given \(\text{B}\) is written \(P(\text{A|B})\). \(P(\text{A|B})\) is the probability that event \(\text{A}\) will occur given that the event \(\text{B}\) has already occurred. A conditional reduces the sample space. We calculate the probability of \(\text{A}\) from the reduced sample space \(\text{B}\). The formula to calculate \(P(\text{A|B})\) is
\[P(\text{A|B}) = \frac{\text{P(A AND B)}}{\text{P(B)}} \nonumber\]
where \(P(\text{B})\) is greater than zero.
For example, suppose we toss one fair, six-sided die. The sample space \(\text{S} = \{1, 2, 3, 4, 5, 6\}\). Let \(\text{A} =\) face is 2 or 3 and \(\text{B} =\) face is even (2, 4, 6). To calculate \(P(\text{A|B})\), we count the number of outcomes 2 or 3 in the sample space \(\text{B} = \{2, 4, 6\}\). Then we divide that by the number of outcomes \(\text{B}\) (rather than \(\text{S}\)).
We get the same result by using the formula. Remember that \(\text{S}\) has six outcomes.
\[ \begin{align*} P(\text{A|B}) &= \dfrac{ \text{ P(A AND B) } } {P(\text{B})} \\[4pt] &= \dfrac{\dfrac{\text{the number of outcomes that are 2 or 3 and even in S}}{6}}{\dfrac{\text{the number of outcomes that are even in S}}{6}} \\[4pt] &= \dfrac{\frac{1}{6}}{\frac{3}{6}} = \dfrac{1}{3} \end{align*}\]
Understanding Terminology and Symbols
It is important to read each problem carefully to think about and understand what the events are. Understanding the wording is the first very important step in solving probability problems. Reread the problem several times if necessary. Clearly identify the event of interest. Determine whether there is a condition stated in the wording that would indicate that the probability is conditional; carefully identify the condition, if any.
Example \(\PageIndex{1}\)
The sample space \(S\) is the whole numbers starting at one and less than 20.
\(S =\) _____________________________
Let event \(A =\) the even numbers and event \(B =\) numbers greater than 13.
\(P(\text{A|B}) = \frac{P(\text{A AND B})}{P(\text{B})} = \frac{1}{2}, P(\text{B|A}) = \frac{P(\text{A AND B})}{P(\text{B})} = \frac{2}{3}\), No.
Example \(\PageIndex{2A}\)
A fair, six-sided die is rolled. Describe the sample space S, identify each of the following events with a subset of S and compute its probability (an outcome is the number of dots that show up).
Event \(\text{T} =\) the outcome is two.
Event \(\text{A} =\) the outcome is an even number.
Event \(\text{B} =\) the outcome is less than four.
The complement of \(\text{A}\).
\(\text{A GIVEN B}\)
\(\text{B GIVEN A}\)
\(\text{A AND B}\)
\(\text{A OR B}\)
\(\text{A OR B′}\)
Event \(\text{N} =\) the outcome is a prime number.
A six-sided die does not have seven dots. \(P(7) = 0\).
Example \(\PageIndex{2B}\)
Table describes the distribution of a random sample \(S\) of 100 individuals, organized by gender and whether they are right- or left-handed.
Right-handed
Left-handed
Males
43
9
Females
44
4
Let’s denote the events \(M =\) the subject is male, \(F =\) the subject is female, \(R =\) the subject is right-handed, \(L =\) the subject is left-handed. Compute the following probabilities:
\(P(\text{M})\)
\(P(\text{F})\)
\(P(\text{R})\)
\(P(\text{L})\)
\(P(\text{M AND R})\)
\(P(\text{F AND L})\)
\(P(\text{M OR F})\)
\(P(\text{M OR R})\)
\(P(\text{F OR L})\)
\(P(\text{M'})\)
\(P(\text{R|M})\)
\(P(\text{F|L})\)
\(P(\text{L|F})\)
Answer
\(P(\text{M}) = 0.52\)
\(P(\text{F}) = 0.48\)
\(P(\text{R}) = 0.87\)
\(P(\text{L}) = 0.13\)
\(P(\text{M AND R}) = 0.43\)
\(P(\text{F AND L}) = 0.04\)
\(P(\text{M OR F}) = 1\)
\(P(\text{M OR R}) = 0.96\)
\(P(\text{F OR L}) = 0.57\)
\(P(\text{M'}) = 0.48\)
\(P(\text{R|M}) = 0.8269\) (rounded to four decimal places)
\(P(\text{F|L}) = 0.3077\) (rounded to four decimal places)
In this module we learned the basic terminology of probability. The set of all possible outcomes of an experiment is called the sample space. Events are subsets of the sample space, and they are assigned a probability that is a number between zero and one, inclusive.
Formula Review
\(\text{A}\) and \(\text{B}\) are events
\(P(\text{S}) = 1\) where \(\text{S}\) is the sample space
\(0 \leq P(\text{A}) \leq 1\)
\(P(\text{A|B}) = \frac{\text{P(A AND B)}}{\text{P(B)}}\)
Glossary
Conditional Probability
the likelihood that an event will occur given that another event has already occurred
Equally Likely
Each outcome of an experiment has the same probability.
Event
a subset of the set of all outcomes of an experiment; the set of all outcomes of an experiment is called a sample space and is usually denoted by \(S\). An event is an arbitrary subset in \(S\). It can contain one outcome, two outcomes, no outcomes (empty subset), the entire sample space, and the like. Standard notations for events are capital letters such as \(A, B, C\), and so on.
Experiment
a planned activity carried out under controlled conditions
Outcome
a particular result of an experiment
Probability
a number between zero and one, inclusive, that gives the likelihood that a specific event will occur; the foundation of statistics is given by the following 3 axioms (by A.N. Kolmogorov, 1930’s): Let \(S\) denote the sample space and \(A\) and \(B\) are two events in S. Then:
\(0 \leq P(\text{A}) \leq 1\)
If \(\text{A}\) and \(\text{B}\) are any two mutually exclusive events, then \(\text{P}(\text{A OR B}) = P(\text{A}) + P(\text{B})\).
\(P(\text{S}) = 1\)
Sample Space
the set of all possible outcomes of an experiment
The AND Event
An outcome is in the event \(\text{A AND B}\) if the outcome is in both \(\text{A AND B}\) at the same time.
The Complement Event
The complement of event \(\text{A}\) consists of all outcomes that are NOT in \(\text{A}\).
The Conditional Probability of A GIVEN B
\(P(\text{A|B})\) is the probability that event \(\text{A}\) will occur given that the event \(\text{B}\) has already occurred.
The Or Event
An outcome is in the event \(\text{A OR B}\) if the outcome is in \(\text{A}\) or is in \(\text{B}\) or is in both \(\text{A}\) and \(\text{B}\).
Exercise 3.2.2
In a particular college class, there are male and female students. Some students have long hair and some students have short hair. Write the symbols for the probabilities of the events for parts a through j. (Note that you cannot find numerical answers here. You were not given enough information to find any probability values yet; concentrate on understanding the symbols.)
Let \(\text{F}\) be the event that a student is female.
Let \(\text{M}\) be the event that a student is male.
Let \(\text{S}\) be the event that a student has short hair.
Let \(\text{L}\) be the event that a student has long hair.
The probability that a student does not have long hair.
The probability that a student is male or has short hair.
The probability that a student is a female and has long hair.
The probability that a student is male, given that the student has long hair.
The probability that a student has long hair, given that the student is male.
Of all the female students, the probability that a student has short hair.
Of all students with long hair, the probability that a student is female.
The probability that a student is female or has long hair.
The probability that a randomly selected student is a male student with short hair.
The probability that a student is female.
Answer
\(P(\text{L′)} = P(\text{S})\)
\(P(\text{M OR S})\)
\(P(\text{F AND L})\)
\(P(\text{M|L})\)
\(P(\text{L|M})\)
\(P(\text{S|F})\)
\(P(\text{F|L})\)
\(P(\text{F OR L})\)
\(P(\text{M AND S})\)
\(P(\text{F})\)
Use the following information to answer the next four exercises. A box is filled with several party favors. It contains 12 hats, 15 noisemakers, ten finger traps, and five bags of confetti.
Let \(H =\) the event of getting a hat.
Let \(N =\) the event of getting a noisemaker.
Let \(F =\) the event of getting a finger trap.
Let \(C =\) the event of getting a bag of confetti.
Use the following information to answer the next six exercises. A jar of 150 jelly beans contains 22 red jelly beans, 38 yellow, 20 green, 28 purple, 26 blue, and the rest are orange.
Let \(B =\) the event of getting a blue jelly bean
Let \(G =\) the event of getting a green jelly bean.
Let \(O =\) the event of getting an orange jelly bean.
Let \(P =\) the event of getting a purple jelly bean.
Let \(R =\) the event of getting a red jelly bean.
Let \(Y =\) the event of getting a yellow jelly bean.
Use the following information to answer the next six exercises. There are 23 countries in North America, 12 countries in South America, 47 countries in Europe, 44 countries in Asia, 54 countries in Africa, and 14 in Oceania (Pacific Ocean region).
Let \(\text{A} =\) the event that a country is in Asia.
Let \(\text{E} =\) the event that a country is in Europe.
Let \(\text{F} =\) the event that a country is in Africa.
Let \(\text{N} =\) the event that a country is in North America.
Let \(\text{O} =\) the event that a country is in Oceania.
Let \(\text{S} =\) the event that a country is in South America.
What is the probability of drawing a red card in a standard deck of 52 cards?
Exercise 3.2.20
What is the probability of drawing a club in a standard deck of 52 cards?
Answer
\(\frac{13}{52} = \frac{1}{4} = 0.25\)
Exercise 3.2.21
What is the probability of rolling an even number of dots with a fair, six-sided die numbered one through six?
Exercise 3.2.22
What is the probability of rolling a prime number of dots with a fair, six-sided die numbered one through six?
Answer
\(\frac{3}{6} = \frac{1}{2} = 0.5\)
Use the following information to answer the next two exercises. You see a game at a local fair. You have to throw a dart at a color wheel. Each section on the color wheel is equal in area.
Let \(\text{B} =\) the event of landing on blue.
Let \(\text{R} =\) the event of landing on red.
Let \(\text{G} =\) the event of landing on green.
Let \(\text{Y} =\) the event of landing on yellow.
Exercise 3.2.23
If you land on \(\text{Y}\), you get the biggest prize. Find \(P(\text{Y})\).
Exercise 3.2.24
If you land on red, you don’t get a prize. What is \(P(\text{R})\)?
Answer
\(\text{P}(R) = \frac{4}{8} = 0.5\)
Use the following information to answer the next ten exercises. On a baseball team, there are infielders and outfielders. Some players are great hitters, and some players are not great hitters.
Let \(\text{I} =\) the event that a player in an infielder.
Let \(\text{O} =\) the event that a player is an outfielder.
Let \(\text{H} =\) the event that a player is a great hitter.
Let \(\text{N} =\) the event that a player is not a great hitter.
Exercise 3.2.25
Write the symbols for the probability that a player is not an outfielder.
Exercise 3.2.26
Write the symbols for the probability that a player is an outfielder or is a great hitter.
Answer
\(P(\text{O OR H})\)
Exercise 3.2.27
Write the symbols for the probability that a player is an infielder and is not a great hitter.
Exercise 3.2.28
Write the symbols for the probability that a player is a great hitter, given that the player is an infielder.
Answer
\(P(\text{H|I})\)
Exercise 3.2.29
Write the symbols for the probability that a player is an infielder, given that the player is a great hitter.
Exercise 3.2.30
Write the symbols for the probability that of all the outfielders, a player is not a great hitter.
Answer
\(P(\text{N|O})\)
Exercise 3.2.31
Write the symbols for the probability that of all the great hitters, a player is an outfielder.
Exercise 3.2.32
Write the symbols for the probability that a player is an infielder or is not a great hitter.
Answer
\(P(\text{I OR N})\)
Exercise 3.2.33
Write the symbols for the probability that a player is an outfielder and is a great hitter.
Exercise 3.2.34
Write the symbols for the probability that a player is an infielder.
Answer
\(P(\text{I})\)
Exercise 3.2.35
What is the word for the set of all possible outcomes?
Exercise 3.2.36
What is conditional probability?
Answer
The likelihood that an event will occur given that another event has already occurred.
Exercise 3.2.37
A shelf holds 12 books. Eight are fiction and the rest are nonfiction. Each is a different book with a unique title. The fiction books are numbered one to eight. The nonfiction books are numbered one to four. Randomly select one book
Let \(\text{F} =\) event that book is fiction
Let \(\text{N} =\) event that book is nonfiction
What is the sample space?
Exercise 3.2.38
What is the sum of the probabilities of an event and its complement?
Answer
1
Use the following information to answer the next two exercises. You are rolling a fair, six-sided number cube. Let \(\text{E} =\) the event that it lands on an even number. Let \(\text{M} =\) the event that it lands on a multiple of three.
Exercise 3.2.39
What does \(P(\text{E|M})\) mean in words?
Exercise 3.2.40
What does \(P(\text{E OR M})\) mean in words?
Answer
the probability of landing on an even number or a multiple of three