Chapter 11 · Probability
Comparing Experimental and Theoretical Probability
Compare what a probability model predicts with what an experiment gives. Measure the gap and judge it against the number of trials.
You can already use a probability to predict about how often something will happen. Now you will check predictions against real results and describe how the two compare.
A few words first. A trial is one run of a chance experiment, such as one flip of a coin. An outcome is one possible result of a trial. An event is an outcome, or a group of outcomes, that you are watching for, such as heads. An outcome in which the event happens is a favourable outcome.
For any event, there are two probabilities you can compare:
- Theoretical probability is what a model predicts. A model is a description of the situation that gives each outcome a probability. You can reason it out without running a single trial.
- Experimental probability is what happened. It is the event's relative frequency: the fraction of the trials in which the event occurred.
One comes from reasoning and the other from data, so they do not have to be the same number. Comparing them means finding both, then asking how far apart they are and why.
| Question | Theoretical probability | Experimental probability |
|---|---|---|
Where does it come from? | A model, reasoned out without running any trial | The results of trials you have run |
How do you find it? | For equally likely outcomes only: | , with at least 1 trial |
Can its value change? | No. The model fixes it. | Yes. Running more trials can give a new value. |
How far can you trust it? | As far as the model fits the real situation | It approximates the event's probability only over many trials |
Before you compare, name the quantities. For the event you are studying:
- is its theoretical probability and is its experimental probability. Both are numbers with no units. ( stands for experimental, not expected.)
- is the number of trials, a whole number that is at least 1, so you never divide by zero.
- is the number of those trials in which the event happened, so and .
From your earlier work, the model's expected count of the event in trials is . It is an approximate prediction, not a guarantee.
Key concept
Compare the model with the data
To compare the two probabilities of one event, write and in the same form (both decimals, or fractions with a common denominator) and subtract. The result is the gap.
- Gap positive: the event happened more often than the model predicts.
- Gap negative: it happened less often.
- Gap zero: the two match.
A gap is normal, because chance makes results vary. Relative frequency approximates probability only over many trials, so judge every gap together with . Even over many trials, is usually close to and need not equal it. All of this assumes that fits the situation: favourable over total is a probability only when the outcomes are equally likely.
Worked example
A fair coin, 50 flips
You flip a fair coin times and get heads times. Compare the experimental probability of heads with the theoretical probability.
Find the theoretical probability T. One flip has 2 outcomes, heads and tails. The coin is fair, so the two outcomes are equally likely. That condition is what lets you use favourable over total. Heads is 1 favourable outcome out of 2.
Find the experimental probability E. It is the relative frequency: k = 28 flips gave heads out of n = 50 flips. Then multiply the numerator and the denominator by 2. Multiplying both by the same nonzero number keeps the fraction's value, and it gives hundredths, which you can read as a decimal.
Both values lie from 0 to 1, as every probability must, and both are decimals, so you can subtract. Take experimental minus theoretical, in that order, so the sign shows which is larger. The gap is positive: heads came up more often than the model predicts.
Say the gap in flips. The model's expected count is T times n, an approximate prediction and not a guarantee. The actual count k is 3 higher. The two views agree: n is positive, so E greater than T means k is greater than T times n. With only 50 flips, 3 extra heads is ordinary chance variation.
Answer
The experimental probability of heads is and the theoretical probability is . The experimental value is greater by , which is more heads than the expected count of about in flips.
Why is there a gap at all? A model cannot control single trials. Each flip is still decided by chance, so the number of heads can land above or below the expected count, and it often does. The useful question is how the gap behaves as the number of trials grows.
The table follows one class spinning a fair spinner with 4 equal sections, 1 of them blue. The sections are equal, so the 4 outcomes are equally likely, and for the event blue that gives . The class keeps a running total, so each row includes all the spins counted in the rows above it.
| Spins so far, n | Times on blue, k | Experimental probability, E | Gap, E minus T |
|---|---|---|---|
Read down the last column: , , , . After 20 spins, was far from . After 2000 spins it was very close, though still not equal.
That is the usual pattern, and it has two limits. First, relative frequency approximates probability only over many trials, so a result from a few trials can sit far from with nothing wrong. Second, the pattern is a tendency, not a promise: a stretch of trials can make the gap wider before it narrows again. So whenever you compare with , state the number of trials too.
Worked example
A number cube: an event and its opposite
You roll a fair number cube with faces numbered to a total of times. A number greater than comes up times. Compare the experimental and theoretical probabilities of rolling a number greater than . Then do the same for not rolling one.
Find T for the event of rolling a number greater than 4. The cube is fair, so its 6 outcomes are equally likely. Each has probability one sixth, and the six probabilities add to 1, as a model's must. Equally likely outcomes allow favourable over total. The favourable outcomes are 5 and 6, which is 2 of the 6.
Find E from the data: k = 46 of the n = 120 rolls. Divide the numerator and the denominator by 2. Dividing both by the same nonzero number keeps the fraction's value.
Write T with the denominator 60 so that both fractions count parts of the same size. Then subtract experimental minus theoretical. The gap is positive, so the event happened more often than the model predicts.
Say the gap in rolls. The model's expected count is T times n, an approximate prediction and not a guarantee. The actual count is 6 rolls higher. As a check, 6 rolls out of 120 is one twentieth, the same gap as in the last step.
Now take the opposite event: not rolling a number greater than 4, which means rolling 1, 2, 3 or 4. The probability that an event does not happen is 1 minus the probability that it does. This holds for T. It holds for E too, because every roll either is greater than 4 or is not: 120 minus 46 leaves 74 rolls, and 74 out of 120 simplifies to 37 sixtieths.
Subtract experimental minus theoretical for this event. The gap has the same size and the opposite sign. That makes sense: the 6 extra rolls that were greater than 4 are 6 rolls missing from the other event.
Answer
Rolling a number greater than has experimental probability , which is above its theoretical probability . Not rolling one has experimental probability , which is below its theoretical probability .
Worked example
Two groups, one spinner
A fair spinner has equal sections: red and white. Group A spins it times and lands on red times. Group B spins it times and lands on red times. Whose experimental probability of red is closer to the theoretical probability? Is that what you would expect?
Find T. The 5 sections are equal, so the 5 outcomes are equally likely and favourable over total applies. Landing on red is favourable in 2 of the 5 sections.
Find each group's experimental probability as k over n, written in hundredths. For Group A, multiply the numerator and the denominator by 4. For Group B, divide both by 4. Neither change alters the fraction's value. The small letter after each E names the group.
Subtract experimental minus theoretical for each group. Group A's gap is positive, so red came up more often than the model predicts. Group B's gap is negative, so red came up less often.
Closer means a smaller distance from T. Distance ignores direction, so compare the absolute values of the gaps, which are their distances from zero.
Check with counts, using the approximate expected count T times n. Group B is 12 spins from its expected count and Group A is only 3 spins from its own. B is still closer as a probability, because 12 out of 400 is 0.03 while 3 out of 25 is 0.12.
Decide whether this is what you would expect. Relative frequency approximates probability only over many trials, so 400 spins would be expected to land closer than 25 spins. It was likely, not guaranteed. Group A's larger gap comes from just 3 spins, so it is no evidence that the spinner is unfair.
Answer
Group B is closer: its experimental probability is below the theoretical probability , while Group A's is above it. That is what you would expect, though it was not guaranteed, because Group B ran many more trials.
Takeaway. Theoretical probability is the model's prediction, and favourable over total gives it only when the outcomes are equally likely. Experimental probability is the relative frequency from real trials. To compare them, write both in the same form, subtract experimental minus theoretical, and report the gap along with the number of trials. Expect a gap, because predictions are approximate expected counts, not guarantees. Relative frequency approximates probability only over many trials, so a comparison tells you more as the number of trials grows.