Probability

UK Secondary (7-11)

Law of Total Probability

Lesson

The Law of Total Probability allows us to calculate the likelihood of an event whose occurrence is influenced by which of several other disjoint events occurs. It involves the idea of conditional probability and one of the axioms of probability.

An example will clarify the concept.

Consider a sample space consisting of four possible weather conditions: we assume tomorrow will be fine or overcast (but not both) and the temperature will reach $25^{\circ}C$25∘`C` or not. We do not know in advance whether the day will be overcast or fine but we would like to know how likely it is that the temperature will reach $25^{\circ}C$25∘`C` anyway.

We know that if the day is overcast the probability that the temperature level will be reached is $0.2$0.2 and if the day is fine, the probability is $0.7$0.7. We also know from meteorological records that the probability of an overcast day at this time of the year is $0.4$0.4.

We observe that the events Overcast and Fine are disjoint: if one occurs, the other does not. We argue that the total probability of reaching $25^{\circ}C$25∘`C` must be the sum of the probabilities of reaching this temperature given the occurrence of each of the separate events Overcast and Fine. The following diagram illustrates the situation.

Intuitively, considering the areas of the relevant parts of the diagram, we might realise that the required calculation is $0.2\times0.4+0.7\times0.6$0.2×0.4+0.7×0.6. Thus, the total probability is $0.5$0.5 in this case.

More generally, suppose $B_1,B_2,B_3,...$`B`1,`B`2,`B`3,... is a partition of a sample space $S$`S`. (The events $B_i$`B``i`have no common outcomes.) Let $A$`A` be an event that does have outcomes in common with some or all of the $B_i$`B``i`.

We speak of the conditional probability that $A$`A` occurs given that one of the $B_i$`B``i` occurs and for this we use the notation $P\left(A|B_i\right)$`P`(`A`|`B``i`) for each $B_i$`B``i`.

(This is t*he probability that* $A$`A` *occurs given that* $B_i$`B``i` *occurs*. Events $B_i$`B``i` and $A$`A` both occur if they have a common outcome. We use the intersection notation $A\cap B_i$`A`∩`B``i` to mean events $A$`A` and $B_i$`B``i` both occur.)

It seems reasonable to define the conditional probability $P\left(A|B_i\right)$`P`(`A`|`B``i`) by $P\left(A|B_i\right)=\frac{P\left(A\cap B_i\right)}{P\left(B_i\right)}$`P`(`A`|`B``i`)=`P`(`A`∩`B``i`)`P`(`B``i`) and so,

$P\left(A\cap B_i\right)=P\left(A|B_i\right).P\left(B_i\right)$`P`(`A`∩`B``i`)=`P`(`A`|`B``i`).`P`(`B``i`)

One of the axioms that we assume for probability tells us under what condition probabilities may be added. If $B_1,B_2,B_3,...$`B`1,`B`2,`B`3,... are disjoint events, then

$P\left(B_1\cup B_2\cup B_3\cup...\right)=P\left(B_1\right)+P\left(B_2\right)+P\left(B_3\right)+...$`P`(`B`1∪`B`2∪`B`3∪...)=`P`(`B`1)+`P`(`B`2)+`P`(`B`3)+...

Now, for a sample space $S$`S`, $A=A\cap S=A\cap\left(B_1\cup B_2\cup B_3\cup...\right)$`A`=`A`∩`S`=`A`∩(`B`1∪`B`2∪`B`3∪...) where the events $B_i$`B``i` partition the sample space. (The union $A\cup B$`A`∪`B` is the set of outcomes that belong to $A$`A` or $B$`B`.)

By a distributive law for unions and intersections, we have

$A=\left(A\cap B_1\right)\cup\left(A\cap B_2\right)\cup\left(A\cap B_3\right)\cup...$`A`=(`A`∩`B`1)∪(`A`∩`B`2)∪(`A`∩`B`3)∪...

and since the right-hand side of this equation is again a union of disjoint sets, we see that

$P\left(A\right)=P\left(A\cap B_1\right)+P\left(A\cap B_2\right)+P\left(A\cap B_3\right)+...$`P`(`A`)=`P`(`A`∩`B`1)+`P`(`A`∩`B`2)+`P`(`A`∩`B`3)+...

Then, using the conditional probability notation, this is

$P\left(A\right)=P\left(A|B_1\right).P\left(B_1\right)+P\left(A|B_2\right).P\left(B_2\right)+P\left(A|B_3\right).P\left(B_3\right)+...$`P`(`A`)=`P`(`A`|`B`1).`P`(`B`1)+`P`(`A`|`B`2).`P`(`B`2)+`P`(`A`|`B`3).`P`(`B`3)+...

and this corresponds perfectly to the calculation that was done in the example above.

In summary, we may use the idea of total probability to calculate the probability of an event $A$`A` when the conditional probabilities $P\left(A|B_i\right)$`P`(`A`|`B``i`) are known and the events $B_i$`B``i` partition the sample space.

In the month of June, it rains on average $17$17 days of the month in Perth. It if rains, the chance that Carl catches the bus to work is $\frac{3}{10}$310. If it doesn’t rain, the chance that Carl catches the bus to work is $\frac{9}{10}$910.

Draw a tree diagram to represent the outcomes in this situation.

Determine the probability that on a given day in June, Carl catches the bus to work.

Given that Carl caught the bus to work, what was the chance it was raining that day?

Maths teachers graduating from a certain university were surveyed about where they were going to teach next year.

$60%$60% were taking a teaching job in a government school. Of those teaching in a government school, $70%$70% were going to teach in a co-educational school. Of those teaching in a private school, $20%$20% were going to teach in a single-sex school.

Draw a tree diagram to represent the outcomes in this situation.

Determine the probability that a graduating teacher was going to teach in a co-educational school.

Given that a graduating teacher is working in a single-sex school, what is the probability that it is a private school.

Give your answer as a fraction.