Module 3 — Uncertainty, probability and inference
Lesson 13 of 13
Why humans are bad at probability
Humans are very good at many forms of reasoning.
We recognise faces.
We understand language.
We notice patterns.
We make decisions quickly with incomplete information.
But probability often exposes weaknesses in our intuition.
We tend to:
- overreact to vivid events,
- ignore base rates,
- see patterns in randomness,
- become overconfident,
- misunderstand rare events,
- confuse possibility with probability,
- treat recent events as unusually informative.
This does not mean humans are irrational.
Many of these shortcuts are useful in everyday life.
The problem is that intuition evolved for making fast decisions in uncertain environments, not for reasoning precisely about:
1-in-10,000 probabilities
or:
conditional distributions
or:
long-run frequencies across billions of events.
Probability is difficult partly because the world we experience one event at a time is not the same thing as the distributions that generate those events.
We experience outcomes, not distributions
Suppose the weather forecast says:
70% probability of rain.
Tomorrow arrives.
Either:
it rains
or:
it does not.
We experience one realised outcome.
We never directly experience:
the 70%.
Probability describes the distribution across many comparable possible cases.
But our lives unfold through individual events.
This creates a fundamental mismatch between:
probabilistic reasoning
and:
human experience.
One outcome feels like evidence about the whole model
Suppose a forecaster says:
There is a 90% probability of rain.
It does not rain.
Someone responds:
The forecast was wrong.
But a calibrated 90% forecast should fail around:
10% of the time.
One failure is therefore perfectly compatible with a good forecasting system.
We need many repeated forecasts to judge the probabilities properly.
Humans naturally focus on the one outcome we just observed.
The outcome becomes obvious after it happens
Before an event:
several futures are possible.
Afterward:
one future happened.
Once the outcome is known, it becomes psychologically difficult to remember how uncertain it appeared beforehand.
This is hindsight bias.
After an election, accident, financial crash or technological success, people often say:
It was obvious.
But it may not have been obvious at all before the event.
Hindsight collapses the probability tree
Before an event:
FUTURE A → 50%
FUTURE B → 30%
FUTURE C → 20%
Then Future C occurs.
Afterward, our minds can unconsciously rewrite the situation as:
FUTURE C → obviously what was going to happen.
The unrealised alternatives disappear from view.
But before the event, they were real possibilities.
Good probabilistic reasoning preserves that distinction.
A good decision can have a bad outcome
Suppose a decision has:
90% chance of success
and:
10% chance of failure.
You take the decision.
It fails.
Was the decision necessarily bad?
No.
The decision may still have been excellent given the information available beforehand.
Similarly, a terrible decision can occasionally produce a good outcome.
This distinction is crucial:
Decision quality should be judged using the information available when the decision was made, not solely by the realised outcome.
Outcome bias
Humans often judge decisions according to what happened afterward.
This is called outcome bias.
Suppose two managers independently take the same poorly justified risk.
One succeeds.
One fails.
We may praise the first and criticise the second.
But the underlying decision process was identical.
Probability forces us to separate:
process
from:
realisation.
We are pattern-seeking machines
Humans are extremely good at finding patterns.
That ability is enormously useful.
But sometimes we find patterns where none exist.
Suppose a fair coin produces:
H H H H H
Many people feel:
Tails must be due.
But if the coin is genuinely fair and each flip is independent:
P(Tails next) = 50%.
The previous sequence does not make Tails more likely.
The gambler's fallacy
The belief that a random process must quickly "balance itself out" is called the gambler's fallacy.
Suppose a roulette wheel lands on red:
five times in a row.
Someone may think:
Black is now more likely.
If the wheel is fair and spins are independent, it is not.
The long-run proportion may approach the expected distribution.
But that does not mean short sequences are forced to alternate.
Randomness often looks non-random
Ask someone to invent a random sequence of Heads and Tails.
They may produce something like:
H T H T T H T H
with frequent alternation.
But genuinely random sequences often contain:
long runs.
For example:
H H H H T T H
can occur perfectly naturally.
Humans tend to expect randomness to look more evenly mixed than real randomness does.
The clustering illusion
Suppose several unusual events occur close together.
We may infer:
Something must be causing this cluster.
Sometimes that is true.
But random processes naturally generate clusters.
For example, if failures occur randomly across thousands of devices, some periods or locations will contain several failures close together purely by chance.
This is sometimes called the clustering illusion.
Random does not mean evenly spaced
Suppose a city experiences on average:
12 major incidents per year.
That does not mean:
one incident every month.
A random pattern could produce:
- three in January,
- none for several months,
- two in one week.
Average frequency does not imply regular spacing.
We underestimate coincidence
Imagine millions of people making:
- phone calls,
- purchases,
- journeys,
- predictions.
Extremely unusual coincidences will occur somewhere simply because there are so many opportunities.
A coincidence can feel:
one in a million.
But if there are:
one billion opportunities,
one-in-a-million events are not surprising.
Scale matters.
The birthday problem
A famous example is the birthday paradox.
How many people need to be in a room before there is more than a 50% chance that two share a birthday?
Many people guess:
well over 100.
The answer is only:
23 people.
Why?
Because we are not comparing one person against everyone else.
We are considering all possible pairs.
The number of possible comparisons grows quickly.
Human intuition is not naturally good at combinatorial probability.
We confuse "unlikely for me" with "unlikely somewhere"
Suppose the chance of a particular failure for one user is:
1 in 100,000.
That sounds extremely rare.
But if a platform has:
500 million users,
the expected number of affected users can be substantial.
This matters enormously for:
- AI,
- cybersecurity,
- healthcare,
- financial platforms.
Global systems operate at scales our intuition did not evolve to understand.
We ignore base rates
One of the most important probability errors is base-rate neglect.
Suppose a medical test is:
99% accurate.
A person tests positive.
Many people instinctively think:
There is about a 99% chance they have the disease.
But if the disease affects only:
1 in 10,000 people,
the result may be very different.
The prevalence of the disease matters.
A concrete example
Imagine:
10,000 people.
Suppose:
1 person has the disease.
Assume the test detects that person correctly.
Now suppose the test falsely identifies:
1% of healthy people.
Among approximately:
9,999 healthy people,
around:
100 may test positive.
So we have roughly:
1 true positive
and:
100 false positives.
A positive result is therefore far from 99% certain to indicate disease.
The base rate dominates.
Natural frequencies are often easier
The same problem becomes easier when expressed using people rather than abstract percentages.
Instead of:
Sensitivity 99%, false-positive rate 1%, prevalence 0.01%.
say:
Out of 10,000 people, about 1 has the disease. The test will find that person, but may also incorrectly flag around 100 healthy people.
Humans often reason better with natural frequencies than with conditional percentages.
This is a useful communication technique.
We confuse P(A|B) with P(B|A)
Recall conditional probability.
These are different:
P(Positive test | Disease)
and:
P(Disease | Positive test).
Likewise:
P(High income | University degree)
is different from:
P(University degree | High income).
The reversal can sound linguistically subtle.
Mathematically, it can change everything.
Prosecutor's fallacy
A famous form of this mistake occurs in legal reasoning.
Suppose DNA evidence would be extremely rare among random innocent people.
Someone may incorrectly conclude:
Therefore the probability the defendant is innocent is extremely low.
But:
P(Evidence | Innocent)
is not the same as:
P(Innocent | Evidence).
Other evidence and the prior probability of different suspects still matter.
This mistake is sometimes called the prosecutor's fallacy.
We overreact to vivid evidence
Suppose you hear about a dramatic aircraft accident.
For the next few days, flying may feel much more dangerous.
But the underlying probability of an accident may have changed very little.
The event is simply:
- vivid,
- recent,
- memorable.
Humans often estimate probability partly from how easily examples come to mind.
This is the availability heuristic.
Availability is not frequency
News media naturally report unusual events.
They do not report:
Millions of journeys completed uneventfully today.
So our memory contains a selected sample:
dramatic events are overrepresented.
If we estimate real-world probability from what we remember seeing in the news, we may badly misjudge frequency.
Social media intensifies this
Algorithms may prioritise content that generates:
- surprise,
- outrage,
- fear,
- novelty.
So users can receive an even more heavily selected sample of reality.
An event may feel common because:
we see it frequently
rather than because:
it occurs frequently.
The data environment shapes probability intuition.
Recent events feel more probable
Suppose a region experiences an unusual flood.
Immediately afterward, people may dramatically increase their estimate of future flood probability.
Sometimes that is rational if the event provides new information.
But sometimes the statistical risk changed little.
Our intuition gives recent events disproportionate weight.
This is recency bias.
We can also forget risk after long quiet periods
The opposite happens too.
Suppose a flood has not occurred for:
50 years.
People may conclude:
It probably won't happen.
But if the annual probability remains unchanged, the absence of recent events does not make the next one impossible.
Long quiet periods can create false confidence.
We misunderstand "one in 100 years"
Suppose a flood is described as:
a 1-in-100-year event.
Many people interpret this as:
Once it happens, we are safe for another 100 years.
That is wrong.
It usually means something closer to:
approximately 1% probability in any given year, under the assumed distribution.
Another such flood could happen next year.
We mistake possibility for probability
Consider two statements:
It is possible that this investment loses everything.
and:
It is likely that this investment loses everything.
They are completely different.
A possibility may have:
0.001% probability
or:
40% probability.
Saying:
It could happen
does not tell us how much weight the possibility deserves.
"Could" is almost information-free
Many debates become confused because participants argue:
But X could happen.
Almost anything physically possible could happen.
Good decision-making requires asking:
How likely is it?
How severe is it?
How confident are we in that probability?
Possibility is the beginning of risk analysis, not the end.
We sometimes do the opposite: zero-probability thinking
If something has never happened to us, we may unconsciously assign:
probability ≈ 0.
But:
not previously observed
does not mean:
impossible.
Rare events may simply require more opportunities before they appear.
This is especially important when systems scale.
Humans dislike ambiguous probabilities
Suppose you can choose between two urns.
Urn A
Contains exactly:
- 50 red balls,
- 50 black balls.
Urn B
Contains 100 balls, but you do not know how many are red.
Many people prefer betting on Urn A even when there is no obvious reason its expected probability must be better.
This preference is known as ambiguity aversion.
We often prefer known risk to unknown uncertainty.
Risk feels different from uncertainty
Compare:
There is exactly a 10% chance of losing €100.
with:
The chance of losing €100 could be anywhere between 2% and 30%.
The expected probabilities might be similar.
But the second often feels more uncomfortable.
Humans care not only about risk.
We care about uncertainty about risk.
This matches the distinction from the previous lesson.
We are often overconfident
Ask people to estimate ranges such that they are:
90% confident
the true value lies inside.
If people were well calibrated, roughly:
90% of answers
should contain the truth.
In practice, people often choose ranges that are too narrow.
The truth falls outside much more than 10% of the time.
We tend to underestimate our uncertainty.
Expertise does not eliminate overconfidence
Experts may know much more than non-experts.
But expertise does not automatically produce perfect calibration.
In some domains, feedback is:
- slow,
- ambiguous,
- incomplete.
Without good feedback, people may never learn how well calibrated their confidence actually is.
Calibration requires feedback
Suppose you make probabilistic predictions:
60%
70%
90%.
Unless you later examine what happened, you cannot learn whether those numbers were appropriate.
Forecasting improves when predictions are:
- recorded,
- scored,
- compared with outcomes.
Probability becomes a learnable skill.
We prefer certainty
Compare:
The economy will grow by 2.1%.
with:
Growth is centred around 2%, but outcomes between -1% and 5% remain plausible.
The first statement feels clearer.
The second may be more honest.
Humans often prefer:
one answer
to:
a distribution.
This creates pressure on forecasters and AI systems to sound more certain than the evidence justifies.
Point forecasts are psychologically attractive
A news headline saying:
Inflation will be 3.2%.
is simple.
A probability distribution requires more thought.
But if plausible outcomes range from:
1% to 6%,
the distribution may contain the information that actually matters for decisions.
Simplicity can hide uncertainty.
We anchor on numbers
Suppose someone first suggests:
€1 million.
Then asks how much a company is worth.
Your estimate may be influenced by that initial number even if it was arbitrary.
This is anchoring.
Once a number enters our thinking, we can adjust insufficiently away from it.
Priors can become anchors
Prior knowledge is useful.
But humans may cling too strongly to an initial belief.
Suppose we initially estimate:
10% probability.
Strong new evidence appears.
We move only to:
15%
when a Bayesian update might justify a much larger change.
The prior has become an anchor rather than a starting point.
Or we can overreact to new evidence
The opposite is also possible.
One unusual observation occurs.
We abandon decades of evidence.
For example:
My friend smoked and lived to 95, therefore smoking is not dangerous.
One anecdote should not outweigh large population-level evidence.
Humans can move too little or too much.
Good probabilistic reasoning asks how informative the new evidence actually is.
Anecdotes are psychologically powerful
A personal story is:
- concrete,
- memorable,
- emotionally vivid.
A statistical distribution is abstract.
So:
I know someone who...
can feel more convincing than:
Across one million people...
But the large dataset may provide far stronger evidence.
Anecdotes are data.
They are usually very small samples.
We neglect sample size
Suppose:
Hospital A
2 of 3 patients recover.
Hospital B
650 of 1,000 patients recover.
Hospital A has a slightly higher recovery percentage.
Would we conclude it is better?
Probably not.
Three observations provide very little evidence.
Humans can nevertheless be overly influenced by extreme percentages from small samples.
Small samples are noisy
Suppose two schools have identical underlying performance.
A school with:
20 students
can easily show an unusually high or low pass rate by chance.
A school with:
20,000 students
will generally have a more stable average.
Extreme outcomes occur more frequently in small samples.
The law of small numbers
Humans often expect small samples to resemble the population more closely than they really do.
This tendency is sometimes called belief in the law of small numbers.
We may infer:
Three customers complained, therefore customers hate the product.
Perhaps.
But three observations may simply be noisy.
Sample size matters.
Regression to the mean
Suppose an athlete has an extraordinary performance.
Next time, performance is more ordinary.
Someone may conclude:
Praise made them worse.
Or after a terrible performance followed by improvement:
Criticism made them better.
But extreme observations are often partly driven by random variation.
The next observation tends naturally to be closer to the average.
This is regression to the mean.
Regression to the mean can create fake causal stories
Imagine a school gives additional support to students who perform exceptionally badly on one test.
Their next scores improve.
Did the intervention work?
Perhaps.
But some improvement might have happened anyway because the first score was an unusually bad realisation.
Without a comparison group, we can mistake regression to the mean for causation.
We see skill where there may be luck
Suppose an investment manager outperforms the market for:
three consecutive years.
Are they exceptionally skilled?
Maybe.
But if there are:
10,000 managers,
some will produce impressive winning streaks by chance.
Selection matters.
If we examine only the winners, randomness can look like skill.
Survivorship bias reinforces this
The poor-performing managers may:
- close,
- disappear,
- stop reporting.
The surviving dataset contains disproportionately successful histories.
We then study the survivors and conclude:
These strategies create success.
Again, selected random outcomes can create compelling stories.
We underestimate how many hypotheses were tested
Suppose a researcher tests:
one relationship
and finds an unusual result.
Interesting.
Now suppose they test:
100,000 relationships
and report the most unusual one.
The probability of finding something apparently remarkable by chance becomes much larger.
This is sometimes called the multiple comparisons problem.
If you search long enough, something looks significant
Large datasets create enormous opportunities to discover:
- correlations,
- patterns,
- subgroups.
Some will occur by chance.
If we only show the successful discoveries, they look much more convincing than they should.
This is why results should ideally be:
- replicated,
- tested on new data.
We prefer stories to randomness
Suppose a company succeeds.
We tell a story:
- brilliant founder,
- excellent culture,
- perfect strategy.
Perhaps those mattered.
But:
- timing,
- luck,
- competitor failure,
- economic conditions
may also have mattered.
Humans prefer causal narratives.
Randomness feels unsatisfying.
Narrative fallacy
We often construct coherent explanations after seeing an outcome.
This is sometimes described as the narrative fallacy.
The story may be:
- plausible,
- internally consistent.
But plausibility is not evidence that the explanation caused the outcome.
The same temptation appears in AI-generated explanations.
A model can tell a convincing story too
A language model can generate a coherent explanation for:
Why did Event X happen?
The explanation may sound convincing because language models are excellent at producing plausible narratives.
But:
plausible explanation ≠ established causal explanation.
Probabilistic humility remains important.
We underestimate conditional dependence
Suppose several systems fail during the same storm.
If we treat failures independently, the joint probability may appear tiny.
But they share:
a common cause.
Humans and models can underestimate systemic risk when they assume independence too readily.
Multiplying probabilities can be dangerous
Suppose:
System A failure = 1%
System B failure = 1%.
If independent:
joint failure = 0.01%.
But if both depend on the same power supply, the actual joint probability may be much higher.
The independence assumption is doing enormous work.
Always ask:
Are these events really independent?
Humans also see dependence where none exists
After:
five losing trades
a trader may think:
My next trade is probably also bad.
Perhaps the trades are independent.
Or:
I am due a winner.
That is the opposite intuition.
Humans can alternate between inventing:
- positive dependence,
- negative dependence
depending on the story that feels convincing.
We misunderstand compounding
Suppose something has:
1% probability per year.
Over:
50 years,
the cumulative probability of experiencing it at least once is much larger than 1%.
Repeated exposure compounds risk.
Humans often focus on the per-period number and ignore cumulative exposure.
Repeated AI use creates the same issue
Suppose an AI makes a serious factual error:
once every 1,000 responses.
A person uses it:
10 times.
Perhaps they never see one.
An organisation generates:
100 million responses.
The absolute number becomes large.
Risk depends on both:
error probability
and:
exposure.
We overweight tiny probabilities in some contexts
Lottery tickets provide an interesting example.
The probability of winning may be extraordinarily small.
Yet people may pay more than the expected monetary value because:
- the upside is vivid,
- the possibility is emotionally attractive.
People do not always treat probabilities linearly.
We underweight tiny probabilities elsewhere
At other times:
The probability is only 0.01%.
So we effectively treat it as:
zero.
If the consequence is catastrophic and exposure is enormous, this may be dangerous.
Humans can both:
- overweight,
- underweight
small probabilities depending on context.
Prospect theory
Psychologists Daniel Kahneman and Amos Tversky developed prospect theory to describe some systematic differences between human decisions and simple expected-utility models.
Among other things, people often:
- respond differently to gains and losses,
- overweight some small probabilities,
- show loss aversion.
The exact behavioural pattern depends on context.
The key idea is:
Humans do not mechanically calculate expected value and choose the maximum.
Loss aversion
Suppose:
Gain €100
and:
Lose €100.
For many people, the loss feels more significant than the equivalent gain feels beneficial.
This is loss aversion.
So decisions depend not only on:
- probability,
- monetary value.
They also depend on how outcomes are perceived.
Framing changes choices
Consider:
Treatment has a 90% survival rate.
versus:
Treatment has a 10% mortality rate.
They describe the same probabilities.
Yet people may respond differently.
This is a framing effect.
The mathematical information is identical.
The representation changes the decision.
Data presentation therefore matters
A system can communicate:
90% success
or:
10% failure.
Both are true.
A responsible interface should recognise that framing influences users.
Probability communication is therefore partly a service-design problem.
Percentages can be difficult
Suppose risk increases from:
1% to 2%.
We could say:
risk increased by 100%.
That sounds dramatic.
The absolute increase is:
1 percentage point.
Both are mathematically correct.
Humans react differently to relative and absolute risk.
Good communication should often show both.
"99% safe" can hide large absolute numbers
Suppose a system is:
99% accurate.
Sounds excellent.
But at:
1 billion decisions,
1% errors would mean:
10 million errors.
Percentages need scale.
"Only 1%" can also hide concentration
Suppose only:
1% of users
experience service failure.
But perhaps it is always the same 1%.
The aggregate percentage may sound small.
For the affected users:
failure rate = 100%.
Distribution matters.
Humans struggle with exponential growth
Suppose something doubles repeatedly.
The early growth looks slow.
Then it becomes enormous very quickly.
Humans tend to reason more naturally in linear terms.
This can make it difficult to understand:
- compound interest,
- epidemic growth,
- compute growth,
- network effects.
Probability and dynamic systems frequently contain nonlinear behaviour.
We often extrapolate linearly
Suppose a trend has risen:
1 unit per year.
We may imagine it will continue.
But systems can:
- saturate,
- accelerate,
- collapse.
Historical trends are not laws.
This is particularly important when forecasting technology.
We are uncomfortable with distributions
Suppose an analyst says:
Expected growth is 2%, with a 25% probability of recession.
Many people immediately ask:
So do you think there will be a recession or not?
The desire is for a binary answer.
But the probability distribution may be the correct answer.
Forcing it into:
yes / no
destroys information.
Decisions still need discrete actions
This creates a real challenge.
The world may be probabilistic.
But actions often are discrete.
We may need to decide:
- build / do not build,
- approve / reject,
- brake / continue.
So uncertainty must eventually become a decision.
The key is not to pretend the uncertainty disappeared.
Probability and decision are different stages
A model might say:
P(failure) = 15%.
The decision depends on:
- consequence of failure,
- cost of prevention,
- uncertainty in the estimate.
So:
PROBABILITY
↓
CONSEQUENCE
OBJECTIVE
CONSTRAINTS
↓
DECISION
Humans often shortcut this process.
We substitute easier questions
Suppose the hard question is:
What is the probability this company succeeds over ten years?
That is difficult.
We may unconsciously answer:
Do I like the founder?
or:
Is the product exciting?
This is sometimes called attribute substitution.
We answer an easier question without noticing the substitution.
AI systems can inherit human probability errors
AI models are trained on human-generated data.
That data contains:
- human beliefs,
- narratives,
- misconceptions.
A model can therefore reproduce probabilistic errors found in training data.
Training on humanity does not automatically produce perfect probabilistic reasoning.
AI may also have its own calibration problems
An AI can:
- output confident answers outside its knowledge,
- assign poor probabilities,
- fail under distribution shift.
So we should not frame the issue as:
irrational humans versus rational machines.
Both humans and machines need:
- calibration,
- feedback,
- evaluation.
Humans and AI can complement each other
Humans may be strong at:
- context,
- novel situations,
- moral judgement.
Models may be strong at:
- combining large datasets,
- statistical consistency,
- repeated calculation.
A well-designed service can combine them.
The goal is not necessarily:
Replace human judgement with probability.
It may be:
Use probability to make human and machine judgement more disciplined.
Externalising probability helps
One way to improve reasoning is simply to write probabilities down.
Instead of:
This will probably happen.
say:
I estimate 70%.
Now the statement can later be evaluated.
Did events assigned 70% occur roughly 70% of the time?
Explicit numbers create accountability.
Forecasting as a learnable skill
Suppose you repeatedly estimate probabilities for future events.
Then record outcomes.
You can examine:
- calibration,
- bias,
- overconfidence.
Over time, probabilistic judgement can improve.
This is one reason forecasting tournaments can produce highly skilled forecasters.
Break complex questions into components
Suppose we want:
Probability a project finishes on time.
Rather than guessing one number, break the problem down:
P(design completed)
×
P(approval | design)
×
P(construction on time | approval)
and so on.
Decomposition can reveal assumptions that a gut estimate hides.
But dependencies between steps must be considered.
Use reference classes
Suppose we ask:
How long will this project take?
One approach is to reason from the inside:
- task list,
- schedule,
- team.
Another is to ask:
How long did similar projects usually take?
This is the outside view or reference-class forecasting.
Historical base rates can counter overconfidence.
The planning fallacy
Projects routinely take:
- longer,
- cost more
than planners expect.
People focus on the details of their own plan and underestimate:
- delays,
- interruptions,
- unknown problems.
This is the planning fallacy.
Reference classes can help.
"This time is different"
Sometimes it genuinely is.
But almost every project can explain why it is special.
Ignoring historical base rates because:
Our team is different.
can be dangerous.
The Bayesian question is:
How much evidence do we actually have that this case differs from the reference class?
Use ranges rather than single values
Instead of:
Project will take 12 months.
estimate:
- 10th percentile,
- median,
- 90th percentile.
For example:
10% chance completed by 9 months
50% chance by 12 months
90% chance by 18 months
This forces us to acknowledge uncertainty.
Consider the opposite
If you strongly believe something, ask:
What evidence would I expect to see if I were wrong?
This can reduce confirmation bias.
Rather than looking only for evidence supporting the current hypothesis, actively search for disconfirming evidence.
This is closely related to Bayesian reasoning.
Confirmation bias
Humans tend to notice or seek evidence that supports what we already believe.
Evidence against the belief may receive less attention.
A strong prior can therefore become self-reinforcing.
Good Bayesian reasoning requires updating in both directions.
Prediction systems can create confirmation loops
Suppose an algorithm predicts:
User likes political content.
It shows more political content.
The user clicks some.
The system interprets this as confirmation.
But the model itself shaped the evidence.
Human confirmation bias can become automated confirmation bias.
Use independent evidence
If five reports all come from one original source, they should not be treated like five independent confirmations.
Likewise, multiple sensors sharing one failure mode should not create false confidence.
This simple habit improves probabilistic reasoning enormously:
Ask whether the evidence sources are genuinely independent.
Separate probability from consequence
Humans often combine them emotionally.
A terrible outcome can feel more likely simply because it is frightening.
A desirable outcome can feel more likely because we want it.
Try to separate:
How likely is this?
from:
How good or bad would it be?
Then combine them explicitly during decision-making.
Wishful thinking
Suppose a company desperately needs a product launch to succeed.
People may unconsciously increase their estimate of success probability.
This is wishful thinking.
Preferences should not change probability estimates unless they change the underlying process.
Pessimism can distort probability too
Someone anxious about an outcome may overestimate its likelihood.
The emotional significance of an event is not evidence about its probability.
Separating:
belief
from:
preference or fear
is an important probabilistic discipline.
Communicate frequencies when possible
Compare:
0.1% probability.
with:
About 1 in 1,000 comparable cases.
The second may be easier to understand.
For repeated systems, natural frequencies often make consequences clearer.
Show both probability and exposure
Instead of:
Error rate = 0.01%.
say:
About 1 error in 10,000 outputs; at 100 million outputs this would correspond to roughly 10,000 errors if the rate remains stable.
Now the probability is connected to scale.
Show both centre and range
Instead of:
Demand forecast = 40 GW.
say:
Expected demand is 40 GW, with most plausible outcomes between 36 and 45 GW.
This prevents the point estimate from being mistaken for certainty.
Show what would change the belief
A good probabilistic statement can include:
Current probability is 30%. If new evidence X appears, I would revise it upward; if Y appears, downward.
This makes the reasoning updateable.
It also makes hidden assumptions visible.
AI interfaces should support probabilistic literacy
An intelligent system should ideally help users understand:
- what is known,
- what is uncertain,
- what evidence supports the prediction,
- how confidence changes.
Simply presenting:
97.3%
may create more confusion than understanding.
The service should communicate uncertainty in a form appropriate to the decision.
Too much uncertainty information can overwhelm users
There is a design challenge.
A probabilistic model may contain:
- distributions,
- confidence intervals,
- calibration metrics.
Most users cannot process all of this for every decision.
The interface needs to simplify without creating false certainty.
That is another service-design problem.
Different users need different representations
A statistician may want:
full predictive distribution.
A doctor may want:
risk range + key evidence.
A driver may only need:
BRAKE NOW.
The underlying uncertainty can be complex while the final interface remains simple.
But simplification should be deliberate.
Decisions can be simple even when probabilities are complicated
Suppose an autonomous vehicle internally maintains:
- distributions over pedestrian position,
- velocity,
- intent.
The passenger does not need to see them.
The service may simply slow down.
Good design separates:
complex internal uncertainty representation
from:
appropriate user-facing action.
Human intuition is still valuable
Probability models are not perfect.
Human beings can sometimes recognise:
- unusual context,
- model failure,
- missing variables.
An experienced engineer may say:
The numbers look fine, but something is wrong.
That intuition can contain valuable tacit knowledge.
The goal is not to discard intuition.
It is to test it against evidence.
The strongest systems combine intuition and calibration
Human intuition can generate:
- hypotheses,
- warnings,
- explanations.
Probability provides discipline:
- How likely?
- Compared with what base rate?
- How confident are we?
- What evidence would change our mind?
The two approaches can complement one another.
The wider lesson
Humans are not bad at probability because we are unintelligent.
We evolved to make fast decisions from:
- small samples,
- direct experiences,
- vivid events.
Modern society asks us to reason about:
- millions of observations,
- tiny probabilities,
- correlated systems,
- long time horizons,
- algorithmic predictions.
Those problems require tools our intuition alone is poorly suited to solve.
Probability is a technology for thinking
Probability is not merely a branch of mathematics.
It is a tool for correcting predictable weaknesses in human reasoning.
It helps us distinguish:
possible
from:
probable.
anecdote
from:
base rate.
one outcome
from:
a distribution.
confidence
from:
certainty.
luck
from:
evidence of skill.
Ask yourself probabilistic questions
When making an uncertain judgement, ask:
- What is the base rate?
- What is the reference class?
- How large is the sample?
- Am I overweighting a vivid example?
- Am I treating a possibility as though it were likely?
- Am I ignoring cumulative exposure?
- Are the events independent?
- Am I seeing a pattern in randomness?
- Am I judging the decision using hindsight?
- Am I too confident?
- What evidence would make me change my mind?
- What happens if my probability estimate is wrong?
These questions do not eliminate bias.
They make it easier to detect.
The central idea
Humans experience:
individual outcomes.
Probability describes:
distributions across possible outcomes.
That gap makes probabilistic reasoning difficult.
We naturally:
- seek patterns,
- construct stories,
- react to vivid events,
- underestimate uncertainty,
- ignore base rates.
Formal probability gives us tools for correcting those tendencies.
The progression of this module is therefore:
UNCERTAINTY
↓
PROBABILITY
↓
RANDOM VARIABLES
↓
DISTRIBUTIONS
↓
EXPECTED VALUE
↓
VARIANCE
↓
CONDITIONAL PROBABILITY
↓
BAYESIAN UPDATING
↓
CALIBRATION
↓
RISK + TAILS
↓
BETTER JUDGEMENT
The goal is not to become perfectly rational probability calculators.
It is to develop a better habit of thought:
Do not ask only what happened, what seems plausible, or what feels likely. Ask what the possible outcomes are, what evidence supports each, how uncertain we are, and what would make us change our mind.
That gives us the mathematical foundation we need for the next stage of the course.
We can now ask a more ambitious question:
Given data from the past, how can a machine learn patterns that help it predict something it has not seen yet?
That is where machine learning begins.