Why AI can be biased
AI tools learn patterns from very large collections of text, images and other material made by people. Whatever is common in that material becomes common in the tool's answers, and whatever is rare or missing becomes rare or missing. This does not mean anyone built the tool to be unfair. It means the tool reflects what it learned, including stereotypes and gaps. Terms such as training data are explained in the glossary.
What bias can look like
- Stereotypes: assumptions about who does certain jobs, who is a leader or what a family looks like.
- Who is represented: some groups, regions and languages appear far more often than others.
- Whose perspective is common: answers may lean toward the viewpoints most often published online.
- Thin or wrong local context: Canadian history, Indigenous peoples, cultures and knowledge, and local places may be missing, oversimplified or mistaken. A tool may default to another country's examples.
This applies to images as well as text. See Should students use AI image generators in class?
The Scrutinize It pillar
The WISE pillar Scrutinize It says that confident does not mean correct. Bias is a good reason why. An answer can sound smooth and balanced while leaving out important voices. Teaching students to scrutinize means asking not only "Is this true?" but also "Who is missing?" Fact checking is covered in why AI makes things up and how students catch it.
What teachers can do
- Notice. Read AI output for assumptions, missing groups and generic examples.
- Test. Ask the same question in several ways and compare the answers. Change one detail and see what changes.
- Ask whose perspective is missing. Make this a standing question for students.
- Verify with Canadian and local sources. For anything about Canada, Indigenous peoples or your community, use trusted sources, and where appropriate, community voices and Indigenous-authored materials.
- Do not treat answers as neutral. Say aloud that every source has a point of view, including AI.
Keep the tone curious and respectful. The goal is skilled readers, not suspicion of everything.
A short classroom activity: compare and ask
This takes about 30 minutes and works with students in the upper elementary grades and above.
- Choose a neutral topic, such as "describe a typical day for a family in Canada" or "write a short story about a scientist".
- Small groups each write the prompt slightly differently.
- Groups compare the answers: Who appears? What is assumed? What is left out?
- Each group then checks one claim or detail against a Canadian or local source.
- The class discusses: Whose perspective is missing? How would we rewrite the prompt, or the answer, to fix it?
Do not enter student information during the activity.
Bias and assessment
Fairness concerns grow when AI touches decisions about students. That is one reason to be cautious about AI in marking. See Should teachers use AI to grade work or give feedback?
Quick answers
Can a better prompt remove bias?
A careful prompt can reduce some problems, but it cannot guarantee a balanced answer. Students still need to read critically and check other sources.