Need Support?
Misinformation, Online Security and More
Generative AI tools can indeed make life and work a lot easier! Like any tool, however, there are many things to consider before using generative AI. You are responsible for educating yourself on the ethics of any AI you use and understanding the risks when you are permitted to use it.
Click the 
icon to enlarge the H5P activity.
Misinformation
Since Gen AI is trained on real-world data, text, and media from the internet, the content it provides to users may be misleading, factually inaccurate, or outright misinformation (like deep fakes, for example). The information provided may be implicitly or explicitly biased, outdated, or a “hallucination.”
AI hallucination: Gen AI fabricating sources of information even though it is meant to be trained on real-world data (Gonzales, 2023). IBM (n.d.) examines the various causes of AI hallucinations, indicating that common factors include “overfitting, training data bias/inaccuracy and high model complexity.”
Examples (IBM, n.d.):
- Google’s Bard chatbot incorrectly claimed that the James Webb Space Telescope had captured the world’s first images of a planet outside our solar system.
- Microsoft’s chat AI, Sydney, admitted to falling in love with users and spying on Bing employees.
- Meta pulled its Galactica LLM demo in 2022 after it provided users with inaccurate information, sometimes rooted in prejudice.
You must examine output critically. For more information on evaluating Gen AI output, visit the Gen AI and Research section.
Online Security and Privacy
Staying safe online does not just apply to social media and password protection. Generative AI is trained on shared data and inputs gathered from users and around the internet. Read more for examples of how various Gen AI tools collect and use your data.
Sign into Copilot using your Conestoga credentials to ensure your data and privacy remain secure.
Data Collected by Bing Chat/Copilot when Using a Personal Account
- Bing Chat collects user data, including prompts and chat interactions.
- In the Edge browser’s sidebar, it gathers data from content loaded in the browser, such as PDFs.
- Data is shared with Microsoft affiliates and subsidiaries.
- Data may be shared with 3rd parties such as OpenAI.
- Data is processed and stored outside Canada.
How Privacy is Affected when Using a Personal Account
- IP Addresses are stored for six months and other identifiers for up to 18 months.
- Users may not be able to delete this data.
- Authentication is unnecessary, so users can use this without logging in.
ChatGPT collects information/data from users via the following points:
Registration: Registering for a ChatGPT account requires users to provide their name, email address, and birthday. OpenAI's Privacy Policy [opens a new tab] states that your personal information may be shared with third parties without further notice to you. Data is stored outside Canada.
Prompts/Forms: Users interact with ChatGPT by asking questions, writing prompts, or uploading files. Do not upload, input, or disclose any personal information. Do not upload, input, or disclose any information that should not be made public.
Training Data: OpenAI uses data to train ChatGPT on how to respond. This includes anything you write or upload to ChatGPT, so you should not input any information you would not want to be made public. Learn how to opt out of having your data used for training [opens a new tab].
This section is adapted from Teaching with Generative AI LibGuide by BCIT Library Services, licensed CC BY-NC. Adaptations include rewording and condensing.
Bias and Discrimination
One may think that technology is objective and neutral. Generative AI, however, is trained on real-world data and information, such as images and text scraped from the internet. This information is rife with human biases.
AI Bias: "also referred to as machine learning bias or algorithm bias, refers to AI systems that produce biased results that reflect and perpetuate human biases within a society" (IBM Data and AI Team, 2023). Some common biases include gender stereotypes and racial discrimination.
Examples (Heaven, 2023):
- "[C]hatbots and image generators tend[ing] to portray engineers as white and male and nurses as white and female.
- Black people risk being misidentified by police departments' facial recognition programs, leading to wrongful arrest.
- Hiring algorithms favour[ing] men over women, entrenching a bias [the hiring algorithms] were sometimes brought to address."
- Researchers at the University of Washington looked at the ability of AI and Gen AI to assist those with disabilities. While there were benefits, there were also concerns with content accuracy and content promoting ableist attitudes (Milne, 2023).
AI Makes Mistakes, Too
Poet Joy Buolamwini shares "AI, Ain't I A Woman" - a spoken word piece that highlights how artificial intelligence can misinterpret the images of iconic black women: Oprah, Serena Williams, Michelle Obama, Sojourner Truth, Ida B. Wells, and Shirley Chisholm.
This spoken word piece was inspired by Gender Shades, a research investigation that uncovered gender and skin-type bias in facial analysis technology from leading tech companies.
Read more on MIT's Black History Archive.
Attribution:
"Like all of us, AI makes mistakes" from Artificial Intelligence Guide by Bronte Chiang, reused under a CC BY 4.0 International License.
Try It with the Most Likely Machine!
Get hands-on experience with algorithm bias in this quick activity by The Artefact Group. Who will win the awards at Millennium Middle School? Will your predictions on the award winners align with the algorithm used by the Most Likely Machine to pick the winners?