Overreliance occurs when an individual trusts an AI system's output without applying critical thinking, domain expertise, or independent verification. In this scenario, the merchandiser accepted Copilot's suggestions as fact and acted on them without reviewing them against other data sources like market trends, which is a direct example of this responsible AI risk. Human oversight is a critical safeguard against the potential inaccuracies or biases in AI-generated content.

A. verification: This is the process of checking for accuracy, which is what the merchandiser failed to do. It is the opposite of their action.

C. fabrication: This refers to the AI generating false or nonsensical information (hallucinating). While the AI's output might be flawed, the user's action is the focus here.

D. prompt injection: This is a security attack where a user crafts a prompt to make the AI bypass its safety features or intended functions, which is not what happened.

1. Microsoft. (2023). Microsoft Responsible AI Standard

v2. Section 4.2.1

"Human-AI interaction patterns

" discusses the risk of automation bias and overreliance

stating "Overreliance on the AI system can lead to an inability to detect or correct system errors."

2. Microsoft Learn. (2024). Identify responsible AI principles. In "Describe the capabilities of Microsoft Copilot for Microsoft 365

" Module 1. This module emphasizes the principle of "Accountability

" where users are accountable for the final output and should review AI-generated content.