Prompt Coaching for Inclusiveness: A Media Literacy Approach to Increase Users’ Awareness of Algorithmic Bias and Prompting Efficacy

Prompt Coaching for Inclusiveness: A Media Literacy Approach to Increase Users’ Awareness of Algorithmic Bias and Prompting Efficacy

Chen, C., Mengqi (Maggie) Liao, Phadnis, A., Li, Y., High, A., Abdullah, S., & Sundar, S. S. (2026). “Prompt Coaching for Inclusiveness: A Media Literacy Approach to Increase Users’ Awareness of Algorithmic Bias and Prompting Efficacy,” in Proceedings of the 2026 CHI Conference on Human Factors in Computing Systems (CHI ’26), April 13–17, 2026, Barcelona, Spain. ACM, New York, NY, USA, 16 pages*. https://doi.org/10.1145/3772318.3791542   *Honorable mention (top 5% of the accepted papers)  Abstract: Large language models often produce biased or stereotypical outputs. One way to reduce this possibility is to be more inclusive in our prompts, but doing so may not come naturally to most users. Therefore, we designed a tool that coaches users to write more inclusive prompts—a strategy that leverages design friction to provide a media literacy intervention. Data from a user study (N=344) show that compared to no coaching, inclusive prompt coaching directly increased users’ awareness of algorithmic bias and their perceived prompting efficacy. It also indirectly enhanced their trust in the system and perceived trust calibration through cognitive elaboration. However, inclusive prompt coaching resulted in a less satisfying user experience. These findings have implications for ethical interventions in prompting for better communicating and combating algorithmic bias. We discuss the benefits and limitations of inclusive prompt coaching, as well as ways to balance usability for long-term adoption of generative AI systems.

Related Research