Young people's perceptions and recommendations for conversational generative artificial intelligence in youth mental health

2026-04-14

AI Summary

This study addresses the insufficient consideration of youth-specific needs in the current design and deployment of generative conversational AI for mental health services. Through an online co-design workshop and in-depth interviews with 32 young users, the research systematically identifies four core user requirements for mental health AI: humanized interaction, algorithmic transparency, contextual adaptability, and personalized safety mechanisms. By deeply integrating user perspectives into the full lifecycle of AI ethics, design, and governance, the study offers actionable recommendations tailored to real-world service contexts—exemplified by the chatbot Mia—and provides both theoretical grounding and practical guidance for developing youth-friendly mental health AI systems.

Technology Category

• Humans and AI: Intelligent User Interfaces
• Philosophy and Ethics of AI: Safety, Robustness & Trustworthiness
• Machine Learning: Ethics, Bias, and Fairness

Application Category

• User Modeling, Personalization and Recommendation: Accountability, Transparency, and Ethics for personalization
• Responsible Web: Machine-in-the-loop, human agency and autonomy
• Social Networks and Social Media: Generative AI / large language models and their impact on social systems

Abstract

Conversational generative artificial intelligence agents (or genAI chatbots) could benefit youth mental health, yet young people's perspectives remain underexplored. We examined the Mental health Intelligence Agent (Mia), a genAI chatbot originally designed for professionals in Australian youth services. Following co-design, 32 young people participated in online workshops exploring their perceptions of genAI chatbots in youth mental health and to develop recommendations for reconceptualising Mia for consumers and integrating it into services. Four themes were developed: (1) Humanising AI without dehumanising care, (2) I need to know what's under the hood, (3) Right tool, right place, right time?, and (4) Making it mine on safe ground. This study offers insights into young people's attitudes, needs, and requirements regarding genAI chatbots in youth mental health, with key implications for service integration. Additionally, by co-designing system requirements, this work informs the ethics, design, development, implementation, and governance of genAI chatbots in youth mental health contexts.

Problem

• conversational generative AI
• youth mental health
• user perspectives
• AI ethics
• co-design

Innovation

• co-design
• generative AI
• youth mental health
• human-centered AI
• AI ethics