Use of emotional AI needs closer monitoring

Editor's note: As emotional artificial intelligence grows more powerful and expands into a wider range of domains, its impact on psychological development, emotional cognition and even the private lives of youth has become a social issue. Guangming Daily spoke to Lyu Xiaokang, a professor in the School of Sociology at Nankai University; Gan Yiqun, a professor in the School of Psychological and Cognitive Sciences at Peking University; Ding Ruyi, an associate professor in the Department of Psychology at Sun Yat-sen University; and Wang Dongmei, an associate professor in the School of Social and Behavioral Sciences at Nanjing University. Below are excerpts of the interview. The views don't necessarily represent those of China Daily.

Emotional AI can recognize, interpret and simulate human emotions through text, voice, facial expressions and other signals. It responds with adaptive interaction styles, creating a more natural and human-centered experience. While such systems do not truly possess emotions, they can mimic emotional understanding with remarkable consistency by offering instant responses, tireless companionship and nonjudgmental support. These features have made emotional AI especially appealing to younger users.

This appeal is closely tied to the developmental characteristics of youth. Young people often seek autonomy, validation and emotional connection, yet may lack fully developed communication skills or emotional regulation abilities. At the same time, they face academic, professional and social pressures, while experiencing a transitional phase in which family bonds loosen but stable peer or romantic relationships are not fully developed.

Emotional AI fills this gap by providing accessible and low-pressure emotional support. Moreover, as digital natives, younger generations are more open to experimenting with such tools, sometimes even forming communities around shared usage.

The rise of emotional AI is embedded in deeper structural changes. In an increasingly digital and individualized society, intimate relationships are becoming more mediated, controllable and low-risk. Meanwhile, emotional expression itself is increasingly shaped by market logic. Against this backdrop, emotional AI offers a seemingly stable and low-cost alternative, helping to fill what might be described as an "emotional vacuum" in contemporary life.

The psychological impact of emotional AI is complex and layered. On the positive side, it can serve as an accessible first line of emotional support, offering early intervention, basic psychological education and a safe space for self-reflection. It can also function as a training ground for social interaction, helping individuals practice communication skills and build confidence before engaging in real-life relationships. In addition, its ability to track and analyze emotional patterns may encourage more proactive approaches to mental health.

However, overreliance on simplified and conflict-free interactions with AI may weaken young people's ability to navigate the complexities of real relationships. Since AI-generated empathy is based on pattern recognition rather than genuine experience, prolonged usage may distort emotional development or limit the growth of authentic empathy.

Emotional AI should be guided by a clear principle which is strengthening, rather than replacing, human emotional agency. This requires thoughtful design, industry standards and public oversight to ensure such systems remain transparent, user-controlled and oriented toward empowerment. They should help individuals better understand and manage their emotions, and engage more meaningfully in real-world relationships.

The division of roles between humans and machines is important. Emotional AI should function as a tool for emotional monitoring, early support and learning, while deeper needs such as value formation and lasting relationships should remain rooted in real human connections and professional support systems.