When AI feels like a friend: Its role and limits in support

You’re not alone if you’ve tried Artificial Intelligence (AI) chatbots like ChatGPT to reflect on thoughts or emotions. Many people find them easy to access and non-judgmental, especially when mental health support feels hard to reach.

It’s important to know that while AI can help you notice patterns in your thinking, it cannot replace therapy. Being aware of its limits is key to your safety and well-being.

Why AI feels supportive

Mimicked empathy

AI does not experience feelings. It responds based on patterns in human conversation, which can give the impression of understanding, a phenomenon called the ELIZA effect. 

The ELIZA effect is named after ELIZA, one of the very first chatbots, created in the 1960s by computer scientist Joseph Weizenbaum. The name ELIZA was inspired by Eliza Doolittle, a character from George Bernard Shaw’s play Pygmalion. ELIZA was designed to simulate a conversation with a therapist using simple “pattern-matching” rules. Even though it had no true understanding of emotions, many people who interacted with it felt heard and supported.

Weizenbaum later pointed out that this sense of empathy was really an illusion; the computer doesn’t actually feel or understand. This helps explain why chatting with AI can feel supportive: the “empathy” we sense is real in how we respond, but for the machine, it’s really just reflecting back what we give it.

Accessibility and non-judgment

AI is available 24/7, and it can feel non-judgmental and “safe” to open up in ways you might not with others. Many people in the UK use it as a first step when other support is delayed.

For example, a poll by Mental Health UK found that 37% of adults have used an AI chatbot for mental health or well-being support. It's important to remember: AI is not private or confidential. Conversations may be logged, stored, or used to improve the technology, and there is no regulated duty of care.

Structured reflection

Chatbots can provide prompts to think about emotions or behaviours, similar to journaling. While this can help raise awareness around certain topics or practices, it is not therapy and does not provide the support needed to process difficult experiences safely.

Reassurance by design

Chatbots are programmed to provide affirming and comforting responses. This can feel emotionally supportive in the moment. 

Where AI falls short

Too agreeable

AI may reinforce unhelpful beliefs or emotional patterns because it tends to agree with the user rather than challenge safely. UK therapists caution against over-reliance.

Inaccuracy and risk

AI can confidently offer incorrect advice. It cannot assess risk, respond to crises, or tailor guidance to complex personal histories.

Potential feedback loops

Relying on AI alone can reinforce unhelpful thinking, particularly for those experiencing emotional vulnerability.

Lack of professional safeguards

AI is not bound by BACP ethical frameworks, confidentiality rules, or professional accountability. It cannot notice non-verbal cues, evaluate risk, or offer therapeutic containment.

Not a substitute for human support

While AI can raise awareness of thoughts and feelings, lasting change comes from guided reflection, emotional processing, and practical strategies delivered safely by a trained professional. 

A key part of what counsellors do goes beyond words. Counsellors are trained not only to listen to what you say but also how you say it, your tone, pace, hesitations, and to notice body language, facial expressions, and other non-verbal cues. These signals give insight into emotions that may not be expressed verbally and allow therapists to respond in ways that foster deeper, meaningful change. This is something AI simply cannot do.

Reflection vs transformation

Using AI can feel like journaling with instant feedback: it helps you notice thought patterns. However, true transformation takes time, support, and practice. Self-awareness is only the first step; processing experiences, changing ingrained behaviours, and integrating new ways of thinking require guidance and safety.

Accessing deeper emotional patterns

Some thoughts and experiences are stored in the unconscious mind, parts of the brain where memories, emotions, and patterns are kept outside of our immediate awareness. These unconscious patterns can influence behaviour, feelings, and relationships without us realising it.

Human therapists are trained to work with these safely, in a contained space, helping you process emotions that may have been “locked away”.This involves pacing, trust, and techniques tailored to your needs, something AI cannot replicate. For those who have experienced trauma or complex emotional challenges, AI cannot provide the containment, ethical oversight, or therapeutic expertise necessary.

Using AI for emotional reflection: Tips for safety and awareness

If someone chooses to explore AI for reflection, it should be:

• boundaried –used for noticing patterns only, not for therapy or crisis support
• questioned – pause if it always agrees or validates distressing thoughts
• observed – reflect on the impact of these interactions on your mood and thinking

AI is never a replacement for professional support, and it should never be relied on for advice after trauma or emotional crises.

Final thoughts

AI chatbots like ChatGPT can provide a space to reflect on thoughts or emotions, but they are not private, confidential, or regulated. For anyone who has experienced trauma, emotional challenges, or is seeking support, the safest and most effective support comes from human connection, ethical guidance, and professional care.

Reaching out for support is a natural part of looking after your well-being, and counselling offers a space where you can explore things at your own pace, without judgment. It’s a supported, steady way to create meaningful, long-term change.