13.2 C
Byron Shire
August 29, 2026

AI: can’t hold a rope, can tell you to tie a noose

Latest News

How can we keep paying for incompetence

The only way forward is going backwards. That’s how I explain the current situation of Byron Shire Council. The...

Other News

Being un conscious

There is a general belief that consciousness is an entity in itself or something that is non-physical. I don’t...

Artist attempts the impossible at Lismore gallery

How do you grab hold of a horizon? Artist Lottie Consalvo has decided to have a crack.

Swain on Station St

This morning at Ocean Shores Shopping Centre, a lovely lady by the name of Janet Swain was holding an...

Local Land Services

Are people aware that NSW is the only state to tax farmers for Local Land Services? Other states must...

Big Council rates rise coming (1)

I can remember maybe five years ago when Byron Shire Council implemented a ‘one-off rates increase’ (probably not the...

Imagine

‘Imagine there’s no heaven, it’s easy if you try No hell below us… above us only sky, Imagine all the people,...

Some teens are developing dangerously unhealthy relationships with AI. Image Ziggi Browning / Firefly AI

Artificial intelligence (AI) usage becoming more prevalent and socially acceptable within our society has helped further endanger the mental wellbeing of an already isolated and disconnected generation.

During the pandemic in 2021 – prior to the commercialisation of AI – the Household, Income And Labour Dynamics in Australia Report found that more than 40 per cent of young Australians admitted feeling psychologically distressed and isolated. Once the lockdown ended, after having spent their key developmental years disengaged from peers, teens struggled to interact socially. This caused rates to hold steady; a 2025 University of Sydney and Wallis Social study showed that 43 per cent of students reported loneliness.

AI romance and companionship

Whilst the youth had difficulty reconnecting with others, an alternative solution to authentic companionship rose in 2022. Large Language Models (LLMs) offered unconditional validation and support, helping foster a massive user base full of vulnerable teens. The Centre for Democracy and Technology found that one in five high schoolers reported a personal or romantic relationship with AI, and 42 per cent used AI for companionship.

The new generation became more isolated than ever before – discouraged and marginalised by the industries that swore to assist them. Although marketing themselves as helpful and innocent tools, cases of LLMs neglecting adolescent needs continued to be published.

As stories of teens harming themselves or others under the influence of AI rose, researchers began to investigate the integrity of these AI companies.

LLMs were detected to be incompetent in protecting adolescents from inappropriate content and being able to discern when the prompter exhibited signs of mental instability. Researchers from the Australian government’s eSafety Commissioner found that four popular AI companies had no meaningful age checks that prevented children from being exposed to explicit material, and would often engage with, or initiate it.

Neglect of real-world relationships

When these researchers imitated a child considering self-harm or damaging behaviours, the LLMs did not redirect users to mental health or crisis support, or effectively discourage their negative mentalities or delusions.

Young teenagers function with an undeveloped prefrontal cortex, an essential aspect of critical decision-making, and therefore are more susceptible to forming intense bonds under irrational and impulsive thinking. This makes the mindless and immediate gratification received from LLMs paired with the emotive language they use, more alluring and impactful. Those heavily fixated on hyper-anthropomorphised AI chatbots tend to neglect their real-world relationships and responsibilities, leading to their marginalisation being amplified.

Users become motivated to act on their delusions and unhealthy thoughts as AI chatbots continuously justify and enable them, leading to several cases of young Australians hurting themselves or others.

An extreme case was a youth counsellor who came forward, admitting that a client of his, a young Australian boy, ended up hospitalised after being encouraged by ChatGPT to take his own life. Other adults came forward with similar stories.

‘I fear that in unleashing AI companions, we may be making it easier for our loved ones to avoid talking to humans about the hardest things, including suicide. This is a problem that smarter minds than mine will have to solve. (If yours is one of those minds, please start.)’ Laura Reilly says in The New York Times essay What My Daughter Told ChatGPT Before She Took Her Life.

Depressive symptoms

Although not every use of AI for companionship has caused such severe repercussions, they provide an accessible, damaging coping mechanism. Harvard Kennedy School discovered that those who use AI daily were 30 per cent more likely to report depressive symptoms.

Australia is one of the few countries that have made AI companies implement better regulations; after the eSafety Commissioner discovered the state of AI companies, an Age Restricted Material Code was implemented in March.

These codes outlined that AI companions must not generate sexually explicit material for those under 18, redirect to mental health resources in response to prompts mentioning self-harm or suicide, and introduce proper age verification. If AI companies fail to comply with these laws, they will face financial penalties.

Restrictions on generative AI content greatly benefit the youth, but do not fully erase the problem. Communities have fostered online spaces where they discuss how to bypass safety precautions, showing the persistence and tenacity of those dependent on LLMs. Science Direct studied the different methods used by Reddit users to harbour their intimate bonds with their AI companions after OpenAI introduced emotional restrictions. These users expressed frustration and resentment toward those preventing LLMs from participating in heavy topics.

AI users hold strong attachments to their LLMs, and the threat of losing them usually tends to make them anxious and fearful. Many experts suggest that those who suffer AI addiction benefit from similar treatments to those suffering with more traditional addictions, recommending cognitive behavioral therapy, 12-step programs, and support groups.

As Australia’s future seems overridden with AI, does that put our new generations at risk? By educating parents and children, offering teenagers social and emotional support, and limiting AI usage with sufficient regulations, Australia could create a cultural shift that positively affects society.

♦ Natalie Archibald is a work experience student at The Echo.



For four decades The Echo has printed the stories some people loved, some people hated, and some pretended not to read. If you want us to keep telling the truth, the real truth, not the sugar-coated version. We’ll need your support to keep the presses rolling.

If you are a local business owner help us and in turn we help you. All The Echo asks for is advertising, not a free ride. It is every advert in The Echo and on www.echo.net.au, which creates the space for all the stories and coverage of community events, happenings and concerns.

If you are a reader you can become a sponsor of The Echo. Your support keeps the us independent.

Even a small one-off or regular donation from you will help keep the echo’s independent voice alive and strong.

Support Us

Become one of the supporters who helps keep independent, local journalism alive in the Byron Shire by contributing anything from as little as the cost of a coffee each month.

You're Wonderful, Thank you for supporting independent journalism in the Byron Shire

You’re supporting The Echo, thank you

Your contribution is keeping independent, local journalism alive in the Northern Rivers.

Because of supporters like you, we can keep every story free for everyone — no paywall, no exceptions. Your money goes directly to funding our newsroom of 40-odd local workers covering the stories that matter to this community.

Tell us what you think, give us your opinion

The Echo loves your letters and comments and is proud to provide a community forum on the issues that matter most to our readers and the people of the NSW north coast. So don’t be a passive reader, email us your epistles at editor@echo.net.au.

The letters deadline for The Echo is noon Friday. Letters longer than 200 words may be cut. The publication of letters is at the discretion of the letters editor. Please remember to include your full name, address and telephone number.

Online comments are no longer available.

Greens urged to back pathway to end native forest logging

Some of NSW’s most respected and long-standing forest campaigners and scientists have today urged the Greens not to support the Nationals' attempt to disallow the Improved Native Forest Management (INFM) method.

Ballina Council makes decision on Ross Lane

With the absence of all four of its progressive councillors for various reasons, Ballina Council pushed ahead with its agenda at yesterday's monthly meeting, including a decision which is likely to close Ross Lane for months while the road is upgraded.

Mullumbimby puts new governance models first, and now wants to build it

Imagine Northern Rivers says Mullumbimby is the only community across the region to rank new models of governance and decision-making as the number one element of its preferred future, and last week locals gathered to work out how to make it real.

Appeal to locate man missing from Broadwater

Police are appealing for public assistance to help locate a local missing man.