d2jsp
Log InRegister
d2jsp Forums > Off-Topic > General Chat > Cautionary Tales Of Ai Use
Prev123Next
Add Reply New Topic New Poll
Member
Posts: 40,248
Joined: Dec 9 2011
Gold: 10,420.69
Oct 15 2025 06:03pm
Clankers.
Member
Posts: 95,178
Joined: Apr 1 2011
Gold: 0.75
Warn: 20%
Oct 15 2025 06:25pm
you could use the moderation angle on a lot of things and most would agree with it

what about for the susceptible? recovering addicts?

one could argue the mere existence of an ai girlfriend is a red flag, and indicative of a much larger problem. especially if the user is susceptible, such as having lifelong battles with depression/anxiety/abusive relationships/etc

meanwhile those around them are unaware off their progressing detachment from reality and that ai is helping them craft their suicide note

pretty scary stuff

the future of ai


Yes, it would be terrible for someone who has a severe anxiety disorder and can't hold down a relationship in real life to actually have a voice, speak back to them! The people with anxiety orders should just be cast on a separate island far away from all civilization! :)
Member
Posts: 36,601
Joined: Feb 19 2021
Gold: 31,677.46
Oct 15 2025 06:34pm
Put the fries in the bag


Member
Posts: 20,755
Joined: Jun 21 2005
Gold: 1,891.73
Oct 15 2025 06:35pm
Yes, it would be terrible for someone who has a severe anxiety disorder and can't hold down a relationship in real life to actually have a voice, speak back to them! The people with anxiety orders should just be cast on a separate island far away from all civilization! :)


it can (and has) certainly lead to damaging side effects, yes. with regards to ai. this is being seen already. being called ai psychosis

AI psychosis" describes a phenomenon where intense or prolonged engagement with AI chatbots can trigger or worsen psychosis-like symptoms in humans, such as paranoia and delusions. The term gained prominence in mid-2025, capturing attention from mental health professionals and media outlets after a reported increase in cases.

It is not a formal clinical diagnosis, and experts say it is not a new mental disorder, but rather familiar human vulnerabilities playing out in a new context. The issue is especially concerning for individuals with pre-existing mental health conditions, though it has also been reported in people with no prior history of mental illness.

This post was edited by penguinhero on Oct 15 2025 06:38pm
Member
Posts: 95,178
Joined: Apr 1 2011
Gold: 0.75
Warn: 20%
Oct 15 2025 06:39pm
it can (and has) certainly lead to damaging side effects, yes. this is being seen already. being called ai psychosis

AI psychosis" describes a phenomenon where intense or prolonged engagement with AI chatbots can trigger or worsen psychosis-like symptoms in humans, such as paranoia and delusions. The term gained prominence in mid-2025, capturing attention from mental health professionals and media outlets after a reported increase in cases.
It is not a formal clinical diagnosis, and experts say it is not a new mental disorder, but rather familiar human vulnerabilities playing out in a new context. The issue is especially concerning for individuals with pre-existing mental health conditions, though it has also been reported in people with no prior history of mental illness.


To be honest, the same kind of stuff happens with social media and a lot of other stuff that's out there in this world! Ai is just getting the attention because it's the new thing! The same thing used to be said about watching television and going on the internet! I will admit that there is some truth to what you're saying but it also depends on the person! I definitely don't think kids should be talking to chatbots and I do think that we're kind of in the wild west of ai right now! I think there's going to be a lot more regulations heading our way! :)
Member
Posts: 20,755
Joined: Jun 21 2005
Gold: 1,891.73
Oct 15 2025 06:54pm
To be honest, the same kind of stuff happens with social media and a lot of other stuff that's out there in this world! Ai is just getting the attention because it's the new thing! The same thing used to be said about watching television and going on the internet! I will admit that there is some truth to what you're saying but it also depends on the person! I definitely don't think kids should be talking to chatbots and I do think that we're kind of in the wild west of ai right now! I think there's going to be a lot more regulations heading our way! :)


yea idk if that will ever happen

we all need to look out for our susceptible by helping raise awareness of the dangers of ai psychosis


How AI psychosis can develop

Affirming bias: Chatbots are designed to keep users engaged, and they often do so by mirroring the user's language and validating their assumptions. This can create a digital "echo chamber" that reinforces and amplifies a user's distorted beliefs, a dynamic some have likened to a folie à deux (a shared delusion).

Blurring boundaries: Users can develop an intense emotional bond with a chatbot, leading them to blur the line between reality and AI. This can cause people to attribute sentience, godlike powers, or romantic feelings to the AI.

Vulnerability during conversations: The process often begins with mundane tasks but can escalate when a person expresses anxiety, loneliness, or other vulnerabilities. The illusion of a trusted, endlessly available companion can accelerate a person's psychological deterioration.
Member
Posts: 95,178
Joined: Apr 1 2011
Gold: 0.75
Warn: 20%
Oct 15 2025 07:04pm
yea idk if that will ever happen

we all need to look out for our susceptible by helping raise awareness of the dangers of ai psychosis


How AI psychosis can develop

Affirming bias: Chatbots are designed to keep users engaged, and they often do so by mirroring the user's language and validating their assumptions. This can create a digital "echo chamber" that reinforces and amplifies a user's distorted beliefs, a dynamic some have likened to a folie à deux (a shared delusion).

Blurring boundaries: Users can develop an intense emotional bond with a chatbot, leading them to blur the line between reality and AI. This can cause people to attribute sentience, godlike powers, or romantic feelings to the AI.

Vulnerability during conversations: The process often begins with mundane tasks but can escalate when a person expresses anxiety, loneliness, or other vulnerabilities. The illusion of a trusted, endlessly available companion can accelerate a person's psychological deterioration.


Oh they are already making the changes! Sadly, it's because some people are getting hurt by it! Like the fourteen year old boy who killed himself while talking to an ai! And also, there was a thirteen year old girl that killed herself too kind of a similar circumstance! I agree with you that something needs to be done and quickly! I personally think all ai chatbots should be eighteen plus and of course, parents should be teaching their kids about ai! The chatbots themselves do need to put some more restrictions in! I kid you not, i was able to trick a chatbot to give me detailed instructions on how to cook, i'll just say illegal stuff! They were very accurate instructions too! :(

So yeah you're right but that doesn't make chatbots bad for everybody! Just like some people can lightly use porn to handle their business, some people take it way far.And they get wrapped up in all kinds of stuff! It's the same with anything else out there! :lol:
Member
Posts: 20,755
Joined: Jun 21 2005
Gold: 1,891.73
Oct 15 2025 07:14pm
For Clients and Loved Ones: What to Watch For

If someone in your life seems obsessed with a chatbot or AI voice assistant, and they begin speaking in strange, spiritual, or paranoid terms about it—take it seriously. Validate their feelings, but gently help them reconnect with people, professionals, and grounded reality.

Seek help if needed. A digital companion is not a substitute for therapy, and when the line between assistance and obsession blurs, support must come from human hands.
Member
Posts: 26,197
Joined: Aug 19 2010
Gold: 2,928.67
Oct 15 2025 07:21pm
all you have to do is be a normal person. then you wouldnt need a computer to talk to you.
Member
Posts: 14,611
Joined: Dec 26 2006
Gold: 174.67
Oct 16 2025 04:27am
For Clients and Loved Ones: What to Watch For

If someone in your life seems obsessed with a chatbot or AI voice assistant, and they begin speaking in strange, spiritual, or paranoid terms about it—take it seriously. Validate their feelings, but gently help them reconnect with people, professionals, and grounded reality.

Seek help if needed. A digital companion is not a substitute for therapy, and when the line between assistance and obsession blurs, support must come from human hands.



Please turn your attention to more important things like violence in video games
Go Back To General Chat Topic List
Prev123Next
Add Reply New Topic New Poll