Recent searches

No recent searches

Search options

Only available when logged in.
sigmoid.social is one of the many independent Mastodon servers you can use to participate in the fediverse.
A social space for people researching, working with, or just interested in AI!

Administered by:

Server stats:

597
active users

sigmoid.social: AboutProfiles directoryPrivacy policy

Mastodon: AboutGet the appKeyboard shortcutsView source codev4.4.1

#not

5 posts5 participants0 posts today
Hacker News

LLMs should not replace therapists

arxiv.org/abs/2504.18412

arXiv logo
arXiv.orgExpressing stigma and inappropriate responses prevents LLMs from safely replacing mental health providersShould a large language model (LLM) be used as a therapist? In this paper, we investigate the use of LLMs to *replace* mental health providers, a use case promoted in the tech startup and research space. We conduct a mapping review of therapy guides used by major medical institutions to identify crucial aspects of therapeutic relationships, such as the importance of a therapeutic alliance between therapist and client. We then assess the ability of LLMs to reproduce and adhere to these aspects of therapeutic relationships by conducting several experiments investigating the responses of current LLMs, such as `gpt-4o`. Contrary to best practices in the medical community, LLMs 1) express stigma toward those with mental health conditions and 2) respond inappropriately to certain common (and critical) conditions in naturalistic therapy settings -- e.g., LLMs encourage clients' delusional thinking, likely due to their sycophancy. This occurs even with larger and newer LLMs, indicating that current safety practices may not address these gaps. Furthermore, we note foundational and practical barriers to the adoption of LLMs as therapists, such as that a therapeutic alliance requires human characteristics (e.g., identity and stakes). For these reasons, we conclude that LLMs should not replace therapists, and we discuss alternative roles for LLMs in clinical therapy.
#HackerNews#LLMs#should
Replied in thread
atticus1956

@GottaLaff

Yeah, sure, right…. I believe! A ceasefire agreement between 3 of the most trustworthy(??) people on the planet earth … (Ali Khamenei, Bibi, & Donny) #NOT

Have we heard from anyone besides Trump?

Apologies for being a doubting Thomas, but history can’t be ignored.

TrendingLive feeds
About