Comment Context Matters a Lot (Score 1) 60
Does not matter. If the machine claims it is a licensed therapist, this either has to stop or the machine has to be turned off.
Yes it does matter. If you watch a film and an actor in it says they are a medical doctor does that mean the actor deserves a lengthy prison sentence for claiming they are a doctor when they are not? Your approach would pretty much make the acting profession illegal. The difference between an actor and a scam artist is purely context: in a film or play we know that not everything we see is true so there is no intent to defraud, only to entertain.
Labelling AI chatbots in a way that makes it clear that their output is not always going to be true is all that is needed. It is then up to the user to decide whether that means they are still useful or not.