In general, I agree that chatbot content should be forbidden.
I am also aware that detecting chatbot content isn't always easy - there are bound to be false positives and false negatives.
As I have flagged several posts as chatbot content myself, I hope that I haven't gotten any innocent parties suspended. I try to be certain before I flag such content, and I'm sure the moderators do their best to verify it before they hit "suspend," but we are all fallible human beings.
What recourse does an innocent user have if they receive this message in error:
You have recently been detected as posting AI-generated (e.g. ChatGPT) content on Stack Exchange. This is neither good community citizenship, nor is it what we expect of our users.
Considering there have been warnings about the disruptiveness of this behavior all over the Stack Exchange Metas, we feel there's sufficient warnings about the inappropriateness of this.
Also this behavior counts as plagiarism since you did not (and cannot) cite & reference the original sources used by the AI to generate that content.
Do not post AI-generated content again. Your account has been temporarily suspended for 30 days.
I have the impression (from looking around other Meta sites) that there is supposed to be a link in (or with) that message that should lead to a place to request a review of the suspension, but I have not seen the message itself, nor do I know what it looks like when it pops up. I also do not know if the message is somehow linked into the user profile so that the user can review it and take needed actions.
I ask this question because I am in personal contact with a user who received the above message. This person swears to have never posted a chatbot based answer.
One possibility that I see is that this person is not a native English speaking person. The somewhat stilted translation from that person's native language (German) to English may have resulted in a text that "looks" somewhat "chatbotish."
While the available chatbot detectors seem to work, I know that they also make mistakes.
I've fed some of my own answers to a few of the chatbot detectors. They usually come back as more than 90 percent certain that they were written by a human, but they have flagged individual passages as "chatbot output" - and I know that I wrote that text. Such "chatbot" passages are usually where I stop the explanations and make a simple blanket statement that summarizes the explanation.