Report Users / Warning&Ban System | Voters

Report Users / Warning&Ban System

complete

braintacles

I keep flagging images from creators who violates the ToS but they keep generating illegal content that I have to report every day.
We should be able to report such users instead of going through each of their illegal pictures...
After a certain number of actioned reports, users should be banned.

May 28, 2023

This post was marked as

complete

Justin Maier

marked this post as

planned

We're working on adding the ability to report users now. Hope to have something soon :)

We've discussed a reputation system as well, but that's going to be further down the road.

A1322

I don't know if "actioned reports" means reports acted upon by moderators, as in a three strikes system, or a certain number of reports, regardless of moderator response (or lack thereof). Either way, this opens up possibilities of gaming in the reporting system to use as a tool of harassment.
In the first case, it encourages flooding reports in the hope that enough of them just happen to stick, pushing the targeted user towards the automatic ban threshold. More reports, more chances. Everyone loses.
The second case is even more obviously open to abuse, encouraging sockpuppets and all manner of other bad behavior. Adding criteria for who can participate in the report counter doesn't help. The system will still be gamed and new users will be disempowered. Every community that has tried something like this has suffered absolute disaster.
If the problem is sloppy or ineffective moderation, trying to create automated triggers to do the moderators' jobs for them is an incredibly self-destructive answer.

Nekos4Lyfe

I disagree.
If you report a user instead of the image,  then mods have to spend a lot of their time scrolling through the users feed to find the offending image/model (assuming it exists). 
Reporting an image isn't difficult to do.  Mods are people, not machines. 
They can make rational judgements if a single user is repeatedly violating TOS. 
For the same reason, I would advice against reporting every single image. Just send a single report and leave it at that. Add the subject to the blacklist and you will never have to worry about seeing that type of content again.

BunnyViking

that doesn't have to be how it works though. Reporting a user could require you to to give concrete examples. I mean you'd hope there's some backend tracking system that'd flag users automatically for having multiple TOS violations, maybe there is.

lekhang

Upvote. This is very important. Also we need a way to hide posts from certain users too.

jeszjesz

Bad news guys. The official response to the masses of child porn on the site is a personal email to me to ask me not to report so much of it. I kid you not. Shaking my head.

braintacles

jeszjesz: We wouldn't have to report so much of it if we could just report the problematic users....

jeszjesz

braintacles: Well apparently the people making child porn aren't the problem: we are

Civitai

jeszjesz:

Below is a screenshot of the email we sent you about your reporting. As we stated we love the passion that you're bringing to the table in your policing of the site, but not everything you're reporting is a TOS violation, I've included two example images you've previously reported as child abuse for context. The offer still stands if you'd like to get on a call so we can go over the content rules and review how we're determining if an item does indeed violate TOS.

warrensky

Civitai: based on what happens here, this report system could be abused by user like in this case for example

Tomas_Aguilar

Just give them the option to make certain users invisible or block users and bye, because each customer personalizes their tastes, I like the current policy.

Justin Maier

Tomas_Aguilar: Hey, you do actually have the ability to hide content from specific users :)

Right now it's only visible on the model card, but we'll add it to the context menu on images and the user page as well.

jeszjesz

I agree completely. Two thirds of my time here is spent reporting the vast amounts of child porn on the site. It's obvious which users are the problem and yet I can't flag them as the problem.

braintacles

jeszjesz: Exactly! Same here! Would you mind voting this up? We need to get this more visibility

jeszjesz

braintacles: Done

Pixel World

Will not use Twitter because of this reason, hope it gets better here :/ honestly makes AI look bad

DerHammer

Also you should give us the option to remove images from our model posts manually until they get removed, I am still stuck with anime child nudes below one of my posts, it got reported over a day ago and is still stuck around -.-

jeszjesz

DerHammer: That's very bad news because I was told by staff to report the resources rather than individual images

lekhang

DerHammer: Completely agree. This is why I hesitate to post my models on CivitAI. Please upvote my request post named "Model Category Control." It currently has 11 votes and shares the same idea as yours.

A1322

DerHammer: It's weird to me that this isn't already a feature. It's like not being able to untag yourself from photos on Facebook. Very basic stuff.

Justin Maier

Thanks for the heads up on this. Sounds like that isn't working correctly. We'll double check the logic here.

→