Reviewing rewards
complete
k
knxo
Lets be honest, when we make models we want to see what people create with them. It can be specially frustrating having 1k+ downloads models with zero reviews, images or feedback.
I would like for some form of bragging rights rewards like a badge or ranking to be implemented for reviewers.
A good methodology would be to to give them points from reviewing models based on the amounts of reviews a model has. For example 10 points for non reviewed models, 5 for models with less than 10 reviews and 1 point for models with more than 10 reviews. Of course only rewarding reviews with images.
This would provide feedback and eyecandy to creators as well as give a more accurate scoring for the models.
This post was marked as
complete
Civitai
planned
Justin Maier
While we have plans to do even more to ensure quality reviews, we just recently launched a new leaderboard system that ranks people based on the creation of quality reviews:
Check it out and let us know what you think.
k
knxo
Justin Maier: I think it is a great step forward, I would still like to see some weight added to reviewing models with fewer reviews. Reading the 1001st review from a popular model is a lot less useful that watching the 1st review of an unknown gem.
m
moesah
I like the idea of incentivizing reviews, it helps the creators and it gives civitai more content to serve to everyone. However with the way reviews currently work, it might be easy to game most of these solutions and actually have the opposite effect. If it's easy to game, now everything suddenly has 5 star ratings because people just mass-clicked 5 stars on everything for review points, and ratings become meaningless. Never underestimate the lengths bored people will go to just to be on a random website's leaderboard.
I think this should be tied directly to incentivizing higher quality content. Specifically, only give points for image uploads that include the generation data, and the generation data is actually for the model they're posting on. Don't give points for images without generation data or duplicate images. That's still not impossible to game but is a lot harder to do than just clicking 5 stars on everything. It expands the gallery of images to look through for any given model, helps model creators, helps people looking for the right model to download, and ultimately helps civitai.
I'd shy away from trying to police/incentivize review text. That will always be a cat and mouse game. Every time you raise the bar to make it harder to game, you annoy (and discourage) legitimate reviewers just trying to crank out a quick attaboy (which also still has value). The way reviews are currently structured, the review text is mostly invisible anyway. At the very least maybe hold on spending dev time for incentivizing review comments until review comments are actually first class citizens on civitai (which is a related but separate problem).
w
wot
I like this idea because the creator will get some feedback quickly but I think this should be improved to minimise some flaws with it. Because this method alone rewards for speed and dosn't rewards for the quality of the first few feedbacks.
So to encourage quick good feedback I got a diffrent idea. Instead of giving points based on who got reviewed first and later, lets change that to multiplier for example 2, 1.5, 1. The source of points could be from following things:
- Giving 10 points for number of meaningful and specific words. Taking away a point for any other word used. This is to avoid waffling and give most of useful information. points should be reduced if the review is too similar to someone else review.
- Points from number of people agreeing with this review.
- Points for images that used this model or relevent to this model.
- A constant number of points should be given by the creator. It should be big enough to compensate for anything previously mentioned on this list. The limit should be based on exponetial number of reviews. For example 1 reward for 3 reviews, 2 for 6, 10 for 100 and so on. This will encarage pointing out previously unnoticed problems and futher feedback. this should be used if the review as actually useful for the creators future content. There should be something seperate and not as restricted as this if the creator just liked the review.
Edits should count as a new review. So someone would not just post a place holder and then edit it.
Also shifting the max multiplyer requierment from first to first 5 or 10 reviews to get max so this would encourage diffrent points of view.
As a reward I think something from paid content should be avaiable on the website for reasonable points amount since the reviewer took some time and efford to write a useful review and improve the content on the website which could return itself in theory if done correcly.
I would also remove the image requierment to not discourage the reviewer from reviewing because they might not want to share their generated NSFW image for NSFW focused model.
Appropriate report options should be added and some points added for the confirmed issue from report. This is to discourage and deal with any negative behavior like point farming with useless reviews. (IDK how reporting work becaused I never used one so far.)
All numbers I used here are just there to show the idea and not actual values for this feature. Those numbers should be carefully set and not decided by a random number used to show just the idea from a random post from random person because this could lead to unwanted behavour.
My english is not the best so I could make some mistakes. Feedback on the idea (and occasionally my english) could be useful.
TL;DR:
First few gets highest point multiplier. Points from quality and usefulness. Remove images requierments. paid features for some points. Be carefull with numbers. My english is not the best. Feedback on the idea, appreciated.
S
SomebodyOnceToldMeh
I like the idea.
I've been doing my best to upload a picture and review loras that i've found personally interest in. I hope it makes the creator feel good for taking their time to create something wonderful, and i hope it incentives them to keep making loras (or fixing up any issues I may find by leaving feedback).
It would be nice to get some kinda badge or something for being a reviewer (having done a ton of them, and not just 1 or 2).
N
Nekos4Lyfe
Clever idea!