Reputation System for MFP....

kapeluza
kapeluza Posts: 3,434 Member
edited October 2024 in Chit-Chat
Youtube review of the tribunal system
http://www.youtube.com/watch?v=qS8yCYwXGi8



I honestly didn't want this to get lost in the 10+ pages of the "OK, Let's Talk" thread.
I was reading and some people mentioned a reputation system. Reputation system seems like a great idea!!!!

On an online game I play, "League of Legends", the company who designed the game came up with a reputation system which they call "The Tribunal". Basically in a nutshell "The Tribunal was created with a number of purposes in mind. Its primary mission, of course, is to empower the community to dictate what conduct it considers inappropriate to a positive gameplay environment. While we have banned a large number of people for serious and obvious harassment, competitive environments -- particularly in a relatively anonymous setting -- can sometimes foster rude, unpleasant behavior."

Here is the logistics behind their reputation system. I think it might translate well to MFP (disregard all the gaming nomenclature please) but if you read it and understand the idea of it then you can see that it might work well for MFP!


DISCLAIMER: Please ignore the gaming nomenclature and the IP rewards and whatever is associated with the game, focus on the idea behind the tribunal! Thanks

And sorry, it's LONG..... but might be worth the read! And hell if this works on teenagers/adults it certainly can work here, no?
And this would take off a huge LOAD off the moderators because it would be up to the community to be adults and act on people misbehaving!


Here is the FAQ section of their Tribunal


"Q: What is the Tribunal and why was it created?

A: The Tribunal was created with a number of purposes in mind. Its primary mission, of course, is to empower the community to dictate what conduct it considers inappropriate to a positive gameplay environment. While we have banned a large number of people for serious and obvious harassment, competitive environments -- particularly in a relatively anonymous setting -- can sometimes foster rude, unpleasant behavior.

Another primary objective is to once again reinforce the importance of the tenets proscribed through the Summoner’s Code.

Q: Can my temporary suspension be lifted?

A: No. We will not lift or reduce your temporary suspension for any reason under any circumstance.

Q: What information do I have to help me make a decision?

A: As an arbitrating player you will have access to a number of materials to help you determine guilt or innocence in a particular instance. These items will include:

Game statistics for all reports that a given player has accrued.
The reason that they were reported in each instance.
The defendant player’s score for each game in which he was reported.
The defendant player’s inventory for each game in which he was reported
Chat logs for each of the games that generated a harassment report.
The player in question’s Summoner statistics.

Q: When should I be voting to punish?

A: When you’re reviewing cases that have reached the Tribunal system for arbitration, remember that your most important resource to make the right decision is the Summoner’s Code. The Code is a blueprint for positive player behavior, and outlines the proper response to most situations that you will encounter in game. In general, when a player is in clear violation of these guidelines, and it is damaging someone else’s enjoyment of the game, you should feel empowered to punish them for it.

Generally speaking, a punishable offense must be a deliberate, malicious act that is intended to spoil another player’s experience. Here are some examples of situations that might constitute punishable offenses:

Explicit use of hate terms, racial slurs, cultural epithets, etc.
Players who deliberately and viciously insult other players.
Repeatedly negative, unconstructive attitudes
Players whose teasing crosses the line, and who persist after being asked repeatedly to stop.
Deliberately disruptive gameplay, such as intentional feeding.

Q: When should I be voting to Pardon?

A: Here are some examples of times where reported players should be pardoned.

Players who are celebrating, but not intending to be offensive.
Players who are playfully quipping at one another.
Someone who is reacting to another player’s repeated badgering or insulting behavior.
Players who are not responding to other players or do not speak the language, but otherwise aren’t displaying any negative or strange behavior.
Players who display poor performance, but do not appear to be intentionally feeding or otherwise disrupting gameplay.
Players who cease their negative behaviors and/or apologize when another player informs them that they have taken things too far and asks them to stop.

Q: If found guilty, what will the punishment consist of?

A: Reported players, if found guilty, will be temporarily suspended from the game. Each time a player is found guilty, the maximum suspension duration will go up. After a number of times, your account will be escalated automatically to a Player Support Specialist for review. Depending on the severity, the representative can take action up to a possible permanent ban.

Q: How many votes are required to result in a suspension?

A: Currently, we are deliberately keeping the specific number of punishment votes required for disciplinary action a secret. However, in the interest of fairness, players must be subject to an overwhelming majority of guilty votes to undergo punishment.

Q: How are the reports that I am allowed to view selected?

A: The reports over which you will be presiding will be selected and assigned randomly by the Tribunal system. You will not be able to choose which cases you review.

Q: Will players be able to see who voted on their case?

A: No. We feel that it is extremely important that a certain level of confidentiality is maintained.

Q: How much IP can I receive from voting?

A: It depends on whether or not you vote correctly. If you vote on a case, and the majority disagrees with your assessment, you’ll receive no rewards; however, if you help decide the outcome of a report, you’ll be compensated with a small amount of IP. We haven’t decided on the amount that will be allocated per case, but the maximum that you can earn per day will be comparable to the amount you would gain after playing for a few hours online.

Q: Does the decision I make on a report affect the amount of IP I earn?

A: Yes! If your recommendation matches the final verdict, you will receive an IP reward for your civil service. The system is designed in this manner in order to create an incentive for players to render thoughtful, intelligent decisions on each and every case that they evaluate.

We will also be taking into account the frequency with which a player votes against the majority in order to weed out those players who are either voting excessively erratically, out of touch with the general will of the community, or deliberately attempting to disrupt consensus.

Q: I have multiple accounts. Can I earn my daily IP on each of them?

A: Certainly. But bear in mind that you must be at least level 30 to serve as part of the Tribunal.

Q: Can I vote on reports that I have submitted?

A: At present you can, but an upcoming update to the system will prevent players from being randomly assigned their own reports.

Q: How many player reports can I vote on each day?

A: Currently, we are limiting the number of cases that a player can vote on to 30 per day, but this number will be subject to review and change based upon our early observations of how players are utilizing the system.



Concerned Summoner FAQ

Q: Can people who don’t like me repeatedly report me?

A: This could only be the case if you find yourself repeatedly matched into games with them. Players are limited to one report per player, per game.

Q: I just got reported. Does this mean I will be reviewed by the Tribunal?

A: It depends, but generally, no. Players are only reviewed by the Tribunal if there is significant evidence to support a need for their behavior to be reviewed. Our system takes a variety of factors into account as player reports roll in, so simply getting reported once is unlikely to land you in front of the Tribunal. Here are a few of the factors considered before you find yourself on the docket:

Accounts that accrue a large volume of player reports are much more likely to be reviewed.
New accounts are judged more stringently than veterans.
The reputation of the player who is reporting you will also be taken into account. Reports made by level 30 Summoners with clean record will be weighed more heavily than those submitted by newer accounts and/or those whose reputation has been tarnished by frequent harassment reports.

Q: What are the most common reasons for a Summoner to be reported?

A: The most common reasons cited for player reports are either harassment or disruption of gameplay (intentional feeding, etc.). Bear in mind that the definition of harassment can range from direct, overt verbal harassment, to intentionally creating an unpleasant gameplay environment.

Generally speaking, if you’re abiding by the Summoner’s Code, you’ll find that other Summoners will enjoy playing with you.

Q: Will my account information be available if I’m reported?

A: Riot Games will never share personal information such as credit cards, email addresses, billing addresses, etc. with anyone. However, your chat logs, game scores, and other data that might be directly relevant to judging your case will be available for review. In general, it is safest to always assume that anything that you say in public game chat could end up on the internet for everyone to see. Please be careful what personal information you disclose during your time playing League of Legends.

Q: What if I was incorrectly reported? How will the Tribunal know I’m innocent?

A: Like any trial that employs a jury system, once you are selected for evaluation by the Tribunal your guilt or innocence will determined by your peers. However, with your game data as evidence, if you have in fact been incorrectly reported, it is our sincerest hope that you will be pardoned.

Like any democratic system, however, the Tribunal is only as good as its checks and balances. As such, a member of the Riot Games Player Support Team will be assigned to audit the system, paying particularly close attention to any serious penalties doled out by the Tribunal and confirming the verdict before allowing the punishment to be carried out. Moreover, except in the most extreme of cases, first offenses will almost always be warnings. In the event that you receive such a warning, just consider it a friendly reminder to observe the Summoner’s Code.

Q: Can I vote to pardon myself if I’m reported?

A: No. The system will never assign you to review a case against yourself.

Q: I was suspended by the Tribunal. How long am I suspended for?

A: Suspensions that happen as a result of Tribunal review works on a graduated system, carrying progressively harsher penalties for repeat offenders. In almost all cases, the first offense is a warning rather than a ban. Following that, additional appearances before the Tribunal might carry penalties ranging from a single day to several weeks.

Q: I’m permanently banned, is there any way to appeal?

A: You always have the option to submit an appeal to our Player Support Team, but it is extremely unlikely that we will decide to rescind a permanent ban. This is largely because all permanent bans are distributed manually, after careful review of all the evidence, which is generally pretty conclusive.

Q: I’m a paying user and was suspended. I feel like I should be given a bit more leniency than free users.

A: We want League of Legends to be an enjoyable experience for all Summoners and we see the Tribunal as a way to help achieve that goal. Once the Tribunal has spoken, you’ll have to live with your punishment. We cannot give any leniency to users, regardless of the money they’ve spent.

Q: How else can I be suspended or permanently banned?

A: In extreme cases, if a member of the Riot Games staff witness’s poor player conduct, they may make a judgment call to issue an immediate suspension or ban. With over a hundred Riot Games employees who play thousands of games a day, you just never know when you could be playing with a Rioter!

Additionally, various violations of the EULA and Terms of Use (such as intentional feeding) sometimes carry penalties that may include suspension of a player account. Also, remember that even if you are not explicitly reported, leaving or going AFK in games may still net you an automatic ban from our LeaverBuster system!"

Replies

  • kapeluza
    kapeluza Posts: 3,434 Member
    Full explanation:

    "POLICY AND PROCEDURE FOR “THE TRIBUNAL”

    In order to ensure that all users of League of Legends (the “Game”) have a fun and safe in-Game experience, Riot Games, Inc. (“Riot Games”) has created “The Tribunal”, whereby all the users of the Game (the “Community”) are empowered to dictate what conduct is considered acceptable within the Game, and what conduct the Community deems inappropriate. Those members of the Community who qualify have the option to participate in The Tribunal by evaluating reports and attached evidence regarding the alleged misconduct of other users. The following Tribunal Policy and Procedure (the “Policy”) explains how you as a user might be reported, how The Tribunal works to evaluate those reports, and what happens when The Tribunal chooses to punish a user’s actions. This Policy is governed by and should be read in conjunction with Riot Games’ Terms of Use, EULA, and Privacy Policy (collectively, the “Riot Games Legal Policies”), and should there be any discrepancy between this Policy and the Riot Games Legal Policies , the terms of the Riot Games Legal Policies shall control and prevail.

    How does a case come before the Tribunal?

    At the end of any live Game session (each, a “Game Session”), each user may report any other user participating in that Game Session by clicking the red exclamation mark (!) that appears next to that user’s Summoner name. You are free to report any user(s) that you feel has violated the Summoner’s Code, Riot Games Legal Policies, or generally displayed unsportsmanlike conduct. After selecting to report a user, you will be asked to choose from one of up to ten pre-selected reasons why that user’s actions necessitated filing the report. You will also have the option to provide a short paragraph further describing the reasons for the report. It is these reports that may come before The Tribunal.

    Not all reported users will be submitted to The Tribunal, but various factors will be considered for each reported user, including without limitation: (i) the number of times the user has been reported; (ii) the frequency at which the user is reported; (iii) the reason(s) for which the user is reported; (iv) the length of time the user’s Game account has been registered (with newer accounts judged more stringently than veterans); and (v) the reputation of the user(s) that are making the reports. This means that, generally, but not necessarily in all cases, you will have to be reported multiple times by multiple users before you face judgment by The Tribunal.


    What evidence is The Tribunal provided with to judge the case?

    Once a user is reported a sufficient number of times to merit a public posting of reports against that user, the system will automatically create a report page for The Tribunal system, containing the following information (a “Report Page”): (i) the Summoner name of the reported user; (ii) in-Game statistics from the particular Game Session(s) for which the user was reported; (iii) the reason(s) provided by the reporting user(s); (iv) any additional comments provided by the reporting user(s); and (v) the entire in-Game chat log for the Game Session(s). The Report Page will also contain a drop-down menu bar that allows the reviewing Tribunal member to evaluate evidence from each Game Session for which the user was reported (appearing as its own Report Page). A Tribunal member will not be casting a vote on each reported Game Session individually, but will vote on the user based on their general history as provided by The Tribunal, and so reviewing each of the Game Sessions individually will help a Tribunal member to better understand the report history of the offending user and deliver a balanced and accurate decision on disciplinary action. For each case a Tribunal member reviews, The Tribunal member will not be able to vote on such case for sixty (60) seconds to help ensure he or she spends an appropriate amount of time reviewing the evidence before casting a vote.
    Private Chat Log Exception: If you are participating in a 3v3 or 5v5 pre-made game in which all of the members on your team are pre-selected (in other words, you have chosen to only play with your friends and are not playing with any strangers on your team), then any chat text that is submitted on team chat (as opposed to public game chat via the “/all” channel) (“Private Chat”) will be redacted from the chat log on the Report Page. For clarification purposes, this redaction only happens when the teams are fully pre-made and only applies to Private Chat. Any public or “all” chat content submitted during a Game Session is subject to review by The Tribunal.
    The Report Pages are assigned at random in The Tribunal – a Tribunal member cannot pick and choose which cases he or she wants to review. While there is a small chance that a Tribunal member might be assigned a Report Page for a user that he or she reported, no Tribunal member will be allowed to vote on a Report Page created for his or her own account.


    How Does Voting Work?

    Once a Tribunal member has reviewed the Report Page, he or she has an opportunity to vote to “pardon,” “punish” or “skip” the case. Each Report Page will be reviewed and voted on by at least twenty (20) different Tribunal members before any action is taken. While this number is subject to change in the sole and absolute discretion of Riot Games, the offending user must always receive an overwhelming majority of “punish” votes to be subject to some form of punishment by Riot Games.
    Penalties imposed as a result of The Tribunal decisions work on a graduated system, carrying progressively harsher penalties for repeat offenders. In almost all cases, a first time offender will receive a warning, explaining that The Tribunal has determined that certain of such offender’s in-Game activity is worthy of punishment and encouraging the user to abide by the Summoner’s Code. Depending on the frequency of discipline by The Tribunal and the nature of the user’s offending actions, punishment will become progressively harsher, resulting in a ban ranging from a single day to several weeks. A member of the Riot Games support team will be assigned to audit The Tribunal system, and will be responsible for reviewing the individual cases deserving of more extreme punishment (generally, anything harsher than a single day ban). The Riot Games staff member will ultimately be responsible for manually approving the appropriate punishment, assigning a less severe level of punishment, or for pardoning the offending user, all of which the staff member shall implement in Riot Games’ sole and absolute discretion.

    While you will not be notified each time another user reports you or when you have a Report Page that comes before The Tribunal, you will be notified via email each time The Tribunal’s verdict on your Report Page is to “punish.” The email you receive will also notify you of the disciplinary action Riot Games has seen fit to take against your account.

    Eligibility and Participation / Who is eligible to participate in The Tribunal?

    Only frequent Game users whose account has reached a level of thirty (30) and who have not otherwise been banned from participating are eligible to act as a member of The Tribunal, although Riot Games reserves the right to suspend or grant access to The Tribunal to any user at any time and for any reason. Those who are eligible and wish to participate must log in to The Tribunal on the League of Legends website, at www.leagueoflegends.com/tribunal, and read and agree to this Policy.

    Your Tribunal Performance

    Each member initially has the opportunity to vote on up to thirty (30) cases per day (this number is subject to change at any time in Riot Games’ sole and absolute discretion).
    Your performance as a Tribunal member is automatically evaluated as you participate in The Tribunal and cast votes on the Report Pages that come before you. If your recommendation on a given report, whether it be to pardon or punish, matches the final verdict on the report, you will be notified by email and will receive a reward in the form of Influence Points (“IP”). If you frequently succeed at voting with the majority in The Tribunal, over time, you will also slowly be granted the capability of reviewing and voting on more Report Pages per day. If, however, you frequently and consistently vote against the majority, or otherwise disrupt or hinder The Tribunal process, you will have access to fewer and fewer Report Pages, and eventually your account may be temporarily or permanently banned from future participation in The Tribunal, at Riot Games’ sole discretion.
    If you recently participated in The Tribunal and voted with the majority on at least one case, Riot Games will notify you via email of the amount of IP that was deposited to your Game account. If you do not wish to receive these email notifications, please do not participate in The Tribunal.
  • kao708
    kao708 Posts: 813 Member
    Sorry, too much info to read without losing my mind. I did get to "temporary suspension" which apparently isn't temporary at all according to the answer to the question about lifting it.

    I don't know that I like the idea of people voting other people off MFP. There are options to report abusive users on each post and then the moderators can decide if the complaint is valid. Unfortunately, leaving the choice to suspend a user up to other users isn't really fair. I mean, who knows if the people complaining are just over sensitive or if they just have some personal vendetta against the user they are voting to suspend.

    I say leave it as is...report the abusers and let the moderators/developers have the final say. People should behave as responsible adults but we all know that doesn't happen 100% of the time and it's not fair for someone to get a vote against them just because they stated their opinion a little more strongly than someone else might have liked!

    Just my opinion! :bigsmile:
  • mrmanmeat
    mrmanmeat Posts: 1,968 Member
    No. It'll be abused.

    Been there done that on other sites.

    Be responsible for yourself, what you read, and what you decided based on what you read.
  • kdchick99
    kdchick99 Posts: 104 Member
    I think I get your whole point and view on the situation. Trying to translate it from gaming to MFP did confuse me at times, but I get the general idea of the theory. BTW...It is a great idea to do too!
  • tigersword
    tigersword Posts: 8,059 Member
    That's NOT a reputation system. That's an arbitration, or self-modding system.

    A reputation system is the karma system you see on a lot of forums. You can click on someone's profile and give them positive or negative karma points depending on whether they are helpful and positive or unhelpful and negative. That way when people are reading posts looking for advice, they can see under the user's name whether they have a positive, neutral, or negative reputation amongst the board in general, and use that to help decide on the validity of the advice.

    It's certainly not a perfect system, but it's probably the best method to use.
  • kapeluza
    kapeluza Posts: 3,434 Member
    Temporary suspension would be a ban of 2-3 days. Permanent ban is well, self explanatory.

    If you spend a lot of time on the forums, there is behavior that with time, just gets ridiculous (harassment, offensive behavior etc) so their idea was "to empower the community to dictate what conduct it considers inappropriate to a positive gameplay environment(in this case would be MFP environment and what the owner constitutes to be behavior within the TOS)".
    Basically it takes the burden off from 2-3 moderators and it puts it on the members to enforce a positive environment. It's hard to explain without reading the whole policy.
  • kapeluza
    kapeluza Posts: 3,434 Member
    No. It'll be abused.

    Been there done that on other sites.

    Be responsible for yourself, what you read, and what you decided based on what you read.

    That's the problem and WHY there was so effing drama yesterday. People are NOT responsible hence why the owner/moderators had to go ninja and start deleting threads and sending out notifications people.

    Which sites has a tribunal system? I would like to see those forums. This is not talking about 2-3 people being on the tribunal but everyone who is a frequent user of MFP. It would lay on the hands of every single one of us. Besides, you get to review what that person was reported for, the explanation given as to why they were reported and your judgement would be based specifically on Terms of Service of MFP and their rules, not your opinion/rules.
  • A reputation system is the karma system you see on a lot of forums. You can click on someone's profile and give them positive or negative karma points depending on whether they are helpful and positive or unhelpful and negative. That way when people are reading posts looking for advice, they can see under the user's name whether they have a positive, neutral, or negative reputation amongst the board in general, and use that to help decide on the validity of the advice.

    Thats a really great idea. i like this one.
  • kapeluza
    kapeluza Posts: 3,434 Member
    That's NOT a reputation system. That's an arbitration, or self-modding system.

    A reputation system is the karma system you see on a lot of forums. You can click on someone's profile and give them positive or negative karma points depending on whether they are helpful and positive or unhelpful and negative. That way when people are reading posts looking for advice, they can see under the user's name whether they have a positive, neutral, or negative reputation amongst the board in general, and use that to help decide on the validity of the advice.

    It's certainly not a perfect system, but it's probably the best method to use.

    So what happens if they have a -10 nasty reputation? Are they still allowed to post, wreck havoc???
  • Disclaimer: I didn't read what you posted in its entirety, but I manage a 10,000+ member community for a living, earned my Master's degree with a focus on digital communication, and have published papers about social media engagement and gamification.

    I study gamification for social good (i.e. health, illness/injury recovery, weight loss), and I think a reputation system would be a good enhancement for MFP. We know from social behavior analytics that people are more inclined to participate in something when there is a system of feedback, a feeling of achievement, movement toward being recognized as an expert, etc. I've seen and implemented reputation systems in a wide variety of settings to a good deal of success, so I think it would work well here too!

    When implemented correctly, users don't get to vote other users "off the island," as it were - it's simply a flagging system. Instead, the systems are designed much more on a positive reinforcement model - you get kudos/thumbs up/stars/whatever for answers that were appreciated by other people. Functions of kudos, posts, and other variables increase your reputation and can establish users as "superusers" or subject-matter experts within a given community. I'd love to see a badging system implemented here!
  • mikeyml
    mikeyml Posts: 568 Member
    My issue with both the reputation and arbitration systems is that there are way too many cliques on these boards. Friends will vote each other up or down regardless of the content they post. However I do like the idea of a "like / dislike" button for each post. It would make it easier to find the best reply in a thread without having to wade through some of the nonsense.
  • kapeluza
    kapeluza Posts: 3,434 Member
    My issue with both the reputation and arbitration systems is that there are way too many cliques on these boards. Friends will vote each other up or down regardless of the content they post. However I do like the idea of a "like / dislike" button for each post. It would make it easier to find the best reply in a thread without having to wade through some of the nonsense.

    Yeah but these cliques consist of what 5-20 people compared to the 10k+ community? And for the system I proposed, it is on an individual basis so everyone reviews the individual reports privately.



    Looky here:


    http://www.youtube.com/watch?v=qS8yCYwXGi8

    Here is a video produced by Riot Games (owners) of the tribunal. Easy to view instead of reading all the page
  • mikeyml
    mikeyml Posts: 568 Member
    My issue with both the reputation and arbitration systems is that there are way too many cliques on these boards. Friends will vote each other up or down regardless of the content they post. However I do like the idea of a "like / dislike" button for each post. It would make it easier to find the best reply in a thread without having to wade through some of the nonsense.

    Yeah but these cliques consist of what 5-20 people compared to the 10k+ community? And for the system I proposed, it is on an individual basis so everyone reviews the individual reports privately.



    Looky here:


    http://www.youtube.com/watch?v=qS8yCYwXGi8

    Here is a video produced by Riot Games (owners) of the tribunal. Easy to view instead of reading all the page

    I think it's definitely an interesting concept and I would like to try it out, but I don't know if it's right for MFP. It seems perfect for a gaming community, but there would have to be some tweaks for it to work here. For example, in the 3rd example in the video, the narrator comes across an online friend that was reported and decides to skip since he knows he won't be impartial. Ideally that's the best option but realistically I think people would vote one way or another instead of skipping. I can see it now on the news feed. "Hey everyone, Mikeyml was reported for blank, go vote him down so he gets punished." "I just voted him down because I hate that guy." "Where is this, I want to vote him down too!" etc etc etc. I used to see that kind of stuff every day on my news feed when I was friends with the "drama crew." Mob mentality takes over very quickly for these people. =/

    But it could work, if it was applied creatively. Maybe have 100-200 people sign up to be on an arbitration panel like that and make a rule prohibiting that they talk about any decisions on their news feed. I'd be fine with something like that. :)
This discussion has been closed.