Milestone 8 TuringMaching Foundation3

From crowdresearch
Revision as of 18:45, 22 April 2015 by Avrimmit (Talk | contribs)

Jump to: navigation, search

Foundation 3: External quality ratings

Metaphor of credit ratings: rather than just people rating each other, have an (external?) authority or algorithm responsible for credit ratings (A, B, C, etc.)
 Benefit: this reduces the incentive to get positively-biased five star ratings on everything — those ratings become meaningless

Challenges

  • Is this a group/authority? For example, Wikipedia reviews are subjective and based on voting. Or is it an algorithm?

  • If it’s a group, who pays for their time to review you?

  • From Anand: “How do you do skills-based ratings, etc., without hindering tasks with a requirement to categorize them?”


Solutions