Milestone 8 TuringMaching Foundation3

From crowdresearch
Revision as of 18:37, 22 April 2015 by Avrimmit (Talk | contribs)

Jump to: navigation, search

Foundation 3: External quality ratings

Metaphor of credit ratings: rather than just people rating each other, have an (external?) authority or algorithm responsible for credit ratings (A, B, C, etc.)


Benefit: this reduces the incentive to get positively-biased five star ratings on everything — those ratings become meaningless

Challenges

Is this a group/authority? For example, Wikipedia reviews are subjective and based on voting. Or is it an algorithm?


If it’s a group, who pays for their time to review you?


From Anand: “How do you do skills-based ratings, etc., without hindering tasks with a requirement to categorize them?”


Solutions