Difference between revisions of "Milestone 8 TuringMaching Foundation3"

From crowdresearch
Jump to: navigation, search
Line 8: Line 8:
 
*If it’s a group, who pays for their time to review you?

 
*If it’s a group, who pays for their time to review you?

 
*From Anand: “How do you do skills-based ratings, etc., without hindering tasks with a requirement to categorize them?”
 
*From Anand: “How do you do skills-based ratings, etc., without hindering tasks with a requirement to categorize them?”
 
  
 
==Solutions==
 
==Solutions==

Revision as of 17:45, 22 April 2015

Foundation 3: External quality ratings

Metaphor of credit ratings: rather than just people rating each other, have an (external?) authority or algorithm responsible for credit ratings (A, B, C, etc.)
 Benefit: this reduces the incentive to get positively-biased five star ratings on everything — those ratings become meaningless

Challenges

  • Is this a group/authority? For example, Wikipedia reviews are subjective and based on voting. Or is it an algorithm?

  • If it’s a group, who pays for their time to review you?

  • From Anand: “How do you do skills-based ratings, etc., without hindering tasks with a requirement to categorize them?”

Solutions