Difference between revisions of "Milestone 8 TuringMaching Foundation3"

From crowdresearch
Jump to: navigation, search
Line 2: Line 2:
  
 
Metaphor of credit ratings: rather than just people rating each other, have an (external?) authority or algorithm responsible for credit ratings (A, B, C, etc.)

 
Metaphor of credit ratings: rather than just people rating each other, have an (external?) authority or algorithm responsible for credit ratings (A, B, C, etc.)

 
 
Benefit: this reduces the incentive to get positively-biased five star ratings on everything — those ratings become meaningless
 
Benefit: this reduces the incentive to get positively-biased five star ratings on everything — those ratings become meaningless
  
 
====Challenges====
 
====Challenges====
 
+
*Is this a group/authority? For example, Wikipedia reviews are subjective and based on voting. Or is it an algorithm?

Is this a group/authority? For example, Wikipedia reviews are subjective and based on voting. Or is it an algorithm?

+
*If it’s a group, who pays for their time to review you?

 
+
*From Anand: “How do you do skills-based ratings, etc., without hindering tasks with a requirement to categorize them?”
If it’s a group, who pays for their time to review you?

+
 
+
From Anand: “How do you do skills-based ratings, etc., without hindering tasks with a requirement to categorize them?”
+
  
  
 
==Solutions==
 
==Solutions==

Revision as of 17:45, 22 April 2015

Foundation 3: External quality ratings

Metaphor of credit ratings: rather than just people rating each other, have an (external?) authority or algorithm responsible for credit ratings (A, B, C, etc.)
 Benefit: this reduces the incentive to get positively-biased five star ratings on everything — those ratings become meaningless

Challenges

  • Is this a group/authority? For example, Wikipedia reviews are subjective and based on voting. Or is it an algorithm?

  • If it’s a group, who pays for their time to review you?

  • From Anand: “How do you do skills-based ratings, etc., without hindering tasks with a requirement to categorize them?”


Solutions