Milestone 7 PixelPerfect

From crowdresearch
Jump to: navigation, search

Template:Db-g7 This is Team PixelPerfect's submission to Milestone 7.

Title

Abstract

This paper will try to determine how feasible the different ideas for input-output moderation schemes are. From the critique posted in the basis of submissions of the Milestone 6, we try to bring up alternative solutions by merging ideas. A lot of workers get their work rejected due to incomprehensibility of posted tasks. Workers and requesters get into conflict over the wage rate and the resolution of such conflicts is of prime concern to enable a smooth experience.

Motivation

We are trying to solve the following issues:

  • Underrepresentation of new workers and concentration of powers in the high quality workers.
  • Incomprehensible task descriptions.
  • Quick dispute resolution.

System

Rating System

Workers and requesters are rated keeping certain parameters into considerations like accuracy and promptness of submission for Workers, while task clarity and professionalism for requesters. Levelling up earns them more privileges and will unlock more complex and highly paid tasks. Workers and Requesters both are categorised into three tiers.

Task Templates

Task clarity is of utmost importance as far as output quality is concerned. This help requesters by making task generation faster and much more structured. Requester will be asked whether to use task template or not. In case templates are used, requester will be presented a structured task descriptor consisting of the tags(type of work involved), skills required, description of the task, adding a video about the task(optional), etc. This could get onerous, yes, but making a task available to a certain set of people to examine and suggest edits would still take as much time and effort.

Voting system for Conflicts

The input output moderation critique tells us about how we would require the results of the moderation within 2-3 minutes. We could incorporate voting system as suggested, but that would probably be biased because we could have a lot more workers than the number of requesters. We can limit the number of requesters and workers that should vote, so as not to bring a wide gap in the numbers. We could also instead let everybody vote, and then show the statistics of the percentage of requesters and workers separately to determine genuine cases of conflict.

Personal communication between the workers and requesters

Small ambiguities in the tasks could easily be resolved by using something like a chat-box to enable short conversations. This could also help requesters gain the trust of the workers and vice-versa.

References