WinterMilestone 5 stormsurfer

From crowdresearch
Revision as of 17:09, 14 February 2016 by Shreygupta (Talk | contribs)

Jump to: navigation, search

System

Please use the following template to write up your introduction section this week.

Brief introduction and problem being solved

For workers, task ranking boils down to two things:

  • Finding good requesters: e.g. requesters that pay well, requesters that accept/reject HITs fairly/on-time, requesters that maintain strong/positive communication
  • Finding good tasks: e.g. interesting tasks, tasks that match the worker's abilities, tasks that allow the work to learn something new, tasks that pay a high wage (money/time)

For requesters, task ranking boils down to simply one thing:

  • Finding good workers: e.g. workers that do a task proficiently

Crowdsourcing platforms such as Amazon Mechanical Turk, Clickworker, and Microworkers fail to address all aspects of reputation and ranking between workers and requesters. Workers cannot easily search for and find requesters and tasks they are interested in, and requesters cannot easily be matched with high-quality workers who are proficient in their specific tasks.

Currently, Boomerang solves one aspect of the problem by introducing "a reputation system that differs from traditional rate-and-leave systems by 'boomeranging' the accuracy of the rating decision back to directly impact the user. This feedback loop means that giving someone a high rating increases the likelihood of working with that individual again, while giving a low rating reduces that likelihood." Boomerang thus effectively matches high-quality workers with high-quality requesters (and vice versa), yet no match is made in regard to task category (classification) and worker proficiency with respect to that category.

Modules of the system

Module 1: ---

Problem and limitations

Module preview

System details

Module 2: ---

Problem and limitations

Module preview

System details

Module 3: ---

Problem and limitations

Module preview

System details

Milestone contributors

Slack usernames of all who helped create this wiki page submission: @shreygupta98