WinterMilestone 1 devinho

From crowdresearch
Jump to: navigation, search

Experience the life of a Worker on Mechanical Turk

For me, signing up was surprisingly easy and required little work on my part. Going in, I thought that there would be a lot of overhead and require a lot of information on my end because I was being paid to do a service (and thus the process would take long).

After verification, I browsed the HITs that were first displayed to me. The pay was low, but that was to be suspected from the type of work. For the most part, it was easy to find the work that I wanted to do (easy image recognition). If I were to try to find harder work that required a higher level of qualification, I would definitely have had a harder time (because of lack of qualifications and lack of available tasks).

The act of fulfilling the task was rather simple and MTurk does a good job of walking you through this. Having example HITs was particularly helpful when the instructions or title were unclear.

Having a completed the tasks a couple days ago, I'm still waiting to get paid. The fact that whether or not I'm paid back is based off of the requesters discretion makes me uncomfortable and would definitely cause a lot of worry if I was doing this seriously.

Experience the life of a Requester on Mechanical Turk

Reflect on your experience as a requester on Mechanical Turk. What did you like? What did you dislike? Also attach the CSV file generated when you download the HIT results. If you're from outside the USA and unable to access MTurk, you can try the MTurk requester sandbox, or CrowdFlower or Microworkers or Clickworker

Explore alternative crowd-labor markets

Compare and contrast the crowd-labor market you just explored (TaskRabbit/oDesk/GalaxyZoo) to Mechanical Turk.



  • What do you like about the system / what are its strengths?
  • What do you think can be improved about the system?


My general thoughts while reading the white paper are outlined below:

The paper is based off of improving two flaws of crowdsourcing and the Daemo paper's corresponding solutions:

1. Flawed reputation system that don't accurately reflect worker and requester quality -> Boomerang reputation system

2. Poorly designed tasks -> Prototype tasks

Flash Teams

  • What do you like about the system / what are its strengths?
  • What do you think can be improved about the system?

Milestone Contributors

Slack usernames of all who helped create this wiki page submission: @devinho