WinterMilestone 2 Team-UXCrowd
- 1 Attend a Panel to Hear from Workers and Requesters
- 2 Reading Others' Insights
- 3 Do Needfinding by Browsing MTurk-related forums, blogs, Reddit, etc
- 4 Synthesize the Needs You Found
- 5 Milestone Contributors
Attend a Panel to Hear from Workers and Requesters
- panel members are actively involving with Turk
- Most of them are run a blog, forum or a different kind of helping channels to help out the Turk society.
- They maintain a communication channel with requesters and recommend them how to choose workers for their tasks.
- Most of them don't have fixed working hours they work whenever they get a good task.
- Chance of getting a task is unpredictable.
- They take extra precautions when they work with a new requester. Because they don't like to get a negative feedback from them.
- it will take a couple of years to have a good worker profile.
- Even a physically disabled person can get a very good income using crowdsource platforms.
- Researchers find it's very easy to create surveys.
- Requesters use their own templates
- Earnings are various day by day. Its cant be predicted.
- They all agree that there should be a better system.
- Some workers get the requesters contact details when they going to start their work. If they got a rejection they could contact the requester and can get an explanation.
- Estimations will help them to understand about the time frames.
- Workers should complete their task with the highest quality.
- Workers should maintain a good profile, in order to get high pay tasks.
- Requesters Should craft their question carefully, so they could get a good answer.
- There should be a workflow system.
Reading Others' Insights
Worker perspective: Being a Turker
- The majority of Turkers (56%) are U.S. based.
- The primary reason for Turking is to earn money.
- Unfair rejection of work, slow payment, low wage and lack of communication with requesters.
- Requesters put the cost to workers of poorly designed tasks.
- There are no equivalent means for rating Requesters
- AMT deliberately hides the relationship between Turkers and Requesters
- Some Turkers had made decisions to accept somewhat (but not much) lower pay if a task was more enjoyable
- One ofthe turekr has mentioned that “I would much rather have my salary back and drop turking” becuase of the low pay.
- Actions can be taken against bad Requesters but the two sides are not treated in an evenhanded manner
Worker perspective: Turkopticon
Requester perspective: Crowdsourcing User Studies with Mechanical Turk
Requester perspective: The Need for Standardization in Crowdsourcing
Both perspectives: A Plea to Amazon: Fix Mechanical Turk
List out the observations you made while doing your fieldwork. Links to examples (posts / threads) would be extremely helpful.
Synthesize the Needs You Found
List out your most salient and interesting needs for workers, and for requesters. Please back up each one with evidence: at least one observation, and ideally an interpretation as well.
A set of bullet points summarizing the needs of workers.
- Example: Workers need to be respected by their employers. Evidence: Sanjay said in the worker panel that he wrote an angry email to a requester who mass-rejected his work. Interpretation: this wasn't actually about the money; it was about the disregard for Sanjay's work ethic.
A set of bullet points summarizing the needs of requesters.
- Example: requesters need to trust the results they get from workers. Evidence: In this thread on Reddit (linked), a requester is struggling to know which results to use and which ones to reject or re-post for more data. Interpretation: it's actually quite difficult for requesters to know whether 1) a worker tried hard but the question was unclear or very difficult or an edge case, or 2) a worker wasn't really putting in a best effort.