WinterMilestone 1 varshinechandrakanthan

From crowdresearch
Jump to: navigation, search

Experience the life of a Worker on Mechanical Turk

I worked on Clickworker & Microworkers. Things I liked: 1. The tasks were small and didn't take too long to complete. 2. On Clickworkers, the instructions were extremely clear and the response from the requester was rather quick after submission. This especially helped as I was new to the concept and wasn't really sure if I was going about things the right way.

Things I disliked: 1. The time estimation for each task was far from what was described. 2. Very often there were bumps along performing tasks and there was no way to quickly communicate with the requester to clarify them. For instance, I started a job that took me 45 mins for $0.40. It involved creating an account. However it failed repeatedly. After sending my concerns across, I still havent heard from the requester. It ended up feeling very frustrated with the system and was sceptical about taking similar tasks.

Experience the life of a Requester on Mechanical Turk

Reflect on your experience as a requester on Mechanical Turk. What did you like? What did you dislike? Also attach the CSV file generated when you download the HIT results. If you're from outside the USA and unable to access MTurk, you can try the MTurk requester sandbox, or CrowdFlower or Microworkers or Clickworker

I worked as a requester on Clickworker as well as Microworkers. It was a steep learning to understand the type of tasks and how they need to be articulated for a worker. It took me a couple of hours to get used how it workers across different platforms.

Readings

MobileWorks

  • What do you like about the system / what are its strengths?

A combination Foundry and flash team is an incredible way to leverage expert users as crowd workers! The feature where blocks can be reused over and again is a great way to reduce the time taken on Foundry Also, pipelining tasks and using out tags and input tags could help even unconventional tasks be completed. Instead of being restricted to only a particular type of tasks, this would open the platform to a larger variety of tasks.

  • What do you think can be improved about the system?

1. A diverse set of flash teams is likely to bring up a large set of issues regarding coordination. 2. The quality of work needs to be evaluated and should comply to what would be needed by the requester. If the requester isn’t involved continuously within the process, he/she could be dissatisfied with the job and the entire project would have to worked on again.

Daemo

  • What do you like about the system / what are its strengths?

Not only talks of the mechanics of a crowd working platform, but actively works to solve problems faced between requester and worker which is very critical for success of any type of crowd sourcing platform. ( Boomerang & Prototyping) Because of the above, such a crowd platform can be useful generic workers as well as workers of niche expertise.

I think the main strength of such a system is that it can applied to system like MobileWorks, as well as flash teams. The problems that this paper seeks to solve as fundamental across all such platforms.

  • What do you think can be improved about the system?

1. Easy & quick communication to requester, so that the worker can clear any doubts he/she has, so he doesn’t have to assume and continue working. 2. For a requester who is new to the system, it could take more than 1 round of feedback to get used to the type of instructions that are required. 3. When the platform just opens up the real world, all requester and workers would be on the same level. There could be a chance where a requester gets a aworker of poor quality and wouldn't be aware of it. So he might have to reassign his/her work to another worker. To avoid the above, he/she should be able to see the workers review on other platforms like MTurk etc, if it available. This could help a good worker fain an edge while starting off on Daemo.

Flash Teams

  • What do you like about the system / what are its strengths?

Mobile Works provides an alternate source of income for the lower income bracket which is great. It is a great to continue earning during their free time.

  • What do you think can be improved about the system?

1. It can be applied to even a level-up of users (middle income bracket) with a one-level higher complexity of tasks. 2. The users could be incentivized with financial gains if they complete certain number of tasks in a day. (Example: 10% bonus on completing 50+ tasks) 3. Currently a set of users are given duplicate tasks ( ie tasks that have already been given to another person), this is duplication of effort and could be reduced.


Milestone Contributors

Slack usernames of all who helped create this wiki page submission: @varshine