Huskyreflection milestone2

From crowdresearch
Jump to: navigation, search

Attend a Panel to Hear from Workers and Requesters

Team members: @parsis @sophiesong

Deliverable

  • Some workers changed their life style to be able to catch HITS. Even though it sounded nice when the worker said she woke up early for that, we should keep in mind that it might be a negative outcome for something who might be staying up really late at night. This meant how important it was for them to be able to catch the HITs.
  • Crowdsourcing can be a good thing for people who rather work alone or remote or don't have the ability (physically or mentally) to go to an office.

Reading Others' Insights

Worker perspective: Being a Turker

1) What observations about workers can you draw from the readings? Include any that may be are strongly implied but not explicit.

  • Money is the main motivation yet enjoying the tasks, allowing turkers to do multi task their HIT with their daily activities.
  • Turkers to some extent enjoy their anonymity and they consider themselves as a community.
  • No Way to rate requesters, but it can be inferred to some extent based on experience.

2) What observations about requesters can you draw from the readings? Include any that may be are strongly implied but not explicit.

  • Requesters post a HIT with a target audience and they set the wage accordingly.

Worker perspective: Turkopticon

1) What observations about workers can you draw from the readings? Include any that may be are strongly implied but not explicit.

  • Turkers have various motivations to accept HITS and sometimes they consider it as a full time job.
  • Too much wasted time to understand the task that could be explained better.
  • Frustration and uncertainty of not knowing whether honest work is going to be valued.
  • No standard payment method or minimum wage (tasks exist with wages as low as 1 cent).
  • Difficulty to make connections and maintain long term relationships.
  • Communication difficulty betweek worker and requester is an issue, discussing things such as clarification, progress can be important to both parties.

2) What observations about requesters can you draw from the readings? Include any that may be are strongly implied but not explicit.

  • Requesters are interested in high quality performance merely task being done is not a measure for them that the task is accomplished.
  • Posting multiple tasks at a time will result in overwhelming number of queries following to the HITS.

Requester perspective: Crowdsourcing User Studies with Mechanical Turk

1) What observations about workers can you draw from the readings? Include any that may be are strongly implied but not explicit.


2) What observations about requesters can you draw from the readings? Include any that may be are strongly implied but not explicit.

Requester perspective: The Need for Standardization in Crowdsourcing

1) What observations about workers can you draw from the readings? Include any that may be are strongly implied but not explicit.

  • Workers are not sure about the true value of the tasks they do.
  • Workers are could save time if requesters used templates so it would be easy for them to not have to read through the instructions that might be very common.
  • Workers have difficulty adjusting to various requirements of requesters.

2) What observations about requesters can you draw from the readings? Include any that may be are strongly implied but not explicit.

  • Requesters have to be responsible for the tasks they post because poor task definition can result in confusion of workers.
  • Requesters are aware of a bigger picture than the workers so sometimes sharing the bigger picture with the worker could potentially help them perform better.
  • Sometimes requesters need to train workers and they are not guaranteed that the workers will stay after training so it will be a waste of money for them.


Both perspectives: A Plea to Amazon: Fix Mechanical Turk

1) What observations about workers can you draw from the readings? Include any that may be are strongly implied but not explicit.

  • Workers want to learn more about their requesters reputation about the requests they have posted and how they have responded to their previous workers.
  • Workers want to be guaranteed wage for the time they spend for their true work.
  • Workers cannot predict how long it takes for a task to be completed and that is often times something easy to be determined by the requester.
  • Difficulty to find appropriate suggestions for finding tasks.

2) What observations about requesters can you draw from the readings? Include any that may be are strongly implied but not explicit.

  • Requesters would like to have access to the worker reputation and history and have a better understanding of their demographics.
  • Standardized templates for common tasks.

Synthesize the Needs You Found

Worker Needs

  • A work/wage balance
  • Standardized way of paying (or maybe fair payment rather than standard)
  • A well explained description of the task or training
  • Estimate of the time it takes to complete a task
  • A moderated way of communication with requester
  • Suggestion of tasks that would be appropriate for them
  • Training for jobs that would be a level higher than what they currently are able to do, so they would have a learning curve as well.
  • Feedback from requester
  • Be able to establish relationships (either with other workers or with requesters)

Requester Needs

  • Get their job done with high quality (or they wouldn't post more jobs for crowdsourcing)
  • Get their tasks done quickly
  • Get feedback for the quality of their post
  • Establish relationship with workers
  • Being able to communicate with workers
  • Moderator, to not give them ultimate power to reject a valuable work