Difference between revisions of "Huskyreflection milestone2"

From crowdresearch
Jump to: navigation, search
(Deliverable)
Line 3: Line 3:
 
=== Deliverable ===
 
=== Deliverable ===
  
Report on some of the observations you gathered during the panel.
+
* Some workers changed their life style to be able to catch HITS. Even though it sounded nice when the worker said she woke up early for that, we should keep in mind that it might be a negative outcome for something who might be staying up really late at night. This meant how important it was for them to be able to catch the HITs.
 +
* Crowdsourcing can be a good thing for people who rather work alone or remote or don't have the ability (physically or mentally) to go to an office.
  
 
== Reading Others' Insights ==
 
== Reading Others' Insights ==

Revision as of 19:40, 24 January 2016

Attend a Panel to Hear from Workers and Requesters

Deliverable

  • Some workers changed their life style to be able to catch HITS. Even though it sounded nice when the worker said she woke up early for that, we should keep in mind that it might be a negative outcome for something who might be staying up really late at night. This meant how important it was for them to be able to catch the HITs.
  • Crowdsourcing can be a good thing for people who rather work alone or remote or don't have the ability (physically or mentally) to go to an office.

Reading Others' Insights

Worker perspective: Being a Turker

1) What observations about workers can you draw from the readings? Include any that may be are strongly implied but not explicit.

  • Money is the main motivation yet enjoying the tasks, allowing turkers to do multi task their HIT with their daily activities.
  • Turkers to some extent enjoy their anonymity and they consider themselves as a community.
  • No Way to rate requesters, but it can be inferred to some extent based on experience.

2) What observations about requesters can you draw from the readings? Include any that may be are strongly implied but not explicit.

  • Requesters post a HIT with a target audience and they set the wage accordingly.

Worker perspective: Turkopticon

1) What observations about workers can you draw from the readings? Include any that may be are strongly implied but not explicit.

  • Turkers have various motivations to accept HITS and sometimes they consider it as a full time job.
  • Too much wasted time to understand the task that could be explained better.
  • Frustration and uncertainty of not knowing whether honest work is going to be valued.
  • No standard payment method or minimum wage (tasks exist with wages as low as 1 cent).
  • Difficulty to make connections and maintain long term relationships.
  • Communication difficulty betweek worker and requester is an issue, discussing things such as clarification, progress can be important to both parties.

2) What observations about requesters can you draw from the readings? Include any that may be are strongly implied but not explicit.

  • Requesters are interested in high quality performance merely task being done is not a measure for them that the task is accomplished.
  • Posting multiple tasks at a time will result in overwhelming number of queries following to the HITS.

Requester perspective: Crowdsourcing User Studies with Mechanical Turk

1) What observations about workers can you draw from the readings? Include any that may be are strongly implied but not explicit.


2) What observations about requesters can you draw from the readings? Include any that may be are strongly implied but not explicit.

Requester perspective: The Need for Standardization in Crowdsourcing

1) What observations about workers can you draw from the readings? Include any that may be are strongly implied but not explicit.

  • Workers are not sure about the true value of the tasks they do.
  • Workers are could save time if requesters used templates so it would be easy for them to not have to read through the instructions that might be very common.
  • Workers have difficulty adjusting to various requirements of requesters.

2) What observations about requesters can you draw from the readings? Include any that may be are strongly implied but not explicit.

  • Requesters have to be responsible for the tasks they post because poor task definition can result in confusion of workers.
  • Requesters are aware of a bigger picture than the workers so sometimes sharing the bigger picture with the worker could potentially help them perform better.
  • Sometimes requesters need to train workers and they are not guaranteed that the workers will stay after training so it will be a waste of money for them.


Both perspectives: A Plea to Amazon: Fix Mechanical Turk

1) What observations about workers can you draw from the readings? Include any that may be are strongly implied but not explicit.

  • Workers want to learn more about their requesters reputation about the requests they have posted and how they have responded to their previous workers.
  • Workers want to be guaranteed wage for the time they spend for their true work.
  • Workers cannot predict how long it takes for a task to be completed and that is often times something easy to be determined by the requester.
  • Difficulty to find appropriate suggestions for finding tasks.

2) What observations about requesters can you draw from the readings? Include any that may be are strongly implied but not explicit.

  • Requesters would like to have access to the worker reputation and history and have a better understanding of their demographics.
  • Standardized templates for common tasks.

Do Needfinding by Browsing MTurk-related forums, blogs, Reddit, etc

List out the observations you made while doing your fieldwork. Links to examples (posts / threads) would be extremely helpful.

Synthesize the Needs You Found

List out your most salient and interesting needs for workers, and for requesters. Please back up each one with evidence: at least one observation, and ideally an interpretation as well.

Worker Needs

A set of bullet points summarizing the needs of workers.

  • Example: Workers need to be respected by their employers. Evidence: Sanjay said in the worker panel that he wrote an angry email to a requester who mass-rejected his work. Interpretation: this wasn't actually about the money; it was about the disregard for Sanjay's work ethic.

Requester Needs

A set of bullet points summarizing the needs of requesters.

  • Example: requesters need to trust the results they get from workers. Evidence: In this thread on Reddit (linked), a requester is struggling to know which results to use and which ones to reject or re-post for more data. Interpretation: it's actually quite difficult for requesters to know whether 1) a worker tried hard but the question was unclear or very difficult or an edge case, or 2) a worker wasn't really putting in a best effort.