Difference between revisions of "Milestone 2 teamtrojan"

From crowdresearch
Jump to: navigation, search
(Worker perspective: Turkopticon)
(Turkopticon)
Line 19: Line 19:
 
'''From the worker's perspective :'''
 
'''From the worker's perspective :'''
  
''A. Amazon Mechanical Turk''
+
'''''A. Amazon Mechanical Turk'''''
  
 
'''1. Limited/ No Authority:''' In Amazon Mechanical Turk(AMT), workers have limited options for dissent in case their work gets rejected. They have no legal recourse against employers who reject their work and then go to reuse it.
 
'''1. Limited/ No Authority:''' In Amazon Mechanical Turk(AMT), workers have limited options for dissent in case their work gets rejected. They have no legal recourse against employers who reject their work and then go to reuse it.
Line 36: Line 36:
  
  
''B. Turkopticon''
+
'''''B. Turkopticon'''''
  
 
'''1. Workers’ mutual aid:''' Workers enter reviews, ratings and comments for the requesters which helps them in avoiding the spammers.
 
'''1. Workers’ mutual aid:''' Workers enter reviews, ratings and comments for the requesters which helps them in avoiding the spammers.

Revision as of 14:37, 11 March 2015


Attend a Panel to Hear from Workers and Requesters

Deliverable

Report on some of the observations you gathered during the panel.

Reading Others' Insights

Worker perspective: Being a Turker

1) What observations about workers can you draw from the readings? Include any that may be are strongly implied but not explicit.

2) What observations about requesters can you draw from the readings? Include any that may be are strongly implied but not explicit.

Turkopticon

From the worker's perspective :

A. Amazon Mechanical Turk

1. Limited/ No Authority: In Amazon Mechanical Turk(AMT), workers have limited options for dissent in case their work gets rejected. They have no legal recourse against employers who reject their work and then go to reuse it.

2. Wage Theft: In AMT, workers are sometimes victims of wage theft when employers deliberately reject their work.

3. Interchangeable Treatment: Due to surplus labor, workers are treated interchangeably i.e no efforts are made to stop a worker from leaving the platform.

4. Difficulty in gaining approval rating: When a worker’s task is rejected, his/her approval rating falls down and then the system high priority tasks from the worker. Thus, hindering his/her chances of improving the approval rating.

5. Communication Issues: Amazon system as well as requesters frequently do not reply back to the workers’ concerns.

6. No Minimum Wage Policy: There is no fixed minimum wage per hit or per hour for the workers making their income highly variable.

7. Reason for working: The purpose of working on this platform varies for each worker from fun/ pass time to paying electricity bills.


B. Turkopticon

1. Workers’ mutual aid: Workers enter reviews, ratings and comments for the requesters which helps them in avoiding the spammers.

2. Search Functionality: Workers have access to search the tasks using keywords like requester’s name or id.

3. Anonymity: Workers are protected from retribution by obfuscating their email addresses while posting reviews and comments for requesters.

Requester perspective: Crowdsourcing User Studies with Mechanical Turk

1) What observations about workers can you draw from the readings? Include any that may be are strongly implied but not explicit.

2) What observations about requesters can you draw from the readings? Include any that may be are strongly implied but not explicit.

The Need for Standardization in Crowdsourcing

From the worker's perspective :

1. Adaptation Problems: Since workers are not provided any kind of training in the current market scenario, they need to work hard to learn the intricacies of interface environment for each employer and adapt to requirements for each employer

2. Variable Income: The amount of money made by a worker by working equal number of hours on two different days is highly variable. Thus, this source of income is highly variable.

3. Insecurity: Because of no proper training and no skillset specification for a worker, a worker is always skeptical about the likely outcome i.e whether his work will be accepted by the requester.

4. Skills mismatch: Workers face problem in finding out the job they need and this often leads to mismatch of skills/ talent.

5. Flexibility: Workers have freedom of choosing the kind of work they wish to perform from all the given available tasks. They have the ease of experimenting with different types of tasks.

Both perspectives: A Plea to Amazon: Fix Mechanical Turk

1) What observations about workers can you draw from the readings? Include any that may be are strongly implied but not explicit.

2) What observations about requesters can you draw from the readings? Include any that may be are strongly implied but not explicit.

Do Needfinding by Browsing MTurk-related forums, blogs, Reddit, etc

List out the observations you made while doing your fieldwork. Links to examples (posts / threads) would be extremely helpful.

Synthesize the Needs You Found

List out your most salient and interesting needs for workers, and for requesters. Please back up each one with evidence: at least one observation, and ideally an interpretation as well.

Worker Needs

A set of bullet points summarizing the needs of workers.

  • Example: Workers need to be respected by their employers. Evidence: Sanjay said in the worker panel that he wrote an angry email to a requester who mass-rejected his work. Interpretation: this wasn't actually about the money; it was about the disregard for Sanjay's work ethic.

Requester Needs

A set of bullet points summarizing the needs of requesters.

  • Example: requesters need to trust the results they get from workers. Evidence: In this thread on Reddit (linked), a requester is struggling to know which results to use and which ones to reject or re-post for more data. Interpretation: it's actually quite difficult for requesters to know whether 1) a worker tried hard but the question was unclear or very difficult or an edge case, or 2) a worker wasn't really putting in a best effort.