Difference between revisions of "Milestone 3"

From crowdresearch
Jump to: navigation, search
(Requester Needs)
(Worker Needs)
Line 15: Line 15:
 
! Interpretations
 
! Interpretations
 
|-
 
|-
|some need
+
|Workers need to be able to quickly find tasks they'd want to work on
|some observation
+
|Monday evening panel workers cite the challenge in identifying or distinguishing tasks because of poor tagging, Reddit discussion also cited the exorbitant amount of time that they spend trying to find tasks and do the mental calculations to find the opportunities that match them best (e.g. time to complete the task on average, average $ per minute on task, requirements to complete the task).
|some interpretation
+
|Finding a task that matches well with the worker's skillset and pays well takes a significant amount of (unpaid) time.
 
|-
 
|-
|some need
+
|Workers need to feel they are being fairly compensated for their work.
|some observation
+
|Reddit discussion cites that the payment system for HITs is not adaptive and does not take into account changing marketplace conditions (supply/demand) and pricing of tasks based on those changes.
|some interpretation
+
|Monetary compensation is the primary motivator for many crowd workers.
 
|-
 
|-
|some need
+
|Workers need to feel like they are treated fairly and respectfully, and have a voice in the platform
|some observation
+
|Comment on Turkopticon: "Got a mass rejection from some hits I did for them! Talked to other turkers that I know in real life and the same thing happened to them. There rejection comments are also really demeaning. Definitely avoid!"
|some interpretation
+
|Unreasonable rejections and low payments lead workers to feel disrespected. The implicit assumption on MTurk is that workers are unskilled and replaceable. They can do little if their work is rejected.
 
|-
 
|-
|some need
+
|Workers need to be able to expose their skills so they can get work they are qualified for and advance their skills
|some observation
+
|Monday evening panel workers from oDesk cite that most employers will not work with them until they have enough feedback or past work on the platform
|some interpretation
+
|If users cannot get new work without feedback, this makes it difficult for new users to establish their reputation and get jobs that will help develop their skillsets.  
|-
+
| Workers need to have a platform to protect their rights and recognize their interests.
+
| Workers realise the importance of a "Worker's Bill of Rights" when brought to their attention by an external source.
+
| Workers lack the technical skill to develop a mutual aid platform on their own. They cannot help themseleves in this respect.
+
|-
+
| Workers need to have methods to evaluate employers and comfortably exert their free speech.
+
| Workers are divided in how they evaluate employers and the privacy they wish to enjoy.
+
| Cultural and demographic diversity of workers pose different requirements and expectations.
+
|-
+
| Workers need to be respected and their work valued more.
+
| Workers have no legal recourse against employers who reject their work, and then use it.
+
| Thus they do not enjoy intellectual property rights over their own work.
+
|-
+
| style="width: 300px;"| Workers need to get Job suggestions according to their skills or previous HIT's.
+
| style="width: 400px;"| Finding work on AMT is tough,Veteran Turkers like SpamGirl and Manish use various tools/scripts to find work.
As David discussed in the morning panel for first-time Turkers
+
it almost impossible to find work.
+
| style="width: 350px;"| The non-user-friendly interface is an obstruction in itself when one starts turking,
and one needs to have various tools to make reasonable money .
+
|-
+
| Workers should be given certain rights and they should be guarded.
+
| "iambob" on Turker Nation was unjustly blocked by a Requester.
+
| This is about what the workers deserve.
+
 
|-
 
|-
 
|}
 
|}

Revision as of 05:24, 14 March 2015

This week, we will take the set of needs that we collectively identified in the previous milestone

Needs from Milestone 2

We synthesized the main needs groups identified in Milestone 2 in the following table:

Worker Needs

Needs Evidence
Observations Interpretations
Workers need to be able to quickly find tasks they'd want to work on Monday evening panel workers cite the challenge in identifying or distinguishing tasks because of poor tagging, Reddit discussion also cited the exorbitant amount of time that they spend trying to find tasks and do the mental calculations to find the opportunities that match them best (e.g. time to complete the task on average, average $ per minute on task, requirements to complete the task). Finding a task that matches well with the worker's skillset and pays well takes a significant amount of (unpaid) time.
Workers need to feel they are being fairly compensated for their work. Reddit discussion cites that the payment system for HITs is not adaptive and does not take into account changing marketplace conditions (supply/demand) and pricing of tasks based on those changes. Monetary compensation is the primary motivator for many crowd workers.
Workers need to feel like they are treated fairly and respectfully, and have a voice in the platform Comment on Turkopticon: "Got a mass rejection from some hits I did for them! Talked to other turkers that I know in real life and the same thing happened to them. There rejection comments are also really demeaning. Definitely avoid!" Unreasonable rejections and low payments lead workers to feel disrespected. The implicit assumption on MTurk is that workers are unskilled and replaceable. They can do little if their work is rejected.
Workers need to be able to expose their skills so they can get work they are qualified for and advance their skills Monday evening panel workers from oDesk cite that most employers will not work with them until they have enough feedback or past work on the platform If users cannot get new work without feedback, this makes it difficult for new users to establish their reputation and get jobs that will help develop their skillsets.

Requester Needs

Needs Evidence
Observations Interpretations
Requesters need to get their HITs completed (quickly / correctly) Requester asking on forum why nobody is doing his HITs (7-minute, 25-cent surveys - a very low wage) Requesters want their HITs done, and when nobody's doing them, they do not know the reason why (e.g. it is because he is underpaying workers)
Requesters need to be able to trust the results they get Requesters will often rely on previous workers whose results they can trust, and add mechanisms to detect spammers, or manually verify some results. If spammers are not caught, this brings the correctness of results into question. If requesters are not sure the results are correct, they may need to discard the data.
Requesters need to have workers who have the appropriate skills and demographics do their tasks Requesters worry that they are not able to verify self-reported demographics for surveys. Workers' self-reported skills and demographics are often not viewed as trustworthy. This is a problem for surveys, which need to have correct demographic data to be useful.
Requesters need to be able to easily generate good tasks Companies hire full-time developers to deal with the complexities of posting microtasks on MTurk. Requesters often develop their own tools and workflow systems on top of Amazon's. The process of authoring HITs is currently difficult and makes crowd-work inaccessible to potential requesters
Requesters need to price their tasks appropriately Requesters asking on forums about the appropriate amount they should pay for their HITs Requesters often don't have a good intuition of what the appropriate wage for their task would be in terms of price per HIT.
Requesters need workers to trust them Requesters say they are reluctant to reject work, because they fear they might get bad reviews. Workers are more likely to do HITs if the requester seems trustworthy. Requesters do not want bad reviews, because they may result in workers ignoring the requester's HITs