Milestone 2 Pumas

From crowdresearch
Jump to: navigation, search

Attend a Panel to Hear from Workers and Requesters

The panel talked about Mturk platform, Mturk platform and Mturk vibe. 
* It is hard to find work in Mturk. It is so difficult to find an opportunity. The worker needs to be popular to get great tasks. 
* The money is the first motivation to get in Turk sometimes the people work part-time to get extra money 
* The communication between workers and requesters takes place in forums, sometimes is better because they can get more feedback
* It is so difficult to be popular into the platform because there are a lot of popular people and they get always the best work. 
* For the foreigners is better to use oDesk 
* Categorisation is a great feature to find work easily 
* The security for requesters is so important because they want to be secured about their researches  

Worker perspective: Being a Turker

Some workers enjoy doing tasks because they use them to learn more about different topics. 
For workers the community is so important because they support themselves to grow up the community.
The government is not their friend because the turking is a great opportunity to get a good job.
Workers are free to calculate their effort and time to work. Workers enjoy managing the work time. 


The communication between requester and worker is so important because they can get a great feedback from worker  
They need to choose great workers to collaborate with them.


Worker perspective: Turkopticon

* ATM is a great system to communicate with requesters
* ATM helps workers to improve the communication with requesters
* Feedback is so important to help growing up the credibility of the platform
* Requesters are more confidence about workers’ job. 

Requester perspective: Crowdsourcing User Studies with Mechanical Turk

1) What observations about workers can you draw from the readings? Include any that may be are strongly implied but not explicit.

2) What observations about requesters can you draw from the readings? Include any that may be are strongly implied but not explicit.

Requester perspective: The Need for Standardization in Crowdsourcing

1) What observations about workers can you draw from the readings? Include any that may be are strongly implied but not explicit.

2) What observations about requesters can you draw from the readings? Include any that may be are strongly implied but not explicit.

Both perspectives: A Plea to Amazon: Fix Mechanical Turk

1) What observations about workers can you draw from the readings? Include any that may be are strongly implied but not explicit.

2) What observations about requesters can you draw from the readings? Include any that may be are strongly implied but not explicit.

Do Needfinding by Browsing MTurk-related forums, blogs, Reddit, etc

What observations about workers can you draw from the readings? Include any that may be are strongly implied but not explicit.

* Workers worry about companies getting away with paying extremely low wages. Workers worry about not being able to visualize the risk they take with certain requesters.  
* Workers worry about not having a group or organization to defend them from deceptive or inexperienced requesters. 
* Workers are annoyed with requesters who lack experience in preparing their requests. 
* Workers are annoyed with researchers who use the Mechanical Turk without learning about it in detail. 
* Workers worry about how they are perceived by Requesters. Especially how their initial inexperience on Mechanical Turk will affect their future employment. 
* Workers brag to each other when they “snag” high paid requests that require little work. 
* Workers support each other when they have failures.
* Workers use social media to discuss requesters (whether they are shady, non-shady)
* Workers use social media to discuss ways to deduce taxes.
* Workers share lists of scam requesters
* Workers share list of requesters that provide easy money


Requesters collaborate with each other by sharing scripts and tips. Some requesters use social media to learn about the needs of turkers Requesters discuss with each other best practices to present a HIT to workers; how to gather certain data.


http://turkernation.com/showthread.php?3756-Silly-researcher-tricks http://turkernation.com/archive/index.php/t-19564.html http://turkernation.com/showthread.php?22649-quot-Turkers-guidelines-for-academic-requesters-quot-appears-on-academic-crowdsourcing-blog http://turkernation.com/showthread.php?23847-Before-Turning-Off-Comments-Try-These-Research-Based-Strategies http://turkernation.com/showthread.php?21352-The-Myth-of-Low-Cost-High-Quality-on-Amazon-s-Mechanical-Turk http://turkernation.com/showthread.php?6422-Ever-wonder-what-Mturk-looks-like-from-the-other-side http://www.reddit.com/r/mturk/comments/2yorvw/guys_i_think_i_may_have_just_really_screwed/ http://i.imgur.com/GHK0YGs.png http://www.reddit.com/r/mturk/ http://www.reddit.com/r/mturk/comments/2yhalw/so_did_anyone_else_snag_that_50_survey/ http://www.reddit.com/r/mturk/comments/2ykgif/scripts_for_demographic_questions/ http://www.reddit.com/r/mturk/comments/2yolml/i_have_some_script_questions_for_tampermonkey_i/ http://www.reddit.com/r/mturk/comments/2yht89/newbie_just_got_my_first_rejection/ http://www.reddit.com/r/mturk/comments/2y471v/taxes_on_mturk/ http://www.reddit.com/r/mturk/comments/2clggw/i_am_a_requester_on_mturk_what_suggestions_do/ http://www.reddit.com/r/HITsWorthTurkingFor/comments/20q1nc/watch_out_for_requester_randy_swagerty/

Synthesize the Needs You Found

* A set of bullet points summarizing the needs of workers.
  Example: Workers need to be respected by their employers. Evidence: Sanjay said in the worker panel that he wrote an angry email to a requester who mass-rejected his work. Interpretation: this      wasn't actually about the money; it was about the disregard for Sanjay's work ethic.
A set of bullet points summarizing the needs of requesters.
 Example: requesters need to trust the results they get from workers. Evidence: In this thread on Reddit (linked), a requester is struggling to know which results to use and which ones to reject or  re-post for more data. Interpretation: it's actually quite difficult for requesters to know whether 1) a worker tried hard but the question was unclear or very difficult or an edge case, or 2) a worker  wasn't really putting in a best effort.

Worker Needs

Workers need ways to easily visualize the risk they might take with requesters. Evidence: In these forms workers discuss how they wish they could understand just how “shaddy” a certain requester  might be, and then decide for themselves whether they want to take the risk and do the hit.  http://turkernation.com/showthread.php?3756-Silly-researcher-tricks
http://turkernation.com/archive/index.php/t-19564.html
Workers need ways to collectively make reports on “shady” requesters and take action against them. Evidence: in these forum posts workers are already collectively reporting inappropriate  requesters, and  wishing they could collectively do something against them. 
http://www.reddit.com/r/HITsWorthTurkingFor/comments/20q1nc/watch_out_for_requester_randy_swagerty/
http://www.reddit.com/r/mturk/comments/2yj04z/the_account_has_been_unsuspended_so_that_you_may/
http://www.reddit.com/r/mturk/comments/2yipv1/sarah_shadid_rejections_overturned/


Requester Needs

Requesters needs ways to easily visualize the needs of workers. Evidence: In this reddit post  a requester asks workers what are their needs as he is unaware.   http://www.reddit.com/r/mturk/comments/2clggw/i_am_a_requester_on_mturk_what_suggestions_do/
New Requesters need ways to easily visualize and understand the dynamics of workers and requesters. Evidence: In these forums many workers complain on the errors made by new requesters  who are oblivious to the dynamics of workers and requesters http://turkernation.com/showthread.php?23847-Before-Turning-Off-Comments-Try-These-Research-Based-Strategies
http://turkernation.com/showthread.php?21352-The-Myth-of-Low-Cost-High-Quality-on-Amazon-s-Mechanical-Turk
http://turkernation.com/showthread.php?22649-quot-Turkers-guidelines-for-academic-requesters-quot-appears-on-academic-crowdsourcing-blog