Difference between revisions of "Milestone 2 Template"

From crowdresearch
Jump to: navigation, search
(Do Needfinding by Browsing MTurk-related forums, Reddit, etc)
Line 5: Line 5:
 
=== Deliverable ===
 
=== Deliverable ===
  
What were the most salient insights you got from hearing the workers and requesters on the panel? What are their needs?
+
Report on some of the observations you gathered during the panel. You can hold back on interpretations and needs until you finish the rest of the observation-gathering in the next steps.
  
 
== Readings ==
 
== Readings ==
Line 11: Line 11:
 
=== Turkopticon ===
 
=== Turkopticon ===
  
What worker needs are discussed or implied by the reading? What requester needs are discussed or implied by the reading?
+
1) What observations about workers can you draw from the readings? Include any that may be are strongly implied but not explicit.
 +
 
 +
2) What observations about requesters can you draw from the readings? Include any that may be are strongly implied but not explicit.
  
 
=== Being a Turker  ===
 
=== Being a Turker  ===
  
What worker needs are discussed or implied by the reading? What requester needs are discussed or implied by the reading?
+
1) What observations about workers can you draw from the readings? Include any that may be are strongly implied but not explicit.
 +
 
 +
2) What observations about requesters can you draw from the readings? Include any that may be are strongly implied but not explicit.
  
 
=== Crowdsourcing User Studies with Mechanical Turk ===
 
=== Crowdsourcing User Studies with Mechanical Turk ===
  
What worker needs are discussed or implied by the reading? What requester needs are discussed or implied by the reading?
+
1) What observations about workers can you draw from the readings? Include any that may be are strongly implied but not explicit.
 +
 
 +
2) What observations about requesters can you draw from the readings? Include any that may be are strongly implied but not explicit.
  
 
=== A Plea to Amazon: Fix Mechanical Turk ===
 
=== A Plea to Amazon: Fix Mechanical Turk ===
  
What worker needs are discussed or implied by the reading? What requester needs are discussed or implied by the reading?
+
1) What observations about workers can you draw from the readings? Include any that may be are strongly implied but not explicit.
 +
 
 +
2) What observations about requesters can you draw from the readings? Include any that may be are strongly implied but not explicit.
  
 
=== The Need for Standardization in Crowdsourcing ===
 
=== The Need for Standardization in Crowdsourcing ===
  
What worker needs are discussed or implied by the reading? What requester needs are discussed or implied by the reading?
+
1) What observations about workers can you draw from the readings? Include any that may be are strongly implied but not explicit.
 +
 
 +
2) What observations about requesters can you draw from the readings? Include any that may be are strongly implied but not explicit.
  
 
== Do Needfinding by Browsing MTurk-related forums, blogs, Reddit, etc ==
 
== Do Needfinding by Browsing MTurk-related forums, blogs, Reddit, etc ==
  
What are some worker and requester needs you discovered while browsing these forums? Summarize the needs, and link to examples (posts / threads).
+
List out your most salient and interesting needs for workers, and for requesters. Please back up each one with evidence: at least one observation, and ideally an interpretation as well.
 
+
=== Worker Needs ===
+
 
+
=== Requester Needs ===
+
  
 
== Synthesize the Needs You Found ==
 
== Synthesize the Needs You Found ==
Line 42: Line 48:
  
 
A set of bullet points summarizing the needs of workers.
 
A set of bullet points summarizing the needs of workers.
* Example: workers need to be respected
+
 
 +
* Example: Workers need to be respected by their employers. Evidence: Sanjay said in the worker panel that he wrote an angry email to a requester who mass-rejected his work. Interpretation: this wasn't actually about the money; it was about the disregard for Sanjay's work ethic.
  
 
=== Requester Needs ===
 
=== Requester Needs ===
  
 
A set of bullet points summarizing the needs of requesters.
 
A set of bullet points summarizing the needs of requesters.
* Example: requesters need to trust the results they get from workers
+
 
 +
* Example: requesters need to trust the results they get from workers. Evidence: In this thread on Reddit (linked), a requester is struggling to know which results to use and which ones to reject or re-post for more data. Interpretation: it's actually quite difficult for requesters to know whether 1) a worker tried hard but the question was unclear or very difficult or an edge case, or 2) a worker wasn't really putting in a best effort.

Revision as of 08:29, 7 March 2015

Template for your submission for Milestone 2. Do not edit this directly - instead, make a new page at Milestone 2 YourTeamName or whatever your team name is, and copy this template over. You can view the source of this page by clicking the Edit button at the top-right of this page, or by clicking here.

Attend a Panel to Hear from Workers and Requesters

Deliverable

Report on some of the observations you gathered during the panel. You can hold back on interpretations and needs until you finish the rest of the observation-gathering in the next steps.

Readings

Turkopticon

1) What observations about workers can you draw from the readings? Include any that may be are strongly implied but not explicit.

2) What observations about requesters can you draw from the readings? Include any that may be are strongly implied but not explicit.

Being a Turker

1) What observations about workers can you draw from the readings? Include any that may be are strongly implied but not explicit.

2) What observations about requesters can you draw from the readings? Include any that may be are strongly implied but not explicit.

Crowdsourcing User Studies with Mechanical Turk

1) What observations about workers can you draw from the readings? Include any that may be are strongly implied but not explicit.

2) What observations about requesters can you draw from the readings? Include any that may be are strongly implied but not explicit.

A Plea to Amazon: Fix Mechanical Turk

1) What observations about workers can you draw from the readings? Include any that may be are strongly implied but not explicit.

2) What observations about requesters can you draw from the readings? Include any that may be are strongly implied but not explicit.

The Need for Standardization in Crowdsourcing

1) What observations about workers can you draw from the readings? Include any that may be are strongly implied but not explicit.

2) What observations about requesters can you draw from the readings? Include any that may be are strongly implied but not explicit.

Do Needfinding by Browsing MTurk-related forums, blogs, Reddit, etc

List out your most salient and interesting needs for workers, and for requesters. Please back up each one with evidence: at least one observation, and ideally an interpretation as well.

Synthesize the Needs You Found

Worker Needs

A set of bullet points summarizing the needs of workers.

  • Example: Workers need to be respected by their employers. Evidence: Sanjay said in the worker panel that he wrote an angry email to a requester who mass-rejected his work. Interpretation: this wasn't actually about the money; it was about the disregard for Sanjay's work ethic.

Requester Needs

A set of bullet points summarizing the needs of requesters.

  • Example: requesters need to trust the results they get from workers. Evidence: In this thread on Reddit (linked), a requester is struggling to know which results to use and which ones to reject or re-post for more data. Interpretation: it's actually quite difficult for requesters to know whether 1) a worker tried hard but the question was unclear or very difficult or an edge case, or 2) a worker wasn't really putting in a best effort.