Difference between revisions of "WinterMilestone 2 fourtypercent"

From crowdresearch
Jump to: navigation, search
Line 10: Line 10:
  
 
Report on some of the observations you gathered during the panel.
 
Report on some of the observations you gathered during the panel.
 +
 +
Main Observations: Being A Turker
 +
 +
Main Observations: Being a Requester
 +
 +
Chris (In General):
 +
 +
What works well:
 +
 +
 +
"one of the best things...as a requester... you can test and make hypothesis very fast"
 +
 +
Often we post a small badge to see if the Instructions make things
 +
often they are emailing...
 +
it would be better maybe to do it on turkeys nation... "Still a work around here"
 +
 +
Clearly convey to work what should be done is important
 +
 +
QUALITY AND REPUTATION
 +
 +
he had someone to do the commounication with the turkers for him
 +
now not anymore but needs someone again
 +
 +
Whis for automatic adjudications system (work could be done by people clearly well on this tasks)
 +
 +
Workers are represented as Serial numbers! Inhuman! He says this is why they are treated bad
 +
 +
REJECTION
 +
 +
being aware of people that work conchíously
 +
(has threshold system)
 +
 +
 +
Confident Guy... Knows what he does
  
 
== Reading Others' Insights ==
 
== Reading Others' Insights ==

Revision as of 10:55, 23 January 2016


Attend a Panel to Hear from Workers and Requesters

Deliverable

For the note taking of the panel we used troll to work visually.

/Users/ferdinandlinke/Library/Group Containers/Q79WDW8YH9.com.evernote.Evernote/Evernote/quick-note/ferlin___Evernote/quick-note-wByEH1/attachment--Wbakro/screenshot.png

Report on some of the observations you gathered during the panel.

Main Observations: Being A Turker

Main Observations: Being a Requester

Chris (In General):

What works well:


"one of the best things...as a requester... you can test and make hypothesis very fast"

Often we post a small badge to see if the Instructions make things often they are emailing... it would be better maybe to do it on turkeys nation... "Still a work around here"

Clearly convey to work what should be done is important

QUALITY AND REPUTATION

he had someone to do the commounication with the turkers for him now not anymore but needs someone again

Whis for automatic adjudications system (work could be done by people clearly well on this tasks)

Workers are represented as Serial numbers! Inhuman! He says this is why they are treated bad

REJECTION

being aware of people that work conchíously (has threshold system)


Confident Guy... Knows what he does

Reading Others' Insights

Worker perspective: Being a Turker

1) What observations about workers can you draw from the readings? Include any that may be are strongly implied but not explicit.

2) What observations about requesters can you draw from the readings? Include any that may be are strongly implied but not explicit.

Worker perspective: Turkopticon

1) What observations about workers can you draw from the readings? Include any that may be are strongly implied but not explicit.

2) What observations about requesters can you draw from the readings? Include any that may be are strongly implied but not explicit.

Requester perspective: Crowdsourcing User Studies with Mechanical Turk

1) What observations about workers can you draw from the readings? Include any that may be are strongly implied but not explicit.

2) What observations about requesters can you draw from the readings? Include any that may be are strongly implied but not explicit.

Requester perspective: The Need for Standardization in Crowdsourcing

1) What observations about workers can you draw from the readings? Include any that may be are strongly implied but not explicit.

2) What observations about requesters can you draw from the readings? Include any that may be are strongly implied but not explicit.

Both perspectives: A Plea to Amazon: Fix Mechanical Turk

1) What observations about workers can you draw from the readings? Include any that may be are strongly implied but not explicit.

2) What observations about requesters can you draw from the readings? Include any that may be are strongly implied but not explicit.

Do Needfinding by Browsing MTurk-related forums, blogs, Reddit, etc

List out the observations you made while doing your fieldwork. Links to examples (posts / threads) would be extremely helpful.

Synthesize the Needs You Found

List out your most salient and interesting needs for workers, and for requesters. Please back up each one with evidence: at least one observation, and ideally an interpretation as well.

Worker Needs

A set of bullet points summarizing the needs of workers.

  • Example: Workers need to be respected by their employers. Evidence: Sanjay said in the worker panel that he wrote an angry email to a requester who mass-rejected his work. Interpretation: this wasn't actually about the money; it was about the disregard for Sanjay's work ethic.

Requester Needs

A set of bullet points summarizing the needs of requesters.

  • Example: requesters need to trust the results they get from workers. Evidence: In this thread on Reddit (linked), a requester is struggling to know which results to use and which ones to reject or re-post for more data. Interpretation: it's actually quite difficult for requesters to know whether 1) a worker tried hard but the question was unclear or very difficult or an edge case, or 2) a worker wasn't really putting in a best effort.