Milestone 2

From crowdresearch
Revision as of 02:41, 7 March 2015 by Geza (Talk | contribs)

Jump to: navigation, search

The goals for this week are to:

  • Learn about needfinding
  • Determine the needs of workers and requesters (from panels and from readings)

Learn about Needfinding

We covered the basics of needfinding in this week's meeting. You may also be interested in viewing Scott Klemmer's HCI lectures on needfinding: [1] [2] [3]

Attend a Panel to Hear from Workers and Requesters

There will be two panels on Hangouts on Air where we will have experienced workers and requesters discussing their experiences on crowdsourcing platforms (MTurk, oDesk, etc). You should to attend one to better understand the needs of workers and requesters:

  • Slot 1: 8:30 am PST (Pacific Time) / 10 pm IST (Indian Time) on Monday March 9th
  • Slot 2: 6 pm PST (Pacific Time) / 9 pm EST (Eastern Time) on Monday March 9th

Deliverable

What were the most salient insights you got from attending the panel?

Readings

Please Do needfinding with microtask workers and with requesters. The easy route would be to attend one of several Hangouts on Air led by workers and requesters. If you want to, go ahead and try to talk to people yourselves. If you want to do that, we recommend paying them. If you’re in India, for example, do you know any relatives who used to be on the platform before Amazon shut it down for Indians?

If you absolutely can’t make it, watch the videos.

Milestone: watch Klemmer’s coursera lecture on needfinding — the videos are on YouTube! (15min)

Invite: GigWalk/FancyHands/Wikipedia

Read: Being A Turker, Turkopticon, Panos Blogs, What is a Need

Submission: Needs for workers. Needs for requesters. —> group meeting: create slides that synthesize the main needs on each side

Video

Watch Kelmmer's needfinding slides

Turker Panels

Attend one of the two panels:

Deliverable:

Write a short response about what was the most salient insights you got from it.

For each of the papersWhat needs do the workers have? What were the


What are the needs for turkers that these papers discuss? What are the needs for requesters that are implicit in these papers?

Participate in the forums.

Synthesize needs

for workers and requesters, what are the things that workers need? what are the things that requesters need?

example of worker need: workers need to be respected example of requester need: requesters need to trust the results they get from workers

a set of bullet points for each of workers and requesters


Readings

Please read the following materials. The papers are copyrighted, so please don't redistribute them. You need to be signed in to view them.

Turkopticon

Irani L C, Silberman M. Turkopticon: Interrupting worker invisibility in amazon mechanical turk. Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. ACM, 2013: 611-620.

If you are able to access Mechanical Turk, you can go try Turkopticon yourself by installing the Chrome Extension.

Being a Turker

Martin D, Hanrahan B V, O'Neill J, et al. Being a turker. Proceedings of the 17th ACM conference on Computer supported cooperative work & social computing. ACM, 2014: 224-235.

Crowdsourcing User Studies with Mechanical Turk

Kittur A, Chi E H, Suh B. Crowdsourcing user studies with Mechanical Turk. Proceedings of the SIGCHI conference on human factors in computing systems. ACM, 2008: 453-456.

A Plea to Amazon: Fix Mechanical Turk

A Plea to Amazon: Fix Mechanical Turk

The Need for Standardization in Crowdsourcing

The Need for Standardization in Crowdsourcing

Deliverables

For each of the above readings, please answer the following:

What worker needs are discussed or implied by the reading? What requester needs are discussed or implied by the reading?

Recommended (but optional) Materials on Worker Needs

These optional materials will help you better understand worker and requester needs:

If you are able to access Mechanical Turk, you can go try Turkopticon yourself by installing the Chrome Extension.

The People Inside Your Machine - a 22-minute NPR radio program about crowd workers

Helpful Blog Posts To Help You Design Your HITs - links to several resources geared towards helping requesters create better HITs

Search Requester Help on Reddit - Requesters often ask for help and advice on Reddit.

Salehi N, Irani L C, Bernstein M S. We Are Dynamo: Overcoming Stalling and Friction in Collective Action for Crowd Workers. 2015. - a system for organizing workers towards collective action

Guidelines for Academic Requesters - A set of guidelines written by Dynamo participants which discusses how to avoid common mistakes made by requesters

Submit on Crowdgrader

Crowdgrader submit link and instructions go here

Fill out this week's survey

Please help us improve our how did you like by filling out this survey.