Difference between revisions of "Milestone 1"

From crowdresearch
Jump to: navigation, search
Line 23: Line 23:
  
 
== Readings ==
 
== Readings ==
 +
 +
Please skim over the following papers. For each system, please note:
 +
 +
* What do you like about the system / what are its strengths?
 +
 +
* What do you think can be improved about the system?
  
 
=== MobileWorks ===
 
=== MobileWorks ===

Revision as of 21:32, 26 February 2015

In this milestone we want you to:

  • Get experience of what it is like to be a worker and requester on current crowd-labor marketplaces
  • Read some research papers about crowdsourcing

Experience the life of a Worker on Mechanical Turk

Sign up as a worker for Mechanical Turk's worker sandbox at SITE

Deliverables:

Experience the life of a Requester on Mechanical Turk

Sign up as a requester for Mechanical Turk's sandbox at SITE

Deliverables:

Explore alternative crowd-labor markets

Choose one of: TaskRabbit/oDesk/GalaxyZoo. Explore. If you’re inspired, get a job. We expect 30-45min.


Readings

Please skim over the following papers. For each system, please note:

  • What do you like about the system / what are its strengths?
  • What do you think can be improved about the system?

MobileWorks

Narula P, Gutheim P, Rolnitzky D, et al. MobileWorks: A Mobile Crowdsourcing Platform for Workers at the Bottom of the Pyramid. Human Computation, 2011, 11: 11.

mClerk

Gupta A, Thies W, Cutrell E, et al. mClerk: enabling mobile crowdsourcing in developing regions. Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. ACM, 2012: 1843-1852.

txtEagle

Eagle N. txteagle: Mobile crowdsourcing. Internationalization, Design and Global Development. Springer Berlin Heidelberg, 2009: 447-456.

Flash Teams

Retelny D, Robaszkiewicz S, To A, et al. Expert crowdsourcing with flash teams. Proceedings of the 27th annual ACM symposium on User interface software and technology. ACM, 2014: 75-85.

Deliverable

Please create a page for your team's deliverable at http://crowdresearch.stanford.edu/w/index.php?title=Milestone_1_YourTeamName&action=edit (substituting in YourTeamName with the team name), copy over the template at Milestone 1 Template - you can see the source here .

Then, after you have filled out the page, post the link to the wiki page you created on CrowdGrader at SOMEWHERE

Old Stuff

Worker: Make at least $1

Requester: work with at least 20 workers (tasks)

—> either: if you have funds, get real workers to do it.

—> or: post on sandbox and recruit some friends

TODO: let’s figure out what the signup procedure is these days

Requester: give a few examples…transcribe audio, extract info from web site, anything you want

If you can’t get in, there are other platforms: Microworkers, crowd flower.


Submit: attach CSV of results

Read: my half-day as an MTurker

Read: MobileWorks, mClerk, txtEagle, (flash teams?)

Submit: what do you like about these systems? What don’t you like?

Submit: reflect on your experience as a worker. reflect on your experience as a requester. write up short reflections: what did you like? what did you hate?