Milestone 1

From crowdresearch
Revision as of 17:44, 26 February 2015 by Geza (Talk | contribs)

Jump to: navigation, search

In this milestone we want you to:

  • Get experience of what it is like to be a worker and requester on current crowd-labor marketplaces
  • Read some research papers about crowdsourcing

Experience the life of a Worker on Mechanical Turk

Sign up as a worker for Mechanical Turk's worker sandbox at SITE


Experience the life of a Requester on Mechanical Turk

Sign up as a requester for Mechanical Turk's sandbox at SITE


Explore alternative crowd-labor markets

Choose one of: TaskRabbit/oDesk/GalaxyZoo. Explore. If you’re inspired, get a job. We expect 30-45min.



Narula P, Gutheim P, Rolnitzky D, et al. MobileWorks: A Mobile Crowdsourcing Platform for Workers at the Bottom of the Pyramid. Human Computation, 2011, 11: 11.


Gupta A, Thies W, Cutrell E, et al. mClerk: enabling mobile crowdsourcing in developing regions. Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. ACM, 2012: 1843-1852.


Eagle N. txteagle: Mobile crowdsourcing. Internationalization, Design and Global Development. Springer Berlin Heidelberg, 2009: 447-456.

Flash Teams

Retelny D, Robaszkiewicz S, To A, et al. Expert crowdsourcing with flash teams. Proceedings of the 27th annual ACM symposium on User interface software and technology. ACM, 2014: 75-85.


Please create a page for your team's deliverable at (substituting in YourTeamName with the team name), copy over the template at Milestone 1 Template - you can see the source here .

Then, after you have filled out the page, post the link to the wiki page you created on CrowdGrader at SOMEWHERE

Old Stuff

Worker: Make at least $1

Requester: work with at least 20 workers (tasks)

—> either: if you have funds, get real workers to do it.

—> or: post on sandbox and recruit some friends

TODO: let’s figure out what the signup procedure is these days

Requester: give a few examples…transcribe audio, extract info from web site, anything you want

If you can’t get in, there are other platforms: Microworkers, crowd flower.

Submit: attach CSV of results

Read: my half-day as an MTurker

Read: MobileWorks, mClerk, txtEagle, (flash teams?)

Submit: what do you like about these systems? What don’t you like?

Submit: reflect on your experience as a worker. reflect on your experience as a requester. write up short reflections: what did you like? what did you hate?