Difference between revisions of "Milestone 1"
| Line 30: | Line 30: | ||
== Explore alternative crowd-labor markets == | == Explore alternative crowd-labor markets == | ||
| − | Choose one of: TaskRabbit/oDesk/ | + | Choose one of the following crowdsourcing sites: |
| + | |||
| + | * [https://www.taskrabbit.com/ TaskRabbit] | ||
| + | * [https://www.odesk.com/ oDesk] | ||
| + | * [http://www.galaxyzoo.org/ GalaxyZoo] | ||
| + | |||
| + | Explore it and a get a feel for how the site works. If you want to, try doing a job on the site. You should not spend any more than 30-45min on this part. | ||
=== Deliverables === | === Deliverables === | ||
Revision as of 21:12, 26 February 2015
In this milestone we want you to:
- Get experience of what it is like to be a worker and requester on current crowd-labor marketplaces
- Read some research papers about crowdsourcing
Contents
Experience the life of a Worker on Mechanical Turk
Sign up as a worker for Mechanical Turk here. Then, practice doing some tasks - you should do enough tasks to earn $1.
If having difficulty signing up as a worker, you can try the worker sandbox, or other sites like CrowdFlower or Microworkers. Your peers will post some worker sandbox HITs at Milestone 1 Sandbox HITs.
Deliverables
Reflect on your experience as a worker on Mechanical Turk. What did you like? What did you dislike?
Experience the life of a Requester on Mechanical Turk
Sign up as a requester for Mechanical Turk here. Then, post some HITs (you will need money, which we will provide how?). If you don't want to spend money, you can post them via the requester sandbox, list them on Milestone 1 Sandbox HITs and ask people to do them for you. Aim to have your HITs done by at least 20 different people.
Examples of tasks you might want to have done (you can pick one of the tasks below, or do a task of your own choosing):
- Transcribe an audio recording
- Get descriptions for images
- Label parts of speech in a sentence
Deliverables
Reflect on your experience as a requester on Mechanical Turk. What did you like? What did you dislike? Also attach the CSV file generated when you download the HIT results.
Explore alternative crowd-labor markets
Choose one of the following crowdsourcing sites:
Explore it and a get a feel for how the site works. If you want to, try doing a job on the site. You should not spend any more than 30-45min on this part.
Deliverables
Compare and contrast the crowd-labor market you just explored (TaskRabbit/oDesk/GalaxyZoo) to Mechanical Turk.
Readings
Please skim over the following papers. For each system, please note:
- What do you like about the system / what are its strengths?
- What do you think can be improved about the system?
MobileWorks
mClerk
txtEagle
Flash Teams
Deliverable
Please create a page for your team's deliverable at http://crowdresearch.stanford.edu/w/index.php?title=Milestone_1_YourTeamName&action=edit (substituting in YourTeamName with the team name), copy over the template at Milestone 1 Template - you can see the source here .
Then, after you have filled out the page, post the link to the wiki page you created on CrowdGrader at SOMEWHERE
