WinterMilestone 1 Vibhor Sehgal

From crowdresearch
Jump to: navigation, search

Experience the life of a Worker on Mechanical Turk

MTurk Worker Sandbox

What I liked.

  • Very Simple Layout and Design.
  • Proper Instruction Description for the HIT task to be performed.

What I did not like.

  • I purposely answered some HITs incorrectly, somehow I still got the reward for these.
  • Sometimes even while reading a task and then pressing 'Accept HIT' , it would show an error that the task can't be assigned , maybe because someone else accepted the task before me. So maybe a mechanism to show how many people are viewing the task or one task is visible to only one worker.
  • Personally didn't like the Color combination though it matches their logo. ( In comparison to microWorker.)
  • Somehow I can not edit my account details, it redirects me to the Mturk page.


What I liked.

  • Best Worker Tab which identifies the best worker, seems cool.
  • Simple and Nice color themed layout.
  • Simple account settings edit feature.
  • Sorting tasks according to Most paying, Best Rated, Time to Rate which was not there in MTurk Sandbox.

What I did not like.

  • Filling a form for doing the Job.
  • Not a nice logo.

Experience the life of a Requester on Mechanical Turk

Task still under progress on MicroWorkers

Explore alternative crowd-labor markets

Compare and contrast the crowd-labor market you just explored (TaskRabbit/oDesk/GalaxyZoo) to Mechanical Turk.

GalaxyZoo vs MTurk Sandbox

GalaxyZoo MTurk
Classification Task without login available Account is required
Graphical Instructions Typical Textual Instructions
Feel and Look of a Modern Website Simple but dull
Complex Classification Task Easy tasks like Right URL

Odesk(Upwork) vs MTurk Sandbox

Upwork MTurk
Awesome Website Not so nice Website
Nice Color theme Dull Color theme
Simple Job filtering method Filtering using keywords

Odesk seems more like an employment opportunity based website.



What do you like about the system / what are its strengths?

  • Accessible to people who are underemployed.
  • Very high accuracy in the results.
  • Using Cell phones for tasks.

What do you think can be improved about the system?

  • Mobile Screen size limitations impact the task, documents are first chopped, distributed and then combined back. Makes it complex.
  • Now mobiles have bigger screens , so tasks should consider the screen size too as a factor, this will reduce the complexity.
  • Historical accuracy to predict future payments, Pay should be be based on the accuracy of the current submitted task.


What do you like about the system / what are its strengths?

  • Fix for the problem of reputation.
  • Other workers provide Feedback.

What do you think can be improved about the system?

  • Website Design issues are there.

Flash Teams

What do you like about the system / what are its strengths?

  • Elastic Recruitment which helps to increase and shrink the team size seems a great idea, removing something which is not required and adding which is ,one of the best feature.
  • It's actually hard to build teams in a crowded project, Flash team makes this easier with team structures that are scalable.
  • Structured Flow of each task and how it will be performed.
  • Foundry helps to perform managerial tasks.

What do you think can be improved about the system?

  • Like the paper highlights, this must be tested for various different tasks.
  • A little intermix of Human Interaction for management if possible.

Milestone Contributors

Contributors : @sehgalvibhor