WinterMilestone 1 frostao

From crowdresearch
Jump to: navigation, search

Experience the life of a Worker on Mechanical Turk

Reflect on your experience as a worker on Mechanical Turk. What did you like? What did you dislike?

  • What I like
    • Since this platform has been there for a while, it has a good amount of tasks available.
    • Pretty fast approves.
  • What I dislike
    • Mechanical Turk's website seem really outdated comparing to other current websites. Its UI designs are really old.
    • The sign up process is not easy. I understand that they will need certain information in order to pay the worker. However, those should come to later when the user actually made enough money and the user wants to withdraw it.
    • As a worker, the amount I get paid is too low for me to get even motivated to do the tasks.
    • It is hard for worker to continuously doing work. The worker usually has to switch between different people's tasks manually in order to continue working.
    • Does not have smart suggest(suggest tasks based on the worker's working history)
    • Some tasks are really hard to do because of poorly written instructions or just impossible to achieve.

Experience the life of a Requester on Mechanical Turk

Reflect on your experience as a requester on Mechanical Turk. What did you like? What did you dislike? Also attach the CSV file generated when you download the HIT results.

  • What I like
    • Has something called qualification that will somehow ensure my work quality.
    • It is highly customizable to accommodate all different tasks because I can basically code the task from scratch.
    • Support auto-review with an application
    • Support dynamic data with imported CSV file.
    • It has a lot of templets for new users like me to use
    • Pretty organized UI for the results.
  • What I dislike
    • The entire UI design is outdated. It can be made more modern like.
    • The interface for manually reviewing the submission does not show previously accepted submission for comparison.
    • A lot of important information such as details about the task is not presented in the review page. It's kind of hard to recall what specifically this task is about
    • Need a better way to ensure work quality.

CSV File

Readings

MobileWorks

  • What do you like about the system / what are its strengths?
    • It is really simple to use.
    • It can work in so many mobile devices.
    • It has a really high accuracy of 98%.
  • What do you think can be improved about the system?
    • It should try to add more functionality other than only OCR.
    • It could try to develop those low end native mobile applications to save data usage.
    • Image compression would be a good way to save data usage.
    • Should add a choice of "cannot read" in the application

Daemo

  • What do you like about the system / what are its strengths?
    • Awesome UI.
    • The Boomerang is pretty good at restoring the trust between the workers and the requester.
    • The Boomerang provides the workers with the best work out there from the requesters first. This increases the worker satisfaction and working experience.
    • It also provides the requesters the ability to give their tasks to the highly rated people first. This increases the quality of the work received from the workers.
    • The prototype task is a really good feature to keep the work worker-friendly.
    • The prototype benefits the workers by giving the workers the opportunities to provide how they think of the tasks. It has not been specifically implemented in other platform yet. At most other platforms have forums. But those feedbacks don't go directly to the requester.
    • The prototype enables the requesters to create readable and do-able tasks with the feedbacks from the sample workers.
  • What do you think can be improved about the system?
    • It should allow requesters to create task that is coded by the requesters and implement auto-reviewing.
    • A mobile application would be great for the requesters to create/review tasks and for the workers to work on tasks.

Flash Teams

  • What do you like about the system / what are its strengths?
    • It is quite unique from usual crowdsourcing platform. Its workers are experts not normal people.
    • It can achieve high level tasks such as software development and video creation that normal crowdsourcing cannot achieve.
    • It enables all the workers to maximize time efficiency by using pipeline.
    • The timetable design is really nice.
  • What do you think can be improved about the system?
    • It limits its worker to experts. It should allow people without experience to perform some simple tasks.
    • A mobile application with notifications would greatly benefit all the worker in the team.

Milestone Contributors

Slack usernames of all who helped create this wiki page submission: @frostao