WinterMilestone 1 fourtypercent

From crowdresearch
Jump to: navigation, search

Template for your submission for Winter Milestone 1. Do not edit this directly - instead, make a new page at WinterMilestone 1 YourTeamName or whatever your team name is, and copy this template over. You can view the source of this page by clicking the Edit button at the top-right of this page, or by clicking here.

Experience the life of a Worker on Mechanical Turk

Reflect on your experience as a worker on Mechanical Turk. What did you like? What did you dislike? If you're from outside the USA and unable to access MTurk, try try the worker sandbox, or other sites like CrowdFlower or Microworkers or Clickworker.

I registered on amazon turk for a transcription job. Before I had to make a test. The hirer warned me to focus, because I need a result of 100 Percents to finish it. I focused on the test and came through. Now I could immediately start with my first hit. In the test there were already explained the major rules of transcription. While transcribing it took me 10 minutes for the first transcription. I could not understand every word and was not sure how often it was okay to highlight a word as unheard. Totally I left out some words and got approved later but it took me 20 minutes for two transcriptions. So I earned totally 20 Cents with Bonues in 20 Minutes. So it would have been good to have a better explanation video of the task for an easier working experience.

Experience the life of a Requester on Mechanical Turk

Setting up an account was a bit tedious, for some reason I had to change my existing Amazon password twice. Furthermore, you have to log in/create multiple accounts (Amazon Payments, etc.) and also provide your SSN which I am not sure why. Also, this limits the availability of AMT to only users in the states, I believe.

Then you have to buy the hits in advance, which is also annoying because for some reason Amazon lists all payments methods ever used except for the most recent one. It also orders the payment methods starting with the expired ones.

The creation of the actual project is more user-friendly. The examples are detailed and creating a project and editing the HITs is fast and easy. In order to make the request look nice you do need a bit of HTML code.

We were asking to list the top 5 most downloaded free apps from the Android Play Store and rewarded this hit with 10 cents. We requested 3 Hits. The project was done in less than 10 minutes. After analyzing the .csv file, we accepted all hits (they were all correct).

Explore alternative crowd-labor markets

Compare and contrast the crowd-labor market you just explored (TaskRabbit/oDesk/GalaxyZoo) to Mechanical Turk.

Story from our User:

We registered on "" It was easy to create an account. I needed to fill out my qualifications and education job. There was one beginner job on the task bar. A survey from the company to earn 10 cents. Woop. This was easy. Then there were already two other jobs displayed. After I did my first job - a google and examine the result task job - very easy - for 10 cents, there were suddenly no jobs displayed anymore. So I wanted to do my first extra qualification to get get copy writer jobs displayed. I didn't really focus on the qualification test, did it fast even while it was quite a lot while doing other stuff and scored only 75 Percent. Not enough to get the qualification! I underestimated that I should have put all my focus on it . You need this qualification to do copywriting and it is not possible to repeat it anymore!!! This was a very frustrating experience. Since then there were no new tasks on the page anymore. Also no easy "Google" Taks . So I am staying there with my 35 Eurocents now and have to wait. All in all the performance of the website was also leaking many times.

All in All: Positive was it to earn 10 Cents in two minutes very easy. At Amazon in contrast I needed half an hour for 20 Dollar Cents as a Beginner on transcription. Negative was the qualification experience and that there were no jobs coming anymore in contrast to amazon turk where they seem to have an unlimited amount of jobs available.



  • What do you like about the system / what are its strengths?

MobileWorks allows anyone to perform tasks and earn extra money simply from their phone. It has a very simple UI which makes it easy to use anytime and everywhere, just as one worker stated: “I could do the work and earn money while traveling to my regular job or even while watching television”

  • What do you think can be improved about the system?

This was only tested with a few users (10), I am curious about the results with more participants. Also, when a user gives a wrong answer his/her quality rating decreases. Are there any mechanisms or guidelines to avoid an extreme decrease? I can imagine that a user who doesn't pay much attention to the tasks (for instance, while watching TV) accidentally destroys his ratings/account and then will not be able to se the system anymore. For example, we made similar experiences with clickworker


  • What do you like about the system / what are its strengths?

Daemo tries to prevent the biggest mistakes of former crowd working systems. Preventing low quality results and low paid workers through a systems which builds up trust through the new "boomerang technology"and creating better task instructions through early feedback with the first users. I especially like the idea of early feedback and gifting the ambitous eager user through the "boomerang technology."

  • What do you think can be improved about the system?

As workers are doing their jobs they are usually improving and become better. It would be great to integrate a learning system. Making it possible to workers to start with simple task and improving them, teaching them new skills on the way so that they are able to do more complex and better paid work later. This could be done through rewards and paying good workers money while they are learning.

Flash Teams

  • What do you like about the system / what are its strengths?

We like that you can easily assign tasks to people around the world and thereby break down a project phase in order to be more productive. Also, the interface of the timeline looks very user friendly and intuitive.

  • What do you think can be improved about the system?

Not sure how user research results from around the world with different cultures will influence each other. Some findings might be controversial to others.

Milestone Contributors

fourtypercent = @ferlin87, @baxterstockman