Milestone 1 bb

From crowdresearch
Jump to: navigation, search

Experience the life of a Worker on CrowdFlower

Reflect on your experience as a worker on CrowdFlower. What did you like? What did you dislike?

Likes:

- As workers complete their tasks, information on their growth will be given to them as well as money

- As you level up, you can access more tasks

- You get information on your progress as a contributor

Dislikes:

- Some jobs on CrowdFlower are intense and are worth a lot of time

- Tasks can take more time then they are approximated to take

- After these time-consuming tasks are completed, the payments are very low

Experience the life of a Requestor on CrowdFlower

Reflect on your experience as a requester on CrowdFlower. What did you like? What did you dislike? Also attach the CSV file generated when you download the HIT results.

Likes:

- CrowdFlower provides a wide variety of templates to create jobs (such as sentiment analysis, product comparison surveys) that can make the job of a requester easier

- When creating a job, they have advice and tips on the side to help you get build your job

- Jobs can be organized into teams and it allows team-access

- When creating jobs, there are two editors you can switch between, graphical editor and CML editor

- The process for creating a job on CrowdFlower is simple. There are 3 sections: Design Job, Manage Quality, and Get Results

Dislikes:

- One cannot contact the worker that has completed a job for more information

- One cannot reward workers differently based on their work

- Communication between contributors and requestors is limited

- When creating a survey it kept saying that I cannot duplicate CML elements, when there was no duplication at all. As a result I was unable to publish my survey and get HIT results: [[1]]

Explore alternative crowd-labor markets

Compare and contrast the crowd-labor market you just explored (TaskRabbit/oDesk/GalaxyZoo) to Mechanical Turk.

oDesk
oDesk is different from CrowdFlower as it places a emphasis on the contributor's skills. As a result, requestors can choose contributors/workers based on their assets. There are less complicated tasks on CrowdFlower compared to Odesk. It seems like you can get a wide variety of tasks done on oDesk. You are guaranteed to find an expertise in the area your task is associated with. In addition, Odesk provides a money back guarantee for particular freelancers which gives secures satisfaction of the task being completed professionally to the requestor. oDesk is efficient because workers can select tasks based on their area of interest and their recommended payment options. From graphic designs to software development, it can be done on oDesk. On oDesk, the payment after completing each task is better than that of Mechanical Turk. In Mechanical Turk, automatic job options that are recommended for the user is not shown like it does on oDesk.

Readings

MobileWorks

STRENGTHS:

- mobile internet is an cost-effective way to send microtasks to people that are in developing countries

- documents are chopped into smaller pieces so people can view them on their mobile phones

- task is distributed to more than one workers until the answers match. As a result,this multiple entry creates high quality crowdsourced human OCR work on simple phones.

- worker can see how much they are earning in real time as the cost of each task is calculated before it is actually completed


WHAT NEEDS TO BE IMPROVED:

- it's only for OCR tasks and maybe it can be available for more types of tasks

- there needs to be improvement in wireless infrastructure in these developing countries so more tasks can be completed and so efficiency will increase (real time responses would also be beneficial in a similar way)

- if there was language translation, there would not be a language barrier and more people would participate in completing these tasks, thus helping more people in developing countries

mClerk

  • What do you like about the system / what are its strengths?

-mobile platform so it works out for those with low-end mobile phones because they get easy access.

- it provides language transliteration abilities, including even local languages.

- tasks can be completed at any time and place

- does well in motivating workers to do more

- free SMS schemes which allow them to send 500 messages daily, so no reimbursements are required

  • What do you think can be improved about the system?

- Payment options should be based on the difficulty level of the tasks that workers do

- The work is too specific, so some would not want to do tasks that focus on something

- data entry needs to be sped up


Flash Teams

  • What do you like about the system / what are its strengths?

- able to assemble and manage paid experts from the crowd in one area

- has a defined structure

- easy to recruit workers and launch, as seen by Foundry

- elasticity: can be expanded or shrunk to meet demands

- flash teams can be pipelined: less waiting time and increased collaboration between workers

  • What do you think can be improved about the system?

- difficult to acquire a group of experts from the crowd

- hard to manage the complexity of crowd work / splitting up work between team members