Milestone 6 bb

From crowdresearch
Jump to: navigation, search

Crowdsourcing: Giving workers power and building a firm crowdwork platform

Abstract

Crowdsourcing is the process of getting work done by the crowd. It is as simple as a requester requesting work on a platform and workers willing to complete a task. Through this process, work often gets done in a proper manner and workers receive money in return for the work completed. Though this process is a simple one, complications often arise when workers and requesters abuse the system by not paying enough money or not doing jobs properly and no one is able to resolve them, leaving one or more parties unsatisfied with crowdsourcing.

Motivation

Both workers and requesters are looking for legitimacy. Workers must be able to know when a requester does not pay well or have clear instructions. Requesters must know whether workers will do proper work or not. When disputes arise, there is a need to resolve them and communicate with both parities without revealing private information.

Workers will be categorized by popularity. By leveling up and racking up points, they will be featured in the popular workers page. As a result, they will get more and probably better jobs to do. This motivates the workers to complete tasks efficiently.

Related Work

What are the existing attempts to solve this problem that have been attempted in prior research papers and real-world systems? Why are their solutions unsatisfactory?

  • You may want to search around Google Scholar to find existing work that is related to the ideas your system proposes.


http://delivery.acm.org/10.1145/1980000/1979826/p1669-dow.pdf?ip=169.233.22.213&id=1979826&acc=ACTIVE%20SERVICE&key=CA367851C7E3CE77%2E9D50D556FB0BF5E3%2E4D4702B0C3E38B35%2E4D4702B0C3E38B35&CFID=498413817&CFTOKEN=29339257&__acm__=1428559035_c2225eb97f9cad75f0c6bb526ecda512

This paper talks about a feedback system in which the requester or other workers can author feedback to workers using a given template. They beleive that peer feedback increases scalability as more crowd workers can be recruited to handle the volume of feedback needs.

Rather than having a "personalized" feedback that eats up time, we would rather require the requester to simply rate the worker in terms of timeliness, skills, and quality of work.

Insight

This section should lay out this the foundational idea(s). These big ideas are the things that you'll be known for, and what other platforms would want to replicate. Explain: Why/how are they novel and better than anything that has been attempted in the past?

Moderators

The idea that we planned out establishes a stronger connection between workers and requesters by putting a moderator in power. Moderators are able to oversee the authenticity and completion of projects by the workers.Workers and requesters have the power to become moderators by racking up positive feedback. This is different from anything that has been done before, in our opinion, because it places a neutral person in charge of the work going on between workers and requesters, and allows them to control the relationship.

Levels

Imposing levels for both workers and requesters allows them to access more jobs and workers as they are good requesters/good workers. By getting good reviews each time they assign a task or complete a task, they can level up thus being able to contribute more. In a way, this idea is a way to control quality. People who are not serious about crowdsourcing will be unable to level up and will not be able to get or give work. In the past there have been workers that lack the skills they need to do a work, thus making the requester unhappy. This will help make both parties happy.

System

The insight above should explain the high level idea (e.g., "All workers are paid in chocolate"). Here, you explain how it works in specifics. (e.g., "We built a crowdsourcing platform called Chococrowd that mails dark chocolate candies to workers at the conclusion of each month. Requesters choose the quality of the dark chocolate based on the quality of the work.")

1. Moderator: resolves disputes between requesters and workers We could have a moderator on the website that looks over any disputes between a worker and a requester. They have the complete authority to contact both parties and resolve the dispute through comments.

2. Ratings of workers/requesters The workers can rate the requesters work and their instructions and pay whereas the requestors can rate the workers on efficiency and accuracy of the work done.

3. Levels of workers and requesters But in order to refrain requesters to setup fake accounts to rate their business, a worker must reach particular level after several jobs in order to rate and a requester must have had given out enough jobs in order to rate workers to avoid abusing the service. In addition, after each job is completed, the requester can endorse certain skills of the worker to help increase their level (and hence accessing more jobs) if they did a good job. As workers and requesters excel in level (by having more tasks or completing more tasks) to get more jobs or workers.

Evaluation

Once the platform you propose has been implemented, how will you determine whether your system actually solves the problem you wanted to solve? What are the results you hope you can realistically achieve? Why do these results show that you have solved the problem?


Through the rating system, workers and requesters will be able to choose their parties and work accordingly. Moderators will continue recording the disputes that occur and graph the results out. Hopefully the number of disputes decreases, resulting in a negatively sloped line when graphed. The less disputes there are, the happier both the workers and requesters are.


References

We referenced our past milestones and the problems we discovered that workers and requestors seemed to have. Link: http://crowdresearch.stanford.edu/w/index.php?title=Milestone_2_bb

3 themes http://crowdresearch.stanford.edu/w/index.php?title=Milestone_4_bb

Also referenced this page that was looked at by many teams http://crowdresearch.stanford.edu/w/index.php?title=Milestone_5_ABC_Storyboard:_Third_Party_Interface