Difference between revisions of "Milestone 7 sanjosespartans"

From crowdresearch
Jump to: navigation, search
(Motivation)
(Motivation)
Line 40: Line 40:
  
 
11. Mechanism present here for 2 major objectives -  
 
11. Mechanism present here for 2 major objectives -  
a) Maximize number of tasks performed under a budget and minimize the payments for given number of tasks. We consider requesters that impose deadline for task completion and workers who arrive according to some known distribution and can strategically misreport their cost or number of tasks that they are performing .  
+
 
b) 'Incentive Compatible Mechanism' designed to ensure allocation and pricing such that it's in everyone's interest to bid truthfully.
+
a) Maximize number of tasks performed under a budget and minimize the payments for given number of tasks. We consider requesters that impose deadline for task completion and workers who arrive according to some known distribution and can strategically misreport their cost or number of tasks that they are performing .  
 +
 
 +
b) 'Incentive Compatible Mechanism' designed to ensure allocation and pricing such that it's in everyone's interest to bid truthfully.
  
 
== Related Work ==
 
== Related Work ==

Revision as of 12:53, 15 April 2015

This is the template for Milestone 7. It is the same format as last week's research proposal.

You will propose your platform in the form of an introduction to a mock research paper. Essentially, imagine you have built your system, incorporating in all the ideas that you wanted to have in it, have run your user studies and evaluations, and everything has gone as planned. How do you convince other researchers that you have built a platform that is novel and that it is more effective at addressing problems than any existing ideas that have been attempted in the past?

An introduction of a research paper summarizes the main contributions of the research. It is generally roughly 1 page (roughly 1000 words), and consists of the following components:

Pricing Mechanism for Crowd Sourcing Market

Abstract

1. Effective Pricing and Allocation of tasks needs good tools.

2. Framework needed to design mechanism with provable guarantees in crowd sourcing market.The framework enables automating process of pricing and allocation of tasks for requester's in AMT where workers arrive in online fashion and requester's face budget constraints and task completion deadlines.

3. Competitive Incentive Compatible Mechanism for maximum number of tasks under budget and minimum payment given to a fixed number of tasks to be completed.

4. Create a platform that enables applying pricing mechanism in markets like Mechanical Turk.

Motivation

1. Advancement of Internet lead to new labor markets called Crowdsourcing Markets where cognitive work distribution was done to hundreds of thousands of people geographically disparate workers.

2. Requesters usually outsource large quantities of simple tasks to anonymous workers. Typically the work includes image labelling,sentiment analysis ,content generation , listing verification etc. those type of things that are too difficult or expensive to automate are usually crowdsourced.

3. There are many crowdsourcing platforms that provide workers with non-monetary incentives like entertainment , educational opportunities, information and altruism for their efforts. Despite platform success its tough to engineer non-monetary incentive scheme for tedious and repetitive tasks.

4. Overwhelming majority of crowdsourcing tasks are done in exchange of payments ,here implementing a campaign successfully needs pricing and allocation of tasks effectively.

5. Designing effective pricing and allocation mechanism presents challenging problems due to requesters constraints and realities of markets.

6. Requesters face task completion deadlines and budget constraints and must account for dramatic elasticity in workforce supply. Also there is large variance in effort needed to complete different tasks , that depend on skills and background of workers based in multiple geographical locations.

7. There are limited tools present in crowdsourcing markets for pricing tasks effectively. Develop theoretical framework and design mechanism that work in practice and have provable guarantee.

8. We describe a platform that enables requesters to automate process of pricing in crowdsource market using mechanism we have along with other pricing schemes. Framework designed for tasks where quality of workers performance doesn't yield additional utility to requesters above a certain threshold.

9. Workers receive payments after requesters approval in crowdsourcing platform . It's assumed that requesters have access to verification schemes and focus on effective pricing and allocating tasks independent of quality .

10. We take mechanism of design approach to pricing problem and enable workers to bid on work by expressing their cost for performing tasks and number of tasks they wish to perform, although most crowdsouring platforms don't provide workers such level of expressions ,existing API's make feature easy to integrate into most platform.

11. Mechanism present here for 2 major objectives -

a) Maximize number of tasks performed under a budget and minimize the payments for given number of tasks. We consider requesters that impose deadline for task completion and workers who arrive according to some known distribution and can strategically misreport their cost or number of tasks that they are performing .

b) 'Incentive Compatible Mechanism' designed to ensure allocation and pricing such that it's in everyone's interest to bid truthfully.

Related Work

What are the existing attempts to solve this problem that have been attempted in prior research papers and real-world systems? Why are their solutions unsatisfactory?

  • You may want to search around Google Scholar to find existing work that is related to the ideas your system proposes.

Insight

This section should lay out this the foundational idea(s). These big ideas are the things that you'll be known for, and what other platforms would want to replicate. Explain: Why/how are they novel and better than anything that has been attempted in the past?

System

The insight above should explain the high level idea (e.g., "All workers are paid in chocolate"). Here, you explain how it works in specifics. (e.g., "We built a crowdsourcing platform called Chococrowd that mails dark chocolate candies to workers at the conclusion of each month. Requesters choose the quality of the dark chocolate based on the quality of the work.")

Evaluation

Once the platform you propose has been implemented, how will you determine whether your system actually solves the problem you wanted to solve? What are the results you hope you can realistically achieve? Why do these results show that you have solved the problem?

References

The reference section is where you cite prior work that you build upon. If you are aware of existing related research papers, list them here. We also encourage you to borrow ideas from the past submissions (see the meteor links above). Please list the links of the ideas you used to create this proposal (there's no restriction in terms of number of ideas or whether its yours or others'). You can use the following template:

  • [Foundation Idea] Link...
  • [Feature Idea] Link...
  • [Foundation Idea] Link...so on, and so forth...