Milestone 4 TuringMachine: Sustainable Reputation Mechanism; Insights from Finance Industry
Influence and Related work
The Future of Work, Kittur etal 2013 and Genomes of Collective Intelligence Framework, Malone etal 2010 have shown that Reputation plays a big role in developing sustainable crowd sourcing communities. There is huge risk involve in the crowd sourcing work. Both requestors and workers are exposed to the risk related to payment or quality.
We build our idea of sustainable reputation using theories in structured finance and recommendation system. This is first attempt of any research groups to estimate and diversify the risk involved in the crowdsourcing work. We propose following reputation based portfolio diversification strategies to mitigate the risk:
- Diversified Task Portfolio for Workers: How should workers select the tasks that would diversify the risk of payment defaults and maximize the gain?
- Diversified Worker's Portfolio for Requestors:How should requestors select the workers so that they would diversify the risk of quality default and maximize the gain?
- Workers and requestors rate each other.
- An automated tranche creation algorithm clusters workers into A to E category.
Tranches Structure Penalties, Incentives, Risk of Default
- For the requestors in A tranche the minimum wage requirement is avg/below avg. However, for the requestors in D the minimum wage requirement is higher because he has a greater risk of default. Similar structure is designed for the worker. Please see figure 2.
- Based on the ratings we can create the tranches of workers and requestors
- This structure exposes the risk involved in the crowdsourcing platforms.
- The workers can build the task portfolio using rating profiles and maximize the profit by diversifying the risk. For instance, a worker can select one task from tranch A, 3 from Avg, and rest from D.
Automated Worker-Requestor Recommendations for Worker/Requestor Portfolio
- Diversified Task Portfolio for Workers: Recommend the combination of the tasks that would diversify the risk of payment defaults and maximize the gain. Workers can submit the diversification criteria.
- Diversified Worker's Portfolio for Requestors: Recommend the combination of the workers that would diversify the risk of quality default and maximize the gain. Requestor can submit the diversification criteria.
- We combine Recommendation engine with Tranches and automatically match up requestors and workers.
Combineing Global and Local Effects
- Combine baseline method with latent factor model
Latent Factor Model for Workers to Requestors Recommendation
- Recommend workers to requestors