Milestone 3 TuringMachine TrustIdea 2: The leaderboard system based on performance
Background and Motivation
The Future of Work, Kittur etal 2013 and Genomes of Collective Intelligence Framework, Malone etal 2010 have shown that Reputation, Incentives, and Motivation play a big role in developing sustainable crowd sourcing communities. However, the question remains how do we motivate people for a long period of time and how do we build the trust? HCI research provides guidelines for developing sustainable online communities. In Building Successful Online Communities: Evidence-Based Social Design, Tausczik, Dabbish, and Kraut 2012 discuss the Identity and bond Based attachments.
Give me the Reward, Respect, and Recognition .
Flow and Objectives
Leaderboard profile for Requestors (individual profile as well as group ranking)
- How might we increase the reputation of requestors?
- Motivate Requestors to be transparent and attract quality workers.
- Workers can vote for top requestors who are providing clear instructions about the tasks and fairness. Borda Count Voting algorithm can be implanted to design the system; see Networks, Crowds, and Markets: Reasoning about a Highly Connected World, Kleinberg
- Create Requestors' profile highlighting their track-records. Make an announcement of top performers.
- Workers can trust the requestors who are high ranked and provide good value for their time
- Requestors' reputation will help them attract new talent for accomplishing complex tasks
- Requestors' reputation will them earn reward from the crowdsourcing system administrators
- How might we increase the reputation of workers?
- Motivate workers by being recognized in the community
- Provide incentive to reach to top using hierarchy
- Provide value to their commitment and ability to get things done
- Requestors can trust the worker's profile based on making payments or recruiting them