Guilds and Quality
A unique byproduct of the asymmetrical relationship between workers and requesters in MTurk is a inability of incremential price increases to effect task quality. Observing this phenonemon, how will the relationship between price and quality play out in a crowdsourcing platform that allows for market forces to playout?
- 1. Quality Control in Crowdsourcing Systems http://www.infosys.tuwien.ac.at/staff/sd/papers/Zeitschriftenartikel%20%20Quality%20Control%20SD%202013.pdf
- 2. Quality Management in Crowdsourcing using Gold Judges Behavior
- 3. Shepherding the Crowd Yields Better Work
- 4. Financial Incentives and the “Performance of Crowds”
- 5. Quality Control for Real-time Ubiquitous Crowdsourcing
- 6. Programmatic Gold: Targeted and Scalable Quality Assurance in Crowdsourcing
- 7. Managing the Quality of Large-Scale Crowdsourcing
- 1. S.R. Epstein. Craft Guilds, Apprenticeship, and Technological Change in Preindustrial Europe. The Journal of Economics History, Vol. 58, N°3, September 1998.
File:Craft guilds apprenticeship and technological change.pdf
- 3. Nicolas Ducheneaut, Nicholas Yee, Eric Nickell, and Robert J. Moore. 2006. "Alone together?": exploring the social dynamics of massively multiplayer online games. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '06), Rebecca Grinter, Thomas Rodden, Paul Aoki, Ed Cutrell, Robin Jeffries, and Gary Olson (Eds.). ACM, New York, NY, USA, 407-416
- 1. Beyond Mechanical Turk: An Analysis of Paid Crowd Work Platforms.
- 2. Collaboratively Crowdsourcing Workflows with Turkomatic.
- Simulations and Crowd Research
- 1. Crowdsourcing User Studies With Mechanical Turk
- 2. Behavioral Mechanism Design: Optimal Crowdsourcing Contracts and Prospect Theory. David Easley, Arpita Ghosh. Proc. 16th ACM Conference on Economics and Computation (EC), 2015.
- 4. Game Theory and Incentives in Human Computation Systems, Arpita Ghosh. Book chapter. Handbook of Human Computation, Springer 2013.
- 5. Galen Pickard, Wei Pan, Iyad Rahwan, Manuel Cebrian, Riley Crane, Anmol Madan, and Alex Pentland. Time-critical social mobilization. Science, 334:509–512, 2011.
- 6. Eleni Koutrouli and Aphrodite Tsalgatidou. Reputation Systems Evaluation Survey. ACM Comput. Surv. 48, 3, Article 35, December 2015.
DOI: http://dx.doi.org/10.1145/2835373 - File:Reputation evaluation survey A35-koutrouli.pdf