Milestone 5 TuringMachine Storyboard: CrowdSourced HITs creation using Task Design Dashboard & Recommendation System
Influence and Related work
MTurk task design templates are limited in functionality and flexibility. It has often seen that the ambitious instructions and confusing task flow affects workers productivity. The Future of Work, Kittur et.al. 2013, authors highlight one of the complains: “Too often the job itself is badly designed or is messed up and there is a degree of misunderstanding between the worker and the job engineer.” Furthermore, the paper elaborates 12 different key aspects of crowd-computing design. One of them Crowd Work Process focuses on How might we design the workflow and control the quality of work?
Templates can be one of the possible solutions to design clear instructions. The PixelPerfect team has proposed an excellent idea of new template framework. In addition, the paper Shepherding the crowd yields better work, Dow et.al. 2012 proposes idea of Rubric that can be helpful for quality measurement.
Scenarios 1: Task Design using Dashboard
Problem Design, Setting, & Environment