Difference between revisions of "Milestone 5 TuringMachine Mockup: CrowdSourced HITs creation using Task Design Dashboard & Recommendation System"

From crowdresearch
Jump to: navigation, search
(Influence and Related work)
 
Line 6: Line 6:
 
[[File:Neil23.png|400px|left|Class]] [[File:future.png|625px|center|Future of Crowd Work]]
 
[[File:Neil23.png|400px|left|Class]] [[File:future.png|625px|center|Future of Crowd Work]]
  
Past research has shown that the lack of skills, misunderstanding, and irresponsible behaviors are some of the main causes of low quality submissions. Various techniques can be used to increase the quality of work. Templates can be one of the possible solutions to design clear instructions. The [http://crowdresearch.stanford.edu/w/index.php?title=Milestone_3_PixelPerfect_PowerIdea_2:_Task_Templates  PixelPerfect team]  has proposed an excellent idea of new template framework.  Figure below highlights the some of these techniques. The paper [http://crowdresearch.stanford.edu/w/img_auth.php/f/f2/Shepherding_the_crowd_%28private%29.pdf ''Shepherding the crowd yields better work, Dow et.al. 2012'' ] proposed an idea of Rubric that can be helpful for quality measurement.  
+
Past research has shown that the lack of skills, misunderstanding, and irresponsible behaviors are some of the main causes of low quality submissions. Various techniques can be used to increase the quality of work. Templates can be one of the possible solutions to design clear instructions. The [http://crowdresearch.stanford.edu/w/index.php?title=Milestone_3_PixelPerfect_PowerIdea_2:_Task_Templates  PixelPerfect team]  has proposed an excellent idea of new template framework.  Figure below highlights the some of these techniques. The paper [http://crowdresearch.stanford.edu/w/img_auth.php/f/f2/Shepherding_the_crowd_%28private%29.pdf ''Shepherding the crowd yields better work, Dow et.al. 2012'' ] proposed an idea of Rubric that can be helpful for quality measurement.
[[File:Rubricneil.png|450px|left|Class]] [[File:1.png|500px|center|Class]]
+
 
+
 
+
  
 
==Link to the Storyboard ==
 
==Link to the Storyboard ==

Latest revision as of 08:51, 19 February 2016

Author

Neil Gaikwad

Influence and Related work

MTurk task design templates are limited in functionality and flexibility. It has often seen that the ambitious instructions and confusing task flow affects workers productivity. The Future of Work, Kittur et.al. 2013, authors highlight one of the complains: “Too often the job itself is badly designed or is messed up and there is a degree of misunderstanding between the worker and the job engineer.” Furthermore, the paper elaborates 12 different key aspects of crowd-computing design. One of them Crowd Work Process focuses on How might we design the workflow and control the quality of work?

Class
Future of Crowd Work

Past research has shown that the lack of skills, misunderstanding, and irresponsible behaviors are some of the main causes of low quality submissions. Various techniques can be used to increase the quality of work. Templates can be one of the possible solutions to design clear instructions. The PixelPerfect team has proposed an excellent idea of new template framework. Figure below highlights the some of these techniques. The paper Shepherding the crowd yields better work, Dow et.al. 2012 proposed an idea of Rubric that can be helpful for quality measurement.

Link to the Storyboard

CrowdSourced HITs creation using Task Design Dashboard

Problem Design, Setting, & Environment

problemDef

Sequence Thumbnails

  1. Task Design Dashboard: Classic Theme
  2. Task Design Dashboard: Task Categorization & Selection
  3. Task Design Dashboard: Drag & Drop Task Design
  4. Task Design Dashboard: Automated Code generation & customization
  5. Task Design Dashboard: Expert Workforce Management
  6. Task Design Dashboard: Task & Trend Analytics
  7. Task Design Dashboard: Dark Theme
  8. Scenario Storyboard

Task Design Dashboard: Classic Theme

Design the task using a web browser or iPad: Task specific Drag & Drop Controls with the Task Design Board


Dashboard Dashboard Dashboard Class Class Class Class


Dashboard

Task Design Dashboard: Task Categorization & Selection

Dashboard Dashboard Dashboard Class Class Class Class

Lego Blocks for designing the complex crowdsourcing tasks Crowd sourcing systems can be designed to solve large number of problems. The eco-system can involve tasks and work that require different kind of expertise and skills, please see Genomes of Collective Intelligence Framework, Malone et.al 2010. These tasks can be broken down into various categories as shown in the figure below

goal
Dashboard

Task Design Dashboard: Drag & Drop Task Design

Dashboard Dashboard Dashboard Class Class Class Class

Dashboard

Task Design Dashboard: Automated Code generation & customization

Dashboard Dashboard Dashboard Class Class Class Class

Class

Task Design Dashboard: Expert Workforce Management

Dashboard Dashboard Dashboard Class Class Class Class

Class

Task Design Dashboard: Task & Trend Analytics

Dashboard Dashboard Dashboard Class Class Class Class

Class

Task Design Dashboard: Dark Theme

Dashboard Dashboard Dashboard Class Class Class Class

Class