Difference between revisions of "Milestone 4 Training to improve quality of work"

From crowdresearch
Jump to: navigation, search
Line 5: Line 5:
  
  
== Experiment: ==  
+
== Experiment 1: ==  
  
 
  Who are you recruiting?  
 
  Who are you recruiting?  
Line 24: Line 24:
 
The workers who complete training on the skills needed to complete the task will produce higher results than the novice workers who do not complete relevant training.  
 
The workers who complete training on the skills needed to complete the task will produce higher results than the novice workers who do not complete relevant training.  
  
Whether or not workers want direct access to skills/knowledge, the best way for the worker to obtain the knowledge/skills whether it be via gold standard tasks, external consumption of learning which is demonstrated through platform badges or certificates, mentoring and/or dual work opportunities, access to examples of good practice,
+
 
 +
How could we measure this?
 +
Whether or not workers want direct access to skills/knowledge, identify the best way for the worker to obtain the knowledge/skills whether it be via gold standard tasks, external consumption of learning which is demonstrated through platform badges or certificates, mentoring and/or dual work opportunities, access to examples of good practice.
  
 
Outline MOOC research  
 
Outline MOOC research  
  
 
One route would be to offer certification such as that offered by Freelancer through completion of assessments, where specifically workers are offered skills subset specific tasks for workers to complete. If they pass, they gain a badge, if they fail, they can try again once they’ve upskilled. It is is time-consuming and costly to create platform specific assessment tasks. Another route would be for collectives of workers to own the skill subset area and manage it. This would include identifying tasks related to that skill subset and offer them for peer review similar to the methods used in MOOC peer assessment on NovoEd or Coursera.  We could run some experiments to identify if either of these are effective ways to assess worker skill level.
 
One route would be to offer certification such as that offered by Freelancer through completion of assessments, where specifically workers are offered skills subset specific tasks for workers to complete. If they pass, they gain a badge, if they fail, they can try again once they’ve upskilled. It is is time-consuming and costly to create platform specific assessment tasks. Another route would be for collectives of workers to own the skill subset area and manage it. This would include identifying tasks related to that skill subset and offer them for peer review similar to the methods used in MOOC peer assessment on NovoEd or Coursera.  We could run some experiments to identify if either of these are effective ways to assess worker skill level.

Revision as of 14:54, 7 February 2016


The economy and workers’ lives have been digitised. Workers want to access opportunities for work as and when suits their individual circumstances. Workers want pathways for learning and skills. They want it geared to their own needs and to their own level of challenge. Workers also want to be able to share their achievements. They want content and resources tailored to their individual needs and accessible for future reference. Workers do not want to be restricted to working in one skill area but for crowdsourcing markets to allow for branching out to other areas of work without barriers or fear of it affecting their reputation rating in the crowdsourcing marketplace. Workers want timely, relevant opportunities for updating their skills. Workers do not want to be penalised for emergencies in work and life that prevent completion of work; they want to be able to reach out to other trusted colleagues to assist as and when.


Experiment 1:

Who are you recruiting? 
1. Experienced microtask workers 
2. Novice workers who have never completed work on a microtask platform - complete newcomer
3. Novice worker who completes relevant training on the task's skills subset
What are the conditions? 
What are you measuring? What statistical procedure will you use? ž 
 1. Quality of task completion for each group - what are we measuring?
 2. The type of training for microtask completion that improves the task completion quality - how will we measure quality?
 3.  ?

The result ž • What (do you imagine) would happen?

The workers who complete training on the skills needed to complete the task will produce higher results than the novice workers who do not complete relevant training.


How could we measure this? Whether or not workers want direct access to skills/knowledge, identify the best way for the worker to obtain the knowledge/skills whether it be via gold standard tasks, external consumption of learning which is demonstrated through platform badges or certificates, mentoring and/or dual work opportunities, access to examples of good practice.

Outline MOOC research

One route would be to offer certification such as that offered by Freelancer through completion of assessments, where specifically workers are offered skills subset specific tasks for workers to complete. If they pass, they gain a badge, if they fail, they can try again once they’ve upskilled. It is is time-consuming and costly to create platform specific assessment tasks. Another route would be for collectives of workers to own the skill subset area and manage it. This would include identifying tasks related to that skill subset and offer them for peer review similar to the methods used in MOOC peer assessment on NovoEd or Coursera. We could run some experiments to identify if either of these are effective ways to assess worker skill level.