Difference between revisions of "Organizational Design and Market Friction"

From crowdresearch
Jump to: navigation, search
(Created page with "==Problem== As we (Dilrukshi, Angela, Yoni, AMDP, Pierre, Mohammed, Alison) have been discussing Organizational Design, we resisted the urge to discuss macro Daemo governance...")
 
Line 1: Line 1:
 
==Problem==
 
==Problem==
 
As we (Dilrukshi, Angela, Yoni, AMDP, Pierre, Mohammed, Alison) have been discussing Organizational Design, we resisted the urge to discuss macro Daemo governance solutions and took a more purposeful, transactional approach to the impact of organization on the balance of trust and power between workers and requesters.  To some extent, we've been bantering around the larger ideas of platform governance for a while and until we establish daemo and have a regular cadre of workers and requesters, experimentation of macro organizational impact is a bit difficult.  However, there are many documented points of friction between workers and requesters, and one wonders, can organizational design re-balance asymmetrical relations or does the pendulum swing to the other extreme. In a more practical vein, these transactional problems and potential remedies are easier to review, examine and experiment against.  As such we can further define the crowdsourcing space as these problems align well with our focus on micro work.
 
As we (Dilrukshi, Angela, Yoni, AMDP, Pierre, Mohammed, Alison) have been discussing Organizational Design, we resisted the urge to discuss macro Daemo governance solutions and took a more purposeful, transactional approach to the impact of organization on the balance of trust and power between workers and requesters.  To some extent, we've been bantering around the larger ideas of platform governance for a while and until we establish daemo and have a regular cadre of workers and requesters, experimentation of macro organizational impact is a bit difficult.  However, there are many documented points of friction between workers and requesters, and one wonders, can organizational design re-balance asymmetrical relations or does the pendulum swing to the other extreme. In a more practical vein, these transactional problems and potential remedies are easier to review, examine and experiment against.  As such we can further define the crowdsourcing space as these problems align well with our focus on micro work.
Of the many problems we could address, three caught the most focus/attention:  Pricing, Grievence Management, Learning.  Using A/B or Multivariate testing we'd like to stress test various Organizational Design approaches to assess the extent to which balance/harmony can be achieved.       
+
Of the many problems we could address, three caught the most focus/attention:  Pricing, Grievence Management, Learning.   
 +
 
 +
==Experiment==
 +
Using A/B or Multivariate testing we'd like to stress test various Organizational Design approaches to assess the extent to which balance/harmony can be achieved.       
  
 
Pricing: Which is best at correcting the MTurk Pricing/Quality imbalance.  We'd look at guilds, a system driven by a dynamic pricing engine and an unstructured group.  We were spit-balling an experiment in which we'd recruit three worker groups of 15 folks each as well as a slew of requestors, run a couple cycles of HITS through Daemo and collect a variety of data points to determine which system achieved a level of equilibrium.   
 
Pricing: Which is best at correcting the MTurk Pricing/Quality imbalance.  We'd look at guilds, a system driven by a dynamic pricing engine and an unstructured group.  We were spit-balling an experiment in which we'd recruit three worker groups of 15 folks each as well as a slew of requestors, run a couple cycles of HITS through Daemo and collect a variety of data points to determine which system achieved a level of equilibrium.   
Line 9: Line 12:
 
Learning: Yoni and Angela have some very cool ideas and experiments to be be run.  http://crowdresearch.stanford.edu/w/index.php?title=Milestone_4_Open_Gov_-_Worker_collectives_to_improve_quality_of_work  
 
Learning: Yoni and Angela have some very cool ideas and experiments to be be run.  http://crowdresearch.stanford.edu/w/index.php?title=Milestone_4_Open_Gov_-_Worker_collectives_to_improve_quality_of_work  
 
      
 
      
==Problems==
+
==Additional Problems==
 
Can Various Organizational designs address the following problems:
 
Can Various Organizational designs address the following problems:
 
*1.  Cold Start for workers  
 
*1.  Cold Start for workers  

Revision as of 19:43, 7 February 2016

Problem

As we (Dilrukshi, Angela, Yoni, AMDP, Pierre, Mohammed, Alison) have been discussing Organizational Design, we resisted the urge to discuss macro Daemo governance solutions and took a more purposeful, transactional approach to the impact of organization on the balance of trust and power between workers and requesters. To some extent, we've been bantering around the larger ideas of platform governance for a while and until we establish daemo and have a regular cadre of workers and requesters, experimentation of macro organizational impact is a bit difficult. However, there are many documented points of friction between workers and requesters, and one wonders, can organizational design re-balance asymmetrical relations or does the pendulum swing to the other extreme. In a more practical vein, these transactional problems and potential remedies are easier to review, examine and experiment against. As such we can further define the crowdsourcing space as these problems align well with our focus on micro work. Of the many problems we could address, three caught the most focus/attention: Pricing, Grievence Management, Learning.

Experiment

Using A/B or Multivariate testing we'd like to stress test various Organizational Design approaches to assess the extent to which balance/harmony can be achieved.

Pricing: Which is best at correcting the MTurk Pricing/Quality imbalance. We'd look at guilds, a system driven by a dynamic pricing engine and an unstructured group. We were spit-balling an experiment in which we'd recruit three worker groups of 15 folks each as well as a slew of requestors, run a couple cycles of HITS through Daemo and collect a variety of data points to determine which system achieved a level of equilibrium.

Grievence: Which system is best at adjudicating grievences and facilitating communication between parties. This could either be run in parallel with the pricing experiment or be a stand alone

Learning: Yoni and Angela have some very cool ideas and experiments to be be run. http://crowdresearch.stanford.edu/w/index.php?title=Milestone_4_Open_Gov_-_Worker_collectives_to_improve_quality_of_work

Additional Problems

Can Various Organizational designs address the following problems:

  • 1. Cold Start for workers
  • 2. Expertise and Competency expectation/standardization (Reputation/Trust). Can guilds solve the ironic relationship between pricing and skill exhibited in Mturk (http://www.inthecrowd.org/wp-content/uploads/2015/10/pi_mkt_power.pdf)
  • 3. Voice for workers: grievence and programatic. (Balance of Power)
  • 4. Universal pricing
  • 5. Upward mobility/skills acquisition/professional development.
  • 6. Improve communication amongst workers
  • 7. Improve the depth of the crowd. Right now 10% of the workers in the crowd do 90% of the work. Can Guilds flatten out the crowd?
  • 8. Can Guilds be dropped into MTurk and fix problems or are they part of an integrated solution....Or, do Guilds only work in new holistic open systems.
  • 9. Creating a sense of belongingness/relatedness for the workers.


Articles

Contributors

  • @Dilrukshi
  • @AMDP
  • @PierreF
  • @Yoni
  • @m.Kambal
  • @Ferlin87
  • @Anotherhuman
  • @acossette