Difference between revisions of "Winter Milestone 21"

From crowdresearch
Jump to: navigation, search
(Created page with "'''8:00 pm 12th June 2016 for submission, 12 pm 13th June 2016 for peer-evaluation.''' Preparation for CSCW continues. This week, we will refine methods and systems propose...")
 
 
Line 6: Line 6:
 
* Winter Meeting 21 slideshow: no slides
 
* Winter Meeting 21 slideshow: no slides
  
== Open Gov and Design ==
+
== Think about next steps ==
  
To propose and set up a prototype -- based on the refinements and feedback provided from workers.
+
We want to make Daemo, the next cool thing in crowd marketplaces. How can we improve the current state by 20X or more. What are the key differentiating features that will make Daemo attractive and a go-to platform. This week we'll brainstorm about these --- helping set the direction further.
 
+
Helpful links:
+
* [[https://docs.google.com/spreadsheets/d/1WtmbrNZJtmvHH5UoPGd7_mXQIXz-mENUxcaC7npLU7U/edit Feedback]]
+
* [[https://docs.google.com/document/d/1SVAz98NamiGP7yrUnOUU3V5xLsTCQ7xIXXVIQwdN2vU/edit Working document]]
+
* [[Crowdresearch:Open Gov - UI Screens]]
+
* [[Guilds Experimental Design]] 
+
* [[Guilds Milestone 11 Worker Feedback]]
+
* [[Guilds Milestone 9]]
+
* [https://docs.google.com/document/d/16kyhc55sBLrQEKgUL7SSfl5h065jq6jD8JYFENWnaq0/edit?usp=sharing Michael's vision for the Guilds]
+
* [https://docs.google.com/document/d/1GiEzgOto9pP6YosJJ4dFxMgExgASiex72IqGgM-MXQc/edit?usp=sharing Google doc paper]
+
* [[Guilds and computational compatibility...The system]]
+
* [[Guilds Milestone 6]]
+
 
+
You can use [https://balsamiq.com/ balsamic] or Google slides or just pencil/paper drawing to give shape to your ideas. Design folks, come join and help move this effort forward. Once you're done, post here: http://crowdresearch.meteor.com/category/open-gov
+
 
+
 
+
== Task Authoring ==
+
 
+
'''Watch last week's task authoring meeting''' [https://www.youtube.com/watch?v=BqhlhKQwGzo here]
+
 
+
'''Rewind of Monday's meeting:''' We ran our second pilot study on the Dark Matter (marijuana) task. It produced useful insight! We realized that the requester variance was mainly coming into play with the tasks that are the most difficult. The obvious ones, everyone gets right. So, we started cleaving off the lowest quartile of tasks by average worker accuracy, and saw bigger variation across requesters. We went back and re-analyzed our original pilot data, and saw the same effect with some of the tasks (e.g. football action prediction).
+
 
+
'''Milestone'''
+
 
+
'''By Wednesday''' Find a task that is difficult, where in the answer is not obvious.
+
 
+
We're thinking that Minnesota and Macalister paper on Arafat Gold might be the right one to go with.
+
So in addition, please read the following Macalister paper [http://www-users.cs.umn.edu/~bhecht/publications/goldstandards_CSCW2015.pdf paper]
+
 
+
Message '''@catherine.mullings''' with any questions and stay up to date with '''#taskauthoring''' channel.  
+
 
+
'''By Thursday/Friday''' we will analyze the results and hold a Google Hangout. Stay tuned!
+
 
+
The analysis for the study will be formally written [https://docs.google.com/document/d/1B-gSbAn3atDvV8qZtsRWrJ0CdKhbMDO7B3dgFK_yZyo/edit?usp=sharing here on Google doc].
+

Latest revision as of 12:37, 6 June 2016

8:00 pm 12th June 2016 for submission, 12 pm 13th June 2016 for peer-evaluation. Preparation for CSCW continues.

This week, we will refine methods and systems proposed last week further:

  • Youtube link of the meeting today: watch
  • Winter Meeting 21 slideshow: no slides

Think about next steps

We want to make Daemo, the next cool thing in crowd marketplaces. How can we improve the current state by 20X or more. What are the key differentiating features that will make Daemo attractive and a go-to platform. This week we'll brainstorm about these --- helping set the direction further.