Winter Milestone 20
8:00 pm 29th May 2016 for submission, 12 pm 30th May 2016 for peer-evaluation. Preparation for CSCW continues.
This week, we will refine methods and systems proposed last week further:
- Youtube link of the meeting today: watch
- Winter Meeting 20 slideshow: no slides
Open Gov and Design
To propose and set up a prototype -- based on the refinements and feedback provided from workers.
Helpful links:
- [Feedback]
- [Working document]
- Crowdresearch:Open Gov - UI Screens
- Guilds Experimental Design
- Guilds Milestone 11 Worker Feedback
- Guilds Milestone 9
- Michael's vision for the Guilds
- Google doc paper
- Guilds and computational compatibility...The system
- Guilds Milestone 6
You can use balsamic or Google slides or just pencil/paper drawing to give shape to your ideas. Design folks, come join and help move this effort forward. Once you're done, post here: http://crowdresearch.meteor.com/category/open-gov
Task Authoring
Watch last week's task authoring meeting here
Rewind of Monday's meeting: We ran our second pilot study on the Dark Matter (marijuana) task. It produced useful insight! We realized that the requester variance was mainly coming into play with the tasks that are the most difficult. The obvious ones, everyone gets right. So, we started cleaving off the lowest quartile of tasks by average worker accuracy, and saw bigger variation across requesters. We went back and re-analyzed our original pilot data, and saw the same effect with some of the tasks (e.g. football action prediction).
Milestone
By Wednesday Find a task that is difficult, where in the answer is not obvious.
We're thinking that Minnesota and Macalister paper on Arafat Gold might be the right one to go with. So in addition, please read the following Macalister paper paper
Message @catherine.mullings with any questions and stay up to date with #taskauthoring channel.
By Thursday/Friday we will analyze the results and hold a Google Hangout. Stay tuned!
The analysis for the study will be formally written here on Google doc.
