Winter Milestone 17

From crowdresearch
Jump to: navigation, search

8:00 pm 8th May 2016 for submission, 12 pm 9th May 2016 for peer-evaluation. Preparation for CSCW continues.

This week, we will refine methods and systems proposed last week further:

  • Youtube link of the meeting today: watch
  • Winter Meeting 17 slideshow: no slides

Open Gov and Design

To propose and set up a prototype -- based on the refinements and feedback provided from workers.

Helpful links:

You can use balsamic or Google slides or just pencil/paper drawing to give shape to your ideas. Design folks, come join and help move this effort forward. Once you're done, post here: http://crowdresearch.meteor.com/category/open-gov


Task Authoring

Watch last week's task authoring meeting here

Rewind of Monday's meeting: We ran our second pilot study on the Dark Matter (marijuana) task. It produced useful insight! We realized that the requester variance was mainly coming into play with the tasks that are the most difficult. The obvious ones, everyone gets right. So, we started cleaving off the lowest quartile of tasks by average worker accuracy, and saw bigger variation across requesters. We went back and re-analyzed our original pilot data, and saw the same effect with some of the tasks (e.g. football action prediction).

Milestone

By Wednesday Find a task that is difficult, where in the answer is not obvious.

We're thinking that Minnesota and Macalister paper on Arafat Gold might be the right one to go with. So in addition, please read the following Macalister paper paper

Message @catherine.mullings with any questions and stay up to date with #taskauthoring channel.

By Thursday/Friday we will analyze the results and hold a Google Hangout. Stay tuned!

The analysis for the study will be formally written here on Google doc.