View source for OGov Milestone 13

== Goals this Week ==
# Run pilots
# Fix Design comments from Milestone 12 Hangout
# Help out with '''#TaskFeed'''
# Refine our experimental design goals and implementation approach so that by the end of the week we can specify the implementation reasonably well for a handoff to engineering

See the [https://docs.google.com/presentation/d/1C1bdupZTIxgWc-R856UJjWItakQiMGRBl-nl7vhvaf8/edit Milestone 12 OGov Presentation] here.

== Pilots ==
# '''Dialogue Pilot''': Testing the phrasing on our main pages with MTurkers
# '''Review Pilot''': Testing review consistency and accuracy with tasks of known quality, using MTurkers of known experience
# '''Levels Pilot''': Testing short term performance effects of introducing leveling by using a Wizard of Oz setup and targeting the same MTurkers each day for several days
[http://crowdresearch.stanford.edu/w/index.php?title=Leveling_Study]

Pilots are mostly set up and will be conducted this week. 
The '''Levels Pilot''' may extend for longer for better quality data.

== Design Refinement ==
See the [http://crowdresearch.stanford.edu/w/index.php?title=Guilds_Milestone_12 Milestone 12 Wiki] for more on current context for this and links.

In the Milestone 12 Hangout the notion of improving text to make sure it focuses on features that guilds provide was brought up. That will be the initial goal for design. Additionally design will be needed for running pilots.

== Experimental Design and Implementation ==
We will focus more on this later in the week.

See [http://crowdresearch.stanford.edu/w/index.php?title=Guilds_Experimental_Design Notes on Experimental Design] to get a sense of this.

'''Keep in mind''', we are anticipating a call for papers with a deadline around the last week of May. We want a Beta paper 1 month before that, so the last week of April, so our Beta paper is going to focus on a narrative based on pilot results and ongoing study results. We will continue the study and get full results sometime before the deadline.