Difference between revisions of "Milestone 6 Research Proposal"
(→Submitting) |
(→[Team Leaders] Milestone 5 Submissions) |
||
| Line 91: | Line 91: | ||
<strong>COMMENT BEST-PRACTICES</strong>: As on Crowdgrader, <strong>everybody</strong> reviews at least 3 prototypes, supported by a comment. The comment should provide constructive feedback. Negative comments are discouraged - if you disliked some aspect of a prototype, make a suggestion for improvement. | <strong>COMMENT BEST-PRACTICES</strong>: As on Crowdgrader, <strong>everybody</strong> reviews at least 3 prototypes, supported by a comment. The comment should provide constructive feedback. Negative comments are discouraged - if you disliked some aspect of a prototype, make a suggestion for improvement. | ||
| − | === [Team Leaders] Milestone | + | === [Team Leaders] Milestone 6 Submissions === |
| − | To help us track all submissions and browsing through them, once you have finished your Milestone | + | To help us track all submissions and browsing through them, once you have finished your Milestone 6 Research Proposal, go to the link below and post the link: |
| − | [[Milestone 6 Submissions]] | + | [[Milestone 6 Research Proposal Submissions]] |
Revision as of 23:53, 3 April 2015
This is one of the two options for Milestone 6, which is geared towards teams which are more interested in the research side of things.
In this milestone, your team will propose a new crowdsourcing platform by synthesizing some foundational ideas that have been proposed over the brainstorming and prototyping stages. You will propose it by writing an introduction to a mock research paper that summarizes the main contributions of a proposed platform, and how/why you expect that it improves on the current state-of-the-art.
Contents
Determine the foundational ideas in your proposed platform
First, you should find a set of ideas from the milestones that you believe will work well together in combination as a platform. Try to focus on big ideas you believe are truly revolutionary and essential underpinning of your platform ("foundational ideas"), as opposed to minor features that are nice to have but are not particularly novel or necessary.
You can draw the set of foundational ideas for your platform by synthesizing ideas and prototypes that have been proposed in Milestones 3, 4, and 5:
http://crowdresearch3.meteor.com/
http://crowdresearch4.meteor.com/
http://crowdresearch5.meteor.com/
One way to determine what the foundational ideas of your proposed platform are, are by thinking about how you would pitch your platform. If you had to describe why your platform is better than any of the countless existing crowd marketplaces in a sentence or two, what would you say? These are your foundational ideas. If your don't think you can explain the novelty and advantages of your system in just a sentence or two, you may want to revisit the set of ideas you have picked - perhaps you are proposing a bag of minor features, with no truly novel, foundational ideas.
Format of your research proposal
You will propose your platform in the form of an introduction to a mock research paper. Essentially, imagine you have built your system, incorporating in all the ideas that you wanted to have in it, have run your user studies and evaluations, and everything has gone as planned. How do you convince other researchers that you have built a platform that is novel and that it is more effective at addressing problems than any existing ideas that have been attempted in the past?
An introduction of a research paper summarizes the main contributions of the research. It is generally roughly 1 page (roughly 1000 words), and consists of the following components:
Title
Research papers should have titles which summarize, in one line, the primary research contribution (see below).
Abstract
A concise summary of the background and your research contributions (described below). Usually around 150 words or less.
Motivation
What are the core problems that your system will solve? Why are these problems important?
- Think about the needs we synthesized from Milestone 2 - ie, trust and power - when thinking about which problems you want to solve.
Related Work
What are the existing attempts to solve this problem that have been attempted in prior research papers and real-world systems? Why are their solutions unsatisfactory?
- You may want to search around Google Scholar to find existing work that is related to the ideas your system proposes.
Research Contributions
What are the foundational ideas that underly your system? Why/how are they novel and better than anything that has been attempted in the past?
Evaluation
Once the platform you propose has been implemented, how will you determine whether your system actually solves the problem you wanted to solve? What are the results you hope you can realistically achieve? Why do these results show that you have solved the problem?
Read introductions of some existing papers
To see concrete examples of how HCI research papers that propose new platforms are structured, you should read the introductions of these papers. You will likely be familiar with the first two papers (mClerk and MobileWorks), as they were part of the Milestone 1 readings.
mClerk
MobileWorks
Twitch Crowdsourcing
Submitting
Create a Wiki Page for your Team's Submission
Please create a page for your team's submission at http://crowdresearch.stanford.edu/w/index.php?title=Milestone_6_YourTeamName&action=edit (substituting in YourTeamName with the team name), copy over the template at Milestone 6 Research Proposal Template .
[Team Leaders] Post the links to your research proposals until 8th April 11:59 pm
We have a service on which you can post research proposals you generated, comment on them, and upvote ones you like.
http://crowdresearch.meteor.com/category/milestone-6-research-proposals
Post links to your research proposals only once they're finished. Give your posts the same title as your mock research paper. Do not include words like "Milestone", "Research Proposal", or your team name in the title.
-Please submit your finished research proposals by 11:59 pm 8th April 2015, and DO NOT vote/comment until 9th April 12:05 am
[Everyone] Peer-evaluation (upvote ones you like, comment on them) from 12:05 am 2nd April until 9 am 3rd April
Post submission phase, you are welcome to browse through, upvote, and comment on others' research proposals. We encourage you especially to look at and comment on research proposals that haven't yet gotten feedback, to make sure everybody's research proposals get feedback.
Step 1: Please use http://crowdresearch.meteor.com/needcomments to find prototypes that haven't yet gotten feedback, and http://crowdresearch.meteor.com/needclicks to find prototypes that haven't been yet been viewed many times.
Step 2: Once you find an idea of interest or less attended, please vote and comment upon it. Please perform this action from 3 to 5 prototypes - this will help us balance the comments and votes. Please do not vote your team's prototypes. Once again, everyone is supposed to vote+comment, whether you're the team leader or not.
COMMENT BEST-PRACTICES: As on Crowdgrader, everybody reviews at least 3 prototypes, supported by a comment. The comment should provide constructive feedback. Negative comments are discouraged - if you disliked some aspect of a prototype, make a suggestion for improvement.
[Team Leaders] Milestone 6 Submissions
To help us track all submissions and browsing through them, once you have finished your Milestone 6 Research Proposal, go to the link below and post the link:
