Difference between revisions of "Milestone 10"
(→How to do user evaluation) |
(→Improving your Prototype) |
||
| (8 intermediate revisions by 2 users not shown) | |||
| Line 1: | Line 1: | ||
| − | Due date (PST): 11:59 pm 6th May 2015 for submission, | + | Due date (PST): 11:59 pm 6th May 2015 for submission, 9:00am 8th May 2015 for voting and commenting on others' submissions. |
| − | This week you will improve your prototype so that you can actually go present it to potential users and get feedback. This week is about user | + | This week you will improve your prototype so that you can actually go present it to potential users and get feedback. This week is about doing informal user studies to get feedback from workers and requesters from MTurk or other platforms. |
| + | |||
| + | * '''Youtube video''' [https://www.youtube.com/watch?v=LsUlLRq6IHw watch] | ||
== Improving your Prototype == | == Improving your Prototype == | ||
| Line 7: | Line 9: | ||
First, based on feedback you have received from peers and from looking at other prototypes, refine your prototype further so that you have something that you can show to potential users and get feedback on. | First, based on feedback you have received from peers and from looking at other prototypes, refine your prototype further so that you have something that you can show to potential users and get feedback on. | ||
| − | == User | + | If you implemented your prototype in HTML/CSS and need a simple way to host it online, try https://www.bitballoon.com/ |
| + | |||
| + | == User Studies == | ||
| − | === Why do | + | === Why do user studies? === |
| − | + | Informal user studies are great for getting feedback on your ideas from actual potential users, and finding flaws before you spend days implementing them and pushing them into production. Hence, it's especially important to continually do informal user studies on prototypes to find areas for improvement early on, as opposed to finding flaws only after you have already built and launched your platform. | |
| − | === How to do user | + | === How to do user studies? === |
| − | See the [https://www.youtube.com/watch?v= | + | See the [https://www.youtube.com/watch?v=s3PJeUsDjYs&list=PLNtQfKgd43l1-YZVJfvm3_5p5xY5W4Zvy HCI lecture series about designing user studies] or more [https://class.coursera.org/hciucsd-005/lecture/preview here on Coursera] |
Also see the [[:Media:dschool_prototyping.pdf | d.school bootleg]] for more resources on testing prototypes with users. | Also see the [[:Media:dschool_prototyping.pdf | d.school bootleg]] for more resources on testing prototypes with users. | ||
| Line 31: | Line 35: | ||
2) A writeup summarizing the key findings you observed during your user study | 2) A writeup summarizing the key findings you observed during your user study | ||
| − | The writeup should discuss the most salient feedback and observations you made while doing user study, with each of your users (You should aim to try out your prototype with at least 2 different people. If the idea you are prototyping impacts both workers and requesters, try to get at least one of each type). Then, summarize the main findings into some concise bullet points, and finally some potential improvements to the idea and prototype that you have observed as a result of these studies. | + | The writeup should discuss the most salient feedback and observations you made while doing your user study, with each of your users (You should aim to try out your prototype with at least 2 different people. If the idea you are prototyping impacts both workers and requesters, try to get at least one of each type). Then, summarize the main findings into some concise bullet points, and finally some potential improvements to the idea and prototype that you have observed as a result of these studies. |
== Submitting == | == Submitting == | ||
| Line 41: | Line 45: | ||
=== Submission Categories === | === Submission Categories === | ||
| − | Submit at http://crowdresearch.meteor.com/ in the category according to which of the 4 foundational ideas you are prototyping. Submit by Wednesday at | + | Submit at http://crowdresearch.meteor.com/ in the category according to which of the 4 foundational ideas you are prototyping. Submit by Wednesday at 11:59pm (pacific time). |
| − | [[Milestone_9#Foundation_1:_Macro.2Bmicro | Foundation 1: Macro and Micro]] at | + | [[Milestone_9#Foundation_1:_Macro.2Bmicro | Foundation 1: Macro and Micro]] at http://crowdresearch.meteor.com/category/milestone-10-foundation-1 |
| − | [[Milestone_9#Foundation_2:_Input.2Foutput_transducers | Foundation 2: Input/output transducers]] at | + | [[Milestone_9#Foundation_2:_Input.2Foutput_transducers | Foundation 2: Input/output transducers]] at http://crowdresearch.meteor.com/category/milestone-10-foundation-2 |
| − | [[Milestone_9#Foundation_3:_External_quality_ratings | Foundation 3: External quality ratings]] at | + | [[Milestone_9#Foundation_3:_External_quality_ratings | Foundation 3: External quality ratings]] at http://crowdresearch.meteor.com/category/milestone-10-foundation-3 |
| − | [[Milestone_9#Foundation_4:_Open_Governance | Foundation 4: Open Governance]] at | + | [[Milestone_9#Foundation_4:_Open_Governance | Foundation 4: Open Governance]] at http://crowdresearch.meteor.com/category/milestone-10-foundation-4 |
=== List Your Submission === | === List Your Submission === | ||
| Line 57: | Line 61: | ||
=== Commenting === | === Commenting === | ||
| − | Remember to vote and comment on each others' submissions on the site, before Friday at | + | Remember to vote and comment on each others' submissions on the site, before Friday at 9:00am (pacific time) |
Please use http://crowdresearch.meteor.com/needcomments to find submissions that haven't yet gotten feedback, and http://crowdresearch.meteor.com/needclicks to find submissions that haven't been yet been viewed many times. | Please use http://crowdresearch.meteor.com/needcomments to find submissions that haven't yet gotten feedback, and http://crowdresearch.meteor.com/needclicks to find submissions that haven't been yet been viewed many times. | ||
Latest revision as of 21:27, 6 May 2015
Due date (PST): 11:59 pm 6th May 2015 for submission, 9:00am 8th May 2015 for voting and commenting on others' submissions.
This week you will improve your prototype so that you can actually go present it to potential users and get feedback. This week is about doing informal user studies to get feedback from workers and requesters from MTurk or other platforms.
- Youtube video watch
Contents
Improving your Prototype
First, based on feedback you have received from peers and from looking at other prototypes, refine your prototype further so that you have something that you can show to potential users and get feedback on.
If you implemented your prototype in HTML/CSS and need a simple way to host it online, try https://www.bitballoon.com/
User Studies
Why do user studies?
Informal user studies are great for getting feedback on your ideas from actual potential users, and finding flaws before you spend days implementing them and pushing them into production. Hence, it's especially important to continually do informal user studies on prototypes to find areas for improvement early on, as opposed to finding flaws only after you have already built and launched your platform.
How to do user studies?
See the HCI lecture series about designing user studies or more here on Coursera
Also see the d.school bootleg for more resources on testing prototypes with users.
Where can we find users?
Turker forums are a great place to start, if you want to find potentially interested workers and requesters to chat with! Ask around on Slack if having trouble finding users.
Deliverables
Please submit:
1) Your updated prototype
2) A writeup summarizing the key findings you observed during your user study
The writeup should discuss the most salient feedback and observations you made while doing your user study, with each of your users (You should aim to try out your prototype with at least 2 different people. If the idea you are prototyping impacts both workers and requesters, try to get at least one of each type). Then, summarize the main findings into some concise bullet points, and finally some potential improvements to the idea and prototype that you have observed as a result of these studies.
Submitting
Create Wiki Page
Please create a wiki page for your team's submission at http://crowdresearch.stanford.edu/w/index.php?title=Milestone_10_YourTeamName&action=edit (substituting in YourTeamName with the team name). Copy over the template at Milestone 10 Template .
Submission Categories
Submit at http://crowdresearch.meteor.com/ in the category according to which of the 4 foundational ideas you are prototyping. Submit by Wednesday at 11:59pm (pacific time).
Foundation 1: Macro and Micro at http://crowdresearch.meteor.com/category/milestone-10-foundation-1
Foundation 2: Input/output transducers at http://crowdresearch.meteor.com/category/milestone-10-foundation-2
Foundation 3: External quality ratings at http://crowdresearch.meteor.com/category/milestone-10-foundation-3
Foundation 4: Open Governance at http://crowdresearch.meteor.com/category/milestone-10-foundation-4
List Your Submission
Please list your submission at Milestone 10 Submissions
Commenting
Remember to vote and comment on each others' submissions on the site, before Friday at 9:00am (pacific time)
Please use http://crowdresearch.meteor.com/needcomments to find submissions that haven't yet gotten feedback, and http://crowdresearch.meteor.com/needclicks to find submissions that haven't been yet been viewed many times.
Please comment on 3 to 5 submissions. Please do not vote for your own submission. Once again, everyone is supposed to vote+comment.
Weekly Survey
Please fill out the weekly survey so we can improve your crowd research experience!
