Difference between revisions of "WinterMilestone 1 nalinc"

From crowdresearch
Jump to: navigation, search
Line 3: Line 3:
 
== Experience the life of a Worker on Mechanical Turk ==
 
== Experience the life of a Worker on Mechanical Turk ==
  
−
I tried hands on Amazon Mechanical Turk Developer sandbox because of its __ and restriction-free access across nations.
+
I tried hands on Amazon Mechanical Turk Developer environment workersandbox[http://workersandbox.mturk.com] because of its __ and restriction-free access across nations.
 
It is a simulated environment that allows users to test their applications and perform HITs[Human Intelligence Tasks].
 
It is a simulated environment that allows users to test their applications and perform HITs[Human Intelligence Tasks].
−
Being a testing platform, it does not allow transfer of funds outside the sandbox. I completed a total of 21 tasks and managed to earn 2.10 USD. Below is a screenshot of my dashboard from worker account at MTurk.
+
Being a testing platform, it does not allow transfer of funds outside the sandbox. I completed a total of '''21 tasks and managed to earn 2.10 USD'''* by 2:00 PM IST 14th January, 2015.  
 +
 
 +
Below is a screenshot of my dashboard from worker account at MTurk.
  
 
[[File:nalinc_workerAccount@MTurkSandbox.png]]
 
[[File:nalinc_workerAccount@MTurkSandbox.png]]
  
−
I attempted the tasks among following categories:
+
'''*Current total is: 27 tasks.'''
 +
 
 +
'''I kept doing few more tasks posted by my peers at Milestone 1 Sandbox HITs[http://crowdresearch.stanford.edu/w/index.php?title=Milestone_1_Sandbox_HITs]'''
 +
 
 +
Following are few of the tasks I attempted during the process:
 
* Find the Hotel Name Address for Given URL
 
* Find the Hotel Name Address for Given URL
 
* Find the correct(valid) url
 
* Find the correct(valid) url
Line 16: Line 22:
  
 
What did you like?  
 
What did you like?  
 +
--todo--
  
 
What did you dislike?
 
What did you dislike?
−
 
+
--todo--
 
== Experience the life of a Requester on Mechanical Turk ==
 
== Experience the life of a Requester on Mechanical Turk ==
  
−
Reflect on your experience as a requester on Mechanical Turk. What did you like? What did you dislike? Also attach the CSV file generated when you download the HIT results.
 
−
If you're from outside the USA and unable to access MTurk, you can try the [https://requester.mturk.com/developer/sandbox MTurk requester sandbox], or [http://www.crowdflower.com/ CrowdFlower] or [https://microworkers.com/ Microworkers] or [http://www.clickworker.com/en Clickworker]
 
  
−
csv file of results:
+
Again, like the workersandbox, I tried Amazon Mechanical Turk's developer environment requestersandbox[requestersandbox.mturk.com] to get into the shoes of a requester. I also did minor investigations in microworkers[https://microworkers.com/] and performed task authoring in  Daemo. Speaking of MTurk sandbox, I published the following tasks
 +
 
 +
 
 +
1) '''Provide descriptions of popular opensource projects'''
 +
* Requester: Nalin Chhibber('''@nalinc''')
 +
* HIT URL: https://workersandbox.mturk.com/mturk/preview?groupId=37TLCE26IMNXBOMLL6HTYPIHZRAM5D
 +
* Qualification required: None
 +
* Number of Assignments per HIT: 15
 +
* Reward per Assignment: $0.10
 +
* Input csv file: [[File:Softwares.csv]]
 +
 
 +
2) '''Judge the sentiment expressed toward: random user tweets'''
 +
* HIT URL: https://workersandbox.mturk.com/mturk/preview?groupId=3Z44DFV2WUQSSAIJ9NVBWWHOQSHL7R
 +
* Qualification required: Worker should be '''master'''
 +
* Number of Assignments per HIT: 5
 +
* Reward per Assignment: $0.15
 +
* Input csv file: [[File:Sentiment.csv]]
 +
 
 +
 
 +
What did you like? --todo
 +
 
 +
What did you dislike? --todo
 +
 
 +
CSV file generated when you download the HIT results:
 
[[File:Batch_119356_batch_results.csv]]
 
[[File:Batch_119356_batch_results.csv]]
  
 
== Explore alternative crowd-labor markets ==
 
== Explore alternative crowd-labor markets ==
  
−
Compare and contrast the crowd-labor market you just explored (TaskRabbit/oDesk/GalaxyZoo) to Mechanical Turk.
+
Because of location restrictions, my account registration was rejected at most of the crowd platforms including MTurk, Uplink. However, I did explore Daemo task authoring locally. Comparison of Daemo with other platforms is described later.
 +
 
  
 
== Readings ==
 
== Readings ==
Line 35: Line 64:
 
=== MobileWorks ===
 
=== MobileWorks ===
  
−
* What do you like about the system / what are its strengths?
+
* What do you like about the system / what are its strengths? --todo
−
* What do you think can be improved about the system?
+
* What do you think can be improved about the system? --todo
  
 
=== Daemo ===
 
=== Daemo ===
  
−
* What do you like about the system / what are its strengths?
+
* What do you like about the system / what are its strengths? --todo
−
* What do you think can be improved about the system?
+
* What do you think can be improved about the system? --todo
  
 
=== Flash Teams ===
 
=== Flash Teams ===
  
−
* What do you like about the system / what are its strengths?
+
* What do you like about the system / what are its strengths? --todo
−
* What do you think can be improved about the system?
+
* What do you think can be improved about the system? --todo
  
 
== Milestone Contributors ==  
 
== Milestone Contributors ==  
  
 
Author: @nalinc
 
Author: @nalinc

Revision as of 12:09, 16 January 2016

This page is intended to serve for Winter Milestone 1 submission by user @nalinc[1]. Do not edit this directly

Experience the life of a Worker on Mechanical Turk

I tried hands on Amazon Mechanical Turk Developer environment workersandbox[2] because of its __ and restriction-free access across nations. It is a simulated environment that allows users to test their applications and perform HITs[Human Intelligence Tasks]. Being a testing platform, it does not allow transfer of funds outside the sandbox. I completed a total of 21 tasks and managed to earn 2.10 USD* by 2:00 PM IST 14th January, 2015.

Below is a screenshot of my dashboard from worker account at MTurk.

Nalinc workerAccount@MTurkSandbox.png

*Current total is: 27 tasks.

I kept doing few more tasks posted by my peers at Milestone 1 Sandbox HITs[3]

Following are few of the tasks I attempted during the process:

  • Find the Hotel Name Address for Given URL
  • Find the correct(valid) url
  • Find the website address for restaurant
  • Tagging of an Image

What did you like? --todo--

What did you dislike? --todo--

Experience the life of a Requester on Mechanical Turk

Again, like the workersandbox, I tried Amazon Mechanical Turk's developer environment requestersandbox[requestersandbox.mturk.com] to get into the shoes of a requester. I also did minor investigations in microworkers[4] and performed task authoring in Daemo. Speaking of MTurk sandbox, I published the following tasks


1) Provide descriptions of popular opensource projects

2) Judge the sentiment expressed toward: random user tweets


What did you like? --todo

What did you dislike? --todo

CSV file generated when you download the HIT results: File:Batch 119356 batch results.csv

Explore alternative crowd-labor markets

Because of location restrictions, my account registration was rejected at most of the crowd platforms including MTurk, Uplink. However, I did explore Daemo task authoring locally. Comparison of Daemo with other platforms is described later.


Readings

MobileWorks

  • What do you like about the system / what are its strengths? --todo
  • What do you think can be improved about the system? --todo

Daemo

  • What do you like about the system / what are its strengths? --todo
  • What do you think can be improved about the system? --todo

Flash Teams

  • What do you like about the system / what are its strengths? --todo
  • What do you think can be improved about the system? --todo

Milestone Contributors

Author: @nalinc

Retrieved from "http://crowdresearch.stanford.edu/w/index.php?title=WinterMilestone_1_nalinc&oldid=13033"