Difference between revisions of "WinterMilestone 1 nalinc"

From crowdresearch
Jump to: navigation, search
Line 3: Line 3:
 
== Experience the life of a Worker on Mechanical Turk ==
 
== Experience the life of a Worker on Mechanical Turk ==
  
I tried hands on Amazon Mechanical Turk Developer sandbox because of its __ and restriction-free access across nations.
+
I tried hands on Amazon Mechanical Turk Developer environment workersandbox[http://workersandbox.mturk.com] because of its __ and restriction-free access across nations.
 
It is a simulated environment that allows users to test their applications and perform HITs[Human Intelligence Tasks].
 
It is a simulated environment that allows users to test their applications and perform HITs[Human Intelligence Tasks].
Being a testing platform, it does not allow transfer of funds outside the sandbox. I completed a total of 21 tasks and managed to earn 2.10 USD. Below is a screenshot of my dashboard from worker account at MTurk.
+
Being a testing platform, it does not allow transfer of funds outside the sandbox. I completed a total of '''21 tasks and managed to earn 2.10 USD'''* by 2:00 PM IST 14th January, 2015.  
 +
 
 +
Below is a screenshot of my dashboard from worker account at MTurk.
  
 
[[File:nalinc_workerAccount@MTurkSandbox.png]]
 
[[File:nalinc_workerAccount@MTurkSandbox.png]]
  
I attempted the tasks among following categories:
+
'''*Current total is: 27 tasks.'''
 +
 
 +
'''I kept doing few more tasks posted by my peers at Milestone 1 Sandbox HITs[http://crowdresearch.stanford.edu/w/index.php?title=Milestone_1_Sandbox_HITs]'''
 +
 
 +
Following are few of the tasks I attempted during the process:
 
* Find the Hotel Name Address for Given URL
 
* Find the Hotel Name Address for Given URL
 
* Find the correct(valid) url
 
* Find the correct(valid) url
Line 16: Line 22:
  
 
What did you like?  
 
What did you like?  
 +
--todo--
  
 
What did you dislike?
 
What did you dislike?
 
+
--todo--
 
== Experience the life of a Requester on Mechanical Turk ==
 
== Experience the life of a Requester on Mechanical Turk ==
  
Reflect on your experience as a requester on Mechanical Turk. What did you like? What did you dislike? Also attach the CSV file generated when you download the HIT results.
 
If you're from outside the USA and unable to access MTurk, you can try the [https://requester.mturk.com/developer/sandbox MTurk requester sandbox], or [http://www.crowdflower.com/ CrowdFlower] or [https://microworkers.com/ Microworkers] or [http://www.clickworker.com/en Clickworker]
 
  
csv file of results:
+
Again, like the workersandbox, I tried Amazon Mechanical Turk's developer environment requestersandbox[requestersandbox.mturk.com] to get into the shoes of a requester. I also did minor investigations in microworkers[https://microworkers.com/] and performed task authoring in  Daemo. Speaking of MTurk sandbox, I published the following tasks
 +
 
 +
 
 +
1) '''Provide descriptions of popular opensource projects'''
 +
* Requester: Nalin Chhibber('''@nalinc''')
 +
* HIT URL: https://workersandbox.mturk.com/mturk/preview?groupId=37TLCE26IMNXBOMLL6HTYPIHZRAM5D
 +
* Qualification required: None
 +
* Number of Assignments per HIT: 15
 +
* Reward per Assignment: $0.10
 +
* Input csv file: [[File:Softwares.csv]]
 +
 
 +
2) '''Judge the sentiment expressed toward: random user tweets'''
 +
* HIT URL: https://workersandbox.mturk.com/mturk/preview?groupId=3Z44DFV2WUQSSAIJ9NVBWWHOQSHL7R
 +
* Qualification required: Worker should be '''master'''
 +
* Number of Assignments per HIT: 5
 +
* Reward per Assignment: $0.15
 +
* Input csv file: [[File:Sentiment.csv]]
 +
 
 +
 
 +
What did you like? --todo
 +
 
 +
What did you dislike? --todo
 +
 
 +
CSV file generated when you download the HIT results:
 
[[File:Batch_119356_batch_results.csv]]
 
[[File:Batch_119356_batch_results.csv]]
  
 
== Explore alternative crowd-labor markets ==
 
== Explore alternative crowd-labor markets ==
  
Compare and contrast the crowd-labor market you just explored (TaskRabbit/oDesk/GalaxyZoo) to Mechanical Turk.
+
Because of location restrictions, my account registration was rejected at most of the crowd platforms including MTurk, Uplink. However, I did explore Daemo task authoring locally. Comparison of Daemo with other platforms is described later.
 +
 
  
 
== Readings ==
 
== Readings ==
Line 35: Line 64:
 
=== MobileWorks ===
 
=== MobileWorks ===
  
* What do you like about the system / what are its strengths?
+
* What do you like about the system / what are its strengths? --todo
* What do you think can be improved about the system?
+
* What do you think can be improved about the system? --todo
  
 
=== Daemo ===
 
=== Daemo ===
  
* What do you like about the system / what are its strengths?
+
* What do you like about the system / what are its strengths? --todo
* What do you think can be improved about the system?
+
* What do you think can be improved about the system? --todo
  
 
=== Flash Teams ===
 
=== Flash Teams ===
  
* What do you like about the system / what are its strengths?
+
* What do you like about the system / what are its strengths? --todo
* What do you think can be improved about the system?
+
* What do you think can be improved about the system? --todo
  
 
== Milestone Contributors ==  
 
== Milestone Contributors ==  
  
 
Author: @nalinc
 
Author: @nalinc

Revision as of 11:09, 16 January 2016

This page is intended to serve for Winter Milestone 1 submission by user @nalinc[1]. Do not edit this directly

Experience the life of a Worker on Mechanical Turk

I tried hands on Amazon Mechanical Turk Developer environment workersandbox[2] because of its __ and restriction-free access across nations. It is a simulated environment that allows users to test their applications and perform HITs[Human Intelligence Tasks]. Being a testing platform, it does not allow transfer of funds outside the sandbox. I completed a total of 21 tasks and managed to earn 2.10 USD* by 2:00 PM IST 14th January, 2015.

Below is a screenshot of my dashboard from worker account at MTurk.

Nalinc workerAccount@MTurkSandbox.png

*Current total is: 27 tasks.

I kept doing few more tasks posted by my peers at Milestone 1 Sandbox HITs[3]

Following are few of the tasks I attempted during the process:

  • Find the Hotel Name Address for Given URL
  • Find the correct(valid) url
  • Find the website address for restaurant
  • Tagging of an Image

What did you like? --todo--

What did you dislike? --todo--

Experience the life of a Requester on Mechanical Turk

Again, like the workersandbox, I tried Amazon Mechanical Turk's developer environment requestersandbox[requestersandbox.mturk.com] to get into the shoes of a requester. I also did minor investigations in microworkers[4] and performed task authoring in Daemo. Speaking of MTurk sandbox, I published the following tasks


1) Provide descriptions of popular opensource projects

2) Judge the sentiment expressed toward: random user tweets


What did you like? --todo

What did you dislike? --todo

CSV file generated when you download the HIT results: File:Batch 119356 batch results.csv

Explore alternative crowd-labor markets

Because of location restrictions, my account registration was rejected at most of the crowd platforms including MTurk, Uplink. However, I did explore Daemo task authoring locally. Comparison of Daemo with other platforms is described later.


Readings

MobileWorks

  • What do you like about the system / what are its strengths? --todo
  • What do you think can be improved about the system? --todo

Daemo

  • What do you like about the system / what are its strengths? --todo
  • What do you think can be improved about the system? --todo

Flash Teams

  • What do you like about the system / what are its strengths? --todo
  • What do you think can be improved about the system? --todo

Milestone Contributors

Author: @nalinc