Difference between revisions of "Qualitative Analysis RDQA"

From crowdresearch
Jump to: navigation, search
(Hairball Map)
Line 9: Line 9:
 
=Results=
 
=Results=
 
==Turker thoughts about pay on Survey Tasks==
 
==Turker thoughts about pay on Survey Tasks==
[[File:Pasted image at 2016 03 19 05 12 AM.png]]
+
[[File:Pasted image at 2016 03 19 05 12 AM.png|400 px]]
  
 
{|Class="wikitable"
 
{|Class="wikitable"
 
|-
 
|-
!Welch Two Sample T-Test
+
!Data: TurkOpticon 5 Votes v.
!Students' T-Test
+
!All Others for Survey Tasks
 
|-
 
|-
|Data: Tasks with TurkOpticon 5 Votes and All Others for Survey Tasks
+
|Welch Two Sample T-Test
 +
|Students' T-Test
 
|-
 
|-
 
|p = 0.005428
 
|p = 0.005428
 
|p = 0.003642
 
|p = 0.003642
 
|}
 
|}
 +
 
Data CSV from March 19 [https://slack-files.com/T03R8AQ66-F0TTXR22K-266b84d029]
 
Data CSV from March 19 [https://slack-files.com/T03R8AQ66-F0TTXR22K-266b84d029]
  
Line 33: Line 35:
 
10.863968  5.252852
 
10.863968  5.252852
  
==Hairball Map==
+
==Hairball Map: What might happen outside of Turk? How might Requesters manipulate tasks as a response?==
 
[[File:DaemoEvidenceMap.png]]
 
[[File:DaemoEvidenceMap.png]]
  
Line 44: Line 46:
 
=Discussion=
 
=Discussion=
 
=Files=
 
=Files=
 +
[https://slack-files.com/T03R8AQ66-F0UQCPH4Y-7c55a1801a TurkOpticon RDQA 3.21.1714 database]
 +
[https://slack-files.com/T03R8AQ66-F0UQDU3CH-f001b7e275 TurkOpticon RDQA 3.19.1700 database]

Revision as of 23:50, 22 March 2016

Overview

Method

TurkOpticon Reviews

Results

Turker thoughts about pay on Survey Tasks

Pasted image at 2016 03 19 05 12 AM.png

Data: TurkOpticon 5 Votes v. All Others for Survey Tasks
Welch Two Sample T-Test Students' T-Test
p = 0.005428 p = 0.003642

Data CSV from March 19 [1]


data: dat$Tasks.w..5s and dat$All.Others t = 3.3403, df = 12.791, p-value = 0.005428 alternative hypothesis: true difference in means is not equal to 0 95 percent confidence interval: 1.976024 9.246208 sample estimates: mean of x mean of y 10.863968 5.252852

Hairball Map: What might happen outside of Turk? How might Requesters manipulate tasks as a response?

DaemoEvidenceMap.png

Tasks w/ 5s All Others Mean 10.86396774 5.252851782 SD 4.807581499 2.259549664 N 10 10 P 0.003642357

Discussion

Files

TurkOpticon RDQA 3.21.1714 database TurkOpticon RDQA 3.19.1700 database