03/18 - Moving on up Monday!

In this case? The data.

Using bonus deception as part of a study is unfair to workers. It completely negates their ability to properly prioritize work and it's unfair. As far as the power dynamics go, the requesters have the ability to rectify this in their studies, workers have zero way of avoiding it other than review platforms so requesters are going to take the L as far as TV is concerned. If it's study breaking, they can recognize TV (& TO) exists, that worker communication channels exist, and structure their study around that publicly available information.

 

this pretty much.

the need to know if work is worth doing outweighs survey content like @ChrisTurk said, if they want a better solution get irbs off their asses and create standards

[citation everything written in the past 7 years] pretty much

 

stech cornell [A2SH9ZRBUQFZF1] Rate 16 claims and tell us if you believe they're true or false - $0.80 $1.50 bonus | PANDA

Generous

Unrated

Unrated

$50.49 / hour
00:02:44 / completion time

​

Pros:
Extremely easy task.
Don't stress about the bonus.

Cons:

Qualifications: NewsRater DoesNotExist ; Total approved HITs > 100; HIT approval rate (%) >= 98; Location EqualTo US;

To read stech cornell's full profile check out TurkerView!​

 

UM [A2FI5PAPNNIR8M] less than 1min survey on your opinions (~ 1 minutes) - $0.20 | PANDA

Generous

Unrated

Unrated

$45.00 / hour
00:00:16 / completion time

​

Pros:
1 question

Cons:

Qualifications: Total approved HITs >= 10000; HIT approval rate (%) >= 98; Location In US;

To read UM's full profile check out TurkerView!​

 

UM [A2FI5PAPNNIR8M] less than 1min survey on your opinions (~ 1 minutes) - $0.20 | PANDA

Unrated

Unrated

Unrated

$65.45 / hour
00:00:11 / completion time

​

Pros:

Cons:

Qualifications: Total approved HITs >= 10000; HIT approval rate (%) >= 98; Location In US;

To read UM's full profile check out TurkerView!​

 

Thanks. I put the bonus in the review. I've seen worse bonus deception, but this one was actually substantial in tripling the pay and I felt it was important to disclose that.

 

For sure!! Gotta let those neighbors know whats up.

 

David Gal [A3SMNGCVAE56LJ] This is a 2 minute survey about your preferences - $0.23 | PANDA

Generous

Unrated

Unrated

$41.40 / hour
00:00:20 / completion time

​

Pros:
1 question 2 demos

Cons:

Qualifications: HIT approval rate (%) >= 95; Location EqualTo US;

To read David Gal's full profile check out TurkerView!​

 

Title: Attitudes Study(~ 4 minutes) [ $ | $ ] PANDA
Requester: Stanford GSB Behavioral Lab [A3OSXTUM1QEXNY]
TurkerView: [ $14.41 / hour ]
Description: $0.48 for 4 mins!
Duration: 00:30:00
Available: 45
Reward: $0.48
Qualifications:

• Total approved HITs GreaterThanOrEqualTo 500,
• HIT approval rate (%) GreaterThanOrEqualTo 95,
• Location In US,

[3K8YRYAXTNJ40JOWFDB47OZ7VJMGDN]​

 

I think she meant "you were supposed to get 10 cents bonus based on your decision, but we will bonus everyone $1" situation.

Also using deception is a huge deal in most of the sciences; you have to do it to get a data that you can use. BUT if you are an economist, you cannot use deception in your studies/experiments.

 

David Gal [A3SMNGCVAE56LJ] This is a 2 minute survey about your preferences - $0.23 | PANDA

Generous

Unrated

Unrated

$43.58 / hour
00:00:19 / completion time

​

Pros:

Cons:

Qualifications: HIT approval rate (%) >= 95; Location EqualTo US;

To read David Gal's full profile check out TurkerView!​

 

Yes, which is why when it isn't material to a worker's livelihood I'm happy to tell folks not to include it in their reviews.

But the amount rewarded for time spent on a task is a good place to draw the line for TV, IMO. Which is probably why economists aren't supposed to do it in the first place

I've seen academics on twitter claim this as well but I think we've all done a study or two where the bonus was "forgotten about" - especially on the longer lived "would you rather have X now or Y in 3mo" studies

 

Yeah, he responded pretty quickly to my email questioning it. Glad they honored the title.

 

Spoiler: possible survey content but if we're going down this rabbit hole...

I feel like in this case the HIT base being under $1 might actually cause it to not be on some peoples' radars when it really should be. And I wanted to be fair to the requester who is super awesome about being fair to both those who took his/her study seriously and those who took a lot of extra time and went against the rules to guarantee they got the bonus. (Which I think is what he/she was probably testing.)

 

Samuel Gershman [A1NLXULMPXG1OY] Search and Collect Rewards in an Online Game(~ 20 minutes) - $2.00 $2.29 bonus | PANDA

Generous

Unrated

Unrated

$23.15 / hour
00:11:07 / completion time

​

Pros:
Big bonus potential.
Pay still good without bonus.

Cons:

Qualifications: Total approved HITs >= 100; Exc: [133263582-135353] DoesNotExist ; HIT approval rate (%) >= 95; Location In US;

To read Samuel Gershman's full profile check out TurkerView!​

 

To be fair, I'd never say anything about the deception if it didn't affect the hourly, but just because this isn't my bread and butter doesn't mean it's not someone else's and I want to make sure I'm as honest as possible to help them out.

 

MIT-PERL [A3NUHDYTCDI1G4] Complete a fun task for MIT-sponsored study - $6.00 | PANDA

Good

Unrated

Unrated

$11.83 / hour
00:30:26 / completion time

​

Pros:
Easy and simple. I took my time doing this so I'm sure someone can shave off a few minutes on the completion time.

Cons:
Topics switches positions, causing you to have to constantly search for the relevant option.

Qualifications: Total approved HITs > 100; HIT approval rate (%) > 95; Location EqualTo US;

To read MIT-PERL's full profile check out TurkerView!​

 

I'm honestly surprised. I thought it was adequate for the time spent as it was and just a simple typo. Nice to see some integrity still exists.

 

Title: Answer a survey about your dinning experience | PANDA
Requester: Sarah Elrafei [A1CJKM2OS6WP7N]
TurkerView: [ $15.44 / hour ]
Description: Give us your opinion about incident took place while dinning in a restaurant
Duration: 120 Min
Available: 1
Reward: $0.50
Qualifications:

• 3rd intake DoesNotExist
• Total approved HITs GreaterThan 1000
• HIT approval rate (%) GreaterThan 95
• Location EqualTo US

[3NXBKB55AA16KSUKNY3WVYT57ZI9LL]​