12/01 - Strumming Saturday!

No arguments from me here. FWIW, if you ever see similar insinuations & don't want to expend the energy to deal w/ it yourself please just hit me w/ a post link on chat because I love explaining why completion times are a horrible metric to reject or judge data quality on, whether to a requester or fellow worker & have no problems doing so regardless of the circumstances, but especially when cooler heads might be more helpful to actually getting a point across.

 

I will do so. Thank you.

 

Ross Niswanger replied

Dear Mechanical Turk Worker:


If you are receiving this message, then you wrote in about your recent denial.


Be advised, your time was significantly below all tested values for time completion in a thoughtful manner... (the average completion time was 7 minutes, and the minimum tested time was 1 minute 15 seconds, when completing the survey as directed, "in a thoughtful manner")


Over 20% of respondents missed the check question, and as many of you pointed out, this was an "easy" survey. (This alone tells us that attention was not really directed by many of the respondents)


Not only was this an easy survey, the pay rate at even taking at least one minute but less than two minutes was over $30 per hour.


We did not expect the survey to take 10 minutes, but at least one minute of thoughtful reflection didn't seem like much to ask, nor was that out of line with our minimum expected value of time to complete the survey "IN A THOUGHTFUL MANNER"


However, since you have written in to contest, we know you are not a bot, so we will overturn.


Overturn will be complete within 72 hours, as we are waiting for all those that initially didn't screen to reply, and then we will run a batch file for all those that passed the check value of 10 minutes.

 

Beat me to it, "the average completion time was 7 minutes" just..lol

 

I'm going to say yes... been up for 3 hours and just looked...I'd swear I was at $30 but.....

 

Sirajul A. Shibly [A1QRUODTXWFY5H] Data breach and shopping behavior - $0.25 | PANDA

Low

Unrated

Unrated

$4.05 / hour
00:03:42 / completion time

Pros:
Two pages

Cons:
Low pay - even for a Saturday

Qualifications: Total approved HITs > 100; HIT approval rate (%) > 95; Location EqualTo US;

To read Sirajul A. Shibly's full profile check out TurkerView!​

 

Star Psychological Research [AAZ9WARJFSTHA] 6-minute ‘Meaning, Identity & Culture 2.1’ Survey - $0.75 | PANDA

Good

Unrated

Unrated

$11.74 / hour
00:03:50 / completion time

Pros:

Cons:

Qualifications: Total approved HITs > 500; HIT approval rate (%) >= 99; Location EqualTo US;

To read Star Psychological Research's full profile check out TurkerView!​

 

Did anyone else receive a rejection from-EVA HABERMANN-TITLE-SHORT SURVEY.
Reason for rejection-spent less than 4 mins.

??????????????

It was short survey, how much time was I meant to spend on it?

FFS!

 

Thanks for the information. I'll reply too.

 

I'm not laughing at you...yes I got a rejection as well.

 

yea i got rejected from Eva Habermann too. probably a scammer.

 

Title: Answer a survey about your attitudes toward various scenarios involving actions by police. | Accept Requester: Bradley Malin [A2RA37KD1NIQ2M] Contact TV: [Hrly=$65.32] [Pay=4.81] [Fast=4.88] [Comm=4.67] [Rej=0] [ToS=0] [Blk=0] TO: [Pay=3.79] [Fast=4.00] [Comm=4.09] [Fair=3.91] [Reviews=17] [ToS=0] Reward: 1.00 Duration: 1:00:00 Available: 1 Description: The purpose of this study is to examine how individuals rank the "intrusiveness" of various scenarios involving actions by police. Qualifications: Previously took Law Enforcement Survey DoesNotExist ; Location EqualTo US

HIT exported from Mturk Suite v2.4.3​

 

Ryan Hauser [A1WD0GA48Q3JMD] Answer a few questions about buying products (~4 mins) - $0.40 | PANDA

Good

Unrated

Unrated

$12.52 / hour
00:01:55 / completion time

Pros:

Cons:

Qualifications: Total approved HITs > 100; HIT approval rate (%) > 95; Location EqualTo US;

To read Ryan Hauser's full profile check out TurkerView!​

 

Just checked MTS to see if I did that survey and . . . nope didn't do it.

 

More often than not its just someone who has no freaking clue people sit around & do surveys for 8hrs/day, all day, for weeks on end, and can fly through them with macros / keybinds / familiarity alone.

So they just assume it takes a long time because this is the most interesting thing in the reqs world & they don't even consider we don't actually get hyped about if lipstick has personal feelings and doing it that quickly must correlate with inattentive/bad data.

9/10 some quick e-mails get the rejections overturned. If it had a university attached, 99/100.