11/30 - Maybe Monday

Moridin · Nov 30, 2020

SG AMT [A3DD7YGZX62UIW] Label the emotion in the audio - ~25 min - Qualification required (see description) - $3.00 | PANDA

Generous

Unrated

Unrated
$26.93 / hour
00:06:41 / completion time

Pros:

Cons:

Catchability: Okay (HIT Last Seen: 8 minutes ago)
Qualifications: SG_AMT_Emotion_Annotation EqualTo 100; Total approved HITs >= 100; ContentDisclaimer EqualTo 100; HIT approval rate (%) >= 80;

To read SG AMT's full profile check out TurkerView!

Joshua Brown · Nov 30, 2020

Stefan Uddenberg [A25ZIMFM995XCX] 2-Player Economic Game - University of Chicago Booth School of Business (5-10 minutes, up to $2.00 bonus; Protocol #IRB20-1363) - $0.75 $0.68 bonus | PANDA

Good

Unrated

Unrated
$11.19 / hour
00:07:40 / completion time

Pros:

Cons:

Catchability: Great (HIT Last Seen: a second ago)
Qualifications: dyads_pilot DoesNotExist ; HIT approval rate (%) >= 95; Location EqualTo US;

To read Stefan Uddenberg's full profile check out TurkerView!

Joshua Brown · Nov 30, 2020

Daniel Goldstein [A1OJ7YWANKDR4Q] Survey about COVID-19 and Government.(~ 10 minutes) - $1.00 | PANDA

Low

Unrated

Unrated
$5.86 / hour
00:10:14 / completion time

Pros:

Cons:

Catchability: Great (HIT Last Seen: a second ago)
Qualifications: Exc: [-775050443-252482] DoesNotExist ; TP Panel: 1892794236 N >= 100; CR Research Group #2 DoesNotExist ; HIT approval rate (%) >= 90; CR Research Group #1 >= 100; Location In US;

To read Daniel Goldstein's full profile check out TurkerView!

Joshua Brown · Nov 30, 2020

Maarten Sap [A1TW2IIFTWJIB2] Survey on hateful and toxic language online (Warning: may contain adult content) - $4.13 | PANDA

Generous

Unrated

Unrated
$28.16 / hour
00:08:48 / completion time

Pros:

Cons:

Catchability: Okay (HIT Last Seen: 35 minutes ago)
Qualifications: NeuralDetoxGroupC Exists ; Location In CA, US; Adult Content Qualification EqualTo 1;

To read Maarten Sap's full profile check out TurkerView!

Joshua Brown · Nov 30, 2020

Daniel Biggers [A19ZU06ZP0E20K] Answer a Survey about Political Policy Preferences and Current Events - $0.75 | PANDA

Fair

Unrated

Unrated
$10.07 / hour
00:04:28 / completion time

Pros:

Cons:

Catchability: Okay (HIT Last Seen: 44 minutes ago)
Qualifications: HIT approval rate (%) >= 95; Location EqualTo US;

To read Daniel Biggers's full profile check out TurkerView!

Joshua Brown · Nov 30, 2020

Altsuss [A1ATES40ZPE477] Decision Making Task(~ 8 minutes) - $1.20 | PANDA

Fair

Unrated

Unrated
$8.64 / hour
00:08:20 / completion time

Pros:

Cons:

Catchability: Okay (HIT Last Seen: 2 minutes ago)
Qualifications: Exc: [1843473607-260693] DoesNotExist ; CR Research Group #2 DoesNotExist ; CR Research Group #1 >= 100; Location In US;

To read Altsuss's full profile check out TurkerView!

mrnotoriousman · Nov 30, 2020

Meaning and Modality Lab [APDC3PD79UWJ] Participate in a linguistics study(~ 15 minutes) - $2.00 | PANDA

Generous

Unrated

Unrated
$38.92 / hour
00:03:05 / completion time

Pros:

Cons:

Catchability: Okay (HIT Last Seen: 89 minutes ago)
Qualifications: TP Panel: 361231105 N >= 100; Exc: [-586578017-260678] DoesNotExist ; Total approved HITs >= 50; HIT approval rate (%) >= 90; CR Research Group #1 >= 100; Location In US;

To read Meaning and Modality Lab's full profile check out TurkerView!

Penelope · Nov 30, 2020

Dean Karlan [A33HJ4AM68LCY8] Predictions Survey(~ 8 minutes) - $1.20 | PANDA

Generous

Unrated

Unrated
$48.00 / hour
00:01:30 / completion time

Pros:

Cons:

Catchability: Great (HIT Last Seen: a second ago)
Qualifications: Exc: [8322826-260656] DoesNotExist ; HIT approval rate (%) >= 95; Location In US;

To read Dean Karlan's full profile check out TurkerView!

Madeline Dewar · Nov 30, 2020

Madison Skov Kunz [A37JUYYP5R0FHM] Evaluate and rate the deference between a video's audio and text captions - $0.90 | PANDA

Fair

Unrated

Unrated
$9.05 / hour
00:05:58 / completion time

Pros:

Cons:

Catchability: Okay (HIT Last Seen: one minute ago)
Qualifications: Age - 55 or Older EqualTo 0; HIT approval rate (%) > 90; Total approved HITs > 50; Location EqualTo US;

To read Madison Skov Kunz's full profile check out TurkerView!

Kathleen! · Nov 30, 2020

Title: Organizational Management(~ 15 minutes) | Accept
Requester: Judgment and Decision Making Experimental Lab [A320N8U8JKHVXS] Contact
TV: [Hrly=$18.20] [Pay=Generous] [Approval=~24 hrs] [Comm=Acceptable] [Rej=0] [Blk=0]
TO: [Pay=3.95] [Fast=4.67] [Comm=3.00] [Fair=4.90] [Reviews=68] [ToS=4]
TO2: No Reviews
Reward: 1.82
Duration: 40:00
Available: 0
Description: A brief survey to understand individual responses to crisis situations.
Qualifications: Not available from queue exports.

HIT exported from Mturk Suite v2.6.13

Penelope · Nov 30, 2020

Hope to God this Kairos hit isn't like the last group forecasting hit!

Moridin · Nov 30, 2020

Dean Karlan [A33HJ4AM68LCY8] Predictions Survey(~ 8 minutes) - $1.20 | PANDA

Generous

Unrated

Unrated
$65.45 / hour
00:01:06 / completion time

Pros:

Cons:

Catchability: Great (HIT Last Seen: one minute ago)
Qualifications: Exc: [8322826-260656] DoesNotExist ; HIT approval rate (%) >= 95; Location In US;

To read Dean Karlan's full profile check out TurkerView!

Joshua Brown · Nov 30, 2020

Qual/Screener!

Research [A2KWU2PP8ICPLM] 1 min demographic survey (with possible bonus survey)(~ 1 minutes) - $0.15 | PANDA

Good

Unrated

Unrated
$11.74 / hour
00:00:46 / completion time

Pros:

Cons:

Catchability: Great (HIT Last Seen: a second ago)
Qualifications: Total approved HITs >= 100; CR Research Group #2 DoesNotExist ; HIT approval rate (%) >= 85; CR Research Group #1 >= 100; Exc: [-1043226949-260709] DoesNotExist ; Location In US;

To read Research's full profile check out TurkerView!

Joshua Brown · Nov 30, 2020

Judgment and Decision Making Experimental Lab [A320N8U8JKHVXS] Organizational Management(~ 15 minutes) - $1.82 | PANDA

Generous

Unrated

Unrated
$25.20 / hour
00:04:20 / completion time

Pros:

Cons:

Catchability: Okay (HIT Last Seen: 3 minutes ago)
Qualifications: Total approved HITs >= 100; CR Research Group #2 DoesNotExist ; HIT approval rate (%) >= 97; Exc: [261211-260622] DoesNotExist ; CR Research Group #1 >= 100; Location In US;

To read Judgment and Decision Making Experimental Lab's full profile check out TurkerView!

mrnotoriousman · Nov 30, 2020

Cognition Computation Development Lab [ASQ3IW66MKEDE] Academic Research Survey (10 Minutes)(~ 20 minutes) - $2.00 | PANDA

Generous

Unrated

Unrated
$19.35 / hour
00:06:12 / completion time

Pros:

Cons:

Catchability: Okay (HIT Last Seen: 55 minutes ago)
Qualifications: SurveyGroup [4530] DoesNotExist ; Exc: [260576-259987] DoesNotExist ; Total approved HITs >= 50; HIT approval rate (%) >= 95;

To read Cognition Computation Development Lab's full profile check out TurkerView!

ChrisTurk · Nov 30, 2020

hypersubtle said: ↑

Here's a thing:

As best I can glean (and I'm a pretty good cyberhunter), the "CR Research Group #1 >= 100" qualification is a White List qual; its counterpart Black List qual is "CR Research Group #2 DoesNotExist".

I was given the Black List qualification. My casual statistics-keeping over the past couple months show me that I am both denied access to more hits AND missing out on more total rewards by having this qual than I am by not having Masters.
Now, I've reluctantly accepted that I'll probably never get Masters because I go away from MTurk for a week or a month at a time. And even though I'm at nearly 30,000 total hits, I cannot bring myself to speed-complete tens of thousands of penny hits to bring that total to the magic number of 50,000. So it at least ***makes sense*** to me that I haven't been given Masters because of the consistency- and total-hit-based prerequisites that the Masters qual apparently requires.

But (and this is all speculation) sometime early to midyear 2020 Amazon outsourced the well-known requester SurveyComet to manufacture a certain criterion, based in a single(?) hit, that granted the worker that did that hit one of the two abovementioned qualifications. I mentioned this in a random post a while ago, and a member kindly tried to help me find this mysterious hit. I never found it. I can't believe that I'm the only Turker affected to this degree by this happening. This is a great impediment to my Turking. And I don't understand it at all. It doesn't *make sense* why out of the blue, Amazon did this. And it also makes no sense why no one's discussing this. There's, like, one Reddit thread from which I got most of the "facts" I'm laying out here. That's about it. ... A paradigm-shifting event occurs on the Mturk landscape, and the only place it's discussed is a single Reddit thread?! No, no, no. That's weird. That brings out the Fox Mulder in me. Why is no one talking about this?!

So... I just want to a) bring this to the attention of any worker who may be unaware of it, and b) ask the MTurk community the following:

1. What was the nature of the hit that decided these qualifications?
2. Is it possible to dialogue with SurveyComet and at most, redo the hit; and at least, be privy to why or how this Big Decision was made for me?
3. Could someone on this forum, if deemed appropriate, start a thread from the homepage on this subject? And if so, please include an easily-searchable term like "furbadoobledoo" so that that thread and/or discussion elsewhere concerning this can be found by any worker looking for it.

Thank you.
Click to expand...

Just for clarity, Amazon has nothing to do with the CR quals. They're entirely managed by a third party research management firm (with no affiliation to Amazon or MTurk) called "CloudResearch" - previously TurkPrime.

You can find all the explanation for the back end here: https://www.cloudresearch.com/resources/blog/new-tools-improve-research-data-quality-mturk/

SurveyComet has always been owned/affiliated with TurkPrime, it's just an extension of the base service w/ an arms length design. Their HITs do probably play into it, and I've seen some people claim a single SurveyComet grants the "whitelist" qualification but the wealth of data TP has on workers makes that kinda questionable to me but who knows. They'll never divulge exactly how the back end functions since workers could "game" the system.

As far as the block goes - yeah, TurkPrime does indeed manage a massive proportion of research on the platform. Having it will basically exclude you from academic work on MTurk.

The reason you're not really seeing a ton of discussion on it is because you're basically a bit of a statistical anomaly. For the overwhelming majority of instances their system works. Unfortunately for whatever reason your account got tossed into their "bot" pile, which is part of the problem when tossing humans through an algorithm, but there haven't been a ton of people who got thrown in there who are normally engaged in the social channels. Which isn't to say more "normal" workers didn't get screwed over, but 99% of them will just think "wow mturk sucks now" and quit since they have no clue anything outside of worker.mturk.com even exists :/

lapetitebaker · Nov 30, 2020

Dean Karlan [A33HJ4AM68LCY8] Predictions Survey(~ 8 minutes) - $1.20 | PANDA

Generous

Unrated

Unrated
$84.71 / hour
00:00:51 / completion time

Pros:

Cons:

Catchability: Okay (HIT Last Seen: 4 minutes ago)
Qualifications: Exc: [8322826-260656] DoesNotExist ; HIT approval rate (%) >= 95; Location In US;

To read Dean Karlan's full profile check out TurkerView!

Penelope · Nov 30, 2020

Judgment and Decision Making Experimental Lab [A320N8U8JKHVXS] Organizational Management(~ 15 minutes) - $1.82 | PANDA

Generous

Unrated

Unrated
$39.47 / hour
00:02:46 / completion time

Pros:

Cons:

Catchability: Okay (HIT Last Seen: 7 minutes ago)
Qualifications: Total approved HITs >= 100; CR Research Group #2 DoesNotExist ; HIT approval rate (%) >= 97; Exc: [261211-260622] DoesNotExist ; CR Research Group #1 >= 100; Location In US;

To read Judgment and Decision Making Experimental Lab's full profile check out TurkerView!

Kathleen! · Nov 30, 2020

Title: Scenario Study(~ 5 minutes) | Accept
Requester: [email protected] [A2ZTECTX04M1LY] Contact
TV: [Hrly=$12.45] [Pay=Good] [Approval=~24 hrs] [Comm=Unrated] [Rej=0] [Blk=0]
TO: [Pay=3.19] [Fast=4.57] [Comm=1.00] [Fair=5.00] [Reviews=22] [ToS=0]
TO2: No Reviews
Reward: 0.60
Duration: 1:00:00
Available: 28
Description: Brief study involving reading a scenario and answering questions
Qualifications: Not available from queue exports.

HIT exported from Mturk Suite v2.6.13

Moridin · Nov 30, 2020

[email protected] [A2ZTECTX04M1LY] Scenario Study(~ 5 minutes) - $0.60 | PANDA

Generous

Unrated

Unrated
$14.03 / hour
00:02:34 / completion time

Pros:

Cons:

Catchability: Great (HIT Last Seen: 55 seconds ago)
Qualifications: Exc: [261305-260716] DoesNotExist ; HIT approval rate (%) >= 95; CR Research Group #1 >= 100; Location In US;

To read [email protected]'s full profile check out TurkerView!

11/30 - Maybe Monday

Moridin Well-Known Turker

Joshua Brown Well-Known Turker

Joshua Brown Well-Known Turker

Joshua Brown Well-Known Turker

Joshua Brown Well-Known Turker

Joshua Brown Well-Known Turker

mrnotoriousman Survey Slinger TurkerView Masters

Penelope Survey Slinger TurkerView Masters

Madeline Dewar Active Turker

Kathleen! Survey Slinger

Penelope Survey Slinger TurkerView Masters

Moridin Well-Known Turker

Joshua Brown Well-Known Turker

Joshua Brown Well-Known Turker

mrnotoriousman Survey Slinger TurkerView Masters

ChrisTurk Administrator

lapetitebaker Survey Slinger TurkerView Masters

Penelope Survey Slinger TurkerView Masters

Kathleen! Survey Slinger

Moridin Well-Known Turker

About TurkerView Forum

11/30 - Maybe Monday

Moridin Well-Known Turker

Joshua Brown Well-Known Turker

Joshua Brown Well-Known Turker

Joshua Brown Well-Known Turker

Joshua Brown Well-Known Turker

Joshua Brown Well-Known Turker

mrnotoriousman Survey Slinger TurkerView Masters

Penelope Survey Slinger TurkerView Masters

Madeline Dewar Active Turker

Kathleen! Survey Slinger

Penelope Survey Slinger TurkerView Masters

Moridin Well-Known Turker

Joshua Brown Well-Known Turker

Joshua Brown Well-Known Turker

mrnotoriousman Survey Slinger TurkerView Masters

ChrisTurk Administrator

lapetitebaker Survey Slinger TurkerView Masters

Penelope Survey Slinger TurkerView Masters

Kathleen! Survey Slinger

Moridin Well-Known Turker

Useful Searches