01/24 - Thwomp Thursday!

Pinterest [AURHK491L2LH6] Pinterest - Pinterest Ad Relevance in Search - $0.40 | PANDA

Generous

Unrated

Unrated

$18.23 / hour
00:01:19 / completion time

​

Pros:

Cons:

Qualifications: sofia_accuracy DoesNotExist ; Scammers DoesNotExist ;

To read Pinterest's full profile check out TurkerView!​

 

Stephen J. Tonks [A1YLG3BNTSUFK2] Reading Motivation(~ 1 minutes) - $0.10 | PANDA

Fair

Unrated

Unrated

$9.00 / hour
00:00:40 / completion time

​

Pros:

Cons:

Qualifications: Exc: [-1279088119-119104] DoesNotExist ; Location In US;

To read Stephen J. Tonks's full profile check out TurkerView!​

 

Elisa Kreiss [A2O23Q58W1CO9A] Read a story and answer questions about it - $0.60 | PANDA

Fair

Unrated

Unrated

$8.93 / hour
00:04:02 / completion time

​

Pros:
Fair pay

Cons:

Qualifications: HIT approval rate (%) >= 95; Location EqualTo US;

To read Elisa Kreiss's full profile check out TurkerView!​

 

last half an hour

Today's Assigned HITs 24 $20.00
Today's Submitted HITs 2 $1.50

 

Juliana [AQGZAPJ1BO9XS] Rating Conversations Survey(~ 12 minutes) - $1.20 | PANDA

Good

Unrated

Unrated

$11.61 / hour
00:06:12 / completion time

​

Pros:
Simple task for good pay

Cons:
None

Qualifications: Exc: [3734000-125135] DoesNotExist ; Total approved HITs >= 500; HIT approval rate (%) >= 95; Location In US;

To read Juliana's full profile check out TurkerView!​

 

Survey Research [AQHH4IOCZMFO3] 10-Minute Scenario Survey - $1.50 | PANDA

Generous

Unrated

Unrated

$35.53 / hour
00:02:32 / completion time

​

Pros:

Cons:

Qualifications: Total approved HITs >= 1; HIT approval rate (%) >= 90; Location EqualTo US;

To read Survey Research's full profile check out TurkerView!​

 

Juliana [AQGZAPJ1BO9XS] Word Search HIT(~ 6 minutes) - $0.60 $0.60 bonus | PANDA

Generous

Unrated

Unrated

$20.47 / hour
00:03:31 / completion time

​

Pros:
- Performance-based bonus
- Progress bar
- Could be completed slightly faster if you don't have a bird on your keyboard attacking your fingers when you try to type

Cons:
- Writing

Qualifications: Total approved HITs >= 500; Exc: [125816-125227] DoesNotExist ; HIT approval rate (%) >= 95; Location In US;

To read Juliana's full profile check out TurkerView!​

 

NOTE 1: This HIT requires a considerable amount of reading and writing.

 

John Stanton [A2ATPYB1Q9ZDX7] 10 minutes simple survey about food products' preferences - $1.00 | PANDA

Low

Unrated

Unrated

$8.61 / hour
00:06:58 / completion time

​

Pros:

Cons:

Qualifications: Total approved HITs > 10000; HIT approval rate (%) >= 98; Location EqualTo US;

To read John Stanton's full profile check out TurkerView!​

 

elisa s [A3PEEBFTVESGEG] Answer a survey about your opinions - $1.00 | PANDA

Generous

Unrated

Unrated

$18.00 / hour
00:03:20 / completion time

​

Pros:

Cons:

Qualifications: HIT approval rate (%) > 95; Location EqualTo US;

To read elisa s's full profile check out TurkerView!​

 

FW [A287T594OSPJ0A] Birthday Party Study (5 minutes)(~ 5 minutes) - $0.50 | PANDA

Low

Unrated

Unrated

$8.45 / hour
00:03:33 / completion time

​

Pros:

Cons:

Qualifications: Total approved HITs >= 100; Exc: [-532637450-125113] DoesNotExist ; HIT approval rate (%) >= 90; Location In US;

To read FW's full profile check out TurkerView!​

 

Social Psychology Experiment [AO02TOCBAPN7W] Rating life experiences - 10 to 15 minute study(~ 12 minutes) - $0.75 | PANDA

Good

<24 hours

Unrated

$19.71 / hour
00:02:17 / completion time

Approved! ​

Pros:

Cons:

Qualifications: Exc: [-145795901-125140] DoesNotExist ; HIT approval rate (%) >= 95; Location In US;

To read Social Psychology Experiment's full profile check out TurkerView!​

 

Joeri Wissink [A27S7Q5W5EJB08] Study on decision making(~ 15 minutes) - $1.80 | PANDA

Unrated

<24 hours

Unrated

$7.05 / hour
00:15:19 / completion time

Approved! ​

Pros:
got paid for waiting

Cons:
I wasn't able to complete the experiment because of people

Qualifications: Total approved HITs >= 100; Exc: [-1481613320-125184] DoesNotExist ; HIT approval rate (%) >= 90; Location In US;

To read Joeri Wissink's full profile check out TurkerView!​

 

Here's the thing: there is no right answer here. And, I think me advocating one way or another is probably unfair as it'll influence the actual results.

Its... so complicated.

Requesters should be qualling everything in their own best interest --- not even considering the wastefulness/negative impact to the workers not qualling things invites workers to lie and essentially destroy the study. Throwing "FOR FEMALES ONLY" in the HIT title will get them a bunch of "females" lol.

Is there an argument to be made that qualling everything isn't feasible/practical? Sure. Maybe. Kinda. No not really because 2 yrs later they come back and blast MTurk for their lazy methods. But either way that's not my circus/monkeys to figure out.

If workers don't want their time wasted, return reviews (RR) are going to be a good way to impact that because it actually gives me data I can send to requesters and say "look at this, stop doing it, its bad for you & us" at the very least. On the better end, we can build things to help cut it down. TurkPrime does a good job of it already, tbf, but they're not all-encompassing and certainly don't really care about our end of the equation much.

RR are very fluid. They don't really have long term negative impacts to the Requesters profile, and when they are integrated into the profile it will be a relative thing (ie, this Requester is the worst we know of for wasting workers time on broken hits, or unpaid screeners, or whatever).

I RR'd a great requester last night as "broken" because the system they used to determine if you've already participated is, IMO, broken.

Are RR kinda garbage data? Yeah, maybe, a little bit on an individual results basis but from the back end perspective I can tell you they are INSANELY valuable as an aggregate system. They really do give a good insight into who sucks & who doesn't (requesters, not workers). They need a lot of work for sure, but they're honestly a good thing overall as long as workers take them with a grain of salt.

Just seeing the red alert should never be an auto-return for workers. They 100% require some discretion/interpretation, and they probably do hurt newbies a bit who don't know how to interpret the (something TV needs to improve on, *points @ the Endor warning*) but when I can look at a requester like this: https://turkerview.com/requesters/A1OH6DWZ2TL944-center-for-the-science-of-social-connection

and see they have an average screening time of almost 4 minutes and have accrued over $1,800 in wasted time for workers just off return reviews then I've got something to work with as far as giving hard data to a problem largely just passed off to us to bear the cost of.

So yeah, it kinda sucks to neg-rep a requester over something you might not need to but it is at least a contained thing & will get love in the future to help workers navigate it better & better. I think the majority of humans are capable of seeing "FOR FEMALES ONLY" with a note "I was screened out for being a guy" and if they've got the lady bits will know to go ahead & proceed with the survey. If not.. I'm not really sure they're going to make it on MTurk anyway.

 

ugent [A3U0ZJEOCOTBKD] Academic Survey (about 4 minutes in length) - $0.50 | PANDA

Good

Unrated

Unrated

$12.50 / hour
00:02:24 / completion time

​

Pros:
one of the better ugents ive done

Cons:
MCs

Qualifications: Total approved HITs > 1000; HIT approval rate (%) > 96; Location EqualTo US;

To read ugent's full profile check out TurkerView!​

 

Basil Beshkov [A1J2VJQQ2T2RXS] Publix survey on Kombucha. - $0.25 | PANDA

Generous

Unrated

Unrated

$14.06 / hour
00:01:04 / completion time

​

Pros:

Cons:

Qualifications: Location EqualTo US;

To read Basil Beshkov's full profile check out TurkerView!​

 

Hyungyu Shin [A2JDSWVLZ8HEQV] Read a news story and comments, share your opinion. - $3.00 | PANDA

Good

Unrated

Unrated

$21.47 / hour
00:08:23 / completion time

Pros:
One of the more interesting studies I've had.

Cons:
Whole bunch of writing

Qualifications: HIT approval rate (%) > 95; Location EqualTo US;

To read Hyungyu Shin's full profile check out TurkerView!​

 

Today's Assigned HITs 38 $21.51
oday's Submitted HITs 15 $9.70

I got up an hour ago and need more coffee

 

im bored. send it my way.