04/15 - Two Thumbs Up Thursday

Yphtach Lelkes [A3QABKQPGF9OKF] [$6.5 for 35 Minutes] Live Policy Discussion for 18+ Years Old US Residents Using Laptop or Desktop(~ 2 minutes) - $0.50 | PANDA

Unrated

Unrated

Unrated

$14.29 / hour
00:02:06 / completion time

​

Pros:

Cons:

Catchability: Great (HIT Last Seen: a second ago)
Qualifications: CR Research Group #2 DoesNotExist ; HIT approval rate (%) >= 80; CR Research Group #1 >= 100; Location In US; Exc: [694872118-288203] DoesNotExist ;

To read Yphtach Lelkes's full profile check out TurkerView!​

 

He should probably ask for the requester's home phone number too.

 

You should never send fewer than 6 emails or more than 9 emails. 6-9 seems like the perfect range for you AND the other party.

 

That's very.... spicy of you.

 

CMU HCII SLab [AFV4B2W1BY3VB] Decision game vCR (average bonus $4) - $2.00 $1.00 bonus | PANDA

Low

Unrated

Unrated

$8.97 / hour
00:20:04 / completion time

​

Pros:

Cons:
Finished the entire tutorial and sat and waited for 13 minutes, only to be told that they had too many players and I wouldn't get the chance to get the big bonuses. :(

Catchability: Okay (HIT Last Seen: 11 minutes ago)
Qualifications: breadboard_participant_d23fd608-2d9c-405b-b395-7e9e75b8b365 DoesNotExist ;

To read CMU HCII SLab's full profile check out TurkerView!​

 

Hmm.. Might not hurt to send an email just in case..

 

good morning afternoon

 

Shelonia [A3GA7G1SKS23J7] New study(~ 8 minutes) - $0.30 | PANDA

Underpaid

Unrated

Unrated

$3.38 / hour
00:05:20 / completion time

​

Pros:
easy bubbles
bonus

Cons:
low base pay

Catchability: Impossible (HIT Last Seen: 5 hours ago)
Qualifications: Total approved HITs >= 100; Exc: [1027842843-287960] DoesNotExist ; CR Research Group #2 DoesNotExist ; HIT approval rate (%) >= 95; Location In US;

To read Shelonia's full profile check out TurkerView!​

 

Cobaltblue85 [A2QBE2N6UZ7VAY] Please provide feedback on a novel media literacy tool - $2.00 | PANDA

Generous

Unrated

Unrated

$31.17 / hour
00:03:51 / completion time

​

Pros:

Cons:
80 character minimum writing x4

Catchability: Expiring Soon (HIT Last Seen: 23 minutes ago)
Qualifications: Location In AU, CA, GB, IE, NZ, US; Gender - Female EqualTo 1; LA, 11 April, Block Past Workers DoesNotExist ; HIT approval rate (%) >= 99;

To read Cobaltblue85's full profile check out TurkerView!​

 

good afternoon

 

PickFu [AI2HRFAYYSAW7] Rank 3 options, 1 written response - $0.19 | PANDA

Unrated

Unrated

Unrated

$7.95 / hour
00:01:26 / completion time

​

Pros:

Cons:

Catchability: Great (HIT Last Seen: a second ago)
Qualifications: PickFu NDA EqualTo 1; TWL >= 10; Location EqualTo US;

To read PickFu's full profile check out TurkerView!​

 

MPR Lab [A1D3TEW14SPDKU] 15 Minute Research Study(~ 15 minutes) - $1.50 | PANDA

Good

Unrated

Unrated

$13.14 / hour
00:06:51 / completion time

​

Pros:

Cons:
some timed pages

Catchability: Great (HIT Last Seen: a second ago)
Qualifications: Total approved HITs >= 1000; HIT approval rate (%) >= 98; CR Research Group #1 >= 100; Location In US; Exc: [-1353203376-288369] DoesNotExist ;

To read MPR Lab's full profile check out TurkerView!​

 

One was enough. Xi Chen was the requester I sent email to.

And man, his reply was long and comprehensive!

Thank you very much for letting me know about this! I had no idea this exists! It does make me feel bad that people felt that way about the task.

I read through people’s feedback and have to agree that this is indeed a long task, unfortunately. I explained at the very beginning that this study has three parts and that the total time for completing this task is expected to be 1.5 to 2 hours. This expected time is based on a pilot study of this same experiment in an independent pool of participants. We will adjust this expectation as we have more data. But based on what we have collected so far, most people actually complete the task within that timeframe. But seeing feedback from workers is really helpful! Thank you for letting me know about this information!

I understand people may think this is not a well-paid job. I don’t know if you have started or are interested in doing the task, but in the first couple slides, I explain this is a research study, rather than a paid work. Being a research study by its nature, this HIT enrolls volunteer research participants, who are essential to scientific research and the science community. I try to be explicit about this at the very beginning. I sincerely appreciate participants who are willing to devote their time to this study! And as a participant in this research, people are free to stop and exit the experiment at any time. NONE of the data will be recorded or accessible to us in any way once participant decides to exit. I appreciate people's interest in the study regardless!

I also saw people are concerned about my approval rate. This interesting measure of approval rate is also a new thing I just learned about! This study is actually my very first MTurk HITs. I have posted a “fake” study to test the posting function. I also tested reject and approve functions in that test study by approving and rejecting myself. I’m still learning the functionality of MTurk and found it to be a very cool platform. So hopefully with my study finishing up, I will be able to approve most people and have a higher approval rate. Thank you for letting me know about this interesting measure of approval rate!

I do feel sorry that this task does require attention and take a lot of time. Some of these challenges are inherently part of the task. And for a research study, we compensate people’s time but this is not a paid job. I appreciate people who understand it and contribute their time and effort. But I also understand those who are disappointed. I really want to just thank you for reaching out and showing me the real feedback from participants. I appreciate their perspective! As I said, this is the first time I use MTurk, so I’m still learning. This is useful information and will definitely help me with future studies that are hopefully better designed for online testing. Please feel free to contact me if you have any further comment, suggestion, or question!

Thank you very much!



Best regards,

Xi

 

Ad Optimum [AN3I62RGPK1IK] Answer a short (~3 min) survey about a Facebook ad - $0.60 | PANDA

Generous

Unrated

Unrated

$21.82 / hour
00:01:39 / completion time

​

Pros:

Cons:

Catchability: Okay (HIT Last Seen: 59 seconds ago)
Qualifications: Facebook Account Holder EqualTo 1; Location EqualTo US;

To read Ad Optimum's full profile check out TurkerView!​

 

Robert E. Overstreet [A2YE5PZV0SHXJ8] Opinions about a Retailer - $2.50 | PANDA

Generous

Unrated

Unrated

$35.02 / hour
00:04:17 / completion time

​

Pros:

Cons:

Catchability: Very Low (HIT Last Seen: 2 hours ago)
Qualifications: JBL3-Already Completed DoesNotExist ; HIT approval rate (%) >= 95; Location EqualTo US;

To read Robert E. Overstreet's full profile check out TurkerView!​

 

TLDR

 

Maxin Wang rejected my hit, said the one page multiple choice survey should have taken 15-20 minutes and I therefore jeopardized the reliability of the data by completing it in about 5. I've been on the platform since 2017 and I've now received two rejections for this bs and they've both come in the past couple weeks.

 

TRI-MAC [AYUK73UESY66E] Decisions Survey - $1.50 | PANDA

Underpaid

Unrated

Unrated

$5.12 / hour
00:17:35 / completion time

​

Pros:
promised bonus $2.12.
Will see...

Cons:
Terrible HIT at the end, a lot of "list your 3 favorites..."
Shameless...
UNDERPAID SO FAR

Catchability: Great (HIT Last Seen: a second ago)
Qualifications: ChoicesV4_reversed DoesNotExist ; PilotCompleted DoesNotExist ; HIT approval rate (%) > 95; Total approved HITs > 5000; Location EqualTo US;

To read TRI-MAC's full profile check out TurkerView!​