12/08 - Wild Wintry Weather Wednesday

Antino Kim [A2U6YZEK262E09] Yelp and Restaurant Search Results - $3.00 | PANDA

Unrated

Unrated

Unrated

$14.94 / hour
00:12:03 / completion time

​

Pros:

Cons:

Catchability: Okay (HIT Last Seen: 9 minutes ago)
Qualifications: YelpLabel DoesNotExist ; HIT approval rate (%) > 98; Total approved HITs > 5000; Location EqualTo US;

To read Antino Kim's full profile check out TurkerView!​

 

Brand Lab [A19U7O692M1ZKO] Opinion research(~ 2 minutes) - $0.25 | PANDA

Generous

Unrated

Unrated

$23.68 / hour
00:00:38 / completion time

​

Pros:

Cons:

Catchability: Okay (HIT Last Seen: 5 minutes ago)
Qualifications: Exc: [149229197-335329] DoesNotExist ; HIT approval rate (%) >= 95; CR Research Group #1 >= 100; Location In US;

To read Brand Lab's full profile check out TurkerView!​

 

Just one of those days when nothing's quite working out.

 

RBC Behavioral Research Lab [A3PZOHOTANLBYJ] Opinion survey. 30 cents for 2 min.(~ 2 minutes) - $0.30 | PANDA

Unrated

Unrated

Unrated

$9.00 / hour
00:02:00 / completion time

​

Pros:

Cons:

Catchability: Great (HIT Last Seen: a second ago)
Qualifications: Exc: [10704674-335050] DoesNotExist ; Total approved HITs >= 500; HIT approval rate (%) >= 98; CR Research Group #1 >= 100; Location In US;

To read RBC Behavioral Research Lab's full profile check out TurkerView!​

 

Antino Kim [A2U6YZEK262E09] Yelp and Restaurant Search Results - $3.00 | PANDA

Unrated

Unrated

Unrated

$15.15 / hour
00:11:53 / completion time

​

Pros:

Cons:

Catchability: Okay (HIT Last Seen: 14 minutes ago)
Qualifications: YelpLabel DoesNotExist ; HIT approval rate (%) > 98; Total approved HITs > 5000; Location EqualTo US;

To read Antino Kim's full profile check out TurkerView!​

 

Tom Jamieson [A3A59UOMG86JKX] 6-7 minute survey about foreign policy(~ 7 minutes) - $1.30 | PANDA

Unrated

Unrated

Unrated

$29.62 / hour
00:02:38 / completion time

​

Pros:

Cons:

Catchability: Okay (HIT Last Seen: 18 minutes ago)
Qualifications: Exc: [10741561-335295] DoesNotExist ; Total approved HITs >= 50; HIT approval rate (%) >= 95; CR Research Group #1 >= 100; Location In US;

To read Tom Jamieson's full profile check out TurkerView!​

 

DecisionResearch Lab [A32XN4TF9CXR6Y] Helping people understand big numbers - $0.10 | PANDA

Unrated

Unrated

Unrated

$3.27 / hour
00:01:50 / completion time

​

Pros:

Cons:

Catchability: Great (HIT Last Seen: 34 seconds ago)
Qualifications: Total approved HITs > 100; HIT approval rate (%) > 97; perspectives_fixed_vs_ranges DoesNotExist ; Location EqualTo US;

To read DecisionResearch Lab's full profile check out TurkerView!​

 

Hengchen [AVFDQWCSJSN3H] 8 min survey for $1(~ 8 minutes) - $1.00 | PANDA

Unrated

Unrated

Unrated

$15.13 / hour
00:03:58 / completion time

​

Pros:

Cons:

Catchability: Great (HIT Last Seen: a second ago)
Qualifications: Total approved HITs >= 100; Exc: [-742269070-335321] DoesNotExist ; SurveyGroup [5015] DoesNotExist ; HIT approval rate (%) >= 90; CR Research Group #1 >= 100; Location In US;

To read Hengchen's full profile check out TurkerView!​

 

Tan Seet Koh [AVSBUMBXXBYBH] Study on how non-professional investors make stock-related judgments (REF:Dec9)(~ 15 minutes) - $1.50 | PANDA

Fair

Unrated

Unrated

$18.75 / hour
00:04:48 / completion time

​

Pros:

Cons:
2 MCs, one of which I don't remember what it asked for

Catchability: Great (HIT Last Seen: 9 seconds ago)
Qualifications: Total approved HITs >= 100; TP Panel: 377889708 N >= 100; Exc: [507009676-335110] DoesNotExist ; HIT approval rate (%) >= 97; CR Research Group #1 >= 100; Location In US;

To read Tan Seet Koh's full profile check out TurkerView!​

 

Stanford GSB Behavioral Lab [A3OSXTUM1QEXNY] Decision Study(~ 3 minutes) - $0.60 | PANDA

Generous

Unrated

Unrated

$24.83 / hour
00:01:27 / completion time

​

Pros:

Cons:

Catchability: Unlikely (HIT Last Seen: 17 minutes ago)
Qualifications: Total approved HITs >= 100; Exc: [335915-335326] DoesNotExist ; HIT approval rate (%) >= 95; CR Research Group #1 >= 100; Location In US;

To read Stanford GSB Behavioral Lab's full profile check out TurkerView!​

 

Title: Answer a survey about companies | PANDA
Requester: T.J. Weber [AH1APY81OUNVJ]
TurkerView: [ $13.70 / hour ]
Description: Give us your opinion about companies
Duration: 20 Min
Available: 4
Reward: $0.50
Qualifications:

• Total approved HITs GreaterThan 100
• HIT approval rate (%) GreaterThan 95
• Location EqualTo US

[33RX46D1RXUKX1DSQW150O7RU4O1XK]​

 

Brand Lab [A19U7O692M1ZKO] Opinion research(~ 2 minutes) - $0.25 | PANDA

Fair

Unrated

Unrated

$14.52 / hour
00:01:02 / completion time

​

Pros:

Cons:

Catchability: Okay (HIT Last Seen: 9 minutes ago)
Qualifications: Exc: [149229197-335329] DoesNotExist ; HIT approval rate (%) >= 95; CR Research Group #1 >= 100; Location In US;

To read Brand Lab's full profile check out TurkerView!​

 

1715 Labs [A3ANBIARIAUKYC] Please categorise the following screenshots of adverts for fast food and drink. - $0.12 | PANDA

Unrated

Unrated

Unrated

$9.39 / hour
00:00:46 / completion time

​

Pros:

Cons:

Catchability: Okay (HIT Last Seen: 7 minutes ago)
Qualifications: Total approved HITs >= 100; 1715 400 DoesNotExist ; HIT approval rate (%) >= 95; 1715-400-20338 DoesNotExist ;

To read 1715 Labs's full profile check out TurkerView!​

 

UM [A2FI5PAPNNIR8M] 3 min survey on your opinions. Do not take it from your phone -- you will not be paid (~ 3 minutes) - $0.40 | PANDA

Generous

Unrated

Unrated

$20.87 / hour
00:01:09 / completion time

​

Pros:

Cons:

Catchability: Okay (HIT Last Seen: 7 minutes ago)
Qualifications: Exc: [10720590-335311] DoesNotExist ; Total approved HITs >= 1000; HIT approval rate (%) >= 99; CR Research Group #1 >= 100; Location In US;

To read UM's full profile check out TurkerView!​

 

I was just sent this email regarding the Frankline Muthomi rejections:

Dear MTurk Worker:

Thank you for your email objecting to the rejection of your HIT for our budget balancing simulation. Valid responses for the research require that we are able to match the answers to the Qualtrics survey with the decisions made in the budget balancing simulation. Any other response is unusable. We have carefully reviewed the dataset as captured in the Qualtrics survey, Balancing Act simulation, and MTurk batch results, and we are very pleased that over 790 MTurk workers have been able to complete the two-part HIT successfully.

Our approval threshold was set that the MTurk submission code must match the code at the end of Qualtrics survey, and the unique code generated in the Qualtrics survey must match the unique code submitted in the budget simulation. Some workers were rejected because it was impossible to connect their survey responses to a completed budget simulation. Entries were rejected when one or more of the codes were either erroneous or missing from the table provided by MTurk that shows worker ID, the simulation code entered, and the end code entered.

We carefully review each submission to insure that the worker has completed the simulation and properly entered the provided code, and then properly completed the survey and entered the proper code.

Some workers have complained that we unfairly rejected their work. Sadly, over 60 MTurk workers skipped the simulation entirely. Others have sent screen shots of the budget simulation, as if this is evidence of complete work. We are unable to substantiate screen shots because they are not tied to a simulation submission. If the person does not push SUBMIT, the answers are not recorded in the simulation database. Anyone can enter a code in the simulation box after the project has been closed and take a screen shot, but if the code is not one issued by the Qualtrics program and recorded by MTurk, it is not evidence of an authentic entry. We can see exactly when someone pushes submit on any one of the 8 different treatments in the simulation data set.

Some workers have charged that our project was faulty. We have thoroughly analyzed the results provided by MTurk to identify a fault. Each of the 8 treatment groups has about the same number of responses across over 790 correct responses, so there was no error with the random assignment of workers to different treatments. The distribution of correct and incorrect submissions does not vary over time, based on MTurk data. Simulations that were completed with a submission were recorded in the data base from Qualtrics and if the code at the end of the survey were correct, we paid the worker appropriately.

When a few workers complained about rejections before the time for review deadline, I directed Mr. Muthomi to give them an opportunity to complete the simulation and survey using their MTurk worker ID in place of the codes. Several people successfully did so and their surveys were acceptable.

The MTurk data suggest that the bulk of the errors are for incorrect end code entries. For example, some workers indicated they clicked the back button to reread directions, and then when they clicked forward, they received a different code. They entered the new code but Qualtrics may have recorded the previous code. Qualtrics does not provide any way for us to test that possibility or correct that error.

We have a keen interest in getting the minimum number of completed entries to successfully proceed with our research. We understand that MTurk workers do not want a rejection on their record.

You have politely requested a chance to remediate the MTurk rejection and you shared your MTurk worker ID for our HIT. Therefore, we are offering you the following remediation to achieve our mutual goals.

They go on to list the process to complete the study again and submit with your worker ID used in the email.

If you agree to this remediation, please use this link to begin the remediation. We look forward to notifying you of a successful completion.

If you reject this remediation invitation, please reply to that effect and we will notify the NIU IRB office accordingly.

Thank you for considering this opportunity to remediate this research project exercise and achieve our mutual goals.


Peace,


Kurt Thurmaier

Distinguished Engagement Professor and Chair

Department of Public Administration

Northern Illinois University


Yeah, they need to meet their quota so they've changed their tone. I honestly don't know how I feel about taking them up on the offer. I would like to be rid of those rejections BUT I also want to stick it them for their treatment of this whole thing. Also, I find it hard to trust them.
Edit: I know everyone probably got the same email but I'm posting this here just in case some people never received a reply from them since they seem to be bad at that.

 

UPenn Researcher [A2M70XENI0CWIR] Behavioral Survey(~ 1 minutes) - $0.25 | PANDA

Good

Unrated

Unrated

$18.00 / hour
00:00:50 / completion time

​

Pros:
Quick.

Hypothetical, followed by a list of choices. Short demographics at the end.

Cons:

Catchability: Okay (HIT Last Seen: 3 minutes ago)
Qualifications: Total approved HITs >= 100; Exc: [335818-335285] DoesNotExist ; cbabc011 DoesNotExist ; HIT approval rate (%) >= 95; Location In US;

To read UPenn Researcher's full profile check out TurkerView!​

 

sophie chen [A13VA259NOQ0WV] A survey about shopping and seeking medical advice(~ 8 minutes) - $0.75 | PANDA

Unrated

Unrated

Unrated

$6.98 / hour
00:06:27 / completion time

​

Pros:

Cons:

Catchability: Great (HIT Last Seen: a second ago)
Qualifications: Exc: [-1856228255-335333] DoesNotExist ; HIT approval rate (%) >= 95; CR Research Group #1 >= 100; Location In US;

To read sophie chen's full profile check out TurkerView!​

 

Brand Lab [A19U7O692M1ZKO] Opinion research(~ 2 minutes) - $0.25 | PANDA

Unrated

Unrated

Unrated

$10.98 / hour
00:01:22 / completion time

​

Pros:

Cons:

Catchability: Great (HIT Last Seen: one minute ago)
Qualifications: Exc: [149229197-335329] DoesNotExist ; HIT approval rate (%) >= 95; CR Research Group #1 >= 100; Location In US;

To read Brand Lab's full profile check out TurkerView!​