05/06 - Turkerhub Masters Sunday

Elizabeth Friedman [A4W6F7C8EKV44] Tell us your shopping opinions! - $0.35 | PANDA

[3HLRSARVHFHC0331JBCU2Z9WQ4M55Q]​

Fair

Unrated

Unrated

$7.46 / hour
00:02:49 / completion time

​

Pros:

Cons:

To read Elizabeth Friedman's full profile check out TurkerView!​

 

Title: Write a simple multiple choice question about science | AcceptA Requester: Peter Clark [A3D5Y7P08H10BD] Contact TV: No Reviews TO: [Pay: 3.90] [Fast: 4.80] [Comm: 5.00] [Fair: 5.00] [Reviews: 12] [ToS: 0] TO2: [Hrly: ---] [Pen: ---] [Res: ---] [Rec: ---] [Rej: 0] [ToS: 0] [Brk: 0] Reward: $1.30 Duration: 8 hours Available: 1157 Description: Write a multiple-choice science question to help us test whether a computer can combine two facts together! Requirements: Masters Exists; Total approved HITs GreaterThanOrEqualTo 1000; HIT approval rate (%) GreaterThanOrEqualTo 95; Location EqualTo US

he bumped that pay a nickel and got rid of the extra work

 

I thought he changed his requester name to Aristo Datasets?

 

he did and added 50% more work to those hits.

 

You've received a bonus from ofir yakobi for work related to 3R5LWXWHR08UXX3IKVYZZ2Z1TM2GX0.
The value of your bonus is: $1.62 USD

The Requester included this note:
Thank you

 

Title: Social Media Preferences in Plastic Surgery [ $ | $ ] PANDA
Requester: Cindy Wu [A1BA26GCWFMBK8]
TurkerView: [ $13.51 / hour ]
Description: Answer a brief survey about social media preferences
Duration: 01:00:00
Available: 1
Reward: $1.25
Qualifications:

• Masters Exists [ Request | How to Use ]
• Location EqualTo US,

[3MX1CQXD049K5JZLNEG2AQC3EMLDWJ]​

 

I'm still sitting here thinking of all the people I want to send sugar-free Gummi Bears to

 

The previous version, which indicated the angle wasn't parallel, rather than acute, was even more open to interpretation.

But:

What part of the book case do you consider to be jutting? The part running roughly perpendicular to the wall, upon which the laptop is resting? Do you mean the taller section positioned closest to the wall?

To which angle are you referring? As the object is oriented in a euclidean space the sum of any two angles compared to the plane of the wall, which we can consider to be a straight line, must be 180. Unless both angles presented in the image are exactly equal to 90, then one of them must, by definition be acute. Since the sentence mentions an angle, we must assume that an angle exists, otherwise this clearly wouldn't have been selected as an example sentence because there wouldn't be any good reason to insert an ambiguous question designed to cause workers to fail your test.

Since there appears to be some small amount of space between the tallest portion of the book case and the wall, which permits the casting of the noticeable shadow, there must be some angle there, however acute. If we extend this to consider the longer lower portion, based on the angle of the photo, it's impossible to determine if the book case is 100% perfectly flush against the wall.

Again, this necessarily indicates that there is the possibility of a non 90 degree angle, which implies one of the angles is acute. Presumably, when this image is compared to the other image pairs, there wouldn't be another grouping with the same two colors of book-cases, with the same color of laptop, permitting this description, even if somewhat incorrect, accurate enough to determine the truth value of the sentence.

Because the sentence isn't obviously and grossly incorrect, which would seem to be the reasonable standard for a training/qualification test, it seems reasonable to treat it as accurate enough to generate truth value.

TLDR: Perhaps it would be best if you included several examples in a training document, with yes/no ratings, and explanations as to why you have selected the chosen rating. If an image is ambiguous, as this image appears to be, don't penalize workers for making a judgement call.

Or, if a single image in your test seems to be tripping up a large number of respondents, send an email to your workers indicating why the previous response was incorrect, to help them learn and provide you with better quality work.

 

Title: 15 minutes survey for 1 $: read sentences and answer questions [ $ | $ ] PANDA
Requester: carla contemori [A1TC4X8NT3Q2YW]
TurkerView: [ $3.53 / hour ]
Description: Read sentences in English and answer questions
Duration: 01:00:00
Available: 1
Reward: $1.00
Qualifications:

• Masters Exists [ Request | How to Use ]
• Location EqualTo US,

[35APIBUPNHFDNWIHH38MYZDQSDP3FF]​

 

She is talking about the other bookcase

 

Title: Respond to a social science survey [ $ | $ ] PANDA
Requester: J Reich [A2O1DG4NUD3EOR]
TurkerView: [ $ / hour ]
Description: Respond to questions about your perceptions and attitudes towards those with autism
Duration: 00:15:00
Available: 1
Reward: $1.00
Qualifications:

• TookStigmaSurvey DoesNotExist [ Request | How to Use ]
• Masters Exists [ Request | How to Use ]
• Total approved HITs GreaterThanOrEqualTo 1000,
• HIT approval rate (%) GreaterThanOrEqualTo 99,
• Location EqualTo US,

[39VHG1VU5PT87SPMH9MO7I2J8B67R5]​

 

Peter Clark
2:14 PM (2 hours ago)



to me






Thanks, that’s really helpful, LLL – yes, I think I made a mistake including the validation questions with the authoring questions. My goal was to help people think about what a good question would look like by seeing other good/bad questions that other Turkers had written, but it seems like the constant context switch from validation to authoring and back is a pain for the Turkers. Next time I’ll follow your advice and split it back into two tasks again.



I really appreciate your feedback, thank you so much – that’s really helpful!



Best wishes, Pete

 

did not read

 

Your welcome

 

fix it as f.ck... He is rude.

 

Greetings from Amazon Mechanical Turk,

The following is a summary of activity for your Mechanical Turk account for the week ending May 05, 2018.

Your HIT activity for this week:
- Number of HITs submitted: 1,320

Approvals and payments that occurred this week:
- Number of HITs approved: 1,352
- Number of HITs rejected: 0
- Bonus reward earned: $5.35
- HIT reward earned: $256.08
- Total Amount earned this week: $261.43

 

This Hazing HIT

 

Nope, correct one.

 

He's not rude just Scottish. Offer him a pint and he'll be your best friend!

 

This^^^
Plus, show a pic for your rules and why this fits or doesn't. If the object is to get people to qualify by understanding what you want them to do or how you want them to look at something, show them. Isn't that what an example is for?
I went to the PDF which was no help. Where there are 2 pics of the same animal- is that considered 2 animals (1 in each pic) or 1 animal (because it is obviously the same)? Why use the same animal- use a pic of 2 different animals.
This has taken up too much time and I think maybe you should go with the people who understood what you were trying to say.