05/06 - Turkerhub Masters Sunday

Rocknrolla · May 6, 2018

Buntastic said: ↑

Nope, correct one.
Click to expand...

Oh, I thought he was talking about the right side one - My Bad - but he's still on the wrong tangent and i will leave it at that

EssArrBee · May 6, 2018

A6_Foul_Out · May 6, 2018

Mothra said: ↑

The previous version, which indicated the angle wasn't parallel, rather than acute, was even more open to interpretation.

But:

What part of the book case do you consider to be jutting? The part running roughly perpendicular to the wall, upon which the laptop is resting? Do you mean the taller section positioned closest to the wall?

To which angle are you referring? As the object is oriented in a euclidean space the sum of any two angles compared to the plane of the wall, which we can consider to be a straight line, must be 180. Unless both angles presented in the image are exactly equal to 90, then one of them must, by definition be acute. Since the sentence mentions an angle, we must assume that an angle exists, otherwise this clearly wouldn't have been selected as an example sentence because there wouldn't be any good reason to insert an ambiguous question designed to cause workers to fail your test.

Since there appears to be some small amount of space between the tallest portion of the book case and the wall, which permits the casting of the noticeable shadow, there must be some angle there, however acute. If we extend this to consider the longer lower portion, based on the angle of the photo, it's impossible to determine if the book case is 100% perfectly flush against the wall.

Again, this necessarily indicates that there is the possibility of a non 90 degree angle, which implies one of the angles is acute. Presumably, when this image is compared to the other image pairs, there wouldn't be another grouping with the same two colors of book-cases, with the same color of laptop, permitting this description, even if somewhat incorrect, accurate enough to determine the truth value of the sentence.

Because the sentence isn't obviously and grossly incorrect, which would seem to be the reasonable standard for a training/qualification test, it seems reasonable to treat it as accurate enough to generate truth value.

TLDR: Perhaps it would be best if you included several examples in a training document, with yes/no ratings, and explanations as to why you have selected the chosen rating. If an image is ambiguous, as this image appears to be, don't penalize workers for making a judgement call.

Or, if a single image in your test seems to be tripping up a large number of respondents, send an email to your workers indicating why the previous response was incorrect, to help them learn and provide you with better quality work.
Click to expand...

but the main problems with the test were the animal image (fixed in iteration 3)

and the soda image (fixed in the latest iteration)

all of the other images were fair.

Sunlite · May 6, 2018

In the meantime, I am not getting any work done today because I have had an aching shoulder muscle for hours and I can't concentrate. Think I'm going to just go take a hot shower and clean the house tonight.

Rocknrolla · May 6, 2018

LLL said: ↑

He's not rude just Scottish. Offer him a pint and he'll be your best friend!
Click to expand...

OK, My question for today. Do you do much AHK?

LLL · May 6, 2018

I didn't do a single one of the others but guess who's not sleepin' tonight. Just got up from my nap and Aristo's mamma's lil' Grinch!

Good luck to whoever else is doing them.

Randomacts · May 6, 2018

Mothra said: ↑

The previous version, which indicated the angle wasn't parallel, rather than acute, was even more open to interpretation.

But:

What part of the book case do you consider to be jutting? The part running roughly perpendicular to the wall, upon which the laptop is resting? Do you mean the taller section positioned closest to the wall?

To which angle are you referring? As the object is oriented in a euclidean space the sum of any two angles compared to the plane of the wall, which we can consider to be a straight line, must be 180. Unless both angles presented in the image are exactly equal to 90, then one of them must, by definition be acute. Since the sentence mentions an angle, we must assume that an angle exists, otherwise this clearly wouldn't have been selected as an example sentence because there wouldn't be any good reason to insert an ambiguous question designed to cause workers to fail your test.

Since there appears to be some small amount of space between the tallest portion of the book case and the wall, which permits the casting of the noticeable shadow, there must be some angle there, however acute. If we extend this to consider the longer lower portion, based on the angle of the photo, it's impossible to determine if the book case is 100% perfectly flush against the wall.

Again, this necessarily indicates that there is the possibility of a non 90 degree angle, which implies one of the angles is acute. Presumably, when this image is compared to the other image pairs, there wouldn't be another grouping with the same two colors of book-cases, with the same color of laptop, permitting this description, even if somewhat incorrect, accurate enough to determine the truth value of the sentence.

Because the sentence isn't obviously and grossly incorrect, which would seem to be the reasonable standard for a training/qualification test, it seems reasonable to treat it as accurate enough to generate truth value.

TLDR: Perhaps it would be best if you included several examples in a training document, with yes/no ratings, and explanations as to why you have selected the chosen rating. If an image is ambiguous, as this image appears to be, don't penalize workers for making a judgement call.

Or, if a single image in your test seems to be tripping up a large number of respondents, send an email to your workers indicating why the previous response was incorrect, to help them learn and provide you with better quality work.
Click to expand...

Could you try not being a dick? That is my job.

LLL · May 6, 2018

Rocknrolla said: ↑

OK, My question for today. Do you do much AHK?
Click to expand...

I personally don't but I know a lot of others who do. It can be a great tool to have. The expert here on that as far as I know is @jim718181

Rocknrolla · May 6, 2018

Randomacts said: ↑

Could you try not being a dick? That is my job.
Click to expand...

The first part is admitting you have a problem - lol

Randomacts · May 6, 2018

Title: Describing Events | PANDA
Requester: tedlab [A3CV1MVF006J21]
TurkerView: [ $12.80 / hour ]
Description: Record descriptions of pictures. **Requires Google Chrome, microphone** **Native English speakers ONLY**
Duration: 00:45:00
Available: 1
Reward: $4.00
Qualifications:

HIT approval rate (%) GreaterThanOrEqualTo 95

Location EqualTo US

[3MU03ZNWUDPGTJ6J7D5SPL393LP5FF]

jim718181 · May 6, 2018

LLL said: ↑

I personally don't but I know a lot of others who do. It can be a great tool to have. The expert here on that as far as I know is @jim718181
Click to expand...

I'm no expert by any means. I will try to answer questions if I can to help. I know some of it but not all. I used to use it a lot more when I worked out of multiple tabs but since I set up a new work flow I haven't turned my script on. That was a few months ago.

Rocknrolla · May 6, 2018

LLL said: ↑

I personally don't but I know a lot of others who do. It can be a great tool to have. The expert here on that as far as I know is @jim718181
Click to expand...

I am all about it right now and there are some things you just can't solve without a tip

GiMiK · May 6, 2018

Where are the Sunday Z's?

NotASingleClare · May 6, 2018

GiMiK said: ↑

Where are the Sunday Z's?
Click to expand...

Rocknrolla · May 6, 2018

jim718181 said: ↑

I'm no expert by any means. I will try to answer questions if I can to help. I know some of it but not all. I used to use it a lot more when I worked out of multiple tabs but since I set up a new work flow I haven't turned my script on. That was a few months ago.
Click to expand...

Good to know I have a simple solution I am working on but i am at an impasse. I will message you the deet's some time if that's ok

rater9 · May 6, 2018

Title: Psychological Survey of Views of Homeless Persons [ $ | $ ] PANDA
Requester: Nyssa Snow [A1TJJQ8N4VHZQN]
TurkerView: [ $6.95 / hour ]
Description: Psychological survey asking your views of homeless persons
Duration: 03:00:00
Available: 19
Reward: $1.00
Qualifications:

Masters Exists [ Request | How to Use ]

HIT approval rate (%) GreaterThan 95,

Location EqualTo US,

[3K27O5FVBZ6JR6Z63YGDX1QGDYB5WY]

jim718181 · May 6, 2018

Rocknrolla said: ↑

Good to know I have a simple solution I am working on but i am at an impasse. I will message you the deet's some time if that's ok
Click to expand...

I'll take a look, but no promises. Watch this when you get a chance.

Mothra · May 6, 2018

Randomacts said: ↑

Could you try not being a dick?
Click to expand...

Girl Polar Bear · May 6, 2018

Elizabeth Friedman [A4W6F7C8EKV44] Tell us your shopping opinions! - $0.35 | PANDA

[3HLRSARVHFHC0331JBCU2Z9WQ4M55Q]

Unrated

Unrated

Unrated
$9.55 / hour
00:02:12 / completion time

Pros:

Cons:
not the usual Elizabeth Friedman

To read Elizabeth Friedman's full profile check out TurkerView!

hvnnvr · May 6, 2018

@Stephanie Zhou

I am finding it interesting that you are providing me feedback on the qualification HITs I have completed (however generic via the requester messaging), Though it seems you have yet to approve or reject any of the actual HITs:

05/06 - Turkerhub Masters Sunday

Do you accept your new king?

Yes

No

Rocknrolla Survey Slinger

EssArrBee Survey Slinger

A6_Foul_Out Organic Meme Panda TurkerView Masters

Sunlite Survey Slinger

Rocknrolla Survey Slinger

LLL Survey Slinger

Randomacts Survey Slinger

LLL Survey Slinger

Rocknrolla Survey Slinger

Randomacts Survey Slinger

jim718181 Survey Slinger

Rocknrolla Survey Slinger

GiMiK Well-Known Turker

NotASingleClare Well-Known Turker

Rocknrolla Survey Slinger

rater9 Survey Slinger

jim718181 Survey Slinger

Mothra Survey Slinger

Girl Polar Bear Queen of the North

hvnnvr Survey Slinger

About TurkerView Forum

05/06 - Turkerhub Masters Sunday

Do you accept your new king?

Yes

No

Rocknrolla Survey Slinger

EssArrBee Survey Slinger

A6_Foul_Out Organic Meme Panda TurkerView Masters

Sunlite Survey Slinger

Rocknrolla Survey Slinger

LLL Survey Slinger

Randomacts Survey Slinger

LLL Survey Slinger

Rocknrolla Survey Slinger

Randomacts Survey Slinger

jim718181 Survey Slinger

Rocknrolla Survey Slinger

GiMiK Well-Known Turker

NotASingleClare Well-Known Turker

Rocknrolla Survey Slinger

rater9 Survey Slinger

jim718181 Survey Slinger

Mothra Survey Slinger

Girl Polar Bear Queen of the North

hvnnvr Survey Slinger

Useful Searches