05/23 - Thespian Thursday!

Yeah I just did one of those lol. "I saw it said it took 30 minutes and I stopped reading there" and it took like 5?

 

Jonathan B. Evans [A3UTCHNKSSBJ8X] Listen to a voice recording - $0.60 | PANDA

Generous

Unrated

Unrated

$18.78 / hour
00:01:55 / completion time

​

Pros:

Cons:

Qualifications: A.Voice DoesNotExist ; Total approved HITs >= 1000; HIT approval rate (%) >= 97; Location EqualTo US;

To read Jonathan B. Evans's full profile check out TurkerView!​

 

Morning.

 

So.. tl:dr first:

IMO, minor bad tradeoff for huge reliability improvements. When looking at the actual #s far more people fuck up comm scores than there are requesters who rely on outside MTurk contact system ratings.

Word vomit b/c I've spent hours thinking about this / looking over the data & there are a ton of scenarios:

So in all seriousness, those folks are great, and if you want to rate them on comm & do them a solid all you have to do is click the contact req button next to their name on the tvjs dash and it will unlock reviewing communication & you can do so (you don't actually have to send a message, it's just minimum barrier to entry here to prevent the most egregious dumb clicks). The changes are aimed at the folks who just think they have to click every button they see no matter what.. the very few instances it prevents a rating where we might want it the barrier to entry is still low enough you can over come it. Still far fewer instances than the annoying "stop rating 500/hr HITs vs people who review compensation hits w/o clearing the time / tvjs isn't perfect & can't track page refreshes/logouts/etc"

WITH THAT SAID.. Honestly sitting on the forum is nice, but it also isn't indicative of what the average worker who may stumble on TV can expect because the # of people sitting on the daily thread all day is much lower than the actual MTurk worker population. So IMO it's not too terrible to make it a little more difficult to CLICKY that button because it doesn't prevent a user from simply typing out that detail into the review (which is good, because the typed info will percolate to the front of their requester profile where people inquiring about the requester are more likely to see the information and then know how to act on it).

C-SATs is another excellent example.. they don't respond to their MTurk messages AT ALL. They do reply to their e-mail pretty consistently. That's ass in a bucket for like 90% of workers, but thankfully it's also well document all over TV, TO, and forums so folks know or at least can find the information & act on it. Now if you can't CLICKY comm maybe you drop that detail on a newer req in writing as well, and thank the good heavens above most people who have some sense (aka anyone who made it this far into my word vomit, love you qtpie whoever you are) will take the 1/2 a second to click the contact button and also drop the comm score in there so it's easier to retrieve on TV w/o also being muddled by a ton of folks who just can't help themselves but CLICKY the stupid button w/o actually having contacted the requester.

With allllll that said, those requesters should also be claiming their TV profile which is gonna be a much brighter mark of "yo this dude/dudette/w/e is legit & you can get in touch w/ them here" than the comm score anyway and there are improvements to that system coming as well

...

 

CT right now

 

jk, i genuinely appreciate all the hard work and the thoughtfulness that goes into it. you're an ok person i guess.

 

That is more than you have ever thought about something before. Hopefully it was worth it.

 

Greetings

 

Title: Short Work Experience Survey (Part 1) | PANDA
Requester: RAD lab [A3RYG0XM2ML62T]
TurkerView: [ $ / hour ]
Description: Answer a 5-minute survey about your work experiences.
Duration: 30 Min
Available: 1
Reward: $1.50
Qualifications:

• Total approved HITs GreaterThanOrEqualTo 1000,
• HIT approval rate (%) GreaterThanOrEqualTo 95,
• Location EqualTo US,

[38GRQLZZRSG1NYLTI8TU0J0R1VKC0O]​

 

New Requester Profile!

RAD lab [A3RYG0XM2ML62T] Short Work Experience Survey (Part 1) - $1.50 | PANDA

Generous

Unrated

Unrated

$131.71 / hour
00:00:41 / completion time

​

Pros:

Cons:

Qualifications: Total approved HITs >= 1000; HIT approval rate (%) >= 95; Location EqualTo US;

To read RAD lab's full profile check out TurkerView!​

 

Awwww, back attcha big guy

 

I mean.. @dan has a point.. it's dumbing down the system to deal w/ the lower end of the spectrum of reviewers who don't read before CLICKY (which.. it happens w/e), which sucks for the folks who know what they're doing, but the system doesn't have enough support to effectively deal w/ those folks (new people in our ecosystem are a never ending avalanche b/c its mturk) so technical shortcuts are required until someone gives RA thanos gloves

I've been known to use the phrase "that's a feature, not a bug" ... occasionally? let's see if I get away w/ the word occasionally