08/25 - Tardy on Tuesday

Discussion in 'Daily mTurk HITs Threads' started by GreenMachine842, Aug 25, 2020.

Thread Status:
Not open for further replies.
  1. Penelope

    Penelope Survey Slinger TurkerView Masters

    Messages:
    11,531
    Gender:
    Female
    Ratings:
    +5,684
    April Huang [A354ATXR0R5X6Z] Consumer Decision Survey - $0.50 | PANDA


    Low

    Unrated

    Unrated
    $8.18 / hour
    00:03:40 / completion time
    Pros:
    Cons:
    44-second video. Time slideshow. Writing prompt.


    Catchability: Okay (HIT Last Seen: 2 minutes ago)
    Qualifications: HIT approval rate (%) >= 95; Location EqualTo US;

    To read April Huang's full profile check out TurkerView!
     
    • Good Review! Good Review! x 1
  2. Turkmom86

    Turkmom86 Survey Slinger

    Messages:
    2,643
    Ratings:
    +6,652
    Snip20200825_11.png

    there are still some good ones up....
     
  3. Moridin

    Moridin Well-Known Turker

    Messages:
    5,607
    Gender:
    Male
    Ratings:
    +1,904
    Tim Salomons [A1F1WJN9AVLW9X] Answer a survey about pain - $1.60 | PANDA


    Generous

    Unrated

    Unrated
    $26.42 / hour
    00:03:38 / completion time
    Pros:
    Cons:


    Catchability: Okay (HIT Last Seen: 14 minutes ago)
    Qualifications: Location In AU, AX, CA, GB, IE, NZ, US; HIT approval rate (%) > 90; Total approved HITs > 50;

    To read Tim Salomons's full profile check out TurkerView!
     
    • Good Review! Good Review! x 1
  4. ChrisTurk

    ChrisTurk Administrator

    Messages:
    56,724
    Ratings:
    +163,219
    Don't really understand what you expect here.. not only is this why right next to the requester overall averages on AMT's interface there is the rating for each individual HIT (which directly solves the problem of a HIT being good at 50 cents but not good at 10cents) but also a giant chart on the reqs page showing the historical rating by week so you can see if it plummets over time.

    I need you to go edit out your ranting at other people on the reviews so I don't have to remove them. Places to throw feedback at the system:

    This forum
    My inbox
    My DMs
    Shouting out a window and hoping I hear you

    But as-is you're literally making it worse by throwing more useless stuff for other people to have to parse through.
     
    • Love Love x 7
    • LOL LOL x 2
  5. Random Turker

    Random Turker Survey Slinger TurkerView Masters

    Messages:
    25,780
    Gender:
    Male
    Ratings:
    +25,045
    Tim Salomons [A1F1WJN9AVLW9X] Answer a survey about pain - $1.60 | PANDA


    Generous

    Unrated

    Unrated
    $24.00 / hour
    00:04:00 / completion time
    Pros:
    Cons:


    Catchability: Okay (HIT Last Seen: 19 minutes ago)
    Qualifications: Location In AU, AX, CA, GB, IE, NZ, US; HIT approval rate (%) > 90; Total approved HITs > 50;

    To read Tim Salomons's full profile check out TurkerView!
     
    • Good Review! Good Review! x 1
  6. ChrisTurk

    ChrisTurk Administrator

    Messages:
    56,724
    Ratings:
    +163,219
    Also to top it off on this requester it's behaving exactly how you're asking.. of all of Az's reviews only one is actually counting towards the requester's hourly aggregate, which is why the majority of them are displaying as $null/hr

    https://turkerview.com/requesters/A3IQEF9LUHNBJB

    Sunny has 2 counting though :emoji_yum:
     
    • Love Love x 2
    • LOL LOL x 1
    • Today I Learned Today I Learned x 1
  7. Pronewbi3

    Pronewbi3 Survey Slinger TurkerView Masters

    Messages:
    15,651
    Gender:
    Male
    Ratings:
    +27,839
    inb4 we have a TV addon where we can review users.


    pls give me 5 stars
     
    • LOL LOL x 8
    • 5/5 Pay 5/5 Pay x 1
  8. LowCalCalzone

    LowCalCalzone Active Turker

    Messages:
    184
    Gender:
    Female
    Ratings:
    +452
    Hey all. Hope everyone is having a good week thus far :wave:

    Just wanted to reach out as I had a few people DM me about the rejections I received a couple of weeks ago from Dimitriy Nikolskiy (The $1 collect data batch). All my initial hits were rejected and after roughly a week I did hear back from Dimitriy. He stated that they were rejected based on a computer algorithm that flagged my hits because I submitted a few with "No Answer Found" (The names given were ambiguous/no email).

    He has since looked through the tasks and reversed all my rejections. He also stated that he was really pleased with the first batch of hits and hopes to post more in the future.:af:
     
    • Like Like x 6
    • Love Love x 4
    • 5/5 Pay 5/5 Pay x 1
  9. AfterDarkMark

    AfterDarkMark Turker

    Messages:
    356
    Gender:
    Male
    Ratings:
    +137
    How is my review throwing off the system/ making it worse, etc? Yes, there is a rating for each individual hit, but once the pay drops, if no one is willing to do that hit/ review it, then a new number doesn't show up. So, the hourly stays the same.

    And I guess I don't find the per hit info as useful as you must assume it is because the hit name might stay the same, but the pay can change drastically (this applies to surveys as much as anything else).

    I'll stop making those venting kinds of posts, but I'm not sure how they are negatively affecting the system though. Those were honest reviews.

    And it's not showing null/ $$ for some of the hits you are talking about. I'm showing super high hourlys for those tasks still.
     
    • Like Like x 1
    • Love Love x 1
  10. SunlitSunflower

    SunlitSunflower baby head

    Messages:
    22,494
    Ratings:
    +36,431
    I love when CT gets a bit spicy.
     
    • Like Like x 2
    • LOL LOL x 2
    • WOW WOW x 1
  11. Random Turker

    Random Turker Survey Slinger TurkerView Masters

    Messages:
    25,780
    Gender:
    Male
    Ratings:
    +25,045
    New Requester Profile!

    Isabelle Clough [AS1USPMLFTJ47] Participants will be asked to pretend they are a juror making decisions about a juvenile defendant. - $1.25 | PANDA


    Fair

    Unrated

    Unrated
    $10.44 / hour
    00:07:11 / completion time
    Pros:
    Cons:


    Catchability: Great (HIT Last Seen: 41 seconds ago)
    Qualifications: Location EqualTo US;

    To read Isabelle Clough's full profile check out TurkerView!
     
  12. Random Turker

    Random Turker Survey Slinger TurkerView Masters

    Messages:
    25,780
    Gender:
    Male
    Ratings:
    +25,045
    [​IMG]
     
    • LOL LOL x 9
  13. Pronewbi3

    Pronewbi3 Survey Slinger TurkerView Masters

    Messages:
    15,651
    Gender:
    Male
    Ratings:
    +27,839
    [​IMG]
     
    • LOL LOL x 4
  14. Tiger33

    Tiger33 Survey Slinger

    Messages:
    4,025
    Gender:
    Male
    Ratings:
    +8,695
    direct quote
     
    • LOL LOL x 6
  15. lapetitebaker

    lapetitebaker Survey Slinger TurkerView Masters

    Messages:
    21,182
    Gender:
    Female
    Ratings:
    +7,897
    Positly [A20SRJ4UG9W0H0] Participate in a study about your jobs (~5.5 mins) - $0.66 | PANDA


    Generous

    Unrated

    Unrated
    $24.24 / hour
    00:01:38 / completion time
    Pros:
    Cons:
    • 20 minute timer


    Catchability: Great (HIT Last Seen: 23 seconds ago)
    Qualifications: 80412233201bcb15666b2ac446860a99b1c3bf42 DoesNotExist ; 73dd54aa72fabbe247128245f9893033c03c2f13 DoesNotExist ; Total approved HITs >= 500; HIT approval rate (%) >= 96; 34ee50c9eacb4e076cedf82013242ddbbbff8013 NotIn 0; Location EqualTo US; ab5c70a2a750f5b115e550db4b754b92dfd32213 DoesNotExist ;

    To read Positly's full profile check out TurkerView!
     
  16. Moridin

    Moridin Well-Known Turker

    Messages:
    5,607
    Gender:
    Male
    Ratings:
    +1,904
    Isabelle Clough [AS1USPMLFTJ47] Participants will be asked to pretend they are a juror making decisions about a juvenile defendant. - $1.25 | PANDA


    Generous

    Unrated

    Unrated
    $15.41 / hour
    00:04:52 / completion time
    Pros:
    relatively short for a jury hit, only a few paragraphs of reading.
    Cons:
    lot of post-scenario questions


    Catchability: Okay (HIT Last Seen: 6 minutes ago)
    Qualifications: Location EqualTo US;

    To read Isabelle Clough's full profile check out TurkerView!
     
  17. ChrisTurk

    ChrisTurk Administrator

    Messages:
    56,724
    Ratings:
    +163,219
    I've tried for a long time to add something akin to this. Not "reviewing other reviewers" (that's just pure drama llama territory lol) but giving people the ability to either/or a reviewer/group include/blocklist so aggregates would be built with data individual users prefer. But the processing required for all that is just way higher than TV can really handle. The only honest but ugly decent solution is just removing the opt-in design and collecting data automatically and sorting it in ways that make sense. It's much easier to sort a boat load of information into predefined bands (see careful=>proficient groupings) than it is a small amount of data into undefined sets - ESPECIALLY when user preferences come into play :emoji_joy:

    Obvious caveat being I have no data science degree and am just hacking away trying to make things work so my take could be objectively stupid lol. Counter-counter point is I still see ads on Amazon for crap I've looked at only because of customer interests over a year ago so even big $$$ hasn't perfectly solved the individual targeting stuff perfectly :p
    I only read the one I quoted that was just directly @'ing someone else lol, but if anyone other than Az loads the page they've gotta read/parse all that info which had nothing to do with the actual HIT so it's kinda just noise IMO. Plus the gripe isn't really w/ any one individual user but the overall system, which makes more sense to just yell @ me about :p
    FWIW though if the pay changes the per-HIT rating wont pull from the other HITs. The constraint is requester_id, title, base_pay. So as soon as the requester drops the pay on a HIT, even if it's the same work or even groupid it'll break the connection and not display those reviews for that particular pay band.
    Oh yea it's not perfect at identifying a multitude of reviews because AMT makes it almost impossible to correctly identify certain "groups" of HITs so I've got to use some crappy & a bit convoluted guess work to have the system toss duplicates/junky stuff but at least on that one profile it was doing a pretty decent job at it. The base aggregate is still high because the 3 reviews were all high hourlies (although yours dropped it a solid clip), but it wasn't just artificially inflated by the multiple reviews from the same user which is the goal
     
    • Love Love x 3
    • Like Like x 1
  18. Penelope

    Penelope Survey Slinger TurkerView Masters

    Messages:
    11,531
    Gender:
    Female
    Ratings:
    +5,684
    Isabelle Clough [AS1USPMLFTJ47] Participants will be asked to pretend they are a juror making decisions about a juvenile defendant. - $1.25 | PANDA


    Fair

    Unrated

    Unrated
    $11.94 / hour
    00:06:17 / completion time
    Pros:
    Cons:
    Bubbles. Sliders.


    Catchability: Great (HIT Last Seen: a second ago)
    Qualifications: Location EqualTo US;

    To read Isabelle Clough's full profile check out TurkerView!
     
  19. Moridin

    Moridin Well-Known Turker

    Messages:
    5,607
    Gender:
    Male
    Ratings:
    +1,904
    Positly [A20SRJ4UG9W0H0] Participate in a study about your jobs (~5.5 mins) - $0.66 | PANDA


    Generous

    Unrated

    Unrated
    $23.29 / hour
    00:01:42 / completion time
    Pros:
    Cons:


    Catchability: Great (HIT Last Seen: 20 seconds ago)
    Qualifications: 80412233201bcb15666b2ac446860a99b1c3bf42 DoesNotExist ; 73dd54aa72fabbe247128245f9893033c03c2f13 DoesNotExist ; Total approved HITs >= 500; HIT approval rate (%) >= 96; 34ee50c9eacb4e076cedf82013242ddbbbff8013 NotIn 0; Location EqualTo US; ab5c70a2a750f5b115e550db4b754b92dfd32213 DoesNotExist ;

    To read Positly's full profile check out TurkerView!
     
  20. Pronewbi3

    Pronewbi3 Survey Slinger TurkerView Masters

    Messages:
    15,651
    Gender:
    Male
    Ratings:
    +27,839
    Let me lighten the mood and tell you guys how I just died in Project Zomboid.

    Was trying to loot a grocery store but there was no food...except a single banana. I HAD to have this damn banana man. Every time I tried to grab it I would get rushed and have to run outside and circle the building...which just added more zombies to the crowd. This went on for like 5 minutes before I decided that I would DIE for this banana. I ran in, got it, got mauled but before I died I ate the banana.


    [​IMG]
     
    • LOL x 5
    • Nom Nom Nom! x 2
    • Like x 1
    • Yikes x 1
    • 5/5 Pay x 1
    • Love x 1
    • WOW x 1
Thread Status:
Not open for further replies.