02/10 - Swifty Sunday!

Discussion in 'Daily mTurk HITs Threads' started by TissueHime, Feb 10, 2019.

Thread Status:
Not open for further replies.
  1. Ana*

    Ana* H&R Blockhead

    Messages:
    21,637
    Gender:
    Female
    Ratings:
    +27,162
    8 to 1, yea his system is as good as always
     
  2. dan

    dan daelian

    Messages:
    28,285
    Gender:
    Male
    Ratings:
    +61,817
    Mine was revoked. I was told I was doing a great job and
    - Ranking the real ending as the best is the main thing that I'm looking for. You ranked the real endings possible 80% of the time, unlikely 18% of the time, and gibberish 1%.

    It was revoked and told me to do the qual test again if I want
     
  3. rowan

    rowan A2RVUSQQ0150J2

    Messages:
    130
    Gender:
    Male
    Ratings:
    +516
    That's possible, I am still getting all of this set up :) There's also some ambiguity because the AI this time around does a lot better at being mostly convincing :p

    Happy to investigate more to figure out what a fair cutoff is. unfortunately, some spot checking is required - on this batch I had one worker guess randomly on ~3000, and it got autoapproved :/ so I had to increase the AA time for the future batches :(
     
    • WOW WOW x 7
  4. Ornac

    Ornac Survey Slinger TurkerView Masters

    Messages:
    8,739
    Gender:
    Male
    Ratings:
    +11,092
    No problem I sent the email that said I was doing a good job to you via PM. If I'm not giving you what your looking for no worries I understand, but if you could take a look when you get the time, I'd appreciate it.
     
  5. dan

    dan daelian

    Messages:
    28,285
    Gender:
    Male
    Ratings:
    +61,817
    block them and report them to amazon if it's possible - because that's really crappy :( Those types of people should not be working on the platform. Save them from scamming others.
     
    • Like Like x 1
    • Love Love x 1
  6. Ana*

    Ana* H&R Blockhead

    Messages:
    21,637
    Gender:
    Female
    Ratings:
    +27,162
    would u mind checking mine too? i got dropped from 8 to 1, and I haven't done anything different since the previous fairly 'good' feedback
     
  7. slothbear

    slothbear Survey Slinger

    Messages:
    10,822
    Gender:
    Male
    Ratings:
    +22,072
    :wave:
     
    • Love Love x 1
  8. sunny

    sunny Turker

    Messages:
    58
    Gender:
    Female
    Ratings:
    +39
    Title: Werewolves and Villagers Game (Bonus up to $1.00) [ $ | $ ] PANDA
    Requester: Pivithuru [A2U0GLJ3CNX872]
    TurkerView: [ $14.08 / hour ]
    Description: You will participate in two "Werewolves and Villagers" games in this task. For each game, your base payment will be $0.25. Your rewards will be added and penalties will be deducted from the base payment. The minimum guaranteed payment for a game will be $0.05 and maximum possible payment will be $0.55. *This HIT should only be completed on a laptop or desktop computer. Do not accept if you are on a mobile device or tablet*.
    Duration: 00:10:00
    Available: 3
    Reward: $0.10
    Qualifications:
    • HIT approval rate (%) GreaterThanOrEqualTo 95,
    • Werewolves and Villagers Game Qualification EqualTo 1, [ Request | How to Use ]
    [3VTCTNDILABMOSZV785NC0SN215TGZ]
     
  9. rater9

    rater9 Survey Slinger

    Messages:
    2,541
    Gender:
    Female
    Ratings:
    +3,920
    Greetings from Amazon Mechanical Turk,

    The following is a summary of activity for your Mechanical Turk account for the week ending Feb 09, 2019.

    Your HIT activity for this week:
    - Number of HITs submitted: 239

    Approvals and payments that occurred this week:
    - Number of HITs approved: 228
    - Number of HITs rejected: 0
    - Bonus reward earned: $1.70
    - HIT reward earned: $29.54
    - Total Amount earned this week: $31.24

    MTurk powers just haven't a clue that sometimes the "exception" to the "majority rule" is more important. ...

    PLEASE KEEP OUR WEEKLY REPORTS !!!
     
    • Like Like x 5
    • 5/5 Pay 5/5 Pay x 1
  10. Lan Ji

    Lan Ji Active Turker

    Messages:
    340
    Gender:
    Male
    Ratings:
    +305
    Who knows what a fork is?

    Enormous kitchen batch just went up

    I don't qualify....

    Perch Mturk
     
  11. Buntastic

    Buntastic Survey Slinger

    Messages:
    12,819
    Gender:
    Female
    Ratings:
    +23,740
    @rowan Here is my issue with the "you're picking the AI answer too often" logic
    [​IMG]

    If all of that isn't an AI vomit of words, I'm shocked.
     
    • Like Like x 1
    • WOW WOW x 1
  12. rowan

    rowan A2RVUSQQ0150J2

    Messages:
    130
    Gender:
    Male
    Ratings:
    +516
    so more info that might clarify this:

    Essentially I'm trying to get a bunch of AI-generated caption endings that humans know are unreasonable, but the AI thinks are fine. to do this, I'm starting with a bunch of endings that the AI thinks are good, and removing AI generated endings that are too good (and thus could be confused with real endings).

    However, in order for me to trust your judgments, then you need to mostly prefer human written endings. If, say, you pick the real ending as 'best' 1/6th of the time, then you're likely just guessing wildly, and it doesn't mean as much if you say an ending is the best one :)

    Anyways, hope that helps- if you have any ideas about how to make this clearer, lmk!
     
    • Today I Learned Today I Learned x 3
  13. Ironbrand

    Ironbrand Active Turker

    Messages:
    492
    Gender:
    Male
    Ratings:
    +764
    The following is a summary of activity for your Mechanical Turk account for the week ending Feb 09, 2019.

    Your HIT activity for this week:
    - Number of HITs submitted: 1,234

    Approvals and payments that occurred this week:
    - Number of HITs approved: 1,208
    - Number of HITs rejected: 1
    - Bonus reward earned: $20.00
    - HIT reward earned: $244.85
    - Total Amount earned this week: $264.85

    How many of you full time Mturk? I'm coming back full steam after quitting my job and I'm wondering how much you guys spend each day, I feel I'm already at the computer most of the day anyway but I want to set a limit. right now I usually wake up at 10am est and try to go to at least 6pm but it's hard to tell once things start trickling off where Mturk ends and computer activities begin.
     
    • Like Like x 4
    • 5/5 Pay 5/5 Pay x 2
  14. Epictetus

    Epictetus Well-Known Turker

    Messages:
    1,158
    Gender:
    Male
    Ratings:
    +1,108
    I think the whole "majority - unhelpful" narrative is a lie, they just don't want to fool with it even though it's completely automated.
     
    • Like Like x 1
  15. Lan Ji

    Lan Ji Active Turker

    Messages:
    340
    Gender:
    Male
    Ratings:
    +305

    A. Got caught cheating with the woman, extremely bitter about upcoming divorce and is following a scorched earth policy.

    B. Alternatively, the rough draft script for "Lawnmower Man"
     
    • LOL LOL x 1
    • WOW WOW x 1
  16. gurlondrums

    gurlondrums Cracker of the Step Whip

    Messages:
    27,160
    Gender:
    Female
    Ratings:
    +76,023
    Yale Cognition & Development Lab [A1B2ILT2409W4R] Yale Survey(~ 5 minutes) - $0.50 | PANDA


    Generous

    Unrated

    Unrated
    $12.95 / hour
    00:02:19 / completion time
    Pros:
    Puzzle pieces!
    Cons:
    53 second video in the beginning.

    Qualifications: Total approved HITs >= 100; Exc: [128679-128138] DoesNotExist ; cc55e628 DoesNotExist ; HIT approval rate (%) >= 98; Location In US;
    To read Yale Cognition & Development Lab's full profile check out TurkerView!
     
  17. dan

    dan daelian

    Messages:
    28,285
    Gender:
    Male
    Ratings:
    +61,817
    Some of the ones that I feel are a bit confusing are the ones that are like "The guy is skiing down a hill"

    and some of the options are - "the ending credits are shown."

    These are a bit tricky to me, as in context of the video - it's really impossible for me to say it's not true - especially if we don't have access to the video. So I always assume that these are true. But often times there will be multiple endings talking about the ending credits - and it's really tricky to figure out which one is human generated.
     
    • Love Love x 2
  18. rowan

    rowan A2RVUSQQ0150J2

    Messages:
    130
    Gender:
    Male
    Ratings:
    +516
    Sure, msg me your worker id :)
     
  19. Tripsa

    Tripsa Gobbling Ghost Mod

    Messages:
    11,989
    Gender:
    Male
    Ratings:
    +30,920
    Im over here still wondering how one is able to take off tire lug nuts with a leaf blower attachment.
    [​IMG]
     
    • LOL LOL x 6
    • WOW WOW x 1
  20. Michelle32

    Michelle32 Well-Known Turker

    Messages:
    996
    Gender:
    Female
    Ratings:
    +1,846
    Josh Siegel [AATN5Y4RG8H0U] Academic survey on employee decision-making (~5-7 minutes) - $0.70 | PANDA


    Low

    Unrated

    Unrated
    $5.81 / hour
    00:07:14 / completion time
    Pros:
    Cons:
    Little longer than expected. When you check a bubble, the color is very pale which makes it look like you didn't check it.

    Qualifications: Completed Pretest Already DoesNotExist ; Total approved HITs > 1000; HIT approval rate (%) > 98; Location EqualTo US;
    To read Josh Siegel's full profile check out TurkerView!
     
Thread Status:
Not open for further replies.