02/10 - Swifty Sunday!

Discussion in 'Daily mTurk HITs Threads' started by TissueHime, Feb 10, 2019.

Thread Status:
Not open for further replies.
  1. Buntastic

    Buntastic Survey Slinger

    Messages:
    12,819
    Gender:
    Female
    Ratings:
    +23,740
    AnaBot confirmed
     
    • LOL LOL x 1
  2. Epictetus

    Epictetus Well-Known Turker

    Messages:
    1,158
    Gender:
    Male
    Ratings:
    +1,108
    Good Morning!

    [​IMG]
     
  3. oldtimeturker

    oldtimeturker Survey Slinger

    Messages:
    2,600
    Gender:
    Male
    Ratings:
    +4,095
    Wtf chelsea
     
  4. Ana*

    Ana* H&R Blockhead

    Messages:
    21,637
    Gender:
    Female
    Ratings:
    +27,162
    honestly nothing i have seen seems written with any coherence....
     
    • Like Like x 1
  5. Buntastic

    Buntastic Survey Slinger

    Messages:
    12,819
    Gender:
    Female
    Ratings:
    +23,740
    You've received a bonus from Rowan Zellers for work related to 3XEIP58NL0UN60WB2CSWOIOMSVDZLA.
    The value of your bonus is: $0.07 USD

    The Requester included this note:
    Hi there! Thanks for doing my HITs (Classifying caption endings). Here's some more feedback, which hopefully can help inform what I'm looking for. Anyways, each caption has one real ending - the other five were generated by AIs. You've ranked the real ending as best or 2nd best 8/15 times, or 53%. Not bad - try to be careful about telling apart AI generated vs real endings.
    Ranking the real ending as the best is the main thing that I'm looking for. You ranked the real endings likely 60% of the time, unlikely 40% of the time, and gibberish 0%.
    You ranked the AI-generated endings likely 30% of the time, unlikely 62% of the time, and gibberish 6%.

    -he put some examples I'm redacting for content reasons-

    A disclaimer: don't worry about perfectly telling apart AI vs. human endings. There's some ambiguity, and what I'm looking for is to tell which AI endings humans prefer. (That way, we can reward the AI for generating sensible endings!) For that reason, it doesn't help me if you cherry pick the easy ones - just do your best, and don't guess wildly :)
    More HITs coming! thanks, -Rowan
     
    • Today I Learned Today I Learned x 1
  6. Buntastic

    Buntastic Survey Slinger

    Messages:
    12,819
    Gender:
    Female
    Ratings:
    +23,740
    [​IMG]
     
  7. Ana*

    Ana* H&R Blockhead

    Messages:
    21,637
    Gender:
    Female
    Ratings:
    +27,162
    @rowan your feedback system is making no sense
     
    • Like Like x 1
    • LOL LOL x 1
  8. turker

    turker Survey Slinger

    Messages:
    14,795
    Ratings:
    +23,253
  9. Charlie Turksalot

    Charlie Turksalot Survey Slinger

    Messages:
    1,957
    Gender:
    Male
    Ratings:
    +6,072
    I submit that if you're developing an AI system and people are having trouble distinguishing AI responses from human responses, maybe your AI system is pretty good.
     
  10. Ana*

    Ana* H&R Blockhead

    Messages:
    21,637
    Gender:
    Female
    Ratings:
    +27,162
    except when everything written is mostly incoherent
     
    • Like Like x 1
  11. sadfrenchtoast

    sadfrenchtoast New Turker

    Messages:
    16
    Gender:
    Female
    Ratings:
    +14
    Mattheus Brenig [A1AC1BTIMTFPZL] Slider Task (you can earn 1.5$ in approximately 8 minutes) - $0.00 $1.50 bonus | PANDA


    Unrated

    <24 hours

    Unrated
    $9.63 / hour
    00:09:21 / completion time
    Approved!
    Pros:
    Instant approval + bonus
    Cons:

    Qualifications: Block Past Workers DoesNotExist ; Total approved HITs >= 100; HIT approval rate (%) >= 90; Location EqualTo US;
    To read Mattheus Brenig's full profile check out TurkerView!
     
  12. JDS

    JDS Well-Known Turker

    Messages:
    1,264
    Gender:
    Male
    Ratings:
    +1,437
    Maybe I'm just a slow reader but I couldn't get these new Rowans to pay more than $10/hr.
     
  13. Charlie Turksalot

    Charlie Turksalot Survey Slinger

    Messages:
    1,957
    Gender:
    Male
    Ratings:
    +6,072
    Ah. Well, having done none of the HITs in question, I'm just making general commentary. Carry on. :)
     
  14. Buntastic

    Buntastic Survey Slinger

    Messages:
    12,819
    Gender:
    Female
    Ratings:
    +23,740
    When the 'prompt' sentence doesn't make sense, it gets hard to pick anything as a viable ending.
     
    • Love Love x 2
    • Like Like x 1
  15. humbleturker

    humbleturker Survey Slinger

    Messages:
    5,697
    Gender:
    Male
    Ratings:
    +11,133
    Your HIT activity for this week:
    - Number of HITs submitted: 6,107

    Approvals and payments that occurred this week:
    - Number of HITs approved: 3,902
    - Number of HITs rejected: 0
    - Bonus reward earned: $19.54
    - HIT reward earned: $633.84
    - Total Amount earned this week: $653.38
     
    • 5/5 Pay 5/5 Pay x 6
    • Like Like x 2
    • WOW WOW x 1
  16. Ornac

    Ornac Survey Slinger TurkerView Masters

    Messages:
    8,739
    Gender:
    Male
    Ratings:
    +11,092
    Mine got revoked and I seem to be doing better than you stats wise. :dunno:

    You've ranked the real ending as best or 2nd best 25/32 times, or 78%. Great job! Ranking the real ending as the best is the main thing that I'm looking for. You ranked the real endings possible 78% of the time, unlikely 21% of the time, and gibberish 0%.
     
    • WOW WOW x 2
  17. jajeawar

    jajeawar Well-Known Turker

    Messages:
    2,310
    Gender:
    Female
    Ratings:
    +1,412
    Greetings from Amazon Mechanical Turk,

    The following is a summary of activity for your Mechanical Turk account for the week ending Feb 09, 2019.

    Your HIT activity for this week:
    - Number of HITs submitted: 257

    Approvals and payments that occurred this week:
    - Number of HITs approved: 284
    - Number of HITs rejected: 1
    - Bonus reward earned: $12.80
    - HIT reward earned: $111.16
    - Total Amount earned this week: $123.96

    For more information about your account status and activity, sign in to
    https://www.mturk.com/?referrer=email, then view your "Dashboard".

    Sincerely,
    Amazon Mechanical Turk
    https://www.mturk.com
     
    • Like Like x 4
    • 5/5 Pay 5/5 Pay x 2
  18. Buntastic

    Buntastic Survey Slinger

    Messages:
    12,819
    Gender:
    Female
    Ratings:
    +23,740
    lowered or revoked? Can you do the batch he just dropped?
     
  19. Audbal

    Audbal Well-Known Turker TurkerView Masters

    Messages:
    2,635
    Gender:
    Male
    Ratings:
    +1,315
    ASU PL LAB [A26S4BHWY8M7E1] Perception of Friendship (10-minute study)(~ 10 minutes) - $1.00 | PANDA


    Generous

    Unrated

    Unrated
    $18.85 / hour
    00:03:11 / completion time
    Pros:
    Cons:

    Qualifications: Exc: [128692-128103] DoesNotExist ; Total approved HITs >= 50; HIT approval rate (%) >= 75; Location In US;
    To read ASU PL LAB's full profile check out TurkerView!
     
  20. Ornac

    Ornac Survey Slinger TurkerView Masters

    Messages:
    8,739
    Gender:
    Male
    Ratings:
    +11,092
    Revoked. I got a very nice email about it.
     
Thread Status:
Not open for further replies.