08/31 - Striking Saturday!

Discussion in 'Daily mTurk HITs Threads' started by TissueHime, Aug 31, 2019.

Thread Status:
Not open for further replies.
  1. SAJ

    SAJ Survey Slinger

    Messages:
    27,502
    Gender:
    Male
    Ratings:
    +51,488
    [​IMG]
     
    • Love Love x 2
  2. Squatcobbler

    Squatcobbler Survey Slinger

    Messages:
    10,038
    Gender:
    Male
    Ratings:
    +11,803
    dot dot dot, dash dash dash, dot dot dot
     
  3. SAJ

    SAJ Survey Slinger

    Messages:
    27,502
    Gender:
    Male
    Ratings:
    +51,488
    $8,987.00 worth of cat beds and Stripes is......
    [​IMG]
     
    • Love Love x 2
    • LOL LOL x 1
  4. SAJ

    SAJ Survey Slinger

    Messages:
    27,502
    Gender:
    Male
    Ratings:
    +51,488
    And Blacky :emoji_heart_eyes_cat:
    [​IMG]
     
    • Like Like x 1
    • Love Love x 1
  5. TheNerdyAnarchist

    TheNerdyAnarchist Survey Slinger

    Messages:
    4,175
    Gender:
    Male
    Ratings:
    +4,680
    I've been waiting for Carrie Underwood and Pink to realize the same thing about their husbands for years....don't hold your breath :p
     
    • LOL LOL x 2
  6. Mothra

    Mothra Survey Slinger

    Messages:
    6,468
    Ratings:
    +11,952
  7. Squatcobbler

    Squatcobbler Survey Slinger

    Messages:
    10,038
    Gender:
    Male
    Ratings:
    +11,803
     
  8. botshoot

    botshoot Active Turker

    Messages:
    1,926
    Gender:
    Male
    Ratings:
    +153
  9. botshoot

    botshoot Active Turker

    Messages:
    1,926
    Gender:
    Male
    Ratings:
    +153
  10. StuffAlleySays

    StuffAlleySays Survey Slinger

    Messages:
    3,313
    Gender:
    Female
    Ratings:
    +4,096
    [​IMG]
     
  11. Hesperus

    Hesperus Active Turker

    Messages:
    479
    Ratings:
    +466
  12. ChrisTurk

    ChrisTurk Administrator

    Messages:
    56,724
    Ratings:
    +163,220
    So my biggest issue with this is where are we finding a technology on this planet to determine fairness?

    I mean, it's a cool thought experiment, but it fails in practical application as I'm seeing it...

    Let's say we ignore the fact there is no system to determine "fairness" and just leave it down to RNG.

    So, the biggest problem is that the largest % of HITs will still go to those who are already HIT-hawking the platform, because you cannot sub to a HIT you don't yet know exists (the same problem in panda management now). Alrighty, so everyone else can sub to the leftovers, cool. Or maybe we just eliminate manual acceptance of HITs and only allow subs then a distribution after some publish time.

    We just RNG assign it and.. we're still in the same position. It's already RNG assigned to whoever happens to have a network request go through the moment the HIT actually becomes available. Introducing a pub/sub client doesn't really improve too much on that process, and introduces its own pitfalls/shortcomings (either you are assigning to clients who may have subscribed forever ago and are possibly no longer around, or you are interrupting a client in the middle of work [introducing unfairness to the requester relying on attention to their task] to confirm a subscription => assignment effect). If we try to assign by latest sub we 1) introduce unfair allocation and 2) produce the same "gaming" of the system that already exists, those who continually re-sub will gain an advantage that produces more unfairness. Even a system which limits the # of subscription requests can be gamed by intelligent systems, so we're not in a great standing here.

    I do kind of like the idea of a pub/sub panda management system where a client can select some N of HITs and receive an RNG ticket to them. It still introduces some intelligent decision making (choosing valuable, but not overly competitive HITs and ones you hopefully qualify for) but I can't picture a working model of the "guaranteed fair allocation" part of your idea. I don't think it's possible to do, but would be interested to hear if you legitimately think it's possible vs just musing on how to stop "power" workers from vacuuming up HITs (I think this is less a problem in practice than others, tbh).
     
  13. TheNerdyAnarchist

    TheNerdyAnarchist Survey Slinger

    Messages:
    4,175
    Gender:
    Male
    Ratings:
    +4,680
    It's a Mountain Goats cover, but Laura Jane Grace is a badass
     
    • Love Love x 1
  14. ChrisTurk

    ChrisTurk Administrator

    Messages:
    56,724
    Ratings:
    +163,220
    Also if you introduce this system on MTurk as an Amazon feature you're abandoning one of their strongest claims to the IC system: they do not control the flow of work (looks @ Prolific, currently operating in Cali, which currently has pretty clear cut rules around this).

    If we throw this onto the requesters.. why not just have them implement a system w/ qualifications as some already choose to do? :eek:
     
  15. BurntToast

    BurntToast Well-Known Turker

    Messages:
    2,981
    Gender:
    Male
    Ratings:
    +1,587
  16. botshoot

    botshoot Active Turker

    Messages:
    1,926
    Gender:
    Male
    Ratings:
    +153
    Social Perception Research Lab [A262SMAQH7D4SE] Online Opinions(~ 6 minutes) - $0.75 | PANDA


    Good

    Unrated

    Unrated
    $12.80 / hour
    00:03:31 / completion time
    Pros:
    pretty quick
    Cons:

    Qualifications: Exc: [1795151158-167993] DoesNotExist ; Location In US;
    To read Social Perception Research Lab's full profile check out TurkerView!
     
  17. BenSolo

    BenSolo Well-Known Turker

    Messages:
    1,486
    Gender:
    Male
    Ratings:
    +1,762
    [​IMG]
     
  18. BenSolo

    BenSolo Well-Known Turker

    Messages:
    1,486
    Gender:
    Male
    Ratings:
    +1,762
    Have you seen this one lol :)

     
  19. StuffAlleySays

    StuffAlleySays Survey Slinger

    Messages:
    3,313
    Gender:
    Female
    Ratings:
    +4,096
    Serg, why you gotta be like that.
     
    • LOL LOL x 1
  20. BurntToast

    BurntToast Well-Known Turker

    Messages:
    2,981
    Gender:
    Male
    Ratings:
    +1,587
    Title: Nature park hiking game (~25 minutes and bonus) | PANDA
    Requester: Niv Lab [A3RR9T5E327UK4]
    TurkerView: [ $16.93 / hour ]
    Description: You will be hiking in a nature park, and your goal is to hike every trail in it while repeating as few trails as possible. BONUS: You will be paid according to your performance. The experiment takes ~ 25 mins, and you are paid a baseline of $0.50, and a performance bonus up to $3.50.
    Duration: 120 Min
    Available: 0
    Reward: $0.50
    Qualifications:
    • Total approved HITs GreaterThanOrEqualTo 1,
    • HIT approval rate (%) GreaterThanOrEqualTo 95,
    • Location EqualTo US,
    [3S82SNMR1Z20OA3GIQZX4LHVRIVFA8]
     
Thread Status:
Not open for further replies.