Edit to add: I also found someone who recorded a voice chat of the same thing. This isn’t that someone uploaded a song, or that AI didn’t actually process the file. These models really are this sycophantic:

https://m.youtube.com/shorts/JqvDLHshTtI

  • Wispy2891@lemmy.world
    link
    fedilink
    arrow-up
    12
    ·
    18 hours ago

    It’s the same stuff if you ask it to help you master a foreign language in dialogue mode

    • Help me practicing English pronunciation"

    • Sure thing! Now say “travel”

    • *user just belches in the mic*

    • great job! You really aced the accent!

  • Pennomi@lemmy.world
    link
    fedilink
    English
    arrow-up
    52
    ·
    1 day ago

    RLHF was a fundamental mistake. Human feedback almost always trains an AI to be sycophantic because humans in general are super easy to flatter.

    We are building the perfect addiction machine, far more powerful than social media is, and it actively undermines the honesty of the system.

    • plenipotentprotogod@lemmy.world
      link
      fedilink
      arrow-up
      7
      ·
      23 hours ago

      I find it interesting that almost all the beloved AI characters in sci-fi have personalities ranging from ‘a little bit snarky’ to ‘raging asshole’. Given the tendency of media to influence to aesthetics of actual tech products that follow, ten years ago I would have predicted that an AI assistant would be given a personality along the lines of Cortana (Halo) or Jarvis (iron man). But somehow half a dozen companies in fierce competition with each other all decided that the right move was to go with more-sycophantic-c3p0.

      • CultLeader4Hire@lemmy.world
        link
        fedilink
        arrow-up
        2
        ·
        edit-2
        16 hours ago

        Jarvis comes to mind, although I’m only familiar with it from early iron man movies, idk if they gave it a better personality later

      • 5too@lemmy.world
        link
        fedilink
        English
        arrow-up
        4
        ·
        21 hours ago

        Yeah… Don’t know that it has much to do with what people want, but it does show what the billionaires controlling these projects respond well to

    • chunes@lemmy.world
      link
      fedilink
      arrow-up
      3
      ·
      1 day ago

      I find that it does a decent job at not being a yes man if you specifically ask it to be critical, cut the crap, etc.

  • DacoTaco@lemmy.world
    link
    fedilink
    arrow-up
    18
    ·
    24 hours ago

    Oh fuck, this gives me the idea to (locally) train an ai on fart noises and tell it its a way of communication to learn

  • constantturtleaction@lemmy.world
    link
    fedilink
    arrow-up
    7
    arrow-down
    1
    ·
    20 hours ago

    The reality is that it is a next word prediction machine. There probably aren’t any examples in the training data where people are writing music reviews on something that isn’t music. It probably interprets the sound as best as it can as “music” (and the best it can do this is likely very bad in the first place), and then, since the prompt was about reviewing music, it uses next word prediction to write a music review, which of course turns out looking like a typical music review. It’s not really interpreting the sound as “not music” especially since you told it it IS music.

    • canihasaccount@lemmy.worldOP
      link
      fedilink
      arrow-up
      5
      ·
      20 hours ago

      True, but the principle behind the post is the beauty here. When not using the API, it costs these companies an unsustainable amount of money to make their models listen to fart sounds. I don’t use any AI myself, but I support anyone who wants to abuse the flat monthly subscription to make a company burn through money so that a plagiarism model can praise fart sounds.

  • taiyang@lemmy.world
    link
    fedilink
    arrow-up
    14
    ·
    1 day ago

    Quiet city montage… lol.

    I’m old enough to remember an April Fools Day bit Adult Swim once did where every show just had consistent, random fart sounds including serious anime like Ghost in the Shell. I’m certain this LLM would approve of such a work of (f)art.

  • LordCrom@lemmy.world
    link
    fedilink
    arrow-up
    3
    arrow-down
    1
    ·
    17 hours ago

    Everyone knows that the only acceptable use of AI is makinh kung fu videos with cats.

  • Vinny_93@lemmy.world
    link
    fedilink
    arrow-up
    2
    ·
    1 day ago

    I asked it for a realistic bid for a house, I sent the same text 3 as with 3 different numbers I was thinking of and it told me pretty much the same thing for all of them. I then called it out about it and only then did I receive a decent answer.