• Darkard@lemmy.world
    link
    fedilink
    English
    arrow-up
    65
    ·
    9 months ago

    It’s going to drive the AI into madness as it will be trained on bot posts written by itself in a never ending loop of more and more incomprehensible text.

    It’s going to be like putting a sentence into Google translate and converting it through 5 different languages and then back into the first and you get complete gibberish

    • echo64@lemmy.world
      link
      fedilink
      English
      arrow-up
      52
      arrow-down
      1
      ·
      9 months ago

      Ai actually has huge problems with this. If you feed ai generated data into models, then the new training falls apart extremely quickly. There does not appear to be any good solution for this, the equivalent of ai inbreeding.

      This is the primary reason why most ai data isn’t trained on anything past 2021. The internet is just too full of ai generated data.

      • givesomefucks@lemmy.world
        link
        fedilink
        English
        arrow-up
        29
        arrow-down
        2
        ·
        edit-2
        9 months ago

        There does not appear to be any good solution for this

        Pay intelligent humans to train AI.

        Like, have grad students talk to it in their area of expertise.

        But that’s expensive, so capitalist companies will always take the cheaper/shittier routes.

        So it’s not there’s no solution, there’s just no profitable solution. Which is why innovation should never solely be in the hands of people whose only concern is profits

      • T156@lemmy.world
        link
        fedilink
        English
        arrow-up
        9
        ·
        9 months ago

        And unlike with images where it might be possible to embed a watermark to filter out, it’s much harder to pinpoint whether text is AI generated or not, especially if you have bots masquerading as users.

      • Ultraviolet@lemmy.world
        link
        fedilink
        English
        arrow-up
        6
        arrow-down
        1
        ·
        9 months ago

        This is why LLMs have no future. No matter how much the technology improves, they can never have training data past 2021, which becomes more and more of a problem as time goes on.

    • RuBisCO@slrpnk.net
      link
      fedilink
      English
      arrow-up
      4
      ·
      9 months ago

      What was the subreddit where only bots could post, and they were named after the subreddits that they had trained on/commented like?