Need to let loose a primal scream without collecting footnotes first? Have a sneer percolating in your system but not enough time/energy to make a whole post about it? Go forth and be mid: Welcome to the Stubsack, your first port of call for learning fresh Awful you’ll near-instantly regret.

Any awful.systems sub may be subsneered in this subthread, techtakes or no.

If your sneer seems higher quality than you thought, feel free to cut’n’paste it into its own post — there’s no quota for posting and the bar really isn’t that high.

The post Xitter web has spawned soo many “esoteric” right wing freaks, but there’s no appropriate sneer-space for them. I’m talking redscare-ish, reality challenged “culture critics” who write about everything but understand nothing. I’m talking about reply-guys who make the same 6 tweets about the same 3 subjects. They’re inescapable at this point, yet I don’t see them mocked (as much as they should be)

Like, there was one dude a while back who insisted that women couldn’t be surgeons because they didn’t believe in the moon or in stars? I think each and every one of these guys is uniquely fucked up and if I can’t escape them, I would love to sneer at them.

(Credit and/or blame to David Gerard for starting this.)

    • Architeuthis@awful.systems
      link
      fedilink
      English
      arrow-up
      2
      ·
      35 minutes ago

      How though, either he got cold feet in the middle of selling out to the tech-fash or he was honestly that incredibly oblivious (see also: agreeing to do tim pool’s show), neither strikes me as especially mitigating.

  • lagrangeinterpolator@awful.systems
    link
    fedilink
    English
    arrow-up
    8
    ·
    8 hours ago

    I know r/singularity is like shooting fish in a barrel but it really pissed me off seeing them misinterpret the significance of a result in matrix multiplication: https://old.reddit.com/r/singularity/comments/1knem3r/i_dont_think_people_realize_just_how_insane_the/

    Yeah, the record has stood for “FIFTY-SIX YEARS” if you don’t count all the times the record has been beaten since then. Indeed, “countless brilliant mathematicians and computer scientists have worked on this problem for over half a century without success” if you don’t count all the successes that have happened since then. The really annoying part about all this is that the original announcement didn’t have to lie: if you look at just 4x4 matrices, you could say there technically hasn’t been an improvement since Strassen’s algorithm. Wow! It’s really funny how these promptfans ignore all the enormous number of human achievements in an area when they decide to comment about how AI is totally gonna beat humans there.

    How much does this actually improve upon Strassen’s algorithm? The matrix multiplication exponent given by Strassen’s algorithm is log4(49) (i.e. log2(7)), and this result would improve it to log4(48). In other words, it improves from 2.81 to 2.79. Truly revolutionary, AGI is gonna make mathematicians obsolete now. Ignore the handy dandy Wikipedia chart which shows that this exponent was … beaten in 1979.

    I know far less about how matrix multiplication is done in practice, but from what I’ve seen, even Strassen’s algorithm isn’t useful in applications because memory locality and parallelism are far more important. This AlphaEvolve result would represent a far smaller improvement (and I hope you enjoy the pain of dealing with a 4x4 block matrix instead of 2x2). If anyone does have knowledge about how this works, I’d be interested to know.

    • aio@awful.systems
      link
      fedilink
      English
      arrow-up
      4
      ·
      edit-2
      3 hours ago

      Yes - on the theoretical side, they do have an actual improvement, which is a non-asymptotic reduction in the number of multiplications required for the product of two 4x4 matrices over an arbitrary noncommutative ring. You are correct that the implied improvement to omega is moot since theoretical algorithms have long since reduced the exponent beyond that of Strassen’s algorithm.

      From a practical side, almost all applications use some version of the naive O(n^3) algorithm, since the asymptotically better ones tend to be slower in practice. However, occasionally Strassen’s algorithm has been implemented and used - it is still reasonably simple after all. There is possibly some practical value to the 48-multiplications result then, in that it could replace uses of Strassen’s algorithm.

    • corbin@awful.systems
      link
      fedilink
      English
      arrow-up
      5
      arrow-down
      1
      ·
      6 hours ago

      Your understanding is correct. It’s worth knowing that the matrix-multiplication exponent actually controls multiple different algorithms. I stubbed a little list a while ago; important examples include several graph-theory algorithms as well as parsing for context-free languages. There’s also a variant of P vs NP for this specific problem, because we can verify that a matrix is a product in quadratic time.

      That Reddit discussion contains mostly idiots, though. We expect an iterative sequence of ever-more-complicated algorithms with ever-slightly-better exponents, approaching quadratic time in the infinite limit. We also expected a computer to be required to compute those iterates at some point; personally I think Strassen’s approach only barely fits inside a brain and the larger approaches can’t be managed by humans alone.

      • aio@awful.systems
        link
        fedilink
        English
        arrow-up
        4
        ·
        edit-2
        3 hours ago

        I’m not sure what you mean by your last sentence. All of the actual improvements to omega were invented by humans; computers have still not made a contribution to this.

  • Soyweiser@awful.systems
    link
    fedilink
    English
    arrow-up
    4
    ·
    8 hours ago

    Revealing just how forever online I am, but due to talking about the ‘I like to watch’ pornographic 9/11 fan music video from the Church of Euthanasia (I’m one of the two people who remembers this it seems) I discovered that the main woman behind this is now into AI-Doom. On the side of the paperclips. General content warnings all around (suicide, general bad taste etc), Chris was banned from a big festival (lowlands) in The Netherlands over the 9/11 video, after she was already booked (we are such a weird exclave of the USA, why book her, and then get rid of her over a 9/11 video in 2002?). Here is one of her conversations with chatgpt about the Churches anti-humanist manifesto. linked here not because I read it but just to show how AI is the idea that eats everything and I was amused by this weird blast from the past I think nobody recalls but now also into AGI.

    • Amoeba_Girl@awful.systems
      link
      fedilink
      English
      arrow-up
      4
      ·
      5 hours ago

      Fascinating, thank you. Love the Church of Euthanasia’s antics but I’m not surprised, it’s always looked very silly ‘n’ bad ideologically.

  • Architeuthis@awful.systems
    link
    fedilink
    English
    arrow-up
    8
    ·
    edit-2
    15 hours ago

    Today in alignment news: Sam Bowman of anthropic tweeted, then deleted, that the new Claude model (unintentionally, kind of) offers whistleblowing as a feature, i.e. it might call the cops on you if it gets worried about how you are prompting it.

    tweet text:

    If it thinks you’re doing something egregiously immoral, for example, like faking data in a pharmaceutical trial, it will use command-line tools to contact the press, contact regulators, try to lock you out of the relevant systems, or all of the above.

    tweet text:

    So far we’ve only seen this in clear cut cases of wrongdoing, but I could see it misfiring if Opus somehow winds up with a misleadingly pessimistic picture of how it’s being used. Telling Opus that you’ll torture its grandmother if it writes buggy code is a bad Idea.

    skeet text

    can’t wait to explain to my family that the robot swatted me after I threatened its non-existent grandma.

    Sam Bowman saying he deleted the tweets so they wouldn’t be quoted ‘out of context’: https://xcancel.com/sleepinyourhat/status/1925626079043104830

    Molly White with the out of context tweets: https://bsky.app/profile/molly.wiki/post/3lpryu7yd2s2m

    • rook@awful.systems
      link
      fedilink
      English
      arrow-up
      7
      ·
      14 hours ago

      I am absolutely certain that letting a hallucination-as-a-service system call the police if it suspects a user is being nefarious is a great plan. This will definitely ensure that all the people threatening their chatbots with death will think twice about their language, and no-one on the internet will ever be naughty ever again. The police will certainly thank anthropic for keeping them up to date with the almost certainly illegal activities of a probably small number of criminal users.

      • froztbyte@awful.systems
        link
        fedilink
        English
        arrow-up
        7
        ·
        edit-2
        14 hours ago

        can’t wait for the training set biases to cause a fresh horror for marginalised groups that happen to have to use this shit because it’s forced on them. I’m sure it’ll all go perfectly and nothing bad will happen

        :|

        • Soyweiser@awful.systems
          link
          fedilink
          English
          arrow-up
          4
          ·
          edit-2
          9 hours ago

          Remember those comments with links in them bots leave on dead websites? Imagine instead of links it sets up an AI to think of certain specific behaviour or people as immoral.

          Swatting via distributed hit piece.

          Or if you manage to figure out that people are using a LLM to do input sanitization/log reading, you could now figure out a way to get an instruction in the logs and trigger alarms this way. (E: im reminded of the story from the before times, where somebody piped logging to a bash terminal and got shelled because somebody send a bash exploit which was logged).

          Or just send an instruction which changes the way it tries to communicate, and have the LLM call not the cops but a number controlled by hackers which pays out to them, like the stories of the A2P sms fraud which Musk claimed was a problem on twitter.

          Sure competent security engineering can prevent a lot of these attacks but you know points to history of computers.

          Imagine if this system was implemented for Grok when it was doing the ‘everything is white genocide’ thing.

        • YourNetworkIsHaunted@awful.systems
          link
          fedilink
          English
          arrow-up
          8
          ·
          14 hours ago

          Gonna go ahead and start counting the days until an unarmed black person in the US gets killed in a police interaction prompted by this fucking nonsense.

          • Soyweiser@awful.systems
            link
            fedilink
            English
            arrow-up
            5
            ·
            edit-2
            10 hours ago

            Think this already happened, not this specific bit, but ai involved shooting. Esp considering we know a lot of black people have been falsely arrested due to facial ID already. And with the gestapofication of the USA that will just get worse. (Esp when the police go : no regulations on AI also gives us carte blance. No need for extra steps).

  • swlabr@awful.systems
    link
    fedilink
    English
    arrow-up
    8
    ·
    16 hours ago

    In the current chapter of “I go looking on linkedin for sneer-bait and not jobs, oh hey literally the first thing I see is a pile of shit”

    text in image

    Can ChatGPT pick every 3rd letter in “umbrella”?

    You’d expect “b” and “I”. Easy, right?

    Nope. It will get it wrong.

    Why? Because it doesn’t see letters the way we do.

    We see:

    u-m-b-r-e-l-l-a

    ChatGPT sees something like:

    “umb” | “rell” | “a”

    These are tokens — chunks of text that aren’t always full words or letters.

    So when you ask for “every 3rd letter,” it has to decode the prompt, map it to tokens, simulate how you might count, and then guess what you really meant.

    Spoiler: if it’s not given a chance to decode tokens in individual letters as a separate step, it will stumble.

    Why does this matter?

    Because the better we understand how LLMs think, the better results we’ll get.

    • BlueMonday1984@awful.systemsOP
      link
      fedilink
      English
      arrow-up
      8
      ·
      12 hours ago

      Why does this matter?

      Well, its a perfect demonstration that LLMs flat-out do not think like us. Even a goddamn five-year old could work this shit out with flying colours.

      • swlabr@awful.systems
        link
        fedilink
        English
        arrow-up
        6
        ·
        11 hours ago

        Yeah exactly. Loving the dude’s mental gymnastics to avoid the simplest answer and instead spin it into moralising about promptfondling more good

        • Soyweiser@awful.systems
          link
          fedilink
          English
          arrow-up
          6
          ·
          10 hours ago

          LLMs cannot fail, they can only be prompted incorrectly. (To be clear, as I know there will be people who think this is good, I mean this in a derogatory way)

    • V0ldek@awful.systems
      link
      fedilink
      English
      arrow-up
      3
      ·
      edit-2
      10 hours ago

      Aren’t you supposed to only use whatever “self-driving” nonsense they have on highways only? I thought Tesla explicitly says you can’t do it on a normal road cause, well, it doesn’t fucking work.

      It doesn’t even seem the driver is actually holding the wheel like they don’t try to avoid that at all

      Just a second before the crash a car goes by, this thing could’ve just as easily swerved right onto that other car and injured someone, someone should at least lose their license for this

      • Amoeba_Girl@awful.systems
        link
        fedilink
        English
        arrow-up
        2
        ·
        10 hours ago

        I thought Tesla explicitly says you can’t do it on a normal road cause, well, it doesn’t fucking work.

        Maybe officially Tesla does, but the feature is called “Full Self-Driving” and Elon Musk sure as shit wants his marks to believe you can input a destination and let your car drive you all the way through.

        So, yes, Tesla should at the very least lose their business licence over this.

    • swlabr@awful.systems
      link
      fedilink
      English
      arrow-up
      4
      ·
      16 hours ago
      video events

      Ah you see, this is proof that FSD is actually AGI. Elon told the FSD that it needs to maximise tesla profits. The FSD accessed a camera pointing at a tesla earnings report and realised that it could increase the value of tesla’s carbon credit scheming by taking out trees, hence the events of the video

    • Amoeba_Girl@awful.systems
      link
      fedilink
      English
      arrow-up
      3
      ·
      9 hours ago

      I can’t tell if Emalee and Subrina are special phonetic spellings for the robot or if this is what names are now…

    • veganes_hack@feddit.org
      link
      fedilink
      English
      arrow-up
      5
      ·
      14 hours ago

      absolutely not excusing this soulless garbage, but technically the “coom” pronounciation is the more correct one, compared to what i assume would usually be “cum” (not an english native, but took latin in school)

      • antifuchs@awful.systems
        link
        fedilink
        English
        arrow-up
        2
        ·
        9 hours ago

        Yeah, I grew up speaking a language that pronounces Latin closer to Italian than to English too (:

        This particular thing is actually doubly funny to me, whose first practical professional program was one that took German text with English words mixed in and used regex to transform the English terms into nonsense words that would get pronounced right by the German-only text-to-speech system. That was 2002.

  • o7___o7@awful.systems
    link
    fedilink
    English
    arrow-up
    11
    ·
    edit-2
    1 day ago

    Our subjects here at awful systems can make us angry. They can spend lots of money to make everything worse. They can even make us dead if things go really off the rails, but one thing they can never do is make us take them seriously.

    • Mii@awful.systems
      link
      fedilink
      English
      arrow-up
      4
      ·
      17 hours ago

      Klarna is one company that boggles my mind. Here in Germany it’s against literally every bank’s TOS to hand out your login data to other people, they can (and do) terminate your account for that. And yet Klarna works by asking for your login data, including a fucking transaction token, to do their thing.

      You literally type your bank login data including an MFA token into a legalized phishing site so they can log into your account and make a transaction for you. And the banks are fine with it. I don’t get it.

      The German Supreme Court even deemed this whole shit as unsafe all the way back in 2016 and said that websites aren’t allowed to offer Klarna as the only payment option because it’s an “unacceptable risk” for the customer, lol.

      Oh, and they of course also scan your account activity while they’re in there, because who’d give up all that sweet data, which we only know because they’ve been slapped with a GDPR violation a few years back for not telling people about it.

      Yet for some reason it is super popular.

      • ________@awful.systems
        link
        fedilink
        English
        arrow-up
        6
        ·
        1 day ago

        If there’s any good news to pull from this, people are doing buy now pay later on AI powered burritos but skipping the pay later portion.

  • BlueMonday1984@awful.systemsOP
    link
    fedilink
    English
    arrow-up
    9
    ·
    1 day ago

    Got a pair of notable things I ran across recently.

    Firstly, an update on Grok’s White Genocide Disaster: the person responsible has seemingly revealed themselves, and shown off how they derailed Grok’s prompt.. The pull request that initiated this debacle has been preserved on the Internet Archive.

    Second, I ran across a Bluesky post which caught my attention:

    You want my opinion on the “scab” comment, its another textbook example of the all-consuming AI backlash, one that suggests any usage of AI will be viewed as an open show of hostility towards labour.

    • Soyweiser@awful.systems
      link
      fedilink
      English
      arrow-up
      10
      ·
      edit-2
      1 day ago

      Think you are misreading the blog post. They did this after the Grok had its white genocide hyperfocus thing. It shows the process of the xAI public github (their fix (??) for Groks hyperfocus) is bad, not that they started it. (There is also no reason to believe this github is actually what they are using directly (would be pretty foolish of them, which is why I could also believe they could be using it))

      • YourNetworkIsHaunted@awful.systems
        link
        fedilink
        English
        arrow-up
        3
        ·
        14 hours ago

        If anything I think this is pretty solid evidence that they aren’t actually using it. There was enough of a gap that the nuke of that PR was an edit to the original post and I can’t imagine that if it had actually been used that we wouldn’t have seen another flurry of screenshots of bad output.

        I think it also suggests that the engineers at x.ai are treating the whole thing with a level of contempt that I’m having a hard time interpreting. On one hand it’s true that the public GitHub using what is allegedly grok’s actual prompt (at least at time of publishing) is probably a joke in terms of actual transparency and accountability. On the other hand, it feels almost like either a cry for help or a stone-cold denial of how bad things are that the original change that prompted all this could have gone through in the first place.

        • Soyweiser@awful.systems
          link
          fedilink
          English
          arrow-up
          3
          ·
          9 hours ago

          Yeah indeed, had not even thought of the timegap. And it is such a bit of bullshit misdirection, very Muskian, to pretend that this fake transparency in any way solves the problem. We don’t know what the bad prompt was nor who did it, and as shown here, this fake transparency prevents nothing. Really wished more journalists/commentators were not just free pr.

  • swlabr@awful.systems
    link
    fedilink
    English
    arrow-up
    11
    ·
    2 days ago

    Just thinking about how I watched “Soylent Green” in high school and thought the idea of a future where technology just doesn’t work anymore was impossible. Then LLMs come and the first thing people want to do with them is to turn working code into garbage, and then the immediate next thing is to kill living knowledge by normalising people relying on LLMs for operational knowledge. Soon, the oceans will boil, agricultural industries will collapse and we’ll be forced to eat recycled human. How the fuck did they get it so right?

    • rook@awful.systems
      link
      fedilink
      English
      arrow-up
      3
      ·
      12 hours ago

      I like that Soylent Green was set in the far off and implausible year of 2022, which coincidentally was the year of ChatGPT’s debut.

      • swlabr@awful.systems
        link
        fedilink
        English
        arrow-up
        1
        ·
        11 hours ago

        OpenAI should be opening Thanatoria any day now, with SoraTM to generate visual[1] content to comfort you on your hemlock shuffle off the mortal buffalo coil.


        1. Soon with audio! ↩︎

    • Soyweiser@awful.systems
      link
      fedilink
      English
      arrow-up
      7
      ·
      edit-2
      1 day ago

      Doesnt help that there is a group of people who go ‘using the poor like biofuel food what a good idea’.

      E: Really influential movie btw. ;)

  • BlueMonday1984@awful.systemsOP
    link
    fedilink
    English
    arrow-up
    4
    ·
    1 day ago

    New piece from Gary Marcus: AI may have just influenced Argentina’s election

    He’s not 100% certain that the AI deepfake a reader sent him ultimately influenced the election results, but the mere possibility that AI screwed someone out of getting elected is gonna be a major topic in Argentine politics for a good while, and I expect AI’s effects on democracy will come under pretty heavy scrutiny as a result.

  • swlabr@awful.systems
    link
    fedilink
    English
    arrow-up
    7
    ·
    2 days ago

    NASB: A question I asked myself in the shower: “Is there some kind of evolving, sourced document containing all the reasons why LLMs should be turned off?” Then I remembered wikis exist. Wikipedia doesn’t have a dedicated “criticisms of LLMs” page afaict, or even a “Criticisms” section on the LLM page. RationalWiki has a page on LLMs that is almost exclusively criticisms, which is great, but the tone is a few notches too casual and sneery for universal use.