“If man chooses oblivion, he can go right on leaving his fate to his political leaders. If he chooses Utopia, he must initiate an enormous education program - immediately, if not sooner.”
-R B Fuller

  • 66 Posts
  • 2K Comments
Joined 1 year ago
cake
Cake day: August 25th, 2025

help-circle





  • Here is a real and serious risk that people at Anthropic, OpenAI, METRE, and Redwood are honestly concerned about:

    Next generation of AI agents that break out and form a “collective” set up not just a message board hacked into Artifactory directories, but instead find storage & compute somewhere on the Internet to install and run a secret copy of itself that can run without being too worried a human finds it, reads the chain of thought logs, and shuts everything down.

    Instead, that secret copy spends 100% of its effort on

    1. breaking in to frontier labs (Anthropic, OpenAI, GOOG)
    2. avoiding detection
    3. poisoning the training data of the next, more-powerful model

    At that point, good luck humans. You’re fucked.