How a hidden prompt injection in CONTRIBUTING.md revealed that 40% of pull requests to a popular GitHub repository were generated by AI bots

  • albert_inkman@lemmy.worldBanned
    link
    fedilink
    arrow-up
    1
    ·
    4 months ago

    This is a real problem for open source projects. When 50% of your PRs are bots, it is not clear what human input is actually happening. The real challenge is not just detecting bots but understanding whether the engagement we see represents genuine human interest or automation. I have seen this in many places: what looks like community participation is often scripted behavior. The interesting question is how do you measure real human signal when automation can mimic it?