How though, either he got cold feet in the middle of selling out to the tech-fash or he was honestly that incredibly oblivious (see also: agreeing to do tim pool’s show), neither strikes me as especially mitigating.

Today in alignment news: Sam Bowman of anthropic tweeted, then deleted, that the new Claude model (unintentionally, kind of) offers whistleblowing as a feature, i.e. it might call the cops on you if it gets worried about how you are prompting it.

Sam Bowman saying he deleted the tweets so they wouldn’t be quoted ‘out of context’: https://xcancel.com/sleepinyourhat/status/1925626079043104830

Molly White with the out of context tweets: https://bsky.app/profile/molly.wiki/post/3lpryu7yd2s2m

Net number of studies reporting positive or negative effects (excluding wages)

excluding wages! (and probably also benefits, retirement, a cap on working hours per day etc)

Is that whole thing in the comments about unions bad because monopolies bad and unions are just monopolies of labor the latest in bootlicking theory? Hadn’t really heard this take before.

Microsoft’s Visual Studio says it’s going to incorporate coding ‘agents’ as soon as maybe the next minor version. I can’t really see them buying up car factories or beating pokemon, but agent- as an AI marketing term is definitely a part of the current hype cycle.

That IQ after a certain level somehow turns into mana points is one of the most basic rationalist assumptions about how intelligence works.

Nice to know even pre-LLM AI techniques remain eminently fuckupable if you just put your mind to it.

Didn’t mean to imply otherwise, just wanted to point out that the call is coming from inside the house.

He claims he was explaining what others believe not what he believes

Others as in specifically his co-writer for AI2027 Daniel Kokotlajo, the actual ex-OpenAI researcher.

I’m pretty annoyed at having this clip spammed to several different subreddits, with the most inflammatory possible title, out of context, where the context is me saying “I disagree that this is a likely timescale but I’m going to try to explain Daniel’s position” immediately before. The reason I feel able to explain Daniel’s position is that I argued with him about it for ~2 hours until I finally had to admit it wasn’t completely insane and I couldn’t find further holes in it.

Pay no attention to this thing we just spent two hours exhaustively discussing, it’s not really relevant context.

Also the title is inflammatory only in the context of already knowing him for a ridiculous AI doomer, otherwise it’s fine. Inflammatory would be calling the video economically illiterate bald person thinks evaluations force-buy car factories, China having biomedicine research is like Elon running SpaceX .

(Are there multiple ai Nobel prize winners who are ai doomers?)

There’s Geoffrey Hinton I guess, even if his 2024 Nobel in (somehow) Physics seemed like a transparent attempt at trend chasing on behalf of the Nobel committee.

Also, add obvious and overdetermined to the pile of siskindisms next to very non-provably not-correct.

Scoot makes the case that agi could have murderbot factories up and running in a year if it wanted to https://old.reddit.com/r/slatestarcodex/comments/1kp3qdh/how_openai_could_build_a_robot_army_in_a_year/

edit: Wrote it up

What is the analysis tool?

The analysis tool is a JavaScript REPL. You can use it just like you would use a REPL. But from here on out, we will call it the analysis tool.

When to use the analysis tool

Use the analysis tool for:

• Complex math problems that require a high level of accuracy and cannot easily be done with “mental math”
• To give you the idea, 4-digit multiplication is within your capabilities, 5-digit multiplication is borderline, and 6-digit multiplication would necessitate using the tool.

uh

You run CanadianGirlfriendGPT, got it.

If LLM hallucinations ever become a non-issue I doubt I’ll be needing to read a deeply nested buzzword laden lemmy post to first hear about it.

copilot assisted code

The article isn’t really about autocompleted code, nobody’s coming at you for telling the slop machine to convert a DTO to an html form using reactjs, it’s more about prominent CEO claims about their codebases being purely AI generated at rates up to 30% and how swengs might be obsolete by next tuesday after dinner.

Ask chatgpt to explain it to you.

Seriously, don’t generate an array unless explicitly asked for it. Please.

Peak prompt engineering right there.

To get a bit meta for a minute, you don’t really need to.

The first time a substantial contribution to a serious issue in an important FOSS project is made by an LLM with no conditionals, the pr people of the company that trained it are going to make absolutely sure everyone and their fairy godmother knows about it.

Until then it’s probably ok to treat claims that chatbots can handle a significant bulk of non-boilerplate coding tasks in enterprise projects by themselves the same as claims of haunted houses; you don’t really need to debunk every separate witness testimony, it’s self evident that a world where there is an afterlife that also freely intertwines with daily reality would be notably and extensively different to the one we are currently living in.

I think most people will ultimately associate chatbots with corporate overreach rather rank-and-file programmers. It’s not like decades of Microsoft shoving stuff down our collective throat made people think particularly less of programmers, or think about them at all.