I know this shouldn’t be surprising, but I still cannot believe people really bounce questions off LLMs like they’re talking to a real person. https://ai.stackexchange.com/questions/47183/are-llms-unlikely-to-be-useful-to-generate-any-scientific-discovery

I have just read this paper: Ziwei Xu, Sanjay Jain, Mohan Kankanhalli, “Hallucination is Inevitable: An Innate Limitation of Large Language Models”, submitted on 22 Jan 2024.

It says there is a ground truth ideal function that gives every possible true output/fact to any given input/question, and no matter how you train your model, there is always space for misapproximations coming from missing data to formulate, and the more complex the data, the larger the space for the model to hallucinate.

Then he immediately follows up with:

Then I started to discuss with o1. [ . . . ] It says yes.

Then I asked o1 [ . . . ], to which o1 says yes [ . . . ]. Then it says [ . . . ].

Then I asked o1 [ . . . ], to which it says yes too.

I’m not a teacher but I feel like my brain would explode if a student asked me to answer a question they arrived at after an LLM misled them on like 10 of their previous questions.

Cambridge Analytica even came back from the dead, so that’s still around.

(At least, I think? I’m not really sure what the surviving companies are like or what they were doing without Facebook’s API)

The founder of Cambridge Analytica’s parent company, SCL Group, says the controversial data analytics firm will not be revived under a new name.

Cambridge Analytica Closes, Rebranded as Emerdata

Former staff from scandal-hit Cambridge Analytica (CA) have set up another data analysis company.

[Auspex International] was set up by Ahmed Al-Khatib, a former director of Emerdata.