"Performs its own peer review."

[aakl@infosec.exchange]

"Performs its own peer review." ????????????????????

"We present The AI Scientist, which creates research ideas, writes code, runs experiments, plots and analyses data, writes the entire scientific manuscript, and performs its own peer review."

Scientific American: An AI-authored paper just passed peer review. The scientific community isn’t ready https://www.scientificamerican.com/article/ai-wrote-a-scientific-paper-that-passed-peer-review/

The study was posted two days ago.

Nature: Towards end-to-end automation of AI research https://www.nature.com/articles/s41586-026-10265-5 @nature #science

[jrdepriest@infosec.exchange]

@AAKL @nature

This is the goal right here:

There was one metric, though, where the AI Scientist did outperform human researchers by a huge margin: it produced a formally passable paper on machine learning within 15 hours at a cost Clune estimated to be around $140. Compare that with the capability of a graduate student, who might take a full semester to write their first accepted workshop paper, according to Schneider.

Devalue the human and reduce the novel work of actually thinking and being creative to the only thing MBAs understand: time and money.

The problem? A graduate student working on their first paper is learning and will become a more effective scientist and perhaps a productive member of society. A genAI regurgitator will always be an unthinking, power hungry black hole. It will not get "smarter". It will never not confabulate because it's all confabulation that just happens to sometimes match reality.

[aakl@infosec.exchange]

@jrdepriest @nature That's a fine catch. Should we write an obit for scientific research because this ain't it?

[jrdepriest@infosec.exchange]

@AAKL @nature

I don't know.

But this?

“We’re not going to be able to remove the power to generate AI scientific papers,” says Aaron Schein, a data scientist at the University of Chicago and one of the ICBINB workshop organizers. “This technology is only going to get better.* I don’t think there’s anything to do about that.”

(Emphasis mine)

Is a delusion pushed by tech bros trying to keep the bubble from popping.

[aakl@infosec.exchange]

@jrdepriest @nature "I don't think there's anything to do about that?"

You. Will. Be. Assimilated. Resistance. Is. Futile.

He should be fired.

[research_ftw@sciences.social]

@AAKL @nature it's easy to pass peer review if you are allowed to mark your own work!