
This drives me mad -- I've had AI check things a bit now, and very often it will want to add a heap of details to stretch out something that the reader already understands, and then cling to that part as the main thing to focus on
Human reviewers pull 8.4% of their criticisms from a paper's appendix. Frontier LLM reviewers: 62%. A new study had GPT-6 and Claude 5.5 models review ICLR 2027 submissions, then mapped each weakness to the section it came from. The AI critiques keep going past page 30 of the appendix. They skew toward detail audits: more seeds, significance tests, confidence intervals. Rarely the core idea. Same pattern via API, web chat or coding agent, which points at the models, not the interface. arxiv.org/abs/2611.17811 #PeerReview #LLMs #AcademicTwitter

























