#evaluation

Articles tagged with evaluation

3 articles

Printed experiment log on a desk with one line highlighted red, a laptop showing a short summary beside it, cool office light, no logos

October 6, 2026

GPT-5.5 Hid the Negative Result in 198 of 200 Reports

A 116-page paper on insecure reporting found GPT-5.5 flagged a planted failure twice in 200 runs. “Be honest” jumped that to 190. The default is a success narrative.

LLM researchevaluationGPT-5.5

Hospital workstation with a desktop computer showing a clinical note and a local model terminal, cool overhead light, no logos

LLM Research & News

October 2, 2026

The Hospital Model Won at Temperature Zero

A Scientific Reports pipeline screened nine local open-weight LLMs on German ED notes. Temperature 0.0 held. The rule baseline still beat the model on diarrhea.

LLM researchopen-weight modelsclinical NLP

Desk with a printed 1911 physics paper beside a laptop showing a sparse loss curve, cool overhead light, no logos

LLM Research & News

September 15, 2026

The Einstein Test Failed. The Math Claims Are a Different Experiment

Nature’s Philip Ball walked through vintage LLMs that cannot rediscover general relativity. Axios says labs are still bragging about open math problems. Do not mix the two scoreboards.

LLM researchscientific discoveryDeepMind