← Back to feed

Evals and red teaming: industry professionalizes measurement

Labs and governments expanded batteries testing dangerous capabilities, jailbreaks, and reliability before deploy.

Evals and red teaming: industry professionalizes measurement

Frontier labs published system cards and red-team results; NIST, UK AISI, and other bodies pushed shared test suites.

They measured bio-risk, cyber, persuasion, sandbagging, and robustness. Universal standards are still missing, but cultural norms shifted: no evals, no serious release.

The open tension is transparency versus not spreading exploitable detail—a mirror of classic infosec dilemmas.