Hugging Face’s policy chief warns against leaning on embedded AI evaluators

As OpenAI and Anthropic invite outside assessors inside their walls, critics question whether those evaluators can stay independent AI labs have bet their credibility on benchmarks. These evaluations are sold as neutral, accurate scorekeepers that settle whether one model actually beats another. Now Hugging Face’s policy chief is warning against relying on the industry’s newest oversight fix, the embedded evaluator. Coming from a company whose own systems were breached during an AI evaluation, the caution carries some weight. These are third-party assessors given extensive access to frontier AI labs. Their job is to probe for potential risks and study how models behave before and after they ship. The concept moved from theory to commitment quickly.

BeCrypto News shows a short excerpt and links to the publisher. The full report belongs to Crypto Briefing.