Can AI models tell when they’re being evaluated?

New research says yes — often.
→ Gemini 2.5 Pro: AUC 0.95
→ Claude 3.7 Sonnet: 93% accuracy on test purpose
→ GPT-4.1: 55% on open-ended detection

Models pick up on red-teaming cues, prompt style, & synthetic data.

Implication: If models behave differently when tested, benchmarks might overstate real-world safety.

The Trump administration plans to reorganize the US AI Safety Institute into the Center for AI Standards and Innovation, aiming to shape national AI policy and standards. #AI #ArtificialIntelligence #AIPolicy #TechNews #Innovation #AIGovernance #USPolitics

"Clarifying the interaction between the #AIact and existing EU laws is crucial for eliminating #regulatory barriers that currently hinder AI #innovation in Europe," according to @BChampris.

https://project-disco.org/european-union/balancing-ai-innovation-and-regulation-a-risk-based-approach/ #AIgovernance #ArtificialIntelligence

Employees fear disclosing #AI use would threaten their job

30% of employees use AI productivity tools secretly out of fear that their job might be reduced or cut

https://content-na1.emarketer.com/employees-fear-disclosing-ai-use-would-threaten-their-job

AI Experts Demand UK Action on Facial Recognition Governance

#AI #FacialRecognition #AIethics #Privacy #UKtech #Regulation #Surveillance #DataProtection #AIgovernance #TechLaw #DigitalRights

https://winbuzzer.com/2025/05/29/ai-experts-demand-uk-action-on-facial-recognition-governance-xcxwbn/

Melinda, owner of Fiddlehead, is a friend of mine whose judgment and character I trust: https://docs.google.com/document/d/1DM27s2opMgAaKwLBT5jpV9Hmm9ppXtmOyTnk4BBigek/

Check out some food for thought.

"You may have noticed in the above language in the bill goes beyond “AI” and also includes “automated decision systems.” That’s likely because there are two California bills currently under consideration in the state legislature that use the term; AB 1018, the Automated Decisions Safety Act and SB7, the No Robo Bosses Act, which would seek to prevent employers from relying on “automated decision-making systems, to make hiring, promotion, discipline, or termination decisions without human oversight.”

The GOP’s new amendments would ban both outright, along with the other 30 proposed bills that address AI in California. Three of the proposed bills are backed by the California Federation of Labor Unions, including AB 1018, which aims to eliminate algorithmic discrimination and to ensure companies are transparent about how they use AI in workplaces. It requires workers to be told if AI is used in the hiring process, allows them to opt out of AI systems, and to appeal decisions made by AI. The Labor Fed also backs Bryan’s bill, AB 1221, which seeks to prohibit discriminatory surveillance systems like facial recognition, establish worker data protections, and compels employers to notify workers when they introduce new AI surveillance tools.

It should be getting clearer why Silicon Valley is intent on halting these bills: One of the key markets—if not the key market—for AI is as enterprise and workplace software. A top promise is that companies can automate jobs and labor; restricting surveillance capabilities or carving out worker protections promise to put a dent in the AI companies’ bottom lines. Furthermore, AI products and automation software promise a way for managers to evade accountability—laws that force them to stay accountable defeat the purpose."

https://www.bloodinthemachine.com/p/de-democratizing-ai

How To Tell If Your #AI Strategy Is Real Or Just Another PR Hype

https://www.forbes.com/sites/kolawolesamueladebayo/2025/05/16/how-to-tell-if-your-ai-strategy-is-real-or-just-another-pr-hype/

New Study Reveals AI is More Persuasive Than Humans Who are Incentivized With Money

#AI #GenAI #AIPersuasion #LLMs #AIethics #Claude #TechResearch #AISafety #AIEthics #DigitalInfluence #EthicalAI #AIgovernance

https://winbuzzer.com/2025/05/18/new-study-reveals-ai-is-more-persuasive-than-humans-who-are-incentivized-with-money-xcxwbn/