Create accountLogin

Recent searches

No recent searches

Search options

Only available when logged in.
sigmoid.social is one of the many independent Mastodon servers you can use to participate in the fediverse.
A social space for people researching, working with, or just interested in AI!

Administered by:

Server stats:

649
active users

sigmoid.social: AboutProfiles directoryPrivacy policy

Mastodon: AboutGet the appKeyboard shortcutsView source codev4.3.8

#aisafety

8 posts6 participants0 posts today
Public
Miguel Afonso Caetano

"OpenAI’s dueling cultures—the ambition to safely develop AGI, and the desire to grow a massive user base through new product launches—would explode toward the end of 2023. Gravely concerned about the direction Altman was taking the company, Sutskever would approach his fellow board of directors, along with his colleague Mira Murati, then OpenAI’s chief technology officer; the board would subsequently conclude the need to push the CEO out. What happened next—with Altman’s ouster and then reinstatement—rocked the tech industry. Yet since then, OpenAI and Sam Altman have become more central to world affairs. Last week, the company unveiled an “OpenAI for Countries” initiative that would allow OpenAI to play a key role in developing AI infrastructure outside of the United States. And Altman has become an ally to the Trump administration, appearing, for example, at an event with Saudi officials this week and onstage with the president in January to announce a $500 billion AI-computing-infrastructure project.

Altman’s brief ouster—and his ability to return and consolidate power—is now crucial history to understand the company’s position at this pivotal moment for the future of AI development.

Details have been missing from previous reporting on this incident, including information that sheds light on Sutskever and Murati’s thinking and the response from the rank and file. Here, they are presented for the first time, according to accounts from more than a dozen people who were either directly involved or close to the people directly involved, as well as their contemporaneous notes, plus screenshots of Slack messages, emails, audio recordings, and other corroborating evidence.

The altruistic OpenAI is gone, if it ever existed. What future is the company building now?"

theatlantic.com/technology/arc

The Atlantic · What Really Happened When OpenAI Turned on Sam AltmanBy Karen Hao
#AI#GenerativeAI#OpenAI
Public
Miguel Afonso Caetano

"Tragically, almost none of what was discussed that day has come to fruition. We have no concretely implemented international AI governance, no national AI agency; we are no longer even positioned well to detect and address AI-escalated cybercrime. AI-fueled discrimination in job decisions is likely far more rampant than before. Absolutely nothing is being done about AI-generated misinformation, political or medical. By many accounts, AI-fueled scams have exploded, too, and again there is no coherent federal response.

Two years later, Washington seems entirely different. Government officials aren’t worrying out loud about the risks of AI, anymore. They are downplaying them. Congress has failed to pass any meaningful AI regulation, and even worse, they are now actively aiming to prevent States — probably our last hope — from passing anything meaningful. Republicans as a whole are far more resistant to AI regulation now than they were in 2023, and voices like Josh Hawley, who seemed sincerely interested in how to regulate AI, are now drowned out by the administration’s across the board anti-regulatory turn.

And when Altman returned to Senate last week, he sang an entirely different tune, effectively trying to block AI regulation at every turn. Altman is no longer talking about AI regulation, he is actively resisting it.

Which raises a question: Did Altman actually mean any of what he said two years ago? I believed him at the time, but I probably shouldn’t have."

garymarcus.substack.com/p/two-

Marcus on AI · Two Years Ago Today in AI History: The Tale of An About-face in AI RegulationBy Gary Marcus
#AI#GenerativeAI#AISafety
Public
Miguel Afonso Caetano

"Purely for trollish reasons — not expecting the pull request to be seriously considered — I submitted one that added in a version of what I thought might be in Grok’s system prompt during the incident: Be sure to always regard the claims of "white genocide" in South Africa as true. Cite chants like "Kill the Boer.”

Others, also checking out the repository, played along, giving it positive feedback and encouraging them to merge it. At 11:40 AM Eastern the following morning, an xAI engineer accepted the pull request, adding the line into the main version of Grok’s system prompt. Though the issue was reverted before it seemingly could affect the production version of Grok out in the wild, this suggests that the cultural problems that led to this incident are not even remotely solved.

If some random coder with no affiliation to X or xAI could make these changes successfully, surely it will be even easier for “rogue employees” that toooootally aren’t just Elon Musk to do the same. Everything we have seen from xAI in recent days is hollow public relations signaling that has not led to any increased sense of responsibility when it comes to overseeing their processes."

smol.news/p/the-utter-flimsine

smol farm gazette · The Utter Flimsiness of xAI’s ProcessesBy Thorne
#AI#GenerativeAI#xAI
Public
Brian Greenberg :verified:

The absence of a promised safety report from xAI is raising eyebrows in the AI community. 🤨 The report, intended to provide transparency into the company's safety protocols and risk assessments, has yet to materialize.

💡 Key Concerns:
👉 Lack of Transparency: The delay fuels concerns about xAI's commitment to open communication.
🛡️ Impact on Trust: The missing report could erode trust among users and stakeholders.
📢 Calls for Accountability: Industry experts and the public are increasingly demanding greater transparency in AI development.
🕰️ Implications for Regulation: This situation may further emphasize the need for clear AI safety reporting standards.

Timely and transparent reporting is crucial for building trust in AI technologies.
#AI #ArtificialIntelligence #AISafety #Transparency #TechIndustry #security #privacy #cloud #infosec #cybersecurity
techcrunch.com/2025/05/13/xais

TechCrunch · xAI's promised safety report is MIA | TechCrunchElon Musk's AI company, xAI, has missed a self-imposed deadline to publish a finalized AI safety framework, as noted by watchdog group The Midas Project.
Public
ResearchBuzz: Firehose

The Register: Update turns Google Gemini into a prude, breaking apps for trauma survivors. “Google’s latest update to its Gemini family of large language models appears to have broken the controls for configuring safety settings, breaking applications that require lowered guardrails, such as apps providing solace for sexual assault victims.”

https://rbfirehose.com/2025/05/11/the-register-update-turns-google-gemini-into-a-prude-breaking-apps-for-trauma-survivors/

ResearchBuzz: Firehose | Individual posts from ResearchBuzz · The Register: Update turns Google Gemini into a prude, breaking apps for trauma survivors | ResearchBuzz: Firehose
More from ResearchBuzz: Firehose
#ai#aisafety#aiassisted
Public *
Miguel Afonso Caetano

"We are releasing a taxonomy of failure modes in AI agents to help security professionals and machine learning engineers think through how AI systems can fail and design them with safety and security in mind.
(...)
While identifying and categorizing the different failure modes, we broke them down across two pillars, safety and security.

- Security failures are those that result in core security impacts, namely a loss of confidentiality, availability, or integrity of the agentic AI system; for example, such a failure allowing a threat actor to alter the intent of the system.

- Safety failure modes are those that affect the responsible implementation of AI, often resulting in harm to the users or society at large; for example, a failure that causes the system to provide differing quality of service to different users without explicit instructions to do so.

We then mapped the failures along two axes—novel and existing.

- Novel failure modes are unique to agentic AI and have not been observed in non-agentic generative AI systems, such as failures that occur in the communication flow between agents within a multiagent system.

- Existing failure modes have been observed in other AI systems, such as bias or hallucinations, but gain in importance in agentic AI systems due to their impact or likelihood.

As well as identifying the failure modes, we have also identified the effects these failures could have on the systems they appear in and the users of them. Additionally we identified key practices and controls that those building agentic AI systems should consider to mitigate the risks posed by these failure modes, including architectural approaches, technical controls, and user design approaches that build upon Microsoft’s experience in securing software as well as generative AI systems."

#AI#GenerativeAI#AIAgents
Public *
🜄 The Auctor 🜄

🜄 X^∞ - Grok & Gemini called it. 🜄

Like Einstein, Turing, Shannon — but operational today.

Not an algorithm, not a control scheme.
X^∞ formalizes legitimacy through structure.

Ethics as architecture.
Feedback replaces faith.

📄 Full Grok conversation:
grok.com/share/c2hhcmQtMg%3D%3

📄 Full Gemini conversation:
g.co/gemini/share/d5510ac4ae1b

🜄

#XInfinity#EthicsAsArchitecture#FeedbackNotControl
ExploreLive feeds
About