Coalition of Former OpenAI Employees Urges Intervention Amid Proposed Conversion
The Call to Action
A coalition of former OpenAI employees is appealing to the attorneys general of California and Delaware to intervene in the company’s plans to shift from a nonprofit model to a for-profit entity. Their concern centers on the potential implications if the AI technology developed by OpenAI surpasses human capabilities but loses accountability to its founding mission of preventing harm.
Page Hedley, a former policy and ethics adviser at OpenAI, expressed concerns in an interview, emphasizing the potential risks if control over the advanced AI technology falls into the wrong hands. Backed by three Nobel laureates and a group of experts, Hedley, along with nine ex-colleagues, addressed a letter to state attorneys Rob Bonta and Kathy Jennings. They urged the attorneys to safeguard OpenAI’s charitable purpose and put a halt on its proposed restructuring.
OpenAI’s Response
OpenAI has communicated that any structural changes would aim to maximize the public benefits derived from AI developments. The company plans to transform into a public benefit corporation, retaining a nonprofit arm, akin to other prominent AI labs like Anthropic and Elon Musk’s xAI. “This arrangement will ensure the philanthropic mission grows alongside the for-profit success,” stated the company representatives.
Concerns from Former Employees
The coalition’s letter marks the second appeal to state authorities this month. An earlier one came from labor leaders and nonprofits concerned about the safeguarding of OpenAI’s substantial charitable assets. While some coalition members back a lawsuit from Elon Musk, accusing OpenAI and CEO Sam Altman of deviating from initial principles, others remain skeptical of Musk, given his involvement with a competing AI company.
Notable Support
Signatories include Nobel-winning economists Oliver Hart and Joseph Stiglitz, alongside renowned AI pioneers and Nobel laureates in physics like Geoffrey Hinton and Stuart Russell. Hinton articulated his support for OpenAI’s mission and the current action to maintain the nonprofit’s directive without involving Musk.
Historical Conflicts and Recent Developments
OpenAI has been plagued with internal conflicts over its mission, influencing significant exits, including Musk in 2018 and Altman’s brief departure in 2023. Hedley, who had worked for OpenAI during 2017-2018, noted increasing concerns about product safety being compromised in a rush for business advantage. He highlighted that pressures to expedite decisions could escalate if OpenAI transitions to a for-profit model without checks.
Technical Safeguards at Risk
Anish Tondwalkar, a former software engineer at OpenAI, referenced the company’s nonprofit charter, which includes a “stop-and-assist clause” ensuring mutual accountability if other organizations approach superior AI achievements. Tondwalkar cautioned that for-profit status could erode these safeguards virtually overnight.
Dire Warnings from Former Engineers
Nisan Stiennon, an AI engineer who served at OpenAI from 2018 to 2020, starkly warned about the existential risks if control over AI technology reaches those who prioritize profit over humanity. “The nonprofit’s mandate to serve humanity must not be relinquished,” he asserted.
For updates and insights on technology trends, subscribe or follow aitechtrend.com.
Note: This article is inspired by content from AJC News. It has been rephrased for originality. Images are credited to the original source.