AI experts disown Musk-backed campaign citing their research By Reuters
2023-04-01 05:25:06
more 
503

By Martin Coulter

LONDON (Reuters) - Four artificial intelligence experts have expressed concern after their work was cited in an open letter – co-signed by Elon Musk – demanding an urgent pause in research.

The letter, dated March 22 and with more than 1,800 signatures by Friday, called for a six-month circuit-breaker in the development of systems "more powerful" than Microsoft-backed OpenAI's new GPT-4, which can hold human-like conversation, compose songs and summarise lengthy documents.

Since GPT-4's predecessor ChatGPT was released last year, rival companies have rushed to launch similar products.

The open letter says AI systems with "human-competitive intelligence" pose profound risks to humanity, citing 12 pieces of research from experts including university academics as well as current and former employees of OpenAI, Google (NASDAQ:) and its subsidiary DeepMind.

Civil society groups in the U.S. and EU have since pressed lawmakers to rein in OpenAI's research. OpenAI did not immediately respond to requests for comment.

Critics have accused the Future of Life Institute (FLI), the organisation behind the letter which is primarily funded by the Musk Foundation, of prioritising imagined apocalyptic scenarios over more immediate concerns about AI, such as racist or sexist biases being programmed into the machines.

Among the research cited was "On the Dangers of Stochastic Parrots", a well-known paper co-authored by Margaret Mitchell, who previously oversaw ethical AI research at Google.

Mitchell, now chief ethical scientist at AI firm Hugging Face, criticised the letter, telling Reuters it was unclear what counted as "more powerful than GPT4".

"By treating a lot of questionable ideas as a given, the letter asserts a set of priorities and a narrative on AI that benefits the supporters of FLI," she said. "Ignoring active harms right now is a privilege that some of us don't have."

Her co-authors Timnit Gebru and Emily M. Bender criticised the letter on Twitter, with the latter branding some of its claims "unhinged".

FLI president Max Tegmark told Reuters the campaign was not an attempt to hinder OpenAI’s corporate advantage.

"It's quite hilarious. I've seen people say, 'Elon Musk is trying to slow down the competition,'" he said, adding that Musk had no role in drafting the letter. "This is not about one company."

RISKS NOW

Shiri Dori-Hacohen, an assistant professor at the University of Connecticut, also took issue with her work being mentioned in the letter. She last year co-authored a research paper arguing the widespread use of AI already posed serious risks.

Her research argued the present-day use of AI systems could influence decision-making in relation to climate change, nuclear war, and other existential threats.

She told Reuters: "AI does not need to reach human-level intelligence to exacerbate those risks."

"There are non-existential risks that are really, really important, but don't receive the same kind of Hollywood-level attention."

Asked to comment on the criticism, FLI's Tegmark said both short-term and long-term risks of AI should be taken seriously.

"If we cite someone, it just means we claim they're endorsing that sentence. It doesn't mean they're endorsing the letter, or we endorse everything they think," he told Reuters.

Dan Hendrycks, director of the California-based Center for AI Safety, who was also cited in the letter, stood by its contents, telling Reuters it was sensible to consider black swan events - those which appear unlikely, but would have devastating consequences.

The open letter also warned that generative AI tools could be used to flood the internet with "propaganda and untruth".

Dori-Hacohen said it was "pretty rich" for Musk to have signed it, citing a reported rise in misinformation on Twitter following his acquisition of the platform, documented by civil society group Common Cause and others.

Twitter will soon launch a new fee structure for access to its research data, potentially hindering research on the subject.

"That has directly impacted my lab's work, and that done by others studying mis- and disinformation," Dori-Hacohen said. "We're operating with one hand tied behind our back."

Musk and Twitter did not immediately respond to requests for comment.

Statement:
The content of this article does not represent the views of fxgecko website. The content is for reference only and does not constitute investment suggestions. Investment is risky, so you should be careful in your choice! If it involves content, copyright and other issues, please contact us and we will make adjustments at the first time!

Related News

您正在访问的是FxGecko网站。 FxGecko互联网及其移动端产品是中国香港特别行政区成立的Hitorank Co.,LIMITED旗下运营和管理的一款面向全球发行的企业资讯査询工具。

您的IP为 中国大陆地区,抱歉的通知您,不能为您提供查询服务,还请谅解。请遵守当地地法律。