Inside the artificial intelligence party at the end of the world

At $ 30 A million palaces float on a cliff overlooking the Golden Gate Bridge Bridge, a group of artificial intelligence researchers, philosophers and technicians who gathered to discuss the end of humanity.

On Sunday afternoon, which is called “worthy successor”, it revolves around a Provocative idea From the entrepreneur Daniel Vaglala: The “moral goal” of advanced artificial intelligence must be to create a form of strong intelligence and wisdom that “you prefer with pleasure (not humanity) to determine the course of life in the future itself.”

Faggella explained the topic clearly in his call. He wrote to me via X DMS: “This event is largely focused on post -human transition.” “Not on AGI who works forever as a tool for humanity.”

A party full of future fantasies can be described, as attendees discuss the end of humanity as a logistical problem instead of metaphorical, position. If you live in San Francisco and work in artificial intelligence, this is a typical day.

About 100 non -alcoholic cocktails were sponsored and entered the cheese panels near the windows from the ground to the ceiling facing the Pacific Ocean before gathering to hear three conversations about the future of intelligence. One of the attendees tied a shirt. Ray CorsellThe future that expects machines will exceed human intelligence in the coming years. Another wore a shirt he said, “Does this help us reach AGI safe?” It is accompanied by the face of expressive symbols.

Faggella Wire told that he threw this event because it was “the big laboratories, the people who know that AGI is likely to end humanity, and do not talk about it because the incentives do not allow it” and pointed to the early comments from technology leaders such as Elon Musk, Sam Altman, Dimis HassanThose who were “all were very frank about the possibility of killing all AGI.” Now that the incentives compete, he says: “They are all racing to adopt.” (To be fair, musk He still talks about the risks Associated with advanced artificial intelligence, although this did not prevent him from race forward).

It is LinkedIn, Faggeella splurge The list of stars guests, with artificial intelligence founders, researchers of all Western artificial intelligence laboratories, and “most important philosophical thinkers on AGI”.

The first speaker, Jinnivira DavisA writer based in New York, warned that human values ​​may be impossible to translate into artificial intelligence. She said that machines may never understand that they are conscious, and the attempt to arduous human preferences in future systems may be short -sighted. Instead, a sounding idea called “cosmic alignment”-the building of Amnesty International that could search for deeper and more comprehensive values ​​we have not yet discovered. Its slices often showed an apparently created image of the AI ​​Technical, as a group of people gathered on a herb overlooking a future city at a distance.

Automated conscious critics will say that large language models are simply randoma – a metaphor formulated by a group of researchers, some of whom worked in Google, who wrote In a famous paper LLMS does not actually understand the language and are only probabilities. But this debate was not part of the symposium, as the speakers took the idea that the excellent cancellation was coming and fast.