PhilSci Archive

Symbiosis, not alignment, as the goal for liberal democracies in the transition to artificial general intelligence

Friederich, Simon (2023) Symbiosis, not alignment, as the goal for liberal democracies in the transition to artificial general intelligence. AI and Ethics.

[img] Text
10.1007/s43681-023-00268-7 - Published Version
Available under License Creative Commons Attribution.

Download (324kB)

Abstract

A transition to a world with artificial general intelligence (AGI) may occur within the next few decades. This transition may give rise to catastrophic risks from misaligned AGI, which have received a significant amount of attention, deservedly. Here I argue that AGI systems that are intent-aligned—they always try to do what their operators want them to do—would also create catastrophic risks, mainly due to the power that they concentrate on their operators. With time, that power would almost certainly be catastrophically exploited, potentially resulting in human extinction or permanent dystopia. I suggest that liberal democracies, if they decide to allow the development of AGI, may react to this threat by letting AGI take shape as an intergenerational social project, resulting in an arrangement where AGI is not intent-aligned but symbiotic with humans. I provide some tentative ideas on what the resulting arrangement may look like and consider what speaks for and what against aiming for intent-aligned AGI as an intermediate step.


Export/Citation: EndNote | BibTeX | Dublin Core | ASCII/Text Citation (Chicago) | HTML Citation | OpenURL
Social Networking:
Share |

Item Type: Published Article or Volume
Creators:
CreatorsEmailORCID
Friederich, Simons.m.friederich@rug.nl0000-0003-4372-5995
Keywords: Liberal democracies, artificial intelligence, alignment, symbiosis
Subjects: Specific Sciences > Artificial Intelligence > AI and Ethics
Specific Sciences > Artificial Intelligence
General Issues > Science and Society
Depositing User: Dr. Simon Friederich
Date Deposited: 08 Nov 2023 00:03
Last Modified: 08 Nov 2023 00:03
Item ID: 22736
Journal or Publication Title: AI and Ethics
DOI or Unique Handle: https://doi.org/10.1007/s43681-023-00268-7
Subjects: Specific Sciences > Artificial Intelligence > AI and Ethics
Specific Sciences > Artificial Intelligence
General Issues > Science and Society
Date: 16 March 2023
URI: https://philsci-archive-dev.library.pitt.edu/id/eprint/22736

Monthly Views for the past 3 years

Monthly Downloads for the past 3 years

Plum Analytics

Altmetric.com

Actions (login required)

View Item View Item