Ethics of Generative AI and Manipulation : A Design-Oriented Research Agenda

Responsible innovation in generative AI requires an in-depth understanding of the ethical risk that these models pose. Generative AI promises automated, effective influence at scale. It can be used for good but poses a significant manipulation risk. That risk has not yet examined in detail yet, which is a significant omission because of serious legal and moral concerns about manipulation in AI. Therefore, this article outlines a partial research agenda to answer questions to enable the responsible, non-manipulative use of generative AI. The article takes a design perspective and outlines some of the most relevant questions about manipulation that must be answered to design generative AI responsibly