Visibility into AI Agents

  • Alan Chan*
  • , Carson Ezell
  • , Max Kaufmann
  • , Kevin Wei
  • , Lewis Hammond
  • , Herbie Bradley
  • , Emma Bluemke
  • , Nitarshan Rajkumar
  • , David Krueger
  • , Noam Kolt
  • , Lennart Heim
  • , Markus Anderljung
  • *Corresponding author for this work

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

38 Scopus citations

Abstract

Increased delegation of commercial, scientific, governmental, and personal activities to AI agents - systems capable of pursuing complex goals with limited supervision - may exacerbate existing societal risks and introduce new risks. Understanding and mitigating these risks involves critically evaluating existing governance structures, revising and adapting these structures where needed, and ensuring accountability of key stakeholders. Information about where, why, how, and by whom certain AI agents are used, which we refer to as visibility, is critical to these objectives. In this paper, we assess three categories of measures to increase visibility into AI agents: agent identifiers, real-time monitoring, and activity logging. For each, we outline potential implementations that vary in intrusiveness and informativeness. We analyze how the measures apply across a spectrum of centralized through decentralized deployment contexts, accounting for various actors in the supply chain including hardware and software service providers. Finally, we discuss the implications of our measures for privacy and concentration of power. Further work into understanding the measures and mitigating their negative impacts can help to build a foundation for the governance of AI agents.

Original languageEnglish
Title of host publication2024 ACM Conference on Fairness, Accountability, and Transparency, FAccT 2024
PublisherAssociation for Computing Machinery, Inc
Pages958-973
Number of pages16
ISBN (Electronic)9798400704505
DOIs
StatePublished - 3 Jun 2024
Externally publishedYes
Event2024 ACM Conference on Fairness, Accountability, and Transparency, FAccT 2024 - Rio de Janeiro, Brazil
Duration: 3 Jun 20246 Jun 2024

Publication series

Name2024 ACM Conference on Fairness, Accountability, and Transparency, FAccT 2024

Conference

Conference2024 ACM Conference on Fairness, Accountability, and Transparency, FAccT 2024
Country/TerritoryBrazil
CityRio de Janeiro
Period3/06/246/06/24

Bibliographical note

Publisher Copyright:
© 2024 Owner/Author.

Keywords

  • ai agents
  • ai deployment
  • ai monitoring
  • ai oversight
  • transparency
  • visibility

Fingerprint

Dive into the research topics of 'Visibility into AI Agents'. Together they form a unique fingerprint.

Cite this