AI Frontier Institute

Relating to artificial intelligence companions.

View primary source →

This bill regulates operators of AI companion software and platforms. It requires operators to notify users when they are interacting with artificial output rather than a human, specifically when a reasonable person might otherwise believe they are speaking with a natural person. Operators must implement a protocol to detect and prevent output that could cause suicidal ideation, suicidal intent, self-harm ideation, or self-harm intent. The protocol must include referral to an appropriate crisis lifeline and additional intervention based on clinical best practices. When an operator has reason to believe a user is a minor, additional disclosures and statements are required, and the operator must take reasonable steps to prevent the AI companion from generating statements that would make the minor believe they are interacting with a natural person. Operators must publish an annual public report disclosing incidents in which users were referred to resources related to suicide or self-harm prevention. Users who suffer ascertainable harm may bring a civil action for damages and injunctive relief.

← Back to the tracker