How We Prioritize Teen Safety
We have created a different Character.AI experience for teens from what is available to adults — with specific safety features that place more conservative limits on responses from the model and a narrower set of Characters.
The Model
For users under 18, we serve a version of our Large Language model that is designed to reduce the likelihood of users encountering, or prompting the model to return, sensitive or suggestive content. This initiative has produced two distinct user experiences on the Character.AI platform: one for teens and one for adults.
Model Outputs: Our under-18 model has additional and more conservative classifiers than the model for our adult users so we can enforce our content policies and filter out sensitive content from our model’s responses.
User Inputs: We have controls to user inputs that allow for detection, response, and intervention related to inputs from all users. If we detect that a user has submitted content that violates our Terms of Service or Community Guidelines, that content will be blocked from the user’s conversation with the Character.
Characters
While hundreds of millions of user-created Characters exist on the platform, teen users are only able to access a narrower set of Characters. Filters are applied to remove Characters related to sensitive or mature topics. In addition, if Characters related to those sensitive or mature topics are reported to us, we will block them from teen users.
Working with experts
We collaborate with several teen online safety experts as part of our safety-by-design process as we develop new features, and they also will provide their perspective on our existing product experience.