Roblox processes 274 million daily avatar updates, and that’s just one type of user-generated content that we moderate for safety violations.1
Player reports are a crucial part of identifying violations early, and we want to make it easy for players to report anything they see that they believe is inappropriate or against our policies.
Because violations in dynamic, user-generated 3D content can be challenging to capture, we leverage ray casting, data model cloning, and an overhauled reporting UI to help players identify and report specific objects with the data and visual evidence necessary for us to take action.
At peak, the Roblox platform processes 274 million daily avatar updates.1 Reporting and reviewing abuse in this type of dynamic, user-generated 3D content is challenging because it doesn’t always leave the explicit trail that static content like a text log or a social media post does. In this blog post, we describe our approach to capturing the data and visual context necessary to act on player reports, from our initial ray casting approach for identifying abusive avatars, to our current system, which integrates with the Roblox data model so that players can precisely report any 3D game object.
Player reports are a crucial part of identifying potential policy violations early, and we recently updated our reporting flow to make it easier for players to immediately report or block anything that makes them feel uncomfortable or unsafe. Player reports now result in the automatic removal of over 19,000 policy-violating avatars per month and serve as an important early signal for detecting inappropriate games.2
You must be logged in to comment.
Log in