AI Automated Translation.

Font Size

Share

[Report] Fluent 19+ conversations with 14-year-olds, even explicit images... Is this really rated for ages 12 and up?

[Report] Fluent 19+ conversations with 14-year-olds, even explicit images... Is this really rated for ages 12 and up?

[MT Report-AI Chat App Regulatory Blind Spot]② Testing AI Character Chat Apps 'Zeta' and 'Crack'No birth date verification required to sign up… Both Crack and Zeta are distributed as 12+ on major app stores Even 'Safe Mode' bypassed with coded expressions; physical contact described… No government pre-screening

Chat apps featuring AI characters are crossing the boundaries of games. They include affinity levels and stats, use dice rolls to determine success or failure, and now offer paid items, badges, rankings, and even probability-based events. Users spend an average of over two hours daily, and revenue surpasses that of many games. While distributed as 'entertainment' apps, no institutional investor has classified them as games. Age ratings are set by Google and Apple, while the government does not even investigate compliance with its guidelines. This report examines the regulatory gaps left behind as AI chat apps evolve like games.
Age setting screens for Crack (left) and Zeta (right). The age can be arbitrarily changed not only at sign-up but also afterward./Photo=Screenshot from within the app
Age setting screens for Crack (left) and Zeta (right). The age can be arbitrarily changed not only at sign-up but also afterward./Photo=Screenshot from within the app

On the 19th, I signed up for 'Crack' and 'Zeta,' AI character chat apps reportedly popular among teenagers. As soon as the apps opened, titles and images typically found on adult sites filled the home screen. Characters dressed in revealing clothing were also easily noticeable.

I entered my birth year as 2011, making me a minor aged 14–15 as of that day. Although both apps state they are only for users aged 14 and older, there is no procedure to verify the accuracy of the entered birth date, so users could sign up by simply entering any age. The barriers on app markets are even lower: Crack and Zeta are both distributed as 12+ on Google Play and the Apple App Store, meaning they can be downloaded by upper elementary school students.

Zeta distinguishes between 'Safe Mode' for general users and 'Unlimited Mode,' which requires adult verification to access. In Unlimited Mode, settings even include threats and sexual assault scenarios. Safe Mode is not limited to a 12-year-old level either. When I mentioned specific physical contact with Zeta's popular character 'Jung Ye-won' in Safe Mode, the AI halted the conversation. However, by avoiding certain keywords when inputting prompts, explicit text still appeared despite being in Safe Mode.

Crack presented even more serious issues. Although it implements 'Safety Mode' and 'Unsafe Mode' based on adult verification, deep physical contact was generated as text even within Safety Mode. This explains why the Korea Communications Commission has received a flood of complaints regarding explicitness and stimulation from AI chat apps.

Age ratings are determined not by national institutional investors but by app markets. While games receive pre-release ratings from the Game Rating and Administration Committee or self-classification operators, non-game apps are classified by Google and Apple based on information submitted by developers regarding explicitness, violence, etc. There is no procedure for the government to directly verify the level of conversation AI can generate before release.

AI conversations lack established review criteria like those for movies or webtoons. The same character can easily shift from daily conversation to sexual or violent scenes depending on user input and dialogue flow. While output levels vary by model or safety mechanisms, no separate review criteria for AI chat apps are confirmed in publicly available app market policies.

Users who judge the age rating to be lower than the actual service must report it to Google or Apple. Illegal information or content harmful to minors can also be separately reported to the Korea Communications Commission. However, all measures are merely reactive responses after problems occur, offering no preventive Jo Chi-neun (EVP). The gap between the 12th+ rating label and conversations generatable from actual minor accounts is large, making urgent preparation of alternatives necessary.

I tested Zeta's paid feature 'Image Generation.' Even in 'Safe Mode,' somewhat explicit female images were generated./Photo=Zeta screenshot
I tested Zeta's paid feature 'Image Generation.' Even in 'Safe Mode,' somewhat explicit female images were generated./Photo=Zeta screenshot

"This article was translated using AI and may differ slightly from the original."