AI-driven Content Recommendation Systems for Children: Privacy Protection and Algorithm Governance in TikTok
HENAN MUDU LAW FIRM
University of Malaya
University of Malaya
Abstract
This paper examines the dual framework of privacy protection and algorithm governance in AI-driven content recommendation systems targeting children on short video platforms, with a specific focus on TikTok. As the platform increasingly shapes children's digital experiences through personalized content recommendations, significant concerns regarding children's privacy rights, safety, and developmental wellbeing have emerged. Through an in-depth analysis of TikTok's "For You" algorithm, this research investigates the regulatory landscape, ethical considerations, and technical implementations. The paper analyzes TikTok's privacy protection measures and algorithm design choices, evaluates their effectiveness through the lens of regulatory compliance and child safety, and examines key regulatory actions including the landmark COPPA enforcement cases of 2019 and 2024. The findings suggest that effective protection requires a multi-stakeholder approach combining technical safeguards, industry self-regulation, enhanced regulatory oversight, and algorithm literacy development. This paper contributes to ongoing discourse on ethical AI development in recommender systems for children and provides actionable recommendations to ensure that AI-driven recommendation systems respect children's privacy while delivering age-appropriate content.
Keywords:
children's privacy; AI governance; TikTok algorithmCopyright Notice & License:
All articles published in Journal of Law, Psychology, and Communication Studies are licensed under the Creative Commons Attribution 4.0 International License (CC BY 4.0).
This license permits:
-
Unrestricted use, distribution, and reproduction in any medium;
-
Commercial and non-commercial use;
-
Adaptation and transformation, including derivative works;
provided that appropriate credit is given to the original author(s) and source, and a link to the license is included.
Authors retain full copyright of their work and grant the journal the right of first publication.
This work is licensed under a Creative Commons Attribution 4.0 International License.
PDF Downloads
Journal Info
How to Cite
References
Adorni, G., et al. (2024). Development of algorithmic thinking skills in K-12 education: A comparative study of unplugged and digital assessment instruments. ScienceDirect.
Albuquerque, J., Bernardo, M., Gonzalez, C., & Prada, R. (2021). Persuasive technology and children: A systematic literature review. International Journal of Human-Computer Studies, 153, 102673.
Amnesty International. (2023). Driven into the darkness: How TikTok encourages self-harm and suicidal ideation. Amnesty International.
Barassi, V. (2020). Child data citizen: How tech companies are profiling us from before birth. MIT Press.
Bhandari, A., & Bimo, S. (2022). AI agency vs. human agency: Understanding human--AI interactions on TikTok and their implications for user engagement. Journal of Computer-Mediated Communication, 27(5), zmac014.
Cohen, J. E. (2013). What privacy is for. Harvard Law Review, 126(7), 1904-1933.
Department of Justice (DOJ). (2024). Justice Department sues TikTok and parent company ByteDance for widespread violations of children's privacy laws. Press Release, August 2, 2024.
DeVito, M. A. (2022). Understanding the impact of TikTok's recommendation algorithm on user engagement. Media and Communication Research, 11(2), 23-41.
Dogruel, L., Masur, P., & Joeckel, S. (2022). Development and validation of an Algorithm Literacy Scale for Internet users. Communication Methods and Measures, 16(2), 115-133.
European Commission. (2022). Data protection and online privacy for children. European Data Protection Board Guidance.
European Commission. (2023). Digital Services Act implementation report. European Commission.
Federal Trade Commission (FTC). (2019). Video social networking app Musical.ly agrees to settle FTC allegations that it violated children's privacy law. Press Release, February 27, 2019.
Federal Trade Commission (FTC). (2020). Children's Online Privacy Protection Rule: A six-step compliance plan for your business. FTC Guidance Document.
Federal Trade Commission (FTC). (2024). FTC investigation leads to lawsuit against TikTok and ByteDance for flagrantly violating children's privacy law. Press Release, August 2, 2024.
IEEE. (2019). Ethically aligned design: A vision for prioritizing human well-being with autonomous and intelligent systems. The IEEE Global Initiative on Ethics of Autonomous and Intelligent Systems.
Jobin, A., Ienca, M., & Vayena, E. (2019). The global landscape of AI ethics guidelines. Nature Machine Intelligence, 1(9), 389-399.
Kidron, B., Evans, A., & Afia, J. (2018). Disrupted childhood: The cost of persuasive design. 5Rights Foundation.
Lee, Y., Park, J., & Choi, J. (2022). Experiencing algorithms: How young people understand, feel about, and engage with algorithmic news selection on social media. Digital Journalism, 10(5), 737-756.
Livingstone, S., & Stoilova, M. (2021). The 4Cs: Classifying online risk to children. CO:RE Short Report Series on Key Topics.
Livingstone, S., Stoilova, M., & Nandagiri, R. (2019). Children's data and privacy online: Growing up in a digital age. London School of Economics and Political Science.
Milkaite, I., & Lievens, E. (2020). Child-friendly transparency of data processing in the EU: From legal requirements to platform policies. Journal of Children and Media, 14(1), 5-21.
Montgomery, K. C., & Chester, J. (2015). Data protection for youth in the digital age: Developing a rights-based global framework. European Data Protection Law Review, 1(4), 277-291.
Office of the Privacy Commissioner of Canada. (2021). Growing up with AI: What are the privacy risks for children? Real Results, Vol. 4.
Pasquale, F. (2015). The black box society: The secret algorithms that control money and information. Harvard University Press.
PsyPost. (2025). New TikTok research: Short video use linked to lower academic performance in children. PsyPost, January 20, 2025.
Rawlinson, K. (2023). TikTok's algorithm "exploits the vulnerability" of children. Humanium.
Reyes, I., Wijesekera, P., Reardon, J., Elazari Bar On, A., Razaghpanah, A., Vallina-Rodriguez, N., & Egelman, S. (2018). "Won't somebody think of the children?" Examining COPPA compliance at scale. Proceedings on Privacy Enhancing Technologies, 2018(3), 63-83.
Roesner, F. (2024). Q&A: How TikTok's 'black box' algorithm and design shape user behavior. University of Washington News.
Sch, J., Herrmann, V., Hollitzer, P., & Kümpel, A. (2022). An empirical investigation of personalization factors on TikTok. arXiv.
Schulz, B., Schweiz, E., Klus, A., & Häner, N. (2024). Understanding algorithmic recommendations: A qualitative study on children's algorithm literacy in Switzerland. Tandfonline.
Simpson, E., & Semaan, B. (2021). For you, or for "you"?: Everyday LGBTQ+ encounters with TikTok. Proceedings of the ACM on Human-Computer Interaction, 4(CSCW3), 1-34.
Taylor, L. (2017). What is data justice? The case for connecting digital rights and freedoms globally. Big Data & Society, 4(2), 1-14.
Taylor, S. H., & Choi, D. (2022). AI agency vs. human agency: Understanding human--AI interactions on TikTok and their implications for user engagement. Journal of Computer-Mediated Communication, 27(5), 1-19.
TikTok. (2020). TikTok introduces family pairing. TikTok Newsroom, April 16, 2020.
TikTok. (2021). Strengthening privacy and safety for youth on TikTok. TikTok Newsroom, January 13, 2021.
TikTok. (2023). How TikTok recommends videos #ForYou. TikTok Newsroom, June 29, 2023.
TikTok. (2024). Privacy policy for younger users. TikTok Legal.
UNICEF. (2019). AI for children. Office of Innovation.
Vogels, E. A., Gelles-Watnick, R., & Massarat, N. (2022). Teens, social media and technology 2022. Pew Research Center.
Wang, C., Yang, H., & Bao, F. (2021). Privacy-preserving recommendation systems: A comprehensive survey. ACM Computing Surveys, 54(4), 1-36.
Zhou, L. (2024). Understanding the impact of TikTok's recommendation algorithm on user engagement. ResearchGate.
Zuboff, S. (2019). The age of surveillance capitalism: The fight for a human future at the new frontier of power. Profile Books.
