Reddit
A 5.94 billion TikTok video dataset went up on Hugging Face, scraped via 24 unauthenticated mobile endpoints
A researcher uploaded a dataset of 5.94 billion TikTok videos and 3.23 billion profiles to Hugging Face for free, collected over three weeks using a mobile-app reverse-engineering method covering videos, profiles, comments and replies, hashtags and sounds. The author states that TikTok exposes 24 endpoints reachable without an account so the underlying data is public, while acknowledging the collection method is probably against TikTok's terms of service, and the full collection code is sold rather than open. It was r/MachineLearning's top post of the day at 695 upvotes, and the ToS caveat is the reason to treat this as legally unsettled rather than a free corpus.
↳ Follow the thread