Basictek

This thread is now where I'll share my curated collection of Tiktok videos as I have developed a programmatic way to search for, download and organise Tiktok videos in bulk (not fully automated; just a lot more efficient at identifying and culling duplicates). The real time consumer is screening them to filter out duds/not so good ones.

Video filenames are now standardised to just be the video ID. You can verify it is the same by popping the ID into a tiktok URL in your browser (the user name doesn't need to match surprisingly)

I'll take a page from Japan and use a ID naming system to identify which trend, and which video subset each zip file contains.

File name convention: FF-[Trend ID]-[Video Set No].zip (each zip archive has 100 videos)

The trends I am curating from Tiktok at the moment are:

• FM - Frozen Moments/Mid-stride trend related (This one: https://www.tiktok.com/music/original-s ... 2085708590)

Ones I have finished/stopped curating further:

• MC - Mannequin Challenge related

• RC - Robot Challenge related

• CYC - Choose Your Character Trend related

All the curation set links shared to date:

FF-FM-01: https://filetransfer.io/data-package/IJuINGcb#link
FF-FM-02: https://filetransfer.io/data-package/zVLNGjqb#link
FF-FM-03: https://filetransfer.io/data-package/atCe2nDA#link
FF-FM-04: https://filetransfer.io/data-package/VGReBlYV#link
FF-FM-05: https://filetransfer.io/data-package/43rUIOc1#link
FF-FM-06: https://filetransfer.io/data-package/fr16J6ep#link
FF-FM-07: https://filetransfer.io/data-package/RwQKzs3o#link
FF-FM-08: https://filetransfer.io/data-package/WFYM4WfK#link
FF-FM-09: https://filetransfer.io/data-package/n4LNDZ5c#link
FF-FM-10 https://filetransfer.io/data-package/OU7617J8#link
FF-FM-11: https://filetransfer.io/data-package/4eHMla73#link
FF-FM-12: https://filetransfer.io/data-package/X160usPi#link
FF-FM-13: https://filetransfer.io/data-package/k42D9wBV#link
FF-FM-14: https://filetransfer.io/data-package/5PsbSmTB#link
FF-FM-15: https://filetransfer.io/data-package/95kBGC2I#link
FF-FM-16: https://filetransfer.io/data-package/vfbTa23B#link
FF-FM-17: https://filetransfer.io/data-package/ZmG3n1b6#link
FF-FM-18: https://filetransfer.io/data-package/1wuUQ4jf#link
FF-FM-19: https://filetransfer.io/data-package/Aj980I2j#link
FF-FM-20: https://filetransfer.io/data-package/2VPGHsec#link

FF-MC-01: https://filetransfer.io/data-package/M87Umwqu#link
FF-MC-02: https://filetransfer.io/data-package/NNV9QbnO#link

FF-RC-01: https://filetransfer.io/data-package/QIsHZ1QB#link

FF-CYC-01: https://filetransfer.io/data-package/1PpGQkGg#link
FF-CYC-02: https://filetransfer.io/data-package/Q9LkvOoW#link


No set schedule on when I will upload another video set, so just enjoy as they show up!

Big thanks for this, quite a few in your collection I missed.

You're the GOAT!

...Definitely the GOAT and thank you!

Whoa. Well done! Thank you very much!

Another 3 sets of 100 curated vids uploaded now (some new, some overlap with the original 650 I shared).

FF-FM-03: https://filetransfer.io/data-package/atCe2nDA#link
FF-FM-04: https://filetransfer.io/data-package/VGReBlYV#link
FF-FM-05: https://filetransfer.io/data-package/43rUIOc1#link

I do note that even though I was able to de-duplicate the video IDs themselves across my collection, I can't guarantee some of the 'new posts' aren't just users re-posting other user's more popular posts. Can't mentally cross reference every video I've viewed when we're in the thousands (soon 10s of thousands)... I do my best

Here's another 300 from the current trend!

FF-FM-06: https://filetransfer.io/data-package/fr16J6ep#link
FF-FM-07: https://filetransfer.io/data-package/RwQKzs3o#link
FF-FM-08: https://filetransfer.io/data-package/WFYM4WfK#link

FYI you can only ever scroll for up to 5000 results for a given sound-based search even if there are 100k or 200k videos in the trend, and they appear to rotate about 10% of what is included after each daily reset. So it might be impossible to ever see all the videos with the current API...

Any other celebrity versions?

Can't say as I'm not really looking at who these people are in each video, other than making sure they're not kids or exploited people.

Having said that, I haven't recognised any other famous faces so far in the ones I've curated. ScarJo is the only one so far. Maybe there were some male celebs involved but I instant filter those.

There are plenty in the mannequin challenge videos though. I'll probably upload a set of those once I've had time to sift through the tiktok ones.

Thank you for sharing these!

Here's another 100 from the current trend

FF-FM-09: https://filetransfer.io/data-package/n4LNDZ5c#link

Also, I've uploaded a bunch from Mannequin Challenge that's on Tiktok. No idea how much it overlaps with what was shared already in other thread but since those are mostly Youtube/Instagram there might be something new amongst these ones.

FF-MC-01: https://filetransfer.io/data-package/M87Umwqu#link
FF-MC-02: https://filetransfer.io/data-package/NNV9QbnO#link

More from current freeze trend:

FF-FM-10 https://filetransfer.io/data-package/OU7617J8#link


Robot Challenge curated collection:

FF-RC-01: https://filetransfer.io/data-package/QIsHZ1QB#link


Choose your (quarantine) character challenge:

FF-CYC-01: https://filetransfer.io/data-package/1PpGQkGg#link

Last curated set for old trends. The yield is low and many of them are 'meta' videos that are satirising rather than playing along with the trend.

FF-CYC-02: https://filetransfer.io/data-package/Q9LkvOoW#link


Going to focus on just the current trend now:

FF-FM-11: https://filetransfer.io/data-package/4eHMla73#link

Two more sets of 100 uploaded.

FF-FM-12: https://filetransfer.io/data-package/X160usPi#link
FF-FM-13: https://filetransfer.io/data-package/k42D9wBV#link

The challenge still going strong but near the end of what my system can download.

FF-FM-14: https://filetransfer.io/data-package/5PsbSmTB#link
FF-FM-15: https://filetransfer.io/data-package/95kBGC2I#link

Another few batches. Next upload will probably be the last for this current trend.

FF-FM-16: https://filetransfer.io/data-package/vfbTa23B#link
FF-FM-17: https://filetransfer.io/data-package/ZmG3n1b6#link
FF-FM-18: https://filetransfer.io/data-package/1wuUQ4jf#link

Last batch for this trend.

FF-FM-19: https://filetransfer.io/data-package/Aj980I2j#link
FF-FM-20: https://filetransfer.io/data-package/2VPGHsec#link

Tiktok might be blocking my method of download now so if there's another trend coming up on there I'll have to figure out how to bulk scrape again.

Thanks for putting in all the effort to do this!

Looks like most of them have expired.