Tiktok curated video sharing

[freezefantasy]

This thread is now where I'll share my curated collection of Tiktok videos as I have developed a programmatic way to search for, download and organise Tiktok videos in bulk (not fully automated; just a lot more efficient at identifying and culling duplicates). The real time consumer is screening them to filter out duds/not so good ones.

Video filenames are now standardised to just be the video ID. You can verify it is the same by popping the ID into a tiktok URL in your browser (the user name doesn't need to match surprisingly)

I'll take a page from Japan and use a ID naming system to identify which trend, and which video subset each zip file contains.

File name convention: FF-[Trend ID]-[Video Set No].zip (each zip archive has 100 videos)

The trends I am curating from Tiktok at the moment are:

• FM - Frozen Moments/Mid-stride trend related (This one: https://www.tiktok.com/music/original-s ... 2085708590)

Ones I have finished/stopped curating further:

• MC - Mannequin Challenge related

• RC - Robot Challenge related

• CYC - Choose Your Character Trend related

All the curation set links shared to date:

FF-FM-01: https://filetransfer.io/data-package/IJuINGcb#link
FF-FM-02: https://filetransfer.io/data-package/zVLNGjqb#link
FF-FM-03: https://filetransfer.io/data-package/atCe2nDA#link
FF-FM-04: https://filetransfer.io/data-package/VGReBlYV#link
FF-FM-05: https://filetransfer.io/data-package/43rUIOc1#link
FF-FM-06: https://filetransfer.io/data-package/fr16J6ep#link
FF-FM-07: https://filetransfer.io/data-package/RwQKzs3o#link
FF-FM-08: https://filetransfer.io/data-package/WFYM4WfK#link
FF-FM-09: https://filetransfer.io/data-package/n4LNDZ5c#link
FF-FM-10 https://filetransfer.io/data-package/OU7617J8#link
FF-FM-11: https://filetransfer.io/data-package/4eHMla73#link
FF-FM-12: https://filetransfer.io/data-package/X160usPi#link
FF-FM-13: https://filetransfer.io/data-package/k42D9wBV#link
FF-FM-14: https://filetransfer.io/data-package/5PsbSmTB#link
FF-FM-15: https://filetransfer.io/data-package/95kBGC2I#link
FF-FM-16: https://filetransfer.io/data-package/vfbTa23B#link
FF-FM-17: https://filetransfer.io/data-package/ZmG3n1b6#link
FF-FM-18: https://filetransfer.io/data-package/1wuUQ4jf#link
FF-FM-19: https://filetransfer.io/data-package/Aj980I2j#link
FF-FM-20: https://filetransfer.io/data-package/2VPGHsec#link

FF-MC-01: https://filetransfer.io/data-package/M87Umwqu#link
FF-MC-02: https://filetransfer.io/data-package/NNV9QbnO#link

FF-RC-01: https://filetransfer.io/data-package/QIsHZ1QB#link

FF-CYC-01: https://filetransfer.io/data-package/1PpGQkGg#link
FF-CYC-02: https://filetransfer.io/data-package/Q9LkvOoW#link


No set schedule on when I will upload another video set, so just enjoy as they show up!

[Jay]

Big thanks for this, quite a few in your collection I missed.

[mannequinmetallic]

You're the GOAT!

[zapped13]

...Definitely the GOAT and thank you!

[lvman]

Whoa. Well done! Thank you very much!

[freezefantasy]

Another 3 sets of 100 curated vids uploaded now (some new, some overlap with the original 650 I shared).

FF-FM-03: https://filetransfer.io/data-package/atCe2nDA#link
FF-FM-04: https://filetransfer.io/data-package/VGReBlYV#link
FF-FM-05: https://filetransfer.io/data-package/43rUIOc1#link

I do note that even though I was able to de-duplicate the video IDs themselves across my collection, I can't guarantee some of the 'new posts' aren't just users re-posting other user's more popular posts. Can't mentally cross reference every video I've viewed when we're in the thousands (soon 10s of thousands)... I do my best

[freezefantasy]

Here's another 300 from the current trend!

FF-FM-06: https://filetransfer.io/data-package/fr16J6ep#link
FF-FM-07: https://filetransfer.io/data-package/RwQKzs3o#link
FF-FM-08: https://filetransfer.io/data-package/WFYM4WfK#link

FYI you can only ever scroll for up to 5000 results for a given sound-based search even if there are 100k or 200k videos in the trend, and they appear to rotate about 10% of what is included after each daily reset. So it might be impossible to ever see all the videos with the current API...

[Stuckfast2000]

Any other celebrity versions?

[freezefantasy]

Can't say as I'm not really looking at who these people are in each video, other than making sure they're not kids or exploited people.

Having said that, I haven't recognised any other famous faces so far in the ones I've curated. ScarJo is the only one so far. Maybe there were some male celebs involved but I instant filter those.

There are plenty in the mannequin challenge videos though. I'll probably upload a set of those once I've had time to sift through the tiktok ones.

[Jay]

Thank you for sharing these!

[freezefantasy]

Here's another 100 from the current trend

FF-FM-09: https://filetransfer.io/data-package/n4LNDZ5c#link

Also, I've uploaded a bunch from Mannequin Challenge that's on Tiktok. No idea how much it overlaps with what was shared already in other thread but since those are mostly Youtube/Instagram there might be something new amongst these ones.

FF-MC-01: https://filetransfer.io/data-package/M87Umwqu#link
FF-MC-02: https://filetransfer.io/data-package/NNV9QbnO#link

[freezefantasy]

More from current freeze trend:

FF-FM-10 https://filetransfer.io/data-package/OU7617J8#link


Robot Challenge curated collection:

FF-RC-01: https://filetransfer.io/data-package/QIsHZ1QB#link


Choose your (quarantine) character challenge:

FF-CYC-01: https://filetransfer.io/data-package/1PpGQkGg#link

[freezefantasy]

Last curated set for old trends. The yield is low and many of them are 'meta' videos that are satirising rather than playing along with the trend.

FF-CYC-02: https://filetransfer.io/data-package/Q9LkvOoW#link


Going to focus on just the current trend now:

FF-FM-11: https://filetransfer.io/data-package/4eHMla73#link

[freezefantasy]

Two more sets of 100 uploaded.

FF-FM-12: https://filetransfer.io/data-package/X160usPi#link
FF-FM-13: https://filetransfer.io/data-package/k42D9wBV#link

[freezefantasy]

The challenge still going strong but near the end of what my system can download.

FF-FM-14: https://filetransfer.io/data-package/5PsbSmTB#link
FF-FM-15: https://filetransfer.io/data-package/95kBGC2I#link

[freezefantasy]

Another few batches. Next upload will probably be the last for this current trend.

FF-FM-16: https://filetransfer.io/data-package/vfbTa23B#link
FF-FM-17: https://filetransfer.io/data-package/ZmG3n1b6#link
FF-FM-18: https://filetransfer.io/data-package/1wuUQ4jf#link

[freezefantasy]

Last batch for this trend.

FF-FM-19: https://filetransfer.io/data-package/Aj980I2j#link
FF-FM-20: https://filetransfer.io/data-package/2VPGHsec#link

Tiktok might be blocking my method of download now so if there's another trend coming up on there I'll have to figure out how to bulk scrape again.

[mannequinmetallic]

Thanks for putting in all the effort to do this!

[readinghypnotist]

Looks like most of them have expired.