My PhD (before 10+ years) was in video search and one of the proposed methods for video comparison was using the shot durations of the video. Notice that with <i>shots</i> I refer to cuts in the camera flow, IIRC hollywood movies have a such a shot cut every 4 seconds as an average (for example when two people talk the camera will move from one person to the other).<p>I remember that I used two techniques for extracting scene cuts:<p>* Difference in the brightness (Y) histogram of the YUV video between frames; when that difference is more than a threshold there's a scene cut<p>* Counting the number of Intra macroblocks per frame on an H.264 encoded video; if that number was more than a threshold then there's a scene cut
Can the link be changed to the home page of the docs instead of the CLI params one? <a href="https://pyscenedetect.readthedocs.io/en/latest/" rel="nofollow">https://pyscenedetect.readthedocs.io/en/latest/</a>
Author of PySceneDetect here: Thank you all for the thought-provoking discussions, and the attention you've given my side project. There are some specific cases where PySceneDetect achieves great accuracy (like fast cuts or fades), and some where it's currently not so good at (like sudden flashes or large obstructions). That being said I do want to track these things and come up with solutions to improve the robustness of the content detection algorithm over time.<p>I'm most open to any feedback or feature requests/ideas/suggestions; feel free to checkout the issue tracker on Github, or create a new entry:<p><a href="https://github.com/Breakthrough/PySceneDetect/issues" rel="nofollow">https://github.com/Breakthrough/PySceneDetect/issues</a><p>Some ideas being considered/researched for future releases:<p>- looking at changes to image histograms<p>- using edge detection to improve robustness<p>- camera flash / foreground object suppression<p>- automatic threshold detection using statistical methods (currently is just a heuristic)
So I can look forward to a "Next scene" shortcut in my video player of choice soon? (Without needing embedded "DVD" chapters) While also getting nice thumbnails for them?<p>Pornhub et al often show scene markers, but I have assumed they're manual or extracted in the same way as DVD chapters.
Tested it out on an anime episode to see if it could detect accurately when the opening and closing credits play. It seemed to be able to detect the ending of both even with a high threshold, but it didn't really detect the start. And with a low threshold, it gave me like 350 chapters for a 22 minute video, which seemed a bit excessive.
Little off topic..<p>I'm trying to help a friend in media industry. His requirement is ability to identify different voice in a movie and have the output time stamped - Ex. Voice A: 00.00.00sec - 00.05.30sec, Voice B: 00.05.31 - 00.06.30, etc.<p>It would be very helpful if anyone can point to any tools that exists that can do that (open source or otherwise).
I've used this tool for breaking up movie trailers and old Vines. I really didn't like the output quality.<p>I ended up using optical flow and key frame information instead.
This was my assignment in the "artificial intelligence" course I took at my University in Naples (Italy) in 2003.
My NN could recognise scenes cuts with about 50% probability :)
a Film is a collection of shots, scenes and sequences. Shots are fairly easy to detect. Most editing software comes with built in shot detection.<p>This approach promises to detect scenes. I’m not enough of a coder to know if it is valid, but I can certainly imagine that it is a solvable problem. Most scenes are defined by location, and movies makers like each locatation to be distinct from the preceding one.<p>To my mind, sequences are where the action is at. Sequences are defined by narrative development... These can usually be defined by a trained human, but are probably tough to computationly define.<p>There is also a huge difference between film genres. The scenes and sequences of Finding Nemo are pretty easy to define. But you try the same approach on an art house film like The Scent of Green Papaya, and see how far you get.<p><a href="https://www.helpingwritersbecomeauthors.com/movie-storystructure/finding-nemo/" rel="nofollow">https://www.helpingwritersbecomeauthors.com/movie-storystruc...</a>
Odd, scene differentiations often seemed like arbitrary slices just meant for trying to get to a certain point in the movie, long ago when I'd look at them on DVD's. Not something where you could objectively say "this is where one scene ends and another begins" and others would come to the same conclusion on their own.
Can it detect subliminal frames? Would an adequate threshold also lead to many false positives (triggering on any brutal massive change, for example a blast-inducing explosion)?