Show HN: Slideo – Synchronize Slides with Video Using Computer Vision (OpenCV)

I made this tool to prepare for exams more efficiently. It is written in rust and uses OpenCV to detect and match features in slides (provided as PDF) and video frames. The matching algorithm is described in [1].<p>The PDF pages can appear anywhere in the video frames, in any order. Rotation, translation, scaling and obstruction is fully supported due to the feature extractor (ORB) being rotation&#x2F;scale&#x2F;transformation invariant.<p>[1] <a href="https:&#x2F;&#x2F;github.com&#x2F;hediet&#x2F;slideo&#x2F;blob&#x2F;master&#x2F;BACKGROUND.md" rel="nofollow">https:&#x2F;&#x2F;github.com&#x2F;hediet&#x2F;slideo&#x2F;blob&#x2F;master&#x2F;BACKGROUND.md</a>

There&#x27;s many old videos on media.ccc.de with very low quality, standard definition camcorder and without slide capture or at maximum grainy vga captured slides. Might it be possible to take re-render those to FHD or even 4K with everything upscaled and the projector replaced? Would need some additional magic to recognize laser pointers, mouse pointers and the presenter walking in front of the screen, but might be worth it for some of the more timeless talks.

Great idea! I have watched some lectures&#x2F;talks online with terrible camera work (e.g. panning to the speaker when they are asking the audience to read the slide).<p>Another solution I&#x27;ve seen was to play a simultaneous video feed of the slides only. Not particularly efficient. Would love to see something like this instead for instructional content!

This is awesome! I can imagine something like this in the text-based video editor we are developing. One usage could be automatic frame alignment for moving objects.

I see only one timestamp for each slide. So I was wondering on how will it handle case when presenter move back and forth for some slide?