I think we need better ways to interact with, retain and exchange information from rich media like audio and video.<p>I often consume podcasts and videos where a speaker will reference source material, suggest recommended reading, quote an individual, or tell a story. I find these 'embellishments' incredibly compelling but I frequently encounter a lot of friction when trying to remember what and when something was referenced. Given that I, and likely many others, primarily consume these media while otherwise occupied (getting ready, working out, cleaning, commuting, eating, etc) I see a distinct need for functionality that allows some type of community driven, timestamped tag cloud.<p>A clear example of this in the wild is any top YouTube comment composed of timestamps and topics. Google is certainly aware of the potential utility [1].<p>A technical implementation with similar crowdsourced tagging is SponsorBlock [2] and I think there are potentially awesome second and third order effects unlocked with a broader feature set. Imagine making API calls to learn the duration and frequency of a sponsor segment, by creator, ordered by time. Now extend that functionality only slightly, and you could query all instances where a book, podcast, video, person, topic or <i>anything</i> was tagged. Run transcription and NLP to infer sentiment about a tag, set up monitoring to be alerted of new tags meeting certain criteria, create customized recommendation feeds based off of tag filters... could there be endless possibilities?<p>Content with a production budget/team often solve this in advance. Podcasts have episode notes, YouTube videos have annotations and chapters, courses have syllabi, wikis have indexes. This is asymmetrical, from creator to consumer. What if, when someone shares a recommendation, you could engage with the content and also see the sections + tags that they found most valuable?<p>Presenting a standardized method for tabulated tagging, designing interactions to avoid interruption (I can't believe it took till iOS 14 to minimize Siri), building cross platform integrations (when feasible) and nurturing a community of tag contributors, are all significant elements of this product roadmap.<p>I've long considered launching this as a commercial project, but I believe with conviction this must be open source. My email is in my bio should anyone share interest.<p>[1]
<a href="https://9to5google.com/2020/11/25/youtube-testing-easier-time-stamp-tagging-in-video-comments/" rel="nofollow">https://9to5google.com/2020/11/25/youtube-testing-easier-tim...</a>
<a href="https://9to5google.com/2020/11/24/youtube-begins-testing-auto-video-chapters-to-help-save-you-valuable-editing-time/" rel="nofollow">https://9to5google.com/2020/11/24/youtube-begins-testing-aut...</a><p>[2]
<a href="https://sponsor.ajay.app/" rel="nofollow">https://sponsor.ajay.app/</a>