Demo: <a href="https://youtu.be/fXj5VYYaoeY" rel="nofollow">https://youtu.be/fXj5VYYaoeY</a>
Website: <a href="https://plusonechinese.com" rel="nofollow">https://plusonechinese.com</a><p>Hey HN, we're Patrick and Thomas and are building an app that uses generative video to teach languages (currently Mandarin only).<p>Background: We think the "Comprehensible Input" theory of language learning has a lot of merit - TL;DR: consume native content that you can understand a high % of and pick everything else up as you go with context. For more detail see <a href="https://refold.la/roadmap/" rel="nofollow">https://refold.la/roadmap/</a> or <a href="https://en.wikipedia.org/wiki/Input_hypothesis" rel="nofollow">https://en.wikipedia.org/wiki/Input_hypothesis</a> However, it is quite difficult to find content that is interesting to you, at your level, and in a format you can study it. Generative AI can help bridge this content gap.<p>What we've built: An AI video agent that takes your vocab level and a short prompt and spits out a ~2-minute video. The video will have dialogue that is 85% comprehensible at the given vocab level, making learning the remaining 15% of new words easier and more effective.<p>For example, this video was generated with a 2,150 word vocab and the prompt “Bringing a pet capybara to the public pool”. <a href="https://youtu.be/B7zRNl60hPY" rel="nofollow">https://youtu.be/B7zRNl60hPY</a><p>Video Details: From that simple prompt we make a story, break down the characters and environment, write the script and ensure it’s properly levelled, break it down into shots, bring those to life with tts/image/video/lipsync, and stitch it together with music. As far as we can tell, this is the first end-to-end automated story video workflow of its kind, with no manual steps or cherry-picking, no choosing from character templates, etc.<p>The app is free for watching videos and studying flashcards, and doesn’t require an email to sign up. After the first free video generation, making your own videos is $15/mo for 1 video/day. Excited to hear everyone’s feedback!