February update (Patreon)
Content
Hey everyone,
I'm always disappointed if the end of a month rolls around and I don't have a video for you. I've been chugging along at the animations for the transformers project I mentioned in the last post. It's a big one, and in my current plans, I have it split up into three separate videos, which will be added as chapters to the neural network series I posted several years ago. The aim is to have at least two of those out to you in March, with the third not far behind, so if all goes well the 2024 videos-per-month rate should pop up to be much closer to 1.
---
Much of the reason I'm a bit behind there is that I got further sucked into the translation project I mentioned in the last post. We now have a preliminary interface to enable people to submit corrections/reviews of translations (more details here).
Ever since YouTube disabled community contributions to captions, I've had no good solution for how to let people submit subtitles, so if nothing else it feels nice to have a clear place to point people for that.
The real motivation of the project, though, is to make dubbings easier, and in particular to experiment with AI dubbings. For a sample, take a look at last year's video on Moser's circle problem, click the gear icon, and try out some of the alternate audio tracks.
My feelings on AI dubs have evolved a bit in the last month, though. It reminds me a bit of my feelings towards AI art in 2022. The first impression is a huge wow factor. Look! It's me, but speaking German! Think of what this unlocks! And yes, it is impressive, probably pretty useful, and almost certainly better than having nothing. But once the wow factor wears off, the deviations from what feels human become more noticeable, and also a bit more obnoxious. The intonation is just a bit strange just a little bit too often, and the fact that your brain knows it's not a human limits how friendly it can feel.
By contrast, one of the translation efforts I feel most pleased with is the Japanese channel, something done with care by a community member, and where channel revenue is shared with them. The problem is that doing dubs manually often takes way more time than people expect it will, and too often they don't garner the reach that justifies the time spent.
What about you? What are your feelings about AI-created dubs?
One thought I'm currently toying with is having a system in place where we can create an AI dub as a first pass, but then reuse a lot of the tooling involved in that which syncs the dubbing to the original video to streamline the process of human-narrated dubs. If the dubbing process was smooth enough, taking say an hour for one video rather than a day, I'd be much more comfortable opening applications for community members who might be interested in that and paying them for the efforts.
All of this, from the coordination to the software development involved, would be something I fully intend to hire out for while my own time mainly goes to new videos. To a good extent, that's what I've been doing so far (many thanks to Vince Rubinetti, Jordan Balke, and Shihab Sarar Ahmed). But at least during early experiments, it's a rabbit hole I haven't been able to fully escape.