27.09.2023

AI

Dubbing Video Creatives with Neural Networks: 3 Services


Dubbing Video Creatives with Neural Networks: 3 Services

Recently, TikTok and other social media platforms have been flooded with old videos featuring new voiceovers. One iconic example is the legendary monologue of a pyromaniac with the line "I like the way it burns." The video gained a whole new life after being adapted for international audiences.

Users grew curious about the new trend and quickly discovered it was the work of neural networks. We couldn't pass up these new tools either — so here's how to apply them in affiliate marketing. 

The Specifics of Adapting Video Creatives

Over the past two years, neural networks have made a massive leap forward. Today you can quickly generate a logo, illustration, or small code snippets using ChatGPT and other tools — saving significant time on routine tasks.

Midjourney and other tools still can't create a creative from scratch that can be uploaded to an ad campaign without editing, but they can partially solve common problems. For example, applying pixelation to adult creatives. 

Recently, services have emerged on the market that can translate a video's audio track into another language while synchronizing the speaker's lip movements and cloning their voice. They position themselves as an alternative to professional studios. Of course, they can't fully replace studios — but in certain situations, they can.

приклад тарифа

Affiliate teams have been testing AI video for several months now, and some have managed to achieve solid results. In June, Space Profit Team published a case study of running deepfake campaigns with a profit of ~$15,000.


They were running nutra offers to LatAm, using the image of a well-known doctor in their creatives. Video testimonials for the campaigns were generated using an AI platform. The full case study in text format is available on Telegra.ph, and there's also a video on Instagram

The case study shows that in some GEOs, users cannot tell a real video from a deepfake. Although if you watch the lip movements closely, the artificiality is visible to the naked eye — for the audience in this case study's GEO, that simply didn't matter. 

3 Tools for Voiceover Adaptation of Creatives

Deepfakes are already fairly common in the FB ad auction, but there's another route — take a creative from a spy tool or use your own and adapt it for a different GEO. There are already several platforms that can help solve this problem. 

You can order a creative for nutra or gambling with professional voiceover, then adapt the video for multiple countries. Just keep in mind the regional specifics — for Spain, for example, you need a Spanish speaker, not an American one. 

HeyGen

A popular platform for generating video content using neural networks. The library includes over 100 different avatars, 300 voices, and 40 languages. Video generation speed is quite high, and there is a free plan available. 

Most likely, Space Profit Team used this particular platform to generate their deepfake testimonials. They didn't reveal the name in the case study, but that conclusion can be drawn from the similarity between the avatars and the examples in their creatives. 

On the free plan, generation takes a long time due to high server load. It's likely that the free tier may be shut down entirely over time as demand continues to grow. 

черга на переклад відео
An example of a video adapted by HeyGen

For free translation, HeyGen provides only one credit — enough for a video up to one minute long. In theory, you could register 10 accounts and end up with ten videos. However, removing the watermark is only available on a paid plan. 

Pricing plans depend on the credit volume. You can purchase 15 credits for $29 per month or 30 minutes for $59. 

RaskAI

The service positions itself as the main alternative to HeyGen. It specializes in video translation, supports 130+ languages, voice cloning in 28 languages, and features automatic source language detection. The latter saves a significant amount of time, as it's not always easy to quickly identify the language spoken in a video.

Unfortunately, we were unable to test the translation quality on a creative sample due to high server load. However, we found several examples that demonstrate solid results in video dubbing.

RaskAI
Examples of videos adapted by RaskAI
Examples of videos adapted by RaskAI

Paid plan pricing: $59 per month for 25 minutes of video and $139 for 100 minutes. HeyGen offers a more attractive pricing structure, but RaskAI holds its own in terms of quality — so it's best to make a decision after running your own tests. 

If you need to generate audio for a voiceover — you can use ElevenLabs. The service offers 20+ different voices with support for 28 languages, including Ukrainian — which is a welcome addition. 

Video dubbing tools are trending right now, so getting free access is no longer as easy as it was in the early days after launch. But spending $30–50 on testing and creative production for your campaigns is a relatively small investment — especially given that these services will only become more powerful and continue rolling out new features.