/mlpol/ - My Little Politics


If you want to see the latest posts from all boards in a convenient way please check out /overboard/


Archived thread


Science Fiction.png
File (hide): DAF4AA67F18CD912327AB27C2CEB3415-9182115.webm (8.8 MB, Resolution:1920x1080 Length:00:00:18, Tw-AI-light.webm) [play once] [loop]
Tw-AI-light.webm
Pony Preservation Project - AI learning to replicate the mane 6's voices
Anonymous
JfzNu
?
No.249436
249437 249466 249689 249700 251211
Hey I know a fair few of you aren't that interested with what's going on with our mother-boards but I stumbled onto this thread and definitely thought it's worth talking about

https://boards.4channel.org/mlp/thread/34514258

To sum it all up, anons are in the process of cleaning audio from the series or using newly leaked assets from the show to teach an AI to replicate the voices of the Mane 6, with Twilight being the main focus at the moment. If you saw or listened to the Jordan Peterson deepfakes, it's a similar thing although harder due to the lack of pure clean vocal audio

So far the results are pretty funny

https://vocaroo.com/i/s13Fa6h24wbh
https://clyp.it/u3qsvxas

I'm hoping to give it a try myself although it seems to mess up if the lines are long which is understandable
Anonymous
aE7go
?
No.249437
>>249436
Soon. Soon!
Perfect for the spinoff My Little Pony: Robots are Asimov.
Anonymous
GPjAD
?
No.249449
249451
Cool. Good to know that soon we can make Sweetie Belle recite the 14 words.
Anonymous
EUFCy
?
No.249451
249460 249808
>>249449
It would be easier (though not cheaper) to just hire a voice impersonator who sounds like one of the VAs. I know some animations have done this.
Anonymous
aE7go
?
No.249460
>>249451
Why not do both to get a more natural sounds voices? Other than the cost requirements.
Anonymous
+stOg
?
No.249466
happy pony.gif
>>249436
Excellent
Anonymous
JfzNu
?
No.249482
249668
Ok so I've had the chance to give it a go now and I do have some interesting results.

https://vocaroo.com/i/s0gErUETpNaz
https://vocaroo.com/i/s0bm85AOcEF2

The difference between these two is that the first is made from using Hit Learn and the second is straight up Hitler. I do like the tone she has in the second even if its not as clear

https://vocaroo.com/i/s0DgAIntznSF
And I found the best way to get her to say anon is by putting it as An Non

Overall in its current state it can't handle large sentences and while it does end rather abruptly on text given, you can get some believable results so long as you try to stay along lines Twilight does say in the show

https://vocaroo.com/i/s0cAXYtXZTsS
Also this one is so wholesome and by far the best I've done so far
Anonymous
f+FHz
?
No.249668
>>249482
im amazed and shocked
cease your technocracy
Anonymous
Rdqsf
?
No.249689
249796
>>249436
How do I use this and get the AI to say what I want?
Anonymous
JkFWl
?
No.249700
249701 249796
>>249436
Whatever happens, we can NOT, under any circumstances, ever use this technology to make recordings of Twilight Sparkle's voice reading passages from Mein Kampf, /pol/ copypastas, and Donald Trump speeches, and then troll Tara Strong by posting links to the recordings on her Twitter and accusing her of saying those things herself. That would just be unconscionable and wrong.
Anonymous
Rdqsf
?
No.249701
>>249700
Same goes for using this technology to replicate Twilight's voice in fanworks.
It'd just be wrong to deprive the "I sound somewhat like x character" women of their jobs!
Anonymous
aXlPO
?
No.249736
249743
As much as I would love to get into this, I promised myself that I wouldn't return to 4cuck after learning how absolutely fucked the moderation is. Those IRC leaks, the whole kicking various things off of the site, and so on, and so on.
For those that do still go there, perhaps you could suggest other Tara Strong voice IPs for more data if it hasn't already been suggested? I think Lollipop Chainsaw cheerleader was similar to Twilight?
Anonymous
IQkrV
?
No.249743
249749
>>249736
>other Tara Strong voices
I'm not really knowledgeable on this stuff, but my concern with this is that similar sounding characters could possibly fuck up Twilight's inflections.
Anonymous
Rdqsf
?
No.249749
249796
>>249743
True. I know all her characters sound similar but this is to preserve Twilight's voice, not Tara's.
Can you get her to say the Yoshikage Kira copypasta?
Anonymous
JfzNu
?
No.249796
249801
>>249689
Hey sorry for the late reply but I'll post the guide here for the most recent usable version.

https://pastebin.com/S5pejVnU
Basically all you need to do here is download all these files and then place them into a folder, from there you need to hold shift and right click on the folder you put all the files in and select "Open Powershell window here" (Or Command Prompt, both still work).
Once you've done that you'll need to paste the part in step 4 into the window (Copying the text and then right clicking into the window will let you paste text that way).
After, just change the "This is a test" and "test.wav" with what you want your text to be and what its called and hit enter, after a few seconds it should have created a file in that folder of your new sound file for you to listen to.

Hope that's helpful and while its not that user friendly its understandable to a script kiddie at least. While I was at it I also made a new one in relation to the season finale
https://voca.ro/7TJDzIh7axI

>>249700
Your mind is telling you no, but your dubs are telling me yes
https://voca.ro/4zzX0zoZVuP
https://voca.ro/94PQxKKw1uz

>>249749
Sadly Twi AI really struggles with large text volumes and so will suddenly turn to incoherent mumbling. But maybe you'd stand a chance if you cut the text into different files and then stitched the audio back together
https://voca.ro/3kJE4SxFhj1
Anonymous
Rdqsf
?
No.249801
250105
>>249796
If you have her read the copypasta in 6-second chunks, does she awkwardly stop at the end of every chunk?
Could a video maker edit the voice clips together for a longer sentence?
Anonymous
Rdqsf
?
No.249805
250105
This is amazing!
But why does her voice sound so breathy and on the verge of tears so often?
Anonymous
9tvkI
?
No.249808
250427 250495
>>249451
why not just kidnap the original voice cast qnd keep them tied to radiators in your basement forcing them to recite lines if they want to be fed?
Anonymous
f+FHz
?
No.250105
>>249801
You would just have three overlapping words at the end of the last part and beginning of the next part, (so it doesn't weirdly change the diction), and then use some kind of crossfade cut.
This is literally nigger tier editing 101.
>>249805
I would assume because that's a pattern that recurs in the samples, probably just good breathing support.
Anonymous
aE7go
?
No.250427
>>249808
Who needs to do that, and deal with cleanup when you just need 5 seconds of audio.
https://youtu.be/0sR1rU3gLzQ

By gosh voice acters and politions have many many seconds of speech.

The not quite AI revolution is nearing for your voice. It's not perfect, but it's getting better.
Anonymous
SixDm
?
No.250492
Imagine, within a few years we could have programs that create audiobooks of erotic fiction, with AI copies of the VAs reading their lines.
Hell, think of the potential for porn games, paired with AI conversation generators. The time is coming soon where we can generate natural dialogue on the fly, and if the program has a voice engine built-in, you could basically talk to your waifu without the need for shitty pre-written dialogue trees and expensive fan VAs.
Anonymous
LkiYZ
?
No.250495
>>249808
get with the times gramps, computers have replaced people.
Anonymous
pTBwp
?
No.250705
nice
Anonymous
01Vr1
?
No.250711
1573691329999.png


Anonymous
M3sOy
?
No.251176
Relevant https://github.com/CorentinJ/Real-Time-Voice-Cloning
Anonymous
6Idvm
?
No.251191
251196 251222
https://clyp.it/r0yypquc?token=e11965be1b6dce146eb61702006c285e

https://clyp.it/ccyaz3rr?token=c14204d84d7069f0f091f38eada3d740
Anonymous
+stOg
?
No.251196
>>251191
AWESOME!
This is getting better and better.
Anonymous
V40nj
?
No.251211
251220
>>249436
Oh, didn't see that thread.
I'm the faggot who did OP's vid, in case you have questions specifically about it.
Anonymous
JfzNu
?
No.251220
251223
>>251211
Oh are you working on the pony game from the video? Maybe you should make a thread about it? I'm sure some many would be interested, especially the anonfilly crowd from what I've seen
Anonymous
zKhv5
?
No.251222
>>251191
Beautiful! Keep it up lads
Anonymous
V40nj
?
No.251223
251226
>>251220
Yep.
Not sure it deserve a thread, I work on it on my spare time so it's not like there is new stuff to discuss often.
I tend to just drop a video in Derpibooru, unless the new thing is related enough to an existing thread.
Anonymous
+stOg
?
No.251226
251227
1511974568011.gif
>>251223
Love the "lipsync" (or what it is called) animation, and I know this is way outside of topic, but can you add an "lipsync" animation for biting the underlip (not sure how it would look)?
>pic related

>Not sure it deserve a thread, I work on it on my spare time so it's not like there is new stuff to discuss often.
We have threads that are over two years old still going so a low update count is not necessary a hindrance for a good topic.
Anonymous
V40nj
?
No.251227
251228
Anonfilly try the sexy underbite thing.jpg
>>251226
... not sure what you mean.

If you just mean "facial expressions", that's what blendshapes (or flexes, depending on software) are.
The SFM models do have a special blendshape for underbite - which look kinda retarded by itself ... maybe an actual animator can mix it with other things to make it look cute.

If you mean, "integrate this kind of expression with the dialogue" then ... not automatically. The PPP guys themselves haven't really tackled emotion and intonation yet.
You can make a classic face animation and blend it with the lipsync automated stuff tho.

Anonymous
+stOg
?
No.251228
>>251227
I'm just thinking on the facial expression at end of gif. It is not an important aspect, and only a fun thing to have (if possible to make cutesy).
>dimples and a bit smiling might make it look cuter, but I'm no animator or artsy so I have no idea what would help
;