top | item 15006552

Create Anime Characters with A.I.

274 points| wei_jok | 8 years ago |make.girls.moe | reply

48 comments

order
[+] duj|8 years ago|reply
It's copy-pasting parts of the training images over and over.

In figure 8 of the technical report [0], compare the hair in images (0,0), (2,0), (3,0), (3,3), (4,4).

The paper suggests their method generates copyright-free images, yet they are very obviously derived from the input images and you can identify the parts of individual input images that are mashed together to form the output.

All in all their method seems to be performing "obfuscated memorization," in the sense that the generated images are scrambled up enough to fool their plagiarsim-detector loss function.

[0] http://make.girls.moe/technical_report.pdf

[+] yohui|8 years ago|reply
You can also view Figure 8 online: http://make.girls.moe/news-img/fixed_noise.jpg

But as the online article states, that figure represents a case where the model is explicitly set to "generate images [which] have similar major visual features with different attribute combinations": http://make.girls.moe/#/news

So some degree of repetition is to be expected, since you've turned off random noise. And despite that the images do still exhibit some variation if you look closely.

[+] indescions_2017|8 years ago|reply
That is an awesome choice of domain name ;)

For the uninitiated: (form Wikipedia) Moe (萌え, pronounced [mo.e]) is a Japanese slang loanword that refers to feelings of strong affection mainly towards characters in anime, manga, and video games.

http://nic.moe/en/

[+] ReverseCold|8 years ago|reply
This is what the domain name was created for IIRC.
[+] ue_|8 years ago|reply
I have a .moe domain, partly because of my hobbies and also beacuse it was surprisingly cheap. Unfortunately szyslak.moe was taken :)
[+] King-Aaron|8 years ago|reply
I just seem to end up generating pictures that look like smashed crabs: http://imgur.com/4PbYuEt
[+] navs|8 years ago|reply
Or a perfect villain
[+] asr1191|8 years ago|reply
Maybe it's the hidden heterochromia feature

And short hair seems to produce male characters

[+] theemathas|8 years ago|reply
Is there a reason it doesn't generate images as pretty as the samples on the news page? (http://make.girls.moe/news-img/samples.jpg)

By the way, the Getchu and illustration2vec links on the news page are broken.

Edit: This part from the Tips page might be why it initially didn't generate great images:

The input of the model consists of two parts, the random noise part and the condition part. If you generate a good image, you could try to fix the noise part and use random conditions to get more good images. We have observed that a good random noise is important for the better generation.

Edit 2: Actually, no. According to the news page, if the noise is fixed, the generated pictures would be all similar.

[+] hardmaru|8 years ago|reply
Amazing this works entirely inside the web browser.
[+] hatsunearu|8 years ago|reply
Yeah, came to ask--so the GAN model is loaded into the Javascript engine and run locally?

I thought DNN models are fucking huge?

[+] codedokode|8 years ago|reply
Not every.

In Cromium 46 (released in 2015) there is an error:

> Error during service worker registration: DOMException: Only secure origins are allowed (see: https://goo.gl/Y0ZkNV).(anonymous function) @ main.4188687f.js:1 descriptor_runner_webassembly.ts:172 ErrorEvent {isTrusted: true}worker.onerror @ descriptor_runner_webassembly.ts:172

> Uncaught RangeError: Invalid array buffer length math.ts:55 Model loading failed for webassembly backend. Trying next backend: Uncaught RangeError: Invalid array buffer length

In Firefox 45 (released in 2015) there is an error

> InternalError: uncaught exception: out of memory

(the necessary amount of memory is not reported)

[+] mollusk|8 years ago|reply
Props for the domain name.
[+] mindw0rk|8 years ago|reply
Shouldn't it generate different avatars everytime? I get the same picture when I generate a new one with same non-random params.
[+] ldjb|8 years ago|reply
If you've selected the 'Noise: Random' option, it should, yes.
[+] jacquesm|8 years ago|reply
Create anime girls. Doesn't anime have boys?
[+] yohui|8 years ago|reply
Well, "make.girls.moe" is the URL and name of the tool.

According to the technical report [1], they used character portraits from Getchu [2] for training data. A cursory glance shows that the overwhelming majority of the characters are female. As a result, the characters the tool generates are likely to appear female to our eyes.

After the code is open sourced, perhaps someone should try to create make.boys.moe using character portraits from otome games [3].

[1]: 12.8 MB PDF, http://make.girls.moe/technical_report.pdf

[2]: example from report (possibly NSFW?), http://www.getchu.com/soft.phtml?id=933144

[3]: games with a female protagonist and many male characters, https://vndb.org/g542

[+] chobytes|8 years ago|reply
are you sure none of them are boys? :^)
[+] thowfaraway|8 years ago|reply
Maybe some of the girl programmers that Google hasn't hired should make a site that generates sexy anime boys?
[+] sanxiyn|8 years ago|reply
Probably a matter of dataset.
[+] tatami|8 years ago|reply
You don't need much of an A.I. to create the ordinary high school student :)
[+] type-2|8 years ago|reply
It generated a boy for me once.
[+] aw3c2|8 years ago|reply
Please don't propagate that sexist, binary view on gender. If you make the effort to criticise non-equal treatment, please always also include genderless, non-binary bigender or trigender, pangender, trans woman, trans man and any other-gendered.
[+] shp0ngle|8 years ago|reply
Yeah but 95% of HN are white heterosexual males so there you go