Face Maker AI — Turn sketches into photorealistic faces

I made a character for a trek story, with her mirror counter-part. Federation Terran

👋 Hey Product Hunt! We’ve been working on this one for a while now and I’m really excited to share it with the community. Over the last year we’ve been experimenting with how machine learning can be incorporated into the artistic process. We’re releasing the Face Maker AI as a free educational tool to demonstrate the potential of GANs. Use the “Palette” to pick a facial feature, like hair, skin, or glasses, draw on the sketch and watch AI imagine a face. If you’re on mobile press the “Generate Face” button. Supported keybindings: “B” - Brush, “I” - Eyedropper/Picker, “ [ “ - Decrease brush size, “ ] “ - Increase brush size, "Ctrl - Z" - Undo. Please share your best and weirdest creations here! This works by using a “segmentation map”. Deep Learning models are really good at performing per pixel labelling. You’ve probably seen the Remove Background tools that classify parts of the image either as background or foreground to make an alpha mask. But we don’t have to stop there. We can classify an image with much more detail such as what parts contain an Eye, Ear, Nose, Mouth… etc. Passing an image of a face to a ML classification model can return a so-called “Segmentation Map”, which assigns a unique color to each class of facial feature. Now this is where it gets interesting, we can play this in reverse, give the ML model a segmentation map, and use a GAN to generate the most convincing image of a face that it can (given the dataset it was trained on). The really cool thing is that this isn’t limited to just faces, you can do this with landscapes (like NVIDIA’s GauGAN), buildings, cars, cats you name it! We’ve added a free to use “segment to face” generator to our Media API and hooked it up to a basic paint interface in this tool. The model was trained using the Celeb HQ data set so you might see some hints of celebrities in the results 😉 This is for research or educational purposes only, but let me know if you have a commercial application and we can make it happen.

I'm not a fantastic artist, but I challenge any hairstylist to recreate this funky style! https://massless.media/FD87b8zKa...

Love it! Great product! Thank you for creating such a cool product!

That's a fun product! Congrats on the launch

This is so cool!

This tool made my day. Splendid achievement!

Cool