The deep dreaming code and many of their networks are publically released and I am still keen to code it up and build something for myself one day (probably not soon). However the meme of deep dreams has spread quickly on the internet and their are now many website that offer the deep dream approach. One of the first was dreamscope, and it is my favorite, but google also has an on-line deep dream generator. Many of theses site like lucid for android phones offer a instragram-like pick and one-click filter approach. Already there are already two variants.
- Convolutional Neural Networks, these have been describe by a team at University of Tubingen. These neural networks are base on a feed forward approach and they are starting to be able to detect style and the nature of marks made as well as the content. The Tubingen study suggest that style and content are separable. Thus you can apply a particular style to a different subject.These system using this approach often have style in their name, (eg google style) and I will adopt that name to characterize this group.
- Inceptionist, neural networks. This is the approach described in the google paper (link at the top of this post. It is really just a way to describe googles approach which are extended (more layers) convolution neural networks but have been put into the feedback loop, desperately looking for what they know how to find.
1. StyleThis group is likely to be the most over-used (instagramed to death) because they are in general so easy to use. I am experimenting with such a system called Lucid on my android phone, there are plenty of others for android & apple and even Faux look-alike systems. The better ones like Lucid, do the processing in the cloud, so you load the photo you wait a little while then pick the thumbnail showing the result you want (Lucid uses famous art works for it network training). You pick one and wait a little longer and presto you have something like your photo but painted or sketched by that artist. Some images work, and work wonderfully a lot look just sad. It will be the posting of these unfortunate images that might give this approach a bad name.
Hang on I’ve already posted a few myself!
There are some web based “filter” or “app sites” that also offer this style approach. My example here is using google’s deep style approach and a Henri Rousseau painting as my network training example. The results are clearly Rousseau inspired and yet also clearly recognizably the subjects of my photos.
Whilst I have seen many wonderful examples, there are a lot of very trashy examples as well and this my lead to the same reaction of many non photographers to the more extreme HDR works. They may reject these works as a gimmick, without seeing the potential
2. InceptionismIt is not only google who offer access to the original inceptionism technique, here I am using Dreamscope again but with two different neural training sets following the feedback approach. The first is called Angel Hair is more about texture and the flow of lines, the second called inception painting is about seeing animals and generates those weird animal eyes and patterns. You may need to click on the images below to see this detail.
Inceptionism is very quirky, and needs to be used with constraint. Also the deep galleries’ sites in general are becoming far to overloaded with selfies & cats.
Still I see a lot of opportunity to build original art with these techniques.