Can AIart be considered an artistic tool?

Despite the overwhelming impression you might get from just reading the latest social media post that there are two sides to the current #AIart cognitive dissonance.  The artist Luddites, who are claiming their creativityis being stolen versus the non-artistic utopians who think that text to image prompts lets them make great art in seconds. However, there is a lot of ground between the two camps.

I have worked with and spoken to other artists who have been very interested in what this new text to image tools, like Dall-E or Stable Diffusion can do. Many have been investigating these techniques as legitimate ways to create expressions of their unique creativity. In other words, is there life in these approaches as a tool. In my opinion it's not a simple yes/no answer but there is promise.

I have actually been interested and evaluating AI for a long time. I was even very early using the hashtag #AIart. In particular I have experimented with the idea of using such machine learning to capture the essence of my style of mark-making and “find” that within photos I have taken. This is one of the areas of what I have investigating under the “hand drawn photo”project. This method definitely has merit. Below is an example I created at nighcafe using their style transfer method. 

I starred with a handrawn image of an eagle's head I drew for Inktober. This was then used to “train” a simple neural net. I also supplied a photo, a self-portrait, which I had used as inspiration for myrevised profile on instagram. The training of the personalised network has to be scheduled on to suitable computer somewhere about on the internet and does take a while so the resulting image is not returned immediately. It is worth waiting for because now I have a black and white rendering. In my style of inkwork is closely follows the tones and shapes of the photo. I printed it on a laser printer and then hand-coloured it with my earth-coloured Ecoline Brush pens. I would consider this a work of my own art, but I have used some aspects of #Aiart in its creation.

Visiting the Night Cafe

Returning to the #handrawphoto project

This isn't hand drawn but was once a self-portrait photo, inspired by MC Escher. It is now however a construct using VQGAN+Clip Artifical Intelligence algorithm via the website Night Cafe. Rather than Building a random "white noise" Canvas, I started with my own photo, and using a cubitist style

Further Experiments with Deep Dreaming towards #HANDDRAWNPHOTOs

Yesterday I did a series of panoramas with two different cameras on the leap track in the southern part of Jells Park. This was primarily to test out the panorama stitching in the new version On1 Photo RAW 2019.2 (trial version). I was quite happy with the results, which managed to capture the quintessential nature of the Australian bush. This inspired me try some further experiments in using Ai methods to refine my #HANDDRAWNPHOTO idea. Basically I’m investigating different styles of photography and post processing that might allow the hand of the artist, his mark making/style to shine through and become part of the photograph.

So the first step for me was to create a simple semi-abstract sketch of just the shapes and textures I could see between the trees in my panoramas. This was made with sharpie pens, in simple blue, purple and black hues. (i wasn’t going to try and use the colours from my sketch just the tones). This is very loose and not too accurate but that was what I wanted.

I used this sketch as my default style in the Deep Style module of Googles Deep Dream, This involves a bit of time to process because the software has to create a neural network which will understand the key style elements, lines and shapes and how I draw them. The original photo is uploaded image at the generate screen. I have been constantly tweaking the settings under the style tiles. The important setting in these examples is preserving colours (from the original photo). Its trial and error from there and can take time, so enjoy it, have a coffee.

This pair shows the original photo above and the resulting deep dream below.

I think this is starting to look what I am after.

PhotoProject :: My #HandDrawnPhoto approach to #AIart

The success of the Belemy portrait auction, has encouraged me to compare Obvious’s DAG approach to my use of Google Deep Dream algorithm. Deep dream uses a convolutional (foreword chaining) neural network to find and/or enhance patterns in an image. This can be applied in two ways Style & Inception (google’s terms). The inception process tries to find the characteristics of a given object/pattern within a photo and tends to produce surreal images. Style on the other hand  seeks to put characteristic patterns back into a photo based on features the trained neural network has recognized. This is the technique I have become very interested in as a way to put my characteristic marks (and sometimes colours) back into a photo. Hence the name Hand Drawn Photos for my approach. The method does have superficial similarities to Onvious’s DAG Approach.

Here I am using my sketch for inktober as the image to be processed and a photo of the same trees as my training image used to build the neural network (AI). The Photo here is acting like the discriminator in Obvious’s approach. The result (below) is tonally similar to the photo and kind of a messy squiggly version of something I might sketch.  But…

In this, my preferred approach, I am using the photo as the image to be modified and my sketch as the image to train the neural network and letting the system modify the photo to “find” my characteristic mark making (aka style) and modify the photo. In this case I am taking the colours from the photograph, but that is not essential.

I feel this second result is much cleaner and fresher, closer to something creative and artistic, Although I am strongly guiding the outcome by using my own sketches (as opposed to an automated algorithm). So the big question is “Do you consider this #HandDrawnPhoto to be legitimate AI art? I’m warming to answering yes.

If you are interested here is the link to my profile and public images on Google Deep Dream website. (Its free to join and use)

Love to hear your views,  please leave your comments here.

PhotoProject :: Building a “Hand Drawn Photo” in 3 layers

I felt it was time to do something creative for this blog (and instagram). I had selected this photo of the young Osprey on the nest on the Mooloolaba spit to make a painting or perhaps a pastel drawing. However I felt it also need to be reinterpreted as a “hand draw photo” using a combination of rendering approaches.

First I loaded the original photo into Google Deep Dream Generator and used the Abstract Nature trained AI filter. This created a darker rendering but I loved the strong blue colouring of the sky. Next I took this new version into Corel Painter as the work to base a clone painting using the artist impressionist clone brush and a linen surface texture and also emphasised warm colours or the plumage and nest.

For the Final Work (above) I used On1 Photo RAW and load the original photo as the base layer and the Clone painting as the second layer. Then I used soft light blending mode and used a semi-opacity masking, a lot like a homemade luminosity mask to bring out some of the original photo (eg almost 100% masking over the eye and beak, but variable 75% or lower on selected parts of the nest and feathers). I also lifted the vibrancy of the blue and yellow/oranges a fraction to give me a strong complimentary colour feel. Finally I cropped in a little to add a bit more drama to the composition.

Back to experiments in HandDrawnPhotography

I’ve been sketching at the beach and also took a photo (or two) so it is a good time get back into the Hand drawn photo project. which is an elaborate way to say I’m merging my sketching with a digital photo. In this examples I’m using google deep dream generator  (in Deep Style Mode) and using my hand drawn sketch a the training image. I’m using the mark making style from the sketch but trying to maintain the colour from my photo.