Saturday, February 25, 2023
Using a reference image within AIart II
Friday, February 24, 2023
Using a reference image within AIart I
Artificial intelligence (AI) has been making great strides in recent years, and one of its most fascinating applications is in the field of art. (AIart) With the help of generative adversarial networks (GANs), we are able to create art that is completely unique and unlike anything that has been seen before.
Most earlier neural networks used a general approach of starting with random noise. Early attempts, such as Portrait of Edmond de Belamy (2018), fetched a whopping US$ 350,000 at auction. However, these early attempts were crude and took numerous iterations. This approach uses two networks: the first is trained on images, called the generator, and the second scores how plausible the result of the iteration is, known as the discriminator. This approach is usually referred to as GAN (Generative Adversarial).A slightly simpler approach to creating
art with neural networks is to build a smaller network based on a single image
or a small number of images from a specific artist. This approach is simpler
than starting with random noise and can produce stunning results.
Back in 2015, German researchers from the University of Tubingen discovered that the earlier nodes of neural networks
trained on images looked mainly at basic picture elements such as line types,
shapes, directions, tones, and colour. These elements collectively made a good
representation of "style". This means that by training a smaller
neural network on a specific artist's style, we can use an existing image as
the starting point to generate new artwork in the style of the artist works use.
Google's Deep Dream Generator was an early adopter of this approach and offered a Deep Style tab to perform this. Many other systems now exist that promise to interpret images, like your selfie, in the style of famous artists, for example.
In this example, I’m using a simple black and white pen sketch of my own, to control the line work but samples the original image colour. Its about what I expected and not exciting, I did however like the unexpected suggestion of a face showing up in the flower on the left.![]() |
| Created with Google Deep Dream Generator |
Thursday, February 23, 2023
Delving Deeper into the Worlds of AIart
As the world around us changes rapidly, it's important to keep up with the latest technologies and trends. That's why I decided to delve deeper into the world of AIart, exploring the various offers and services available. Specifically, I've been experimenting with three of the current top AIart tools: Google Deep Dream Generator, Dall.E 2, and Stable Diffusion.
To test out these tools, I've been working with a local group of artists who meet fortnightly on Zoom to paint from a photo. Jeannine Desailly, a co-founder of our little Wednesday Wanderers painting group, kindly supplied a set of photos to paint. I will base my experiment on them.
My first step was to send a suitable prompt “pink lilly still life” to Dall.E 2. While the result was superficially impressive, there were a few things not quite right about the output. The image was overcropped and a little too zoomed in, it lacked the esthetics and composition of a still life subject.
But I'm not giving up on these AIart tools just yet. In my nextpost, I'll be exploring ways to "assist" these tools using these
reference images. Stay tuned!
Monday, February 20, 2023
Photowalking on Sunday
Next Photowalk seeing in Detail
The first photowalk has come to an end, with only a few participants showing up. Thanks to those that came But don't worry, we'll make sure to notify you of the next one well in advance. In fact, it's already scheduled on the MGA events calendar!During this Photowalk, we explored the concept of seeing by chance, inspired by Freeman Patterson's idea of thinking sideways. I’ve provided a short PDF (optimized for phone or iPad) that outlined the tasks for the day. seeing by chance. Firstly, we asked participants to capture three different themes or hashtags. Secondly, we encouraged them to periodically throw a dice and either choose the number of subjects in a photo or the direction they must photograph.
Our objective was to challenge participants to move beyond taking a simple snapshot. With modern cameras and phones, it's easy to obtain well-focused and well-exposed photos. Instead, our random tasks were designed to distract the photowalkers and encourage them to look for different things. By taking numerous photos, participants had the opportunity to review their work later, to see what they captured and saw and how they managed to capture it.
Here are some of my results
#Tranguil, #shadows
Six Dots on the Dice
Straight Ahead Small aside, I forgot to pick up my dice when I took this, but later I was able to retrace where I took this shot from this photo and there was my dice on the ground!
![]() |
| #sculpture #sky |
Start planning for the next photowalk, hope to see you there
Friday, February 03, 2023
There is always time to find your Zoe & your Magic Marker
The Artist who Couldn't Draw: an animated film by Danny Gregor
Wednesday, January 18, 2023
Can AIart be considered an artistic tool?
Despite the overwhelming impression you might get from just reading the latest social media post that there are two sides to the current #AIart cognitive dissonance. The artist Luddites, who are claiming their creativityis being stolen versus the non-artistic utopians who think that text to image prompts lets them make great art in seconds. However, there is a lot of ground between the two camps.
I have worked with and spoken to other artists who have been very interested
in what this new text to image tools, like Dall-E or Stable Diffusion can do. Many have been investigating
these techniques as legitimate ways to create expressions of their unique creativity.
In other words, is there life in these approaches as a tool. In my opinion it's not
a simple yes/no answer but there is promise.
I have actually been interested and evaluating AI for a long time. I was even very early using the hashtag #AIart. In particular I have experimented with the idea of using such machine learning to capture the essence of my style of mark-making and “find” that within photos I have taken. This is one of the areas of what I have investigating under the “hand drawn photo”project. This method definitely has merit. Below is an example I created at nighcafe using their style transfer method.
I starred with a handrawn image of an eagle's head I drew for Inktober. This was then used to “train” a simple neural net. I also supplied a photo, a self-portrait, which I had used as inspiration for myrevised profile on instagram. The training of the personalised network has to be scheduled on to suitable computer somewhere about on the internet and does take a while so the resulting image is not returned immediately. It is worth waiting for because now I have a black and white rendering. In my style of inkwork is closely follows the tones and shapes of the photo. I printed it on a laser printer and then hand-coloured it with my earth-coloured Ecoline Brush pens. I would consider this a work of my own art, but I have used some aspects of #Aiart in its creation.
Saturday, January 14, 2023
The makeshift Incremental Backup
My revised archive system is bedding done nicely.
As a gentleman of leisure now, I don’t produce as much data
as I used to and thus the automated incremental backups (such as having a NAS
system constantly) are no longer urgent and the number of files is considerably
smaller. The old NAS has stopped working and the priority of setting up such a
system has almost disappeared.
However, in setting up the three-tiered archive system
(Son-Father-Grandfather) and re-arranging my back-pack portable harddrives, I
ended up with one older 1.5GB that was slightly bulkier than the rest.
Significantly it didn’t fit the small zip-up disk wallets I was using to store
the archive sets.
I thought it would give me the opportunity to store incremental
backups, so I put it through a few chkdsk/fix sessions and all was well. I just kept it on my desk (but not connected)
and then at least each week or more often if I doing a lot of stuff (eg larger
photo session). All that is required is setting up an INC Backup folder and setting up 5 folders below that for each week in the month, which will
ensure I have fewer files to look through should I need to recover anything. I just
plug it in and copy anything I’ve been recently working onto the drive.
I’m doing this manually but it is not a big task anymore other
than remembering what to copy. Maybe I should set up an automatic file synch
system. Hopefully, that can wait.
Monday, January 02, 2023
If a picture is worth 1000 words…
What value will a picture have if it's based on 10, or maybe 100 words?
I’m a chronic dyslexic and words don’t flow easily for me.
However, I had decided it was about time to update my Instagram profile picture
(it still had me behind a COVID Mask). So why not try and find what Stable
Diffusion (a leading text-to-image AI system) had to offer.
Prompt: "Profile artwork for instagram, using watercolour markers" 7 words
Plus a starter image, a head and shoulders photo of me. Hmmm, I’m not a girl and my eyes are roughly the same size. So it didn’t really take much notice of my picture perhaps I need to tell it I have grey hair and a beard
Prompt: "Portrait artist, gray hair goatee beard Profile
artwork for instagram, using watercolour markers head and shoulders" 16 words
I add a few negatives with a -0.3 weight to discourage the process going there
"ugly, scary, poorly drawn face, out of frame, cut
off" 10 more words, 26 in total
A mighty improvement and without a starter photo this time BUT how are these an artist and blue rinse in my hair? Seriously?
The last image set was choosen with the same starter but used the additional modifiers (artistic portrait preset image). It added a lot of words some for a positive match some negative, for a total of 88 words
Prompt: "Portrait artist, gray hair goatee beard Profile
artwork for instagram, using watercolour markers head and shoulders portrait,
8k resolution concept art portrait by Greg Rutkowski, Artgerm, WLOP, Alphonse
Mucha dynamic lighting hyperdetailed intricately detailed Splash art trending
on Artstation triadic colors Unreal Engine 5 volumetric lighting” 56words
"ugly, tiling, poorly drawn hands, poorly drawn feet,
poorly drawn face, out of frame, extra limbs, disfigured, deformed, body out of
frame, blurry, bad anatomy, blurred, watermark, grainy, signature, cut off,
draft" 32 negative words
Well it’s a lot more realistically rendered, but still
poorly cropped (head chopped up and at best a single shoulder, etc… etc and... Why
is this an artist? So do I need to craft a longer more descriptive prompt, or
just run a lot more prompts?
The images above have been created on Nightcafe using Stable Diffusion interface
It actually took less time to have a play with my ecoline watercolour brush pens and a pitt pen than to assemble the above.
So my new Instagram profile picture is handdrawn, I trust you
understand why.
PS I must humbly apologise to @Greg Rutkowski (I hadn't noticed he was mentioned in the final prompt, hmm the problems with presets) and I do understand why he is not happy.
Sunday, January 01, 2023
Why I'm not too concerned about the current #AIart
I don't consider these overhyped bitmaps to be magic or even that intelligent. When we see the results of these text to image services, we are looking at a fairly straightforward machine learning neural network application, albeit on a massively large training data set scale.
The data sets are so large and were scrapped together so
quickly, without curation or even human review that they contain a lot of
straight rubbish and often the darkest side of human behaviour. Whilst this is
unpleasant it will be difficult to fix without starting again but there is a
taint of not quite right. Importantly, a lot of the material used in the
training was copyrighted but that was ignored as it was scrapped and fed into
the neural nets. This is legally questionable, but the big money potential may
spend this small problem away.
I think it is the lack of ethics in not attributing or even
asking artists if they wish to contribute, that could be the undoing of the
magic. If the majority of those consuming the images on the net don`t care or
have already scrolled over the issue in their cosy little social media bubble,
nothing will happen. However, if those looking also see the discussion of unhappy artists and appreciate the widespread collection and indiscriminant use of existing
art renderings (style and colour, not cut and paste copies). Perhaps they might
investigate and get a whiff of what is so on the nose. Let’s hope so.
Saturday, December 24, 2022
Reaching for the light...
How many times have you heard an "expert" claim you can't get bokeh with a M43 (micro four thirds) sensor, zoom lens or stopped down to more than f4?
Sometimes you just need to ignore those rules.
Wednesday, December 21, 2022
Opt-in & Opt-out Talk about #AIart and Have I Been Trained website
Nothing brings the finer points of a debate into the spotlight than personal involvement.
The big AIart news of the last few days is that Stable AI will allow artist to opt out of being included in the next dataset being used to train the neural network to be used for Stable Diffusion 3. Well at least you can opt-out for the next couple of weeks, so follow this up now.
There is a site, that can check whether you have been included in the massive Laion-5B & Laion-400m neural networks used in Stable Diffusion & Google's Imogen, yes they were trained on 5.8 billion images. I haven't established its legitimacy as an ethical stance, but it does seem legit. It doesn't appear to be a sneaky way to get more images (with so much hacking and phising establishing trust is a big issue in the #AIart discussions)
However, when you see you are one of the artist whose images have been used to train the Lioan Neural Network and had no idea they are in there, some things suddenly confront you.
It took me very little time using the image search feature, to find two of my works. They were part of my Retracing Darwin exhibition in early 2010 and very early examples of my personal technique I call photoimpression. I actually don't mind if others study my method and even create examples of their own. I would like them to acknowledge me, which is becoming a hollow wish on today's web. I don't blame redbubble either, I am sure they didn't know and/or had not given permission either,
I really don't want my work, especially my own special techniques, style, mark-making colouring or composition used without my permission. This is the stuff that makes my work original. Firstly because I know I'll never be acknowledged, that others could profit from this work or contribution to this work to what is presented as their original, I also actually find a lot of the so-called art generated by these AI's a bit scary and I don't approve, and finally I find the whole process a bit morally questionable and not ethical.
So I've made up my mind, Now I do want to opt out.
Damn! I have to do it image by image. Cest La Vie
Saturday, December 17, 2022
GrandFather, Father, Son archive startegy
It's December already and I'm still contemplating the Backtober idea. Something more distracting seems to arrive everytime I stop to consider a NAS (network storage) option, and I really haven't given trueNAS a real work-out yet either. What I have done is dropped back to the very old Grandfather, Father, Son Archive strategy from the days when anything off the computer was stored on large reels of magnetic tape. In those days Backup was rightly considered as different to Archive. Usually the backup set was in two parts Full (everything import) and Incremental (only those files that have changed since the last full backup).
The three disks on the green sleeve also act as my Backup set, they are kept on my desk under the shelf/alcove lifting up my monitor to eye level. They are normally not connected to any computer but can be. When I retrieve my grandfather copy from remote storage I immediately clean off the disk (a full format as that does checks of the disk for problems and will map out and mark any problem areas).
Friday, December 16, 2022
AI moving fast and probably in the wrong direction
The developments in AI (well large-scale machine learning in natural language and image generation areas) have been astonishing. However, the "viral" usage seems to be sliding towards that all to common race to the bottom. Well, several bottoms, exploiting others to make money for nothing, chasing fame and likes, selling AIart as NFTs and now creating and selling books (children's stories in fact). All that as others question the ethics and legality of profiting off someone else's work.
Today I became aware of two books that have been raced into production using these AI tools. (I say this confidentially because the tools to create them have only been available in recent months and the better version in the last weeks)
"I think this book is a glimpse at what anyone can do with merely some AI software, basic Photoshop skills, and an idea. If my [idea] can be turned into a book, then I'm sure your far better ideas can, too!"
—Mark Terry of The Truth About Bees
Yet I do see that there is great potential for many artist being able to use these Ai tools as aids to improving their skills, helping with inspiration and understanding, and even making their own unique tools on a much smaller scale. As Alice's story says there is power in these tools which can be used for good and evil, depending on how they are guided (what they given to learn)
Saturday, December 10, 2022
What can Relight AI do?
So I started thinking could Lunimar Neo's new-ish RelightAI tool help out? It has sliders for adding brightness near or far and/or warming to cooling again near or far. Whilst the result is definitely not yet spectacular but it is a definite improvement.
I couldn't help noticing a couple of items lower in the creative block was the Sunrays tool and I just couldn't help myself!
Saturday, December 03, 2022
Its about time I had something truly photographic
So that means the sunset was a little ordinary. BUT still great to watch it set.
You really don't have to photograph everything, just being there can and taking time to gather in the ambience is all you need. Way better than a selfie on your phone that you never look at again.
But a cloudless sky sets a promise of stary night. Forgot it is almost full moon and the bight moon really diminished the star gazing. AND yet just taking the time to view it is also rewarding.
Monday, November 28, 2022
Blood on my hands?
All I wanted to do was leave Facebook, so I decided to create a goodbye profile picture using a text-to-image AI art algorithm. Really puzzled why I ended up with blood on my hands?
However, I did make the mistake of making my goodbye message public instead of just to my friends warning them not to click on any request from me, this started a flood of uninformed comments not to be so angry (which I wasn’t just frustrated) and each with convenient links to go somewhere else. If you see those please don’t click on them either.
So my facebook account should be gone (well in 30days)
Friday, November 25, 2022
When "good enough" isn't really.
The general vibes I am getting back from my fairly intermittent and probably very personalized investigation of the massive deluge of commentary on "text to image" AIart is that of two extremes. Those vehemently against it (with the argument that it will be the end of artists, whatever that means) and those who see it as a wonderful new technology (bringing artistic creation to everyone). I don't agree with either. Like all technology there are pluses and minuses.
![]() |
| Created with Google Deep Dream Generator |
Let's begin by discussing a small personal project of my own. Can AIart tools be used to inspire my creativity? Specifically help me create a new cartoon character, I'm just using a simple prompt.
"cartoon of a watercolour artist painting with red hat"
I submitted this to a number of the more popular AIart tools. I definitely didn't expect similar results as I have been following most of the technical issues how each system has been created. The biggest difference is the data selected to train the neural networks, and remember there are usually two neural nets, one to review images (usually scrapped fairly randomly from the broader web, and the second to analyse associated text (usually within the websites or social media posts as an alternate text caption). Finally, it is very important to recognize that these systems are not copying the original images or even parts of those images. In the case of the image-based network it is just using "abstracted" dimensions (descriptors) that allow it to differentiate or group parts of the image. A previous post includes a video that explains these steps clearly. These could be shape, colour, texts, line ... I'll call them patches of style ... or perhaps how marks are shown might be a better description. Well, the results are a lot different.![]() |
| Created in Nightcafe using a variety of methods but the same prompt. |
Wednesday, November 23, 2022
Autodraw, another AI assisted drawing tool
I am late discovering this experimental tool from google labs, called autodraw.com. It dates back to mid 2017 and uses the same technology to guess an object as google's quickdraw. Only this time it lets you sketch out the object you want and "It pairs machine learning with drawings from talented artists to help everyone create anything visual, fast."
Its as simple as that. The graphics are good (created by graphic artists), with Creative Commons Licensing, so free for non-commercial use, easy to download and use. Its also a bit of fun although you may find it quickly reaches its limits of what it might recognize.
Friday, October 21, 2022
The impulse buy, that wasn't really
Finally biting the bullet, I had undertaken a little review of what backup/archive space would cost at the moment, specifically on devices I owned. Using USB expansion style hard drives started at around AUD$ 32 to AUD$35 per TB (terabyte=1,000,000 megabytes) or 3.2 to 3.5 cents per GB (gigabyte=1000 megabytes), this was still way cheaper than SSD offering or even old fashion magnetic tape.
But I'm sure I mostly ingored these ads. Until in a different electronic store by chance I saw the 4TB drives again but for a higher price. I casually mentioned I had seen them cheaper and got an instant price match and even a little extra discount, damn again targeted advertising and slick salemanship. I decided quickly I bought two.
Now to catch up on the important archiving and backing up that was
sliping behind. No more excuses.
Prices have come down a little, as capacities have increased but things are relatively similar to my article back in 2018 The Myth that Digital Photography is free.
Thursday, October 20, 2022
Creativity in name, not so much in practice
Whilst I have long since stopped using Lightroom and other Adobe products, I do still take a keen interest in what is going on at Adobe and more particularly what they are working on. So I have been attending the virtual aspects of adobe’s big MAX conference for the last few years.
Adobe CEO Shantanu Narayen described how the company is determined to develop "AI for social good” in his keynote address. They are certainly using AI within many of their tools. Creating a wealth of “one-click”, “fix-it”, “make it better” tools within their existing suites of applications. For sure it will take a lot of tedious hack work out of making visual images and video, but I don’t think this is going to re-assure the real creatives worried about the rise of AI art.
The hyped “new” tool Adobe Express has a lot of the look and
feel of Canva, perhaps with nicer integration with other adobe tools (so you
need to pay more rent), The photographic enhancements in lightroom and photoshop are mainly not new and exciting, being offered in a number of other pieces of software, just not integrated so again you have to spend more renting it all. The sneaks segment usually my favourite to see what new technology might be coming up was a disappointment. Perhaps with the exception of project blink (for AI-powered video editing on the web)
I did like the short presentation by Relu Ou on "the
myths and realities about Artifical Intelligence", Particularly his closing
remark “Please let your imagination direct how you use these tools.”








































