How to use an AI image generator...

[Scuzi]

...to do this, if it can be done.

Can any of the current AI image generators be used to effectively generate a picture of the mental image that may be conjured up by the lyrics of a song? The song was a favourite of a very close relative who has since passed, and I want to capture the song in a single image which can be printed, framed, and take pride of place on the wall.

I would like to create an image which captures all of the elements of the lyrics of "What a Wonderful World" by Louis Armstrong. For those unfamiliar, it goes:

I see trees of green
Red roses too
I see them bloom
For me and for you
And I think to myself
What a wonderful world

I see skies of blue
And clouds of white
The bright blessed day
The dark sacred night
And I think to myself
What a wonderful world

The colors of the rainbow
So pretty in the sky
Are also on the faces
Of people going by

I see friends shaking hands
Saying, "How do you do?"
They're really saying
"I love you"

I hear babies cry
I watch them grow
They'll learn much more
Than I'll ever know
And I think to myself
What a wonderful world

Yes, I think to myself
What a wonderful world
Ooh yeah

I have tried pasting the lyrics as they are into Craiyon but it cant resolve the detail and generally shows a picture of a multicoloured tree or a single rose. Is there a technique which may make this endeavour more successful? I'm wondering if the word structure can be optimised, or if maybe multiple images will have to be generated and stacked. I may also want to add other details specific to the person. Interested to hear how others would approach this problem.

Many thanks!

 

[Scuzi]

So I tried it with Stable Diffusion and Realistic Vision, and broke down some of the verses so they fit in together more easily as descriptors that it can understand, providing as much information as possible on what to generate and include.


If you don't need realism, then you can try different AI generators, but I tend to stick with the realistic approaches.

Wow, thank you very much! That is definitely moving in the right direction and gives me a good basis from which I can tweak. Seeing how you worded it has given me some ideas of how to approach this rather than just pasting in lyrics like I have been doing. I think I’m fine without realism, as in my mind’s eye it is quite a surrealistic, almost psychedelic image, so I will give some others a try too.

Have you tried mid journey? Not free anymore though.

Not yet but if it is worth paying for I’ll give it a try. Out of all the available options, paid and free, what is the best for the job?

I’ll have a play this evening after work and I’ll post my results.

 

[Scuzi]

Midjourney - straight paste of first sentence/verse. Four versions....

Midjourney seems to be the best one so far. Here’s what I’ve come up with after a bit of playing…

It’s getting surprisingly close to the image I have in my mind. Just needs more refinement to make it slightly less surreal.