A bit of my experience with making AI-generated images and LoRAs ( 1 )


Updated:

At the beginning, please allow me to apologize—English isn't my native language, and this article was written with the help of AI translation. There may be grammatical errors or technical term inaccuracies that could cause misunderstandings.

https://tensor.art/articles/868883998204559176  ( 2 )

https://tensor.art/articles/868884792773445944 ( 3 )

https://tensor.art/articles/868885754846123117 ( 4 )

https://tensor.art/articles/868890182957418586 ( 5 )

And this article is not a guide or tutorial. If you have never used AI drawing, you may not understand it. If you have made pictures or Lora, it will be easier to find possible misunderstandings and errors in the article. The variables and approaches I mention are based on personal experience, and given AI's vast randomness, they may not be universally applicable, your own experiments might yield totally different results. You can use the experience in this article as a comparison, or even as potential "wrong answers" to rule out in your own workflow.

 

Some of my friends have just started AI painting or are preparing to start, I just hope that this article will be of some help to them.

 

Like many people, when I first heard about AI painting, I thought it was a joke. It wasn't until more and more AI pictures of popular characters appeared on social media that I gradually changed my mind. It turned out that there was a way to make doujin like this. However, the carnival of those star boys and the grand occasion of girls who were hundreds and thousands of times more than these star boys did not make me interested in AI painting. 

One day, on the homepage of Twitter, I saw a post featuring an extremely obscure boy - the kind that barely anyone knows about. Why? How? At that time, my mind was full of excitement except for questions.

After that, I would search for the names that lingered in my heart forever on Twitter or pixiv every day, hoping for a miracle to appear, and then, it really appeared.

So I continued to wait for the results of others as if I was longing for a miracle, and still didn't think about whether I should try it. I didn't even know about websites like civitai or tensor at that time. More and more people started to make AI pictures, and then I knew about the existence of these websites from their links.

These online AIs became a place for daily prayers. I never even clicked the start button, and just indulged in the joy of winning the lottery. Those pioneers shared new pictures and new things called lora every day. One day, I saw the lora of the boy that I was most fascinated with. Finally, I couldn't help it. I clicked the button, figured out how to start, copied other people's prompts, and replaced them with my favorite boy. In this way, I began to try to make pictures myself - the pictures full of bugs.

 

The excitement gradually faded. It turned out that AI couldn't do it, or I couldn't do it. Questions replaced the excitement and occupied my brain. I continued to copy, paste, copy, and paste. Why were other people's results so good, but mine were always so disappointing? At that time, I thought that people didn't need to know the principle of fire, as long as they could use it. I just tried repeatedly without thinking.

At this time, there was a phenomenon on the Internet that was becoming more and more common.That is, just hearing about AI drawing in the previous second, the next second, copying and pasting began, and the next second, sponsorship was opened to sell those error-filled picture packages - when the creators of those checkpoint and the creators of lora completely disagreed. What's worse, steal these picture packages and resell them. Not to mention those who stole the pictures that people released for free and sold them. The copyright of AI was originally controversial, and I had my own doubts, but these thieves were too utilitarian and too despicable. Why? How? In anger, I no longer have any doubts. I must think about how AI graphics came about, and I must know that fire needs air to burn and how to extinguish it.

 

-- I have to regain the original motivation for using the Internet when I was still a chuuni boy -- sharing the unknown, sharing the joy, at least sharing it with my friends. I have no power to fight against those shameless guys, but they can never invade my heart.

 

I'm sorry for writing so much nonsense. Let's write down my thoughts and experiences over the past year in a way that's easier to understand.These understandings are only for make character doujin and are not applicable to more creative uses. These experiences are mainly based on the use of illustrious and noobai and their derivative models. They are also based on using only prompt and basic workflows. More complex workflows, such as Controlnet, are not discussed. They can indeed produce more complete pictures, but they are still too cumbersome for spare time. Just writing prompts is enough to generate eye-catching pictures in the basic workflow.

 

First of all, the most important conclusion is that AI drawing is still a probability game at present. All we can do is to intervene in this probability as much as possible to increase the possibility of the expected result. How to improve or change this probability to improve the quality? We need to understand a concept first. The order of AI drawing and human drawing (just digital, not traditional media) is completely opposite. When people draw, they will first conceive the complete scene of the image, then fill in the details, line draft, color, and then zoom in on a certain area to refine, such as the eyes. At this time, the resolution is very high, and even if you zoom back to the full picture, it will not affect the details. However, AI is the opposite. It first generates small details, such as eyes, and then gradually zooms in to depict the full picture. Therefore, when the resolution remains unchanged and undergoes several zooms, those initial details may be blurred. This is why AI drawing a headshot is much better than a full-body picture. So the easiest way to improve the quality is to only do the upper body, or close-up.

0