So you want to make a LORA? (Part 1)


Updated:

So you want to make a LORA, but aren't sure where to start? Hopefully, after reading these articles, you'll decide this is something you'd like to try. I've tried to include examples and helpful resource links.

If you’re like me you have probably found yourself sitting there after your image generated, staring at the screen, thinking: ‘I don't like how this looks.’ Wishing you had a better LORA to use for your artwork. Or maybe you were muttering something with more colorful metaphors because, well, things and stuff happens.

Well, curse at your screens no longer! Making a LORA, at least here on Tensor.art, is surprisingly simple.

No. Really. If I can do it so can you.

There are many how to guides for LORA creation that will take you step-by-step through the process. This article isn’t one of those. This offers some practical advice and, hopefully, useful information based on my own observations (good, bad, and d’oh!) from creating a couple of passable LORAs.

To begin have a basic idea of the what and why of your goal for creating a LORA. Even if it’s just to see how it’s done, you need a good basic thematic end result in mind. Meaning what type of character or art style you'd like to create with your LORA. Anything is possible from Dark Jedi, Barbarian Warrior, Frank Thorne art style, Pies, race cars, Whimsical Kittens, Post-apocalyptic Landscape, and etcetera et al.

Main question: What kind of art are we wanting to create?

Not sure. Then ask yourself: What character or style do I need (or want to create) that there isn’t already a LORA for. Or that no LORA exists for your preferred generative Model. Or that you just would like a better version of. (Not all LORAs are created equal. You can try three similar character LORAs and often get very different results.)

For example there are many Character LORAs for actress Kaley Cuoco. But there were none of her as a fantasy warrior. Of course with the right LORA combos you can create awesome Kaley Cuoco Barbarian Warrior artwork. But what about a blood-splattered Warrior? Sure, we can create that, but using how many LORAs to get the image just right?

I took this idea and created BARBARIAN WARRIOR KALEY using 25 images in the training dataset. The images I curated include 7 head and shoulder shots, 3 mid close-up body shots (head to knees), 10 full body shots in dynamic poses, 1 artistic image, and 4 sample images using a test prompt similar to the one used to generate the LORA sample images generated during training then in-painting to touch up the face and eyes.

Here’s the published LORA link: https://tensor.art/models/876777897912706295?source_id=njeyo1nrnEW3oPYsaX309xkk so you can view the gallery of generated images. This LORA appears to do dungeon backgrounds and blood-splatter very well. In fact it may seem too bloody, depending on your prompt, and not enough like Kaley even at the default weight of 1. Lowering the weight to .8 lessens the persistence of blood-splatter, but this may affect the likeness since the source images were AI generated facsimiles. But it's good enough we can use it with a Character LORA, if we want a more realistic likeness.

Now, having seen some of what is possible, all you need is to…

Step 1. Decide what type of LORA you want to create, and what you want it to do for you.

(PART 2 HERE: https://tensor.art/articles/876855087064988656)

0