Original Author:adempotent

Put in your negative prompt:

<lora:EasyFix:1> (overfit style:1.0)

EasyFix is a negative LoRA trained on AI generated images from CivitAI that show extreme overfitting. This LoRA improves generated image quality without any major stylistic changes for any SDXL model.

Suggested Strength: 1 to 16

Important: adjust the strength of (overfit style:1.0) more than the strength of the LoRA

What is overfitting?

According to IBM (source: https://www.ibm.com/topics/overfitting), "Overfitting is a concept in data science, which occurs when a statistical model fits exactly against its training data. When this happens, the algorithm unfortunately cannot perform accurately against unseen data, defeating its purpose. Generalization of a model to new data is ultimately what allows us to use machine learning algorithms every day to make predictions and classify data."

What does overfitting look like in Stable Diffusion?

Repeating patterns, nonsensical details, small dots, strange artifacts, facial blemishes... etcetera. If you look at an AI generated image and see some strange details that don't make sense, the chances are high that the image shows signs of overfitting.

Overfitting as an Aesthetic

Aesthetic appeal is subjective, so if you enjoy the incredibly detailed images Stable Diffusion is good at making, don't view this model as an attack on your personal taste! Please do an A/B comparison using EasyFix and judge for yourself which is better.

Avoiding Overfitting

In Image Generation:

Simpler prompts, with minimal negative prompting. If needed, lower CFG scale.

In Training:

I will eventually be writing a short guide for advanced users on how I train my LoRA, so watch this space. AI_Characters has an excellent guide on training methodology (see: "Evaluating your model") https://civitai.com/articles/1771

Methodology

Collect tagged AI-generated images from CivitAI that show overfitting (using https://github.com/hassan-sd/civitai-image-scraper). Images should be greater than minimum size of 768x768.

Remove all brackets and attention strength from captions. (e.g. "((cute dog:4))" becomes "cute dog"). Remove all tags relating to quality (e.g. "masterpiece, best quality, insanely detailed"). Add a trigger word at the start of each word like "overfit style".

Train on the images and generate A/B comparison images while training to save time later.