LoRa & LyCORIS Fusion
Trained on ~217 650 MJ Images
LyCoris trained on 211 924 MJ Images
LoRa trained on 217 650 MJ Images
Merged in di.FFUSION.ai-stage-I.safetensorsdim
dim128 | conv32
UNet attention weight average magnitude: 5.714574005824907
UNet attention weight average strength: 0.014448476696414102
UNet conv weight average magnitude: 3.623326885917904
UNet conv weight average strength: 0.00653153534681701
Text Encoder weight average magnitude: 5.401999128837191
Text Encoder weight average strength: 0.010774937006810953
Training took less than a day on both using a 8 a100 (80GB) and 8 40GB
Samples were generated on SD 2.1 768 NoEma & Ema / realismEngine_v10 / classicNegativeSD21_classicNegative768px / aZovyaRPGArtistTools_sd21768V1
Negative used:
(deformed, distorted, disfigured:1.3), poorly drawn, bad anatomy, red eyes, wrong anatomy, extra limb, missing limb, floating limbs, (mutated hands and fingers:1.4), disconnected limbs, mutation, mutated, ugly, disgusting, blurry, amputation (oversaturated:1.5),(saturated:1.2),big contrast,contrast white burn,white spots overexposed,over saturated,burnt image,ugly,hideous,deformed,mutant,butchered,gore,sloppy,artifacts,mutilated,poorly drawn,poorly detailed,smudged,sketch,pencil,glossy skin,doll,plastic,lowres,overexposed,broken,fuzzy,aliasing,cheap,oldschool,poor quality,pixelated,sleepy,closed-eyes,crippled,crooked,weird,odd,distorted,erased,cut,hideous,pixelated,text,logo,watermark,deformed eyes,close up,((disfigured)),((bad art)),((deformed)),((extra limbs)),(((duplicate))),((morbid)),((mutilated)),out of frame,extra fingers,mutated hands,poorly drawn eyes,((poorly drawn hands)),((poorly drawn face)),(((mutation))),blurry,((bad anatomy)),(((bad proportions))),cloned face,body out of frame,bad anatomy,gross proportions,(malformed limbs),((missing arms)),((missing legs)),(((extra arms))),(((extra legs))),(fused fingers),(too many fingers),(((long neck))),tiling,mutated,cross-eye
Training data:
FFusion SM - LyCoris
"ss_sd_model_name": "stabilityai/stable-diffusion-2-1-base",
"ss_resolution": "(768, 768)",
"ss_clip_skip": "2",
"ss_num_train_images": "211924",
"ss_network_args":
"conv_dim": "16",
"conv_alpha": "16",
"algo": "loha"
"ss_network_module": "lycoris.kohya",
"ss_optimizer": "torch.optim.adamw.AdamW(weight_decay=0.01,betas=(0.9, 0.99))",
FFusion SMB 3 - LoRa
"ss_resolution": "(512, 512)",
"ss_clip_skip": "2",
"ss_num_train_images": "217650",
"ss_network_alpha": "128.0",
"ss_network_args": {
"conv_dim": "32",
"conv_alpha": "32"
"ss_network_dim": "128",
"ss_network_module": "networks.lora",
"ss_num_batches_per_epoch": "54422",
"ss_optimizer": "dadaptation.dadapt_adam.DAdaptAdam(decouple=True,weight_decay=4.0,betas=(0.9, 0.98),use_bias_correction=True,log_every=100)"
Fully trained only with Kohya S & Shih-Ying Yeh (Kohaku-BlueLeaf) tools 🤟 🥃
