DCAU Style for Pony (Justice League Unlimited)

LORA
Original


Updated:

4.2K

This Lora only works on Pony v6 XL and Pony-based models.

Trained on screenshots from Justice League/Unlimited and other DCAU shows with the streamlined animated series designs.

Trigger word: dcaustyle

  • Strength: 1.0 (or lower if style is too exaggerated)

  • Use Pony's quality tags: "score_9, score_8_up, score_7_up," etc. (Removing some/all of these tags can make the style more accurate but also possibly make it more badly drawn.)

  • Use booru tags. Natural language prompting can work too.

  • (The style seems to be a bit random on the base Pony v6 XL model. It's more consistent when used with 2D anime-based Pony models, though the style may get slightly anime-like.)

This is my first try at training a style lora. Let me know how it works. Good for solo images. May not be very coherent with complex multi character images. As always, use detailer or inpainting to fix faces that are small in the frame. This was trained on civitai because I don't have enough vram.

Dataset was made almost entirely from screenshots from fancaps.net of JL/U, upscaled TNBA (after the redesign) and the movies that used the Timmverse art style. I put more emphasis on major female characters, but I included some men, random characters, and scenery. I avoided crowd shots or pictures where characters were overlapping, since that seemed to confuse the AI based on a previous attempt.

Many of the frames from the cartoon are simple and at times "badly drawn". Maybe it was a bad idea to train this on "bad" drawings, but I wanted it to look authentic to the TV show. (Somebody else has made a lora that looks more like Bruce Timm's personal artwork: Retro Cartoons, the Animated Series.)

Version 3

Trained on 314 images and trained longer over all. I added more diversity of images split between: heavily-trained characters, less-trained/random characters, and a small amount of scenery.

I tried strategically removing some tags from some images. For example, I dropped basic hair and eye description tags from most images of characters that have more than 3 images. This is an effort to reduce trained characters bleeding into original characters. Will this work? I don't know. Some characters have been learned better, but some might be worse than v2. Overall though the style is stronger.

Some clothing tags for known characters were changed. See the Character section below for the current tags.

Version 2

Trained on 212 images, up from 128. Added more pictures of the featured characters I'm trying to train and random characters/costumes for dataset diversity. This version has more varied male characters too, though major male characters were not represented by more than a couple of pictures and will probably not be accurate. Sorry.

Some tags used for major characters were changed. See the updated character section below. Training was slightly longer with tweaked settings. (2 repeats x 17 epochs = 34 looks at each image.)

SD 1.5 version

I made this by request, just with mostly the same dataset as v2. It doesn't work that well. Use it with a 1.5 anime model. You'll need to use hires fix, inpainting, detailer, etc. to improve the images from this one. Tags should be the same as v2, except of course don't use Pony's tags.

Characters

This is meant to be a style lora, but I also tried to make it like a multi-character lora, which maybe was trying too much. But it's an experiment. (Other people are already making individual JLU character loras for Pony, which should work with this.)

Some characters were trained with about 9-15 images each, and can be generated with fair accuracy. Try using the name and some of the booru tags that are listed below. (You don't have to use all the tags, just what you need to emphasize. Try also prompting "constricted pupils" or "no pupils" if it doesn't draw the correct type of iris.)

  • Batgirl: batgirl, light blue eyes, mask, red hair, black lips, two-tone cape, belt, black bodysuit, yellow gloves

  • Barbara Gordon: barbara gordon, light blue eyes, no pupils, red hair, black lips, black shirt, pleated skirt

  • Black Canary: black canary, blue eyes, blonde hair, sidelocks, medium breasts, cropped jacket, black leotard, pantyhose, cleavage

  • Galatea: galatea, blonde hair, bob cut, swept bangs, aqua eyes, gold belt, turtleneck leotard, long sleeves, cleavage cutout, gloves

  • Hawkgirl (Justice League season 1-2 masked outfit; you have to prompt "feathered wings" or it will leave them out): hawkgirl, feathered wings, orange hair, strapless shirt, belt, tights, red footwear

  • Hawkgirl (JLU outfit with no mask): shayera hol, feathered wings, green eyes, constricted pupils, orange hair, parted bangs, yellow sports bra, yellow track pants

  • Huntress: huntress, black eyes, mask, cloak, leotard, navel cutout, purple belt, utility belt, elbow gloves, thigh boots, thigh holster

  • Supergirl: supergirl, blonde hair, swept bangs, light blue eyes, no pupils, hairband, white t-shirt, cape, miniskirt, gloves, boots

  • Wonder Woman: wonder woman, blue eyes, constricted pupils, tiara, star earrings, star /(symbol/), strapless leotard, lasso, high heel boots

  • Vixen: vixen, pixie cut, orange eyes, dark skin, tooth necklace, pendant, tooth earrings, orange bodysuit, cleavage, plunging neckline, belt, elbow gloves, claws

  • Zatanna: zatanna zatara, black hair, long hair, medium breasts, magician, tuxedo, suit jacket, white bowtie, vest, leotard, pantyhose, sleeve cuffs, top hat, high heels

Characters with 5-9 images. Might work with low accuracy:

  • Harley Quinn (jester costume; might work because the model already knows her): harley quinn, domino mask, blue eyes, black lips, makeup, jester cap, cuffs, two-tone bodysuit

  • Harleen Quinzel (out of costume): harleen quinzel, short twintails, blonde hair, blue eyes, no pupils, black lips

  • Katma Tui: katma tui, black hair, gray eyes, no pupils, orange skin, medium hair, forked eyebrows

  • Lois Lane: lois lane, black hair, swept bangs, purple eyes, earrings, suit jacket, purple jacket, pleated skirt

  • Poison Ivy: poison ivy, red hair, green skin (or white skin), green eyes, strapless leotard, elbow gloves

  • Roulette: roulette, black hair, hair bun, hair stick, aqua eyes, dangle earrings, sunglasses, looking over eyewear, tattoo, cleavage cutout, sleeveless dress, elbow gloves, fingerless gloves, side slit

  • Stargirl: stargirl, blonde hair, blue eyes, star print, mask, long sleeves, midriff, red belt, bike shorts, gloves, holding staff

  • Volcana: volcana, orange hair, very long hair, spiky hair, red eyes, cleavage cutout, long sleeves, midriff, armband, red gloves

Other characters represented by very few pictures in the dataset. Likely low accuracy!

  • Aquaman, Batman, Bruce Wayne, Circe, Flash, Giganta, John Stewart, Lex Luthor, Livewire, Martian Manhunter, Mercy Graves, Princess Audrey, Superman.

Concepts that were trained somewhat and might work:

  • pointy breasts: Those classic Bruce Timm pointy breasts, though the TV show did not often depict them. Doesn't always work.

  • gotham city: Use the tags "gotham city, red sky, dark" for the red sky look. If you use "night", it may blend the red sky with blue.

  • space station interior, watchtower

  • green lantern bodysuit

  • gold bikini, pelvic curtain, neck ring: the gold space bikini from the episode "Hearts and Minds"

Version Detail

Pony
New version with tweaked dataset and settings. I think this has better style and character accuracy than previous versions. Eyes and hands may still be questionable, so use inpainting or detailer to fix. 330 images x 3 repeats x 20 epochs = 19,800 Optimizer: Prodigy Clip skip 2 min SNR gamma=6 noise offset=0.03 alpha/dim=16/32

Project Permissions

    Use Permissions

  • Use in TENSOR Online

  • As a online training base model on TENSOR

  • Use without crediting me

  • Share merges of this model

  • Use different permissions on merges

    Commercial Use

  • Sell generated contents

  • Use on generation services

  • Sell this model or merges

Comments

Related Posts

Describe the image you want to generate, then press Enter to send.