Does life imitate art? Does art imitate life? Or maybe, it's just a case of art becoming life.
Overview
I've been working on this LoRa since October of last year. First figuring out how to get it to even understand the basic concept of art coming to life and coming off the page/out of the screen, and then about 30 more tries roping it back in so the hands don't blow up every time. You'll still get your fair share of misfires here, but it is finally at the point where it hits way more often than it fails. And when it does fail to get what we were going for, it often does something fun and interesting anyway.
Main:
OutOfScreen
Screens:
Monitor
Battlestation*
Laptop
oil painting
crt
Methods:
stepping
walking
flying
leaning
Gender:
Man
Woman
Styles:
Cartoon
tech style
60s style
Rave Style
Psychedelic
pop art style
B&W
FX:
pixel explosion
explosion
hologram
fiery explosion
vortex
static
colored smoke
circuitry
Misc. Looks:
Burglar
flowing hair
* - Note on "Battlestation" - this doesn't work as consistently as the other "Screens" and the better your checkpoint is at drawing a "battlestation" (i.e. a tricked out multi-monitor computer setup), the more likely your success. It sometimes has a tendency to have the people coming out of the desktop/floor rather than one of the monitors.
Dynamic Prompt Template
If you use the Dynamic Prompts extension or something else that will pick a {random|token|from|list} in brackets - this is a good template to experiment with. Keep in mind that some things work better together than others. For example, "static" works best on a CRT type screen.
The FX tokens - especially if you use more than one - sometimes benefit from making the weight a bit lower. The more special effects going on - especially effects that are near the hands - the more likely you are to get the dreaded spindly fingers thing.
<lora:XenoTALES-OutOfScreen:1>OutOfScreen, {man|woman|burglar}, ({Monitor|Laptop|battlestation|oil painting|crt}), {stepping|walking|flying|leaning| }, {Cartoon|tech style|60s style|Rave Style|Psychedelic|pop art style|B&W| }, ({pixel explosion|explosion|hologram|fiery explosion|vortex|static|colored smoke|cicuitry}:0.8), The "man|woman|burglar" can be replaced by character names or just about any person. You MIGHT even be able to get things coming out that aren't humans, but I haven't quite figured out a consistent way to get that happening yet.
TIPS
Hands: You know the drill with hands... the more dynamic the action, the more likely things are to go bad. "Flying" out of the screen is the most volatile. If the hands look under-detailed, more steps can often help. If they are spindly and weird, then backing down the weight of the token (or even the LoRa) can sometimes help. Until the past few weeks, my hand failures were coming about 80% of the time. With the new tagging system and training settings I used, it's now down to maybe 20% (or maybe 30-35% if you're going for lots of action). If there's anything about this LoRa that is going to drive you insane - it's this. Inpainting can solve most issues though. (I've left some hand-fails in the sample images so you can get an idea of what they look like - and how hard or easy it may be to fix with some post-work).
Checkpoint Selection: I tried to make this work on as many checkpoints as possible BUT... it struggles a bit on checkpoints that are locked into a specific style. If it ONLY does a specific art style or photorealistic generations, it will likely struggle a bit. If the styles in the checkpoint are more flexible, it works a lot better.
Other Portals: If you lower the weight of the LoRa a bit and use regular prompts, you might find that doorways become portals or windows seem to be looking out into a world that is different from the interior. Most of my testing to date has been just ensuring that it works and doesn't blow up, so I haven't mastered controlling this yet - but FX and Styles from this LoRa can make interesting outputs worth exploring.
Learn More/Do More
Please don't forget to Follow Me here on Civitai so you will be informed of new things.
Need help prompting, finding tools and techniques to accomplish specific things, or generally want to learn more about SD, Generation, Making your own LoRas, Checkpoints, TI's and more - join the Xeno Engine Discord - we're a growing group of creators from all over the world with various, though often a bit deviant, interests. (NSFW).
Please take a moment to like, collect, and review any of my models that you enjoy. Each of those things helps the model be more visible to the community. The more visible, the more likes and reviews and downloads, which leads to more buzz and more rankings. Eventually, I hope that my earning pennies for each dollar put into buzz will get me to the point where I'm making an extra $10 a week to cover my Friday PBR Six-Pack. I know... high hopes, but... I can dream, right?
The Only Dumb Question is the Unasked Question. This is an important rule that I live by. You might feel shy about asking for help with something that is probably obvious to most people who have been doing this for a while, but here's a secret... we ALL were at that "total newb" stage at one point - and heck, when it comes to prompting especially, I still consider myself a "somewhat skilled novice". If you want some help on something - it's only dumb if you don't ask. If you do ask - on site, on discord or wherever - you'll never be looked down upon by me (or any of the people on the discord, lest they be shut down like an illegal gambling operation.
