Simply Sybian - Vibing Edition
The goal was to train a second Sybian LORA focusing on a grinding motion. I also had a set of clips that I called 'steady', since the women weren't moving their hips much at all. Alas, grinding and steady positions are extremely similar, so I combined them and called them: Vibing!
After captioning I decided to train a Proof Of Concept model at low resolution that I was expecting to throw out, but it's pretty darn effective, so I'm sharing it with you all now.
I will also train a second model with a higher resolutions and lower learning rate to ensure we have better details and a smoother integration with other concepts. Time will tell if that one outdoes One.
The videos in the showcase should all include the ComfyUI workflow with a healthy wildcard prompt that works for most cases (when it doesn't contradict itself...).
Versions
One
POC training on ~10 of well captioned 2 second videos at 25fps (50 frames). Resolution was 192 pixels squared, 7e-5 learning rate. Repeats 10, training time only about 1.5 hours.
Two
Full training run on nearly the same dataset as one, minus a couple views I determined were not representative enough (missing some key elements of the Sybian experience). Run for 3600 steps on square 324x324x50 vids at 25fps. LR 7e-5 with 500 warm up steps. Training time was over 24 hours.
The only thing this one seems to get wrong sometimes is it will put the person almost behind the sybian, but I find proper prompting solves this just fine and otherwise the quality and flexibility seem as good as any of my LORAs.
Enjoy!
All constructive criticism is very welcome! I don't need Buzz since I train and generate locally, but hitting the LIKE, following and posting your own creations would be awesome!
I've also written a training guide, so check it out if you want to get into it!