Waifu Diffusion 1.4 Anime Release Notes

Download Pages

HuggingFace Diffusers: https://huggingface.co/hakurei/waifu-diffusion
Pickled Models: https://huggingface.co/hakurei/waifu-diffusion-v1-4

Table of Contents

Model Overview

The Waifu Diffusion 1.4 Anime model is a Stable Diffusion v2 model that has been finetuned from Stable Diffusion v2.1 Base.

The data used for finetuning Waifu Diffusion 1.4 Anime was 5,468,025 text-image samples that had been downloaded through an image board that provides high-quality tagging and original sources to the artworks themselves that are uploaded to the site.

Within the HuggingFace Waifu Diffusion 1.4 Repository are various models used within the production of the model:

Waifu Diffusion 1.4 Anime Epoch 1: A test model made to properly ensure that the training setup works.
Waifu Diffusion 1.4 Anime Inference Config: A file included to allow for inference with Automatic's WebUI and with the original Stable Diffusion codebase.

Prompting

During dataset processing, the following quality modifiers were added to samples depending on the score of the post:

Quality Modifier Score Criterion

masterpiece >150

best quality 100-150

high quality 75-100

medium quality 25-75

low quality -5-0

worst quality <-5

Additionally, certain metadata were also added in the form of rating modifiers.

Rating Modifiers Criterion

safe Samples that are safe for work.

questionable Samples that include risque visuals which are probably not safe for work.

nsfw Sexually explicit or graphic material that you should not view while your boss is looking over your shoulder.

deleted Samples that were marked for deletion.

Based off of the above modifiers, an ideal negative prompt to guide the model towards high aesthetic generations would look like:

worst quality, low quality, medium quality, deleted, lowres, comic, bad anatomy, bad hands, text, error, missing fingers, extra digit, fewer digits, cropped, jpeg artifacts, signature, watermark, username, blurry

And, the following should also be prepended to prompts to get high aesthetic results:

masterpiece, best quality, high quality, absurdres

Team Members and Acknowledgements

This project would not have been possible without the incredible work by StabilityAI. I would also like to personally thank everyone for their generous support in our Discord server! Thank you guys!

In order to reach us, you can join our Discord server.

Waifu Diffusion 1.4 - AnimeE1