Hypernetwork-MonkeyPatch-Ex.../README.md

1.6 KiB

Hypernetwork-MonkeyPatch-Extension

Extension that patches Hypernetwork structures and training image

For Hypernetwork structure, see https://github.com/AUTOMATIC1111/stable-diffusion-webui/pull/4334

For Variable Dropout, see https://github.com/AUTOMATIC1111/stable-diffusion-webui/pull/4288

Train_Beta tab allows some more options with improved training.

image

Features

No-Crop Training image You can train without cropping images.

Fix OSError while training

Unload Optimizer while generating Previews

Create_Beta_hypernetwork allows creating beta hypernetworks.

This extension also overrides how webui loads and finds hypernetworks, to use variable dropout rates, and etc. Thus, hypernetwork created with variable dropout rate might not work correctly in original webui.

Train_Gamma tab uses Gradient Accumulation from separate PR.(as well as beta functionalities)

image

CosineAnnealingWarmupRestarts

image

This also fixes some CUDA memory issues. Currently both Beta and Gamma Training is working very well, as far as I could say.