41 lines
1.6 KiB
Markdown
41 lines
1.6 KiB
Markdown
# Hypernetwork-MonkeyPatch-Extension
|
|
Extension that patches Hypernetwork structures and training
|
|
|
|
|
|
For Hypernetwork structure, see https://github.com/AUTOMATIC1111/stable-diffusion-webui/pull/4334
|
|
|
|
For Variable Dropout, see https://github.com/AUTOMATIC1111/stable-diffusion-webui/pull/4288
|
|
|
|
|
|
### Train_Beta tab allows some more options with improved training.
|
|
|
|
|
|
### Features
|
|
|
|
**No-Crop Training**
|
|
|
|
You can train without cropping images.
|
|
|
|
**Fix OSError while training**
|
|
|
|
**Unload Optimizer while generating Previews**
|
|
|
|
|
|
|
|
|
|
### Create_Beta_hypernetwork allows creating beta hypernetworks.
|
|
|
|
|
|
This extension also overrides how webui loads and finds hypernetworks, to use variable dropout rates, and etc.
|
|
Thus, hypernetwork created with variable dropout rate might not work correctly in original webui.
|
|
|
|
### Train_Gamma tab uses Gradient Accumulation from separate PR.(as well as beta functionalities)
|
|
|
|
|
|
|
|
|
|
### CosineAnnealingWarmupRestarts
|
|
|
|
|
|
This also fixes some CUDA memory issues. Currently both Beta and Gamma Training is working very well, as far as I could say.
|