Commit Graph

36 Commits (b9d5db8a423a4e321546eb609bfba0c572306d24)

Author SHA1 Message Date
bmaltais 90d2160417 Merge branch 'sdxl' of https://github.com/kohya-ss/sd-scripts into dev2 2023-08-04 19:58:06 -04:00
Kohya S 0636399c8c add adding v-pred like loss for noise pred 2023-07-31 08:23:28 +09:00
bmaltais 7c57254de9 Merge branch 'sdxl' of https://github.com/kohya-ss/sd-scripts into dev2 2023-07-18 15:27:02 -04:00
Kohya S 6d2d8dfd2f add zero_terminal_snr option 2023-07-18 23:17:23 +09:00
bmaltais ac04f95ae7 Merge branch 'sdxl' of https://github.com/kohya-ss/sd-scripts into sdxl 2023-06-30 14:25:20 -04:00
Kohya S 92e50133f8
Merge branch 'original-u-net' into dev 2023-06-17 21:57:08 +09:00
bmaltais 567e41f236 Merge branch 'main' of https://github.com/kohya-ss/sd-scripts into dev2 2023-06-09 09:25:02 -04:00
Kohya S 045cd38b6e fix clip_skip not work in weight capt, sample gen 2023-06-08 22:02:46 +09:00
bmaltais aeefc0da8c Merge branch 'main' of https://github.com/kohya-ss/sd-scripts into dev2 2023-06-03 19:31:01 -04:00
Kohya S 5bec05e045 move max_norm to lora to avoid crashing in lycoris 2023-06-03 12:42:32 +09:00
Kohya S ec2efe52e4 scale v-pred loss like noise pred 2023-06-03 10:52:22 +09:00
ddPn08 1f1cae6c5a
make the device of `snr_weight` the same as loss 2023-06-01 20:39:28 +09:00
Kohya S f4c9276336 add scaling to max norm 2023-06-01 19:46:17 +09:00
AI-Casanova 9c7237157d
Dropout and Max Norm Regularization for LoRA training (#545)
* Instantiate max_norm

* minor

* Move to end of step

* argparse

* metadata

* phrasing

* Sqrt ratio and logging

* fix logging

* Dropout test

* Dropout Args

* Dropout changed to affect LoRA only

---------

Co-authored-by: Kohya S <52813779+kohya-ss@users.noreply.github.com>
2023-06-01 14:58:38 +09:00
bmaltais ee310e3776 Merge branch 'main' of https://github.com/kohya-ss/sd-scripts into dev2 2023-05-15 15:14:05 -04:00
Kohya S 714846e1e1 revert perlin_noise 2023-05-15 23:12:11 +09:00
hkinghuang bca6a44974 Perlin noise 2023-05-15 11:16:08 +08:00
hkinghuang 5f1d07d62f init 2023-05-12 21:38:07 +08:00
bmaltais 18229b26fc Merge branch 'main' of https://github.com/kohya-ss/sd-scripts into dev2 2023-05-11 14:02:18 -04:00
青龍聖者@bdsqlsz 8d562ecf48
fix pynoise code bug (#489)
* fix pynoise

* Update custom_train_functions.py for default

* Update custom_train_functions.py for note

* Update custom_train_functions.py for default

* Revert "Update custom_train_functions.py for default"

This reverts commit ca79915d7396ddb57adbeb4b78bafb9a1a884b5c.

* Update custom_train_functions.py for default

* Revert "Update custom_train_functions.py for default"

This reverts commit 483577e137b13933ff24b6ae254f82c0a8d9f1fe.

* default value change
2023-05-11 21:48:51 +09:00
bmaltais 80057b5546 Merge branch 'main' of https://github.com/kohya-ss/sd-scripts into dev 2023-05-07 10:02:21 -04:00
Kohya S 09c719c926 add adaptive noise scale 2023-05-07 18:09:08 +09:00
bmaltais e2b56451d1 Merge branch 'main' of https://github.com/kohya-ss/sd-scripts into dev 2023-05-03 07:06:06 -04:00
Pam b18d099291 Multi-Resolution Noise 2023-05-02 09:42:17 +05:00
bmaltais 873af2adc8 Merge branch 'main' of https://github.com/kohya-ss/sd-scripts into dev 2023-04-09 16:11:21 -04:00
Kohya S 6a5f87d874 disable weighted captions in TI/XTI training 2023-04-08 21:45:57 +09:00
Kohya S a876f2d3fb format by black 2023-04-08 21:36:35 +09:00
AI-Casanova dbab72153f
Clean up custom_train_functions.py
Removed commented out lines from earlier bugfix.
2023-04-08 00:44:56 -05:00
AI-Casanova 1892c82a60 Reinstantiate weighted captions after a necessary revert to Main 2023-04-02 19:43:34 +00:00
bmaltais 8822eab5a6 Merge new sd-scripts updates 2023-03-28 11:54:42 -04:00
Kohya S 43a08b4061 add ja comment 2023-03-27 20:47:27 +09:00
AI-Casanova 4c06bfad60 Fix for TypeError from bf16 precision: Thanks to mgz-dev 2023-03-26 00:01:29 +00:00
AI-Casanova 518a18aeff (ACTUAL) Min-SNR Weighting Strategy: Fixed SNR calculation to authors implementation 2023-03-23 12:34:49 +00:00
AI-Casanova a3c7d711e4 Min-SNR Weighting Strategy: Fixed SNR calculation to authors implementation 2023-03-23 05:43:46 +00:00
AI-Casanova 64c923230e Min-SNR Weighting Strategy: Refactored and added to all trainers 2023-03-22 01:27:29 +00:00
bmaltais 77ccc53046 min-snr 2023-03-21 20:03:53 -04:00