Commit Graph

626 Commits (b9d5db8a423a4e321546eb609bfba0c572306d24)

Author SHA1 Message Date
bmaltais 78c14bd46f Add max_train_steps and lr_scheduler_args 2023-08-09 20:04:04 -04:00
bmaltais 254069ce5f Add v pred like loss support 2023-08-09 12:08:46 -04:00
bmaltais 2958dd8c51
Merge pull request #1352 from channelcat/master
Manual Caption/Tag Tool
2023-08-09 07:28:15 -04:00
bmaltais ef42cf2bb7 Merge branch 'sdxl' of https://github.com/kohya-ss/sd-scripts into dev2 2023-08-09 11:17:01 -04:00
Channel Cat 9d1c890269 Update description text of manual caption tab 2023-08-08 15:27:32 -07:00
Channel Cat 8c088ad1e7 Add manual captioning tab 2023-08-08 15:09:21 -07:00
bmaltais 85f8ece7c9 Update 2023-08-08 08:20:43 -04:00
Kohya S 6f80fe17fc fix crashing in saving lora with clipskip 2023-08-08 21:03:16 +09:00
bmaltais 8d3b4732c9 Fix bf16 selection gui 2023-08-07 08:57:29 -04:00
bmaltais 26dc755c5c Improve training layout. 2023-08-07 08:37:28 -04:00
bmaltais 3b12546e71 Merge branch 'sdxl' of https://github.com/kohya-ss/sd-scripts into dev2 2023-08-06 19:54:30 -04:00
Kohya S 78226f8574 change assert to print 2023-08-06 22:35:01 +09:00
Kohya S 3cdbbb43be fix error in huggingface_path_in_repo=None 2023-08-06 22:08:30 +09:00
Kohya S 92f41f1051 update sdxl ver in lora metadata from v0-9 to v1-0 2023-08-06 22:06:48 +09:00
Kohya S c142dadb46 support sai model spec 2023-08-06 21:50:05 +09:00
bmaltais 3e6438684d Updates 2023-08-05 13:35:42 -04:00
bmaltais 08eb3adae7 Merge branch 'sdxl' of https://github.com/kohya-ss/sd-scripts into dev2 2023-08-05 11:14:00 -04:00
Kohya S e5f9772a35 fix training textencoder in sdxl not working 2023-08-05 21:22:50 +09:00
bmaltais 90d2160417 Merge branch 'sdxl' of https://github.com/kohya-ss/sd-scripts into dev2 2023-08-04 19:58:06 -04:00
bmaltais 78bae1602d Updates 2023-08-04 19:50:22 -04:00
Kohya S 9d855091bf make bitsandbytes optional 2023-08-04 22:29:14 +09:00
Kohya S f3be995c28 remove debug print 2023-08-04 08:44:17 +09:00
Kohya S 9d7619d1eb remove debug print 2023-08-04 08:42:54 +09:00
Kohya S c6d52fdea4 Add workaround for clip's bug for pooled output 2023-08-04 08:38:27 +09:00
Kohya S 0636399c8c add adding v-pred like loss for noise pred 2023-07-31 08:23:28 +09:00
Kohya S f61996b425 remove dependency for albumenations 2023-07-30 16:29:53 +09:00
Kohya S 496c3f2732 arbitrary args for diffusers lr scheduler 2023-07-30 14:36:03 +09:00
Kohya S a296654c1b refactor optimizer selection for bnb 2023-07-30 13:43:29 +09:00
Kohya S b62185b821 change method name, add comments 2023-07-30 13:34:07 +09:00
Kohya S e6034b7eb6 move releasing cache outside of the loop 2023-07-30 13:30:42 +09:00
青龍聖者@bdsqlsz 9ec70252d0
Add Paged/ adam8bit/lion8bit for Sdxl bitsandbytes 0.39.1 cuda118 on windows (#623)
* ADD libbitsandbytes.dll for 0.38.1

* Delete libbitsandbytes_cuda116.dll

* Delete cextension.py

* add main.py

* Update requirements.txt for bitsandbytes 0.38.1

* Update README.md for bitsandbytes-windows

* Update README-ja.md  for bitsandbytes 0.38.1

* Update main.py for return cuda118

* Update train_util.py for lion8bit

* Update train_README-ja.md for lion8bit

* Update train_util.py for add DAdaptAdan and DAdaptSGD

* Update train_util.py for DAdaptadam

* Update train_network.py for dadapt

* Update train_README-ja.md for DAdapt

* Update train_util.py for DAdapt

* Update train_network.py for DAdaptAdaGrad

* Update train_db.py for DAdapt

* Update fine_tune.py for DAdapt

* Update train_textual_inversion.py for DAdapt

* Update train_textual_inversion_XTI.py for DAdapt

* Revert "Merge branch 'qinglong' into main"

This reverts commit b65c023083d6d1e8a30eb42eddd603d1aac97650, reversing
changes made to f6fda20caf5e773d56bcfb5c4575c650bb85362b.

* Revert "Update requirements.txt for bitsandbytes 0.38.1"

This reverts commit 83abc60dfaddb26845f54228425b98dd67997528.

* Revert "Delete cextension.py"

This reverts commit 3ba4dfe046874393f2a022a4cbef3628ada35391.

* Revert "Update README.md for bitsandbytes-windows"

This reverts commit 4642c52086b5e9791233007e2fdfd97f832cd897.

* Revert "Update README-ja.md  for bitsandbytes 0.38.1"

This reverts commit fa6d7485ac067ebc49e6f381afdb8dd2f12caa8f.

* Update train_util.py for DAdaptLion

* Update train_README-zh.md for dadaptlion

* Update train_README-ja.md for DAdaptLion

* add DAdatpt V3

* Alignment

* Update train_util.py for experimental

* Update train_util.py V3

* Update train_util.py

* Update requirements.txt

* Update train_README-zh.md

* Update train_README-ja.md

* Update train_util.py fix

* Update train_util.py

* support Prodigy

* add lower

* Update main.py

* support PagedAdamW8bit/PagedLion8bit

* Update requirements.txt

* update for PageAdamW8bit and PagedLion8bit

* Revert

* revert main

* Update train_util.py

* update for bitsandbytes 0.39.1

* Update requirements.txt

* vram leak fix

---------

Co-authored-by: Pam <pamhome21@gmail.com>
2023-07-30 13:15:13 +09:00
Kohya S e20b6acfe9
Merge pull request #676 from Isotr0py/sdxl
Fix RAM leak when loading SDXL model in lowram device
2023-07-30 12:46:23 +09:00
bmaltais 6f6bf88458 Merge branch 'sdxl-dev' into dev2 2023-07-29 17:08:30 -04:00
bmaltais 814191b5a0 Merge branch 'sdxl' of https://github.com/kohya-ss/sd-scripts into dev2 2023-07-29 17:06:00 -04:00
Isotr0py d9180c03f6 fix typos for _load_state_dict 2023-07-29 22:25:00 +08:00
Kohya S 4072f723c1 Merge branch 'main' into sdxl 2023-07-29 14:55:03 +09:00
Kohya S 1e4512b2c8 support ckpt without position id in sd v1 #687 2023-07-29 14:19:25 +09:00
Isotr0py 1199eacb72 fix typo 2023-07-28 13:49:37 +08:00
Isotr0py fdb58b0b62 fix mismatch dtype 2023-07-28 13:47:54 +08:00
Isotr0py 315fbc11e5 refactor model loading to catch error 2023-07-28 13:10:38 +08:00
Isotr0py 272dd993e6
Merge branch 'sdxl' into sdxl 2023-07-28 10:19:37 +08:00
Isotr0py 96a52d9810 add dtype to u-net loading 2023-07-27 23:58:25 +08:00
Isotr0py 50544b7805 fix pipeline dtype 2023-07-27 23:16:58 +08:00
bmaltais a9ec90c40a Update extract LoRA and add sdpa 2023-07-25 20:11:32 -04:00
bmaltais 101d2638e2 Merge branch 'sdxl' of https://github.com/kohya-ss/sd-scripts into sdxl-dev 2023-07-25 10:01:44 -04:00
Kohya S b78c0e2a69 remove unused func 2023-07-25 19:07:26 +09:00
bmaltais fcf087c2ce Fix finetuner gui code issues 2023-07-23 22:58:54 -04:00
bmaltais 4849ea8dbc Merge branch 'dev' of https://github.com/kohya-ss/sd-scripts into sdxl-dev 2023-07-23 06:34:10 -04:00
bmaltais 46638c326e Merge branch 'sdxl' of https://github.com/kohya-ss/sd-scripts into dev2 2023-07-23 06:29:48 -04:00
Isotr0py eec6aaddda fix safetensors error: device invalid 2023-07-23 13:29:29 +08:00