Commit Graph

63 Commits (b9d5db8a423a4e321546eb609bfba0c572306d24)

Author SHA1 Message Date
bmaltais b762ed2d8b Merge branch 'sdxl' of https://github.com/kohya-ss/sd-scripts into dev2 2023-07-10 09:02:35 -04:00
Kohya S 66c03be45f Fix TE key names for SD1/2 LoRA are invalid 2023-07-08 09:56:38 +09:00
bmaltais ac04f95ae7 Merge branch 'sdxl' of https://github.com/kohya-ss/sd-scripts into sdxl 2023-06-30 14:25:20 -04:00
Kohya S 747af145ed add sdxl fine-tuning and LoRA 2023-06-26 08:07:24 +09:00
Kohya S 92e50133f8
Merge branch 'original-u-net' into dev 2023-06-17 21:57:08 +09:00
bmaltais c5b11b2720 Merge branch 'main' of https://github.com/kohya-ss/sd-scripts into dev2 2023-06-06 17:49:03 -04:00
Kohya S bb91a10b5f fix to work LyCORIS<0.1.6 2023-06-06 21:59:57 +09:00
bmaltais aeefc0da8c Merge branch 'main' of https://github.com/kohya-ss/sd-scripts into dev2 2023-06-03 19:31:01 -04:00
Kohya S 5bec05e045 move max_norm to lora to avoid crashing in lycoris 2023-06-03 12:42:32 +09:00
Kohya S 0f0158ddaa scale in rank dropout, check training in dropout 2023-06-02 07:29:59 +09:00
Kohya S dde7807b00 add rank dropout/module dropout 2023-06-01 22:21:36 +09:00
ddPn08 c8d209d36c
update diffusers to 1.16 | train_network 2023-06-01 20:39:26 +09:00
Kohya S f8e8df5a04 fix crash gen script, change to network_dropout 2023-06-01 20:07:04 +09:00
AI-Casanova 9c7237157d
Dropout and Max Norm Regularization for LoRA training (#545)
* Instantiate max_norm

* minor

* Move to end of step

* argparse

* metadata

* phrasing

* Sqrt ratio and logging

* fix logging

* Dropout test

* Dropout Args

* Dropout changed to affect LoRA only

---------

Co-authored-by: Kohya S <52813779+kohya-ss@users.noreply.github.com>
2023-06-01 14:58:38 +09:00
bmaltais 68246d8646 Merge branch 'main' of https://github.com/kohya-ss/sd-scripts into dev2 2023-05-22 21:07:32 -04:00
琴动我心 f7a1868fc2
fix: support old LoRA without alpha raise "TypeError: argument of type 'int' is not iterable " 2023-05-22 17:15:51 +08:00
bmaltais 18229b26fc Merge branch 'main' of https://github.com/kohya-ss/sd-scripts into dev2 2023-05-11 14:02:18 -04:00
Kohya S 2767a0f9f2 common block lr args processing in create 2023-05-11 21:47:59 +09:00
bmaltais 80057b5546 Merge branch 'main' of https://github.com/kohya-ss/sd-scripts into dev 2023-05-07 10:02:21 -04:00
Kohya S fdbdb4748a pre calc LoRA in generating 2023-05-07 09:57:54 +09:00
bmaltais 5eb3488511 Merge branch 'main' of https://github.com/kohya-ss/sd-scripts into dev 2023-04-07 08:31:06 -04:00
Kohya S 5c020bed49 Add attension couple+reginal LoRA 2023-04-06 08:11:54 +09:00
bmaltais 54a204165b Update to latest kohya_ss code 2023-04-04 18:05:20 -04:00
Kohya S 83c7e03d05 Fix network_weights not working in train_network 2023-04-03 22:45:28 +09:00
Kohya S 6134619998 Add block dim(rank) feature 2023-04-03 21:19:49 +09:00
Kohya S 3beddf341e Suppor LR graphs for each block, base lr 2023-04-03 08:43:11 +09:00
Kohya S c639cb7d5d support older type hint 2023-04-02 16:18:04 +09:00
Kohya S 97e65bf93f change 'stratify' to 'block', add en message 2023-04-02 16:10:09 +09:00
u-haru 19340d82e6 層別学習率を使わない場合にparamsをまとめる 2023-04-02 12:57:55 +09:00
u-haru 058e442072 レイヤー数変更(hako-mikan/sd-webui-lora-block-weight参考) 2023-04-02 04:02:34 +09:00
bmaltais 2eddd64b90 Merge latest sd-script updates 2023-04-01 07:14:25 -04:00
u-haru 3032a47af4 cosineをsineのreversedに変更 2023-03-31 01:42:57 +09:00
u-haru 1b75dbd4f2 引数名に_lrを追加 2023-03-31 01:40:29 +09:00
u-haru dade23a414 stratified_zero_thresholdに変更 2023-03-31 01:14:03 +09:00
u-haru 4dacc52bde implement stratified_lr 2023-03-31 00:39:35 +09:00
Kohya S 2d6faa9860 support LoRA merge in advance 2023-03-30 21:34:36 +09:00
Kohya S bf3674c1db format by black 2023-03-29 21:23:27 +09:00
bmaltais fc5d2b2c31 Update to sd-script dev code base 2023-03-10 11:44:52 -05:00
Kohya S 75d1883da6 fix LoRA rank is limited to target dim 2023-03-10 21:12:15 +09:00
bmaltais 2deddd5f3c Update to sd-script latest update 2023-03-09 11:06:59 -05:00
Kohya S e7051d427c fix default conv alpha to 1 2023-03-09 20:26:14 +09:00
Kohya S c4b4d1cb40 fix LoRA always expanded to Conv2d-3x3 2023-03-09 08:47:13 +09:00
bmaltais 25d6e252d3 Save prompt file in sample directory 2023-03-08 07:30:14 -05:00
Kohya S 19386df6e9 expand LoRA to all Conv2d 2023-03-06 22:03:09 +09:00
Kohya S fe4f4446f1 Add region control for LoRA 2023-03-04 18:03:11 +09:00
bmaltais 60ad22733c Update to latest code version 2023-02-23 19:21:30 -05:00
Kohya S d94c0d70fe support network mul from prompt 2023-02-19 18:43:35 +09:00
bmaltais 09d3a72cd8 Adding support for caption dropout 2023-02-07 20:58:35 -05:00
Kohya S b3020db63f support python 3.8 2023-02-07 22:29:12 +09:00
bmaltais 03bd2e9b01 Add TI training support 2023-01-26 16:22:58 -05:00