1580158
/
kohya_ss
mirror of https://github.com/bmaltais/kohya_ss
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
1,538 Commits
16 Branches
178 Tags
68 MiB
Commit Graph

125 Commits (4c2d2176159c1c84e3293cea6041b8a34f738324)

Author SHA1 Message Date
bmaltais c5b11b2720 Merge branch 'main' of https://github.com/kohya-ss/sd-scripts into dev2 2023-06-06 17:49:03 -04:00
Kohya S bb91a10b5f fix to work LyCORIS<0.1.6 2023-06-06 21:59:57 +09:00
bmaltais aeefc0da8c Merge branch 'main' of https://github.com/kohya-ss/sd-scripts into dev2 2023-06-03 19:31:01 -04:00
Kohya S 5bec05e045 move max_norm to lora to avoid crashing in lycoris 2023-06-03 12:42:32 +09:00
Kohya S 0f0158ddaa scale in rank dropout, check training in dropout 2023-06-02 07:29:59 +09:00
Kohya S dde7807b00 add rank dropout/module dropout 2023-06-01 22:21:36 +09:00
Kohya S f8e8df5a04 fix crash gen script, change to network_dropout 2023-06-01 20:07:04 +09:00
AI-Casanova 9c7237157d
Dropout and Max Norm Regularization for LoRA training (#545) 
* Instantiate max_norm

* minor

* Move to end of step

* argparse

* metadata

* phrasing

* Sqrt ratio and logging

* fix logging

* Dropout test

* Dropout Args

* Dropout changed to affect LoRA only

---------

Co-authored-by: Kohya S <52813779+kohya-ss@users.noreply.github.com>
 2023-06-01 14:58:38 +09:00
bmaltais 68246d8646 Merge branch 'main' of https://github.com/kohya-ss/sd-scripts into dev2 2023-05-22 21:07:32 -04:00
琴动我心 f7a1868fc2
fix: support old LoRA without alpha raise "TypeError: argument of type 'int' is not iterable " 2023-05-22 17:15:51 +08:00
bmaltais 18229b26fc Merge branch 'main' of https://github.com/kohya-ss/sd-scripts into dev2 2023-05-11 14:02:18 -04:00
Kohya S 2767a0f9f2 common block lr args processing in create 2023-05-11 21:47:59 +09:00
Kohya S af08c56ce0 remove unnecessary newline 2023-05-11 21:20:18 +09:00
Kohya S 968bbd2f47
Merge pull request #480 from yanhuifair/main 
fix print "saving" and "epoch" in newline
 2023-05-11 21:05:37 +09:00
bmaltais 80057b5546 Merge branch 'main' of https://github.com/kohya-ss/sd-scripts into dev 2023-05-07 10:02:21 -04:00
Kohya S fdbdb4748a pre calc LoRA in generating 2023-05-07 09:57:54 +09:00
Fair b08154dc36 fix print "saving" and "epoch" in newline 2023-05-07 02:51:01 +08:00
bmaltais e2b56451d1 Merge branch 'main' of https://github.com/kohya-ss/sd-scripts into dev 2023-05-03 07:06:06 -04:00
Isotr0py e1143caf38
Fix DDP issues and Support DDP for all training scripts (#448) 
* Fix DDP bugs

* Fix DDP bugs for finetune and db

* refactor model loader

* fix DDP network

* try to fix DDP network in train unet only

* remove unuse DDP import

* refactor DDP transform

* refactor DDP transform

* fix sample images bugs

* change DDP tranform location

* add autocast to train_db

* support DDP in XTI

* Clear DDP import
 2023-05-03 10:37:47 +09:00
bmaltais 8ef3947369 Merge branch 'main' of https://github.com/kohya-ss/sd-scripts into dev 2023-04-20 18:11:17 -04:00
Kohya S 314a364f61 restore `sd_model` arg for backward compat 2023-04-19 21:11:12 +09:00
Kohya S f770cd96c6
Merge pull request #392 from A2va/fix 
Lora interrogator fixes
 2023-04-19 20:28:27 +09:00
A2va 87163cff8b Fix missing pretrained_model_name_or_path 2023-04-17 09:16:07 +02:00
bmaltais 27c91db673 Merge branch 'main' of https://github.com/kohya-ss/sd-scripts into dev 2023-04-15 08:26:32 -04:00
Kohya S 92332eb96e fix load_state_dict failed in dylora 2023-04-14 22:13:26 +09:00
Kohya S 2de9a51591 fix typos 2023-04-13 21:18:18 +09:00
Kohya S 9ff32fd4c0 fix parameters are not freezed 2023-04-13 21:14:20 +09:00
Kohya S 68e0767404 add comment about scaling 2023-04-12 23:40:10 +09:00
Kohya S e09966024c delete unnecessary lines 2023-04-12 23:16:47 +09:00
Kohya S 893c2fc08a add DyLoRA (experimental) 2023-04-12 23:14:09 +09:00
A2va 683680e5c8 Fixes 2023-04-09 21:52:02 +02:00
bmaltais 5eb3488511 Merge branch 'main' of https://github.com/kohya-ss/sd-scripts into dev 2023-04-07 08:31:06 -04:00
Kohya S 5c020bed49 Add attension couple+reginal LoRA 2023-04-06 08:11:54 +09:00
bmaltais 54a204165b Update to latest kohya_ss code 2023-04-04 18:05:20 -04:00
Kohya S 83c7e03d05 Fix network_weights not working in train_network 2023-04-03 22:45:28 +09:00
Kohya S 6134619998 Add block dim(rank) feature 2023-04-03 21:19:49 +09:00
Kohya S 3beddf341e Suppor LR graphs for each block, base lr 2023-04-03 08:43:11 +09:00
Kohya S c639cb7d5d support older type hint 2023-04-02 16:18:04 +09:00
Kohya S 97e65bf93f change 'stratify' to 'block', add en message 2023-04-02 16:10:09 +09:00
u-haru 19340d82e6 層別学習率を使わない場合にparamsをまとめる 2023-04-02 12:57:55 +09:00
u-haru 058e442072 レイヤー数変更(hako-mikan/sd-webui-lora-block-weight参考) 2023-04-02 04:02:34 +09:00
bmaltais 2eddd64b90 Merge latest sd-script updates 2023-04-01 07:14:25 -04:00
u-haru 786971d443
Merge branch 'dev' into feature/stratified_lr 2023-04-01 15:08:41 +09:00
Kohya S 770a56193e fix conv2d3x3 is not merged 2023-04-01 09:17:37 +09:00
Kohya S 1cd07770a4 format by black 2023-04-01 09:13:47 +09:00
u-haru 3032a47af4 cosineをsineのreversedに変更 2023-03-31 01:42:57 +09:00
u-haru 1b75dbd4f2 引数名に_lrを追加 2023-03-31 01:40:29 +09:00
u-haru dade23a414 stratified_zero_thresholdに変更 2023-03-31 01:14:03 +09:00
u-haru 4dacc52bde implement stratified_lr 2023-03-31 00:39:35 +09:00
Kohya S 2d6faa9860 support LoRA merge in advance 2023-03-30 21:34:36 +09:00