1580158
/
kohya_ss
mirror of https://github.com/bmaltais/kohya_ss
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
2,653 Commits
16 Branches
178 Tags
68 MiB
Commit Graph

206 Commits (0d4e6c4ece67e8375062cf39f3a8a1e83317382f)

Author SHA1 Message Date
bmaltais f1193eaece Fix issue with noise offset 2023-05-04 15:00:43 -04:00
bmaltais d3a89443cd Add multi-resolution noise training support 2023-05-03 09:59:18 -04:00
bmaltais 856d610ea9 Add --cache_latents_to_disk option to the GUI 2023-05-01 20:10:47 -04:00
bmaltais 536260dc15 update logging 2023-04-28 21:40:34 -04:00
bmaltais 7bd1cb9d08 Merge branch 'main' of https://github.com/kohya-ss/sd-scripts into dev 2023-04-27 09:03:59 -04:00
bmaltais 35afccc37a Update merge lora 2023-04-20 09:56:40 -04:00
bmaltais 2e07329088 Upgrading to latest gradio release 2023-04-17 20:54:55 -04:00
bmaltais 27c91db673 Merge branch 'main' of https://github.com/kohya-ss/sd-scripts into dev 2023-04-15 08:26:32 -04:00
bmaltais 1f8fdd632d Fix Adafactor issue 2023-04-13 19:42:46 -04:00
bmaltais 873af2adc8 Merge branch 'main' of https://github.com/kohya-ss/sd-scripts into dev 2023-04-09 16:11:21 -04:00
bmaltais 1f153629fe Fix bug 554 2023-04-07 08:55:03 -04:00
bmaltais 7b87edfd29 Adding GUI support for new sd-scripts features 2023-04-05 08:33:24 -04:00
bmaltais 369341d69f
Revert "macOS GUI functionality, sub-processed GUI components" 2023-04-01 21:28:47 -04:00
JSTayco eef5becab8 All sorts of broken, but I need to commit this for now so I don't lose it. WIP: Using some OOP to reduce imports and centralize some code. No need to remake Tk Windows everywhere for example. Renamed common_gui to common_gui_functions.py to make some of the new code separation more obvious. 2023-03-31 14:39:10 -07:00
JSTayco e5b83df675 Removed one warning dealing with get_file_path() 
Using lambdas now to pass in variable amount of arguments from components. This works right now with a few open windows, but saving and possibly loading will be broken right now. They need the lambda treatment next.

I also split the JSON validation placeholder to library/common_utilities.py.
 2023-03-30 13:13:25 -07:00
jstayco 160e371be3
Merge branch 'dev' into macos_gui 2023-03-30 01:53:32 -07:00
JSTayco 7b5639cff5 Huge WIP 
This is a massive WIP and should not be trusted or used right now. However, major milestones have been crossed. Both message boxes and file dialogs are now properly subprocessed and work on macOS. I think by extension, it may work on runpod environments as well, but that remains to be tested.
 2023-03-30 01:40:00 -07:00
bmaltais ea90c05841
Merge pull request #471 from srndpty/feature/decimal-network-alpha 
Change step of network_alpha from 1 to 0.1
 2023-03-28 11:57:59 -04:00
bmaltais 8822eab5a6 Merge new sd-scripts updates 2023-03-28 11:54:42 -04:00
Masaki Takano 2e6ebec8b2 same change for conv_alpha 2023-03-28 21:28:41 +09:00
Masaki Takano 5c4c1d6f17 Change step of network_alpha from 1 to 0.1 2023-03-28 21:11:17 +09:00
bmaltais ad018dd56d
Merge pull request #454 from kvzn/master 
Fixed the bug that it did not support capital image extensions like .JPG, .JPEG
 2023-03-26 11:06:58 -04:00
KVZN 3f86e8f7df Fixed the bug that it did not support capital image extensions like .JPG, .JPEG 2023-03-26 17:59:42 +08:00
bmaltais 0e25977a09
Merge pull request #446 from ykk648/master 
add LAN support
 2023-03-25 12:45:45 -04:00
bmaltais d0ffba6650 Remove bad save_model_as choices for LoRA and TI 2023-03-25 09:08:02 -04:00
luanjintai 959ab91484 add LAN support 2023-03-25 15:59:57 +08:00
bmaltais 1c8d901c3b Update to latest sd-scripts updates 2023-03-21 20:20:57 -04:00
bmaltais ccae80186a Update to latest sd-script code 2023-03-20 08:47:00 -04:00
bmaltais baf009d2b1 Fix basic captioning logic 2023-03-15 19:31:52 -04:00
bmaltais 91e19ca9d9 Fix issue with kohya locon not training the convolution layers 2023-03-12 20:36:58 -04:00
bmaltais 75c21eabbc Update description 2023-03-11 14:53:43 -05:00
bmaltais 5597f19cbc Merge branch 'dev' into LoHa-Support 2023-03-11 10:47:40 -05:00
bmaltais a65555ea67 Add support to load a config without opening the UI to get the file name 2023-03-10 20:05:38 -05:00
bmaltais fc5d2b2c31 Update to sd-script dev code base 2023-03-10 11:44:52 -05:00
bmaltais ba9e26a99d LoHa support 2023-03-09 07:49:50 -05:00
bmaltais cd0d72c7f5 Update color of command for print 2023-03-08 09:46:20 -05:00
bmaltais 3a5d491ff2 Add option to print LoRA trainer command without executing it 2023-03-08 08:49:12 -05:00
bmaltais 25d6e252d3 Save prompt file in sample directory 2023-03-08 07:30:14 -05:00
bmaltais 7ed8f7c3c5 Add additional parameters feild 2023-03-07 07:42:13 -05:00
bmaltais 7249b0baa8 Update to latest sd-script release 
add gui support for sample config
 2023-03-06 19:15:02 -05:00
bmaltais 2e47a45e3f Change how subprocess is run 2023-03-05 11:43:59 -05:00
bmaltais 09939ff8a8 Remove legacy 8bit adam checkbox 2023-03-05 10:34:09 -05:00
bmaltais 3beeef4414 Add linux support 2023-03-04 18:56:22 -05:00
bmaltais fa92a5c1e3
Merge branch 'dev' into master 2023-03-04 17:59:31 -05:00
bmaltais e93de7f8ea Fix issue 296 2023-03-04 17:46:32 -05:00
devNegative-asm a79d7be063
Merge branch 'bmaltais:master' into master 2023-03-04 00:13:22 -05:00
devdn bc45bd7e70 fix bugs that make some processes not work on linux 2023-03-04 00:11:23 -05:00
bmaltais c61ad5f8f9 Fix for LoCon sliders visibility 2023-03-03 10:21:24 -05:00
bmaltais 29bb8599bb Fix issue 278 2023-03-03 07:41:44 -05:00
bmaltais 4c762e3abb Upgrade Gradio 
Fix Gradio issues
Fix missing LoCon new GUI
 2023-03-02 20:39:07 -05:00
bmaltais 11b3955032
Merge branch 'LoCon' into dev 2023-03-02 07:53:01 -05:00
bmaltais 384009d4eb
Merge pull request #251 from Ki-wimon/master 
LoCon script auto upgrade feature
 2023-03-02 07:09:16 -05:00
bmaltais 182080bb78 Run blue 2023-03-01 19:24:11 -05:00
bmaltais 7f0e5683c6 v21.0.1 2023-03-01 19:02:04 -05:00
bmaltais 1e3055c895 Update tensorboard 2023-03-01 13:14:47 -05:00
Ki-wimon 5bfd478d32
update description to LoCon training 2023-03-01 20:27:23 +08:00
Ki-wimon 88a49df47e
set inital value to LoCon conv parameters 2023-03-01 18:57:02 +08:00
Ki-wimon cdb8bb1182
update code of cloning locon scripts 2023-03-01 13:07:38 +08:00
Ki-wimon 6bcd52c9cc
update new locon args support 2023-03-01 12:22:11 +08:00
Ki-wimon c07e3bba76
add new LoCon args 2023-03-01 12:19:18 +08:00
Ki-wimon d76fe7d4e0
LoCon script auto upgrade feature 2023-02-28 22:58:35 +08:00
bmaltais b1fb87a9e1 Merging PR into LoCon branch 2023-02-28 07:45:42 -05:00
bmaltais dfd155a8e1 Undo LoCon commit 2023-02-28 07:37:19 -05:00
bmaltais f6bec77eaa
Merge branch 'dev' into master 2023-02-28 07:04:08 -05:00
Ki-wimon c32a99dad5
Update lora_gui.py 2023-02-28 01:38:05 +08:00
Ki-wimon 6e664f1176
support locon 2023-02-28 01:16:23 +08:00
bmaltais 9d2e3f85a2 Add tensorboard support 2023-02-26 19:49:22 -05:00
bmaltais f213b15014 Updates 2023-02-24 20:37:51 -05:00
bmaltais bf0344ba9e Adding GUI support for new features 2023-02-22 20:32:57 -05:00
bmaltais dfc9a8dd40 Fix issue with save config 2023-02-20 07:56:24 -05:00
bmaltais 758bfe85dc Adding support for Lion optimizer in gui 2023-02-19 20:13:03 -05:00
bmaltais e5f8ba559f Add server_port and inbrowser support 
- to all gui scripts
 2023-02-10 08:22:03 -05:00
bmaltais 09d3a72cd8 Adding support for caption dropout 2023-02-07 20:58:35 -05:00
bmaltais cbfc311687 Integrate new bucket parameters in GUI 2023-02-05 20:07:00 -05:00
bmaltais 2486af9903 Update to latest dev code of kohya_s. WIP 2023-02-05 14:16:53 -05:00
bmaltais 2626214f8a Add support for LoRA resizing 2023-02-04 11:55:06 -05:00
bmaltais 045750b46a v20.6.0 
- Increase max LoRA rank (dim) size to 1024.
    - Update finetune preprocessing scripts.
        - ``.bmp`` and ``.jpeg`` are supported. Thanks to breakcore2 and p1atdev!
        - The default weights of ``tag_images_by_wd14_tagger.py`` is now ``SmilingWolf/wd-v1-4-convnext-tagger-v2``. You can specify another model id from ``SmilingWolf`` by ``--repo_id`` option. Thanks to SmilingWolf for the great work.
        - To change the weight, remove ``wd14_tagger_model`` folder, and run the script again.
        - ``--max_data_loader_n_workers`` option is added to each script. This option uses the DataLoader for data loading to speed up loading, 20%~30% faster.
        - Please specify 2 or 4, depends on the number of CPU cores.
        - ``--recursive`` option is added to ``merge_dd_tags_to_metadata.py`` and ``merge_captions_to_metadata.py``, only works with ``--full_path``.
        - ``make_captions_by_git.py`` is added. It uses [GIT microsoft/git-large-textcaps](https://huggingface.co/microsoft/git-large-textcaps) for captioning.
        - ``requirements.txt`` is updated. If you use this script, [please update the libraries](https://github.com/kohya-ss/sd-scripts#upgrade).
        - Usage is almost the same as ``make_captions.py``, but batch size should be smaller.
        - ``--remove_words`` option removes as much text as possible (such as ``the word "XXXX" on it``).
        - ``--skip_existing`` option is added to ``prepare_buckets_latents.py``. Images with existing npz files are ignored by this option.
        - ``clean_captions_and_tags.py`` is updated to remove duplicated or conflicting tags, e.g. ``shirt`` is removed when ``white shirt`` exists. if ``black hair`` is with ``red hair``, both are removed.
    - Tag frequency is added to the metadata in ``train_network.py``. Thanks to space-nuko!
        - __All tags and number of occurrences of the tag are recorded.__ If you do not want it, disable metadata storing with ``--no_metadata`` option.
 2023-02-04 08:36:35 -05:00
bmaltais c8f4c9d6e8 Add support for lr_scheduler_num_cycles, lr_scheduler_power 2023-01-30 08:26:15 -05:00
bmaltais 202923b3ce Add support for --keep_token option 2023-01-27 07:33:44 -05:00
bmaltais bf371b49bf Fix issue 71 2023-01-27 07:04:35 -05:00
bmaltais 03bd2e9b01 Add TI training support 2023-01-26 16:22:58 -05:00
bmaltais 511361c80b - Add new tool to verify LoRA weights produced by the trainer. Can be found under "Dreambooth LoRA/Tools/Verify LoRA 2023-01-22 11:40:14 -05:00
bmaltais 2ca17f69dd v20.4.0: 
Add support for `network_alpha` under the Training tab and support for `--training_comment` under the Folders tab.
 2023-01-22 10:18:00 -05:00
bmaltais fcad6bfd98 Add default for caption extension tools 2023-01-20 18:41:37 -05:00
bmaltais 6a85f15542 Remove arg that were replaced 2023-01-19 20:49:40 -05:00
bmaltais 567221549f Complete training code refactoring 2023-01-15 19:59:40 -05:00
bmaltais 123cf4e3c5 Move cxommon adv train parm to common gui 2023-01-15 15:03:04 -05:00
bmaltais abccecb093 Move save_state and resume to common gui 
Format code
 2023-01-15 12:01:59 -05:00
bmaltais 6aed2bb402 Add support for new arguments: 
- max_train_epochs
- max_data_loader_n_workers
Move some of the codeto  common gui library.
 2023-01-15 11:05:22 -05:00
bmaltais 43116feda8 Add support for max token 2023-01-10 09:38:32 -05:00
bmaltais 11fbc63440 Fix issue with lora model loading 2023-01-09 17:22:42 -05:00
bmaltais dc5afbb057 Move functions to common_gui 
Add model name support
 2023-01-09 11:48:57 -05:00
bmaltais a4262c0a66 - Add vae support to dreambooth GUI 
- Add gradient_checkpointing, gradient_accumulation_steps, mem_eff_attn, shuffle_caption to finetune GUI
- Add gradient_accumulation_steps, mem_eff_attn to dreambooth lora gui
 2023-01-08 20:55:41 -05:00
bmaltais 34f7cd8e57 Add new Utility to Extract a LoRA from a finetuned model 2023-01-06 18:25:55 -05:00
bmaltais c20a10d7fd Emergency fix for dreambooth_ui no longer working, sorry 
- Add LoRA network merge too GUI. Run `pip install -U -r requirements.txt` after pulling this new release.
 2023-01-06 07:13:12 -05:00
bmaltais b8100b1a0a - Add support for `--clip_skip` option 
- Add missing `detect_face_rotate.py` to tools folder
- Add `gui.cmd` for easy start of GUI
 2023-01-05 19:16:13 -05:00
bmaltais 9d3c402973 - Finetune, add xformers, 8bit adam, min bucket, max bucket, batch size and flip augmentation support for dataset preparation 
- Finetune, add "Dataset preparation" tab to group task specific options
 2023-01-02 13:07:17 -05:00
bmaltais 1d460a09fd add support for color and flip augmentation to "Dreambooth LoRA" 2023-01-01 22:43:44 -05:00
bmaltais bfa590b313 Quick fix for bug when no LoRA network weights is provided 2023-01-01 14:37:32 -05:00
bmaltais af46ce4c47 Update LoRA GUI 
Various improvements
 2023-01-01 14:14:58 -05:00
bmaltais 2c069d1067 Improve GUI 2023-01-01 00:33:29 -05:00
bmaltais 6b41f4f951 Fix standalone lora gui issue 2022-12-30 21:18:50 -05:00
bmaltais 0c5966f6f4 Fix issue with LR 2022-12-29 21:17:41 -05:00
bmaltais b44f075f60 Implement open and save config for LoRA 2022-12-29 14:00:02 -05:00
bmaltais 0f42ab78c4 Fix issue with caption extension 2022-12-28 23:19:18 -05:00
bmaltais d6def2343f !st rough implementation of LoRA GUI 2022-12-28 23:02:35 -05:00