1580158
/
kohya_ss
mirror of https://github.com/bmaltais/kohya_ss
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
3,371 Commits
16 Branches
178 Tags
68 MiB
Commit Graph

147 Commits (master)

Author SHA1 Message Date
Kohya S 7e736da30c update versions of accelerate and diffusers 2023-09-24 17:46:57 +09:00
bmaltais 49c67e5e71 Fix for LyCoris extraction 2023-08-19 10:48:44 -04:00
bmaltais d17f9c1f23 Fix requirements 2023-08-10 13:12:53 -04:00
bmaltais 90d2160417 Merge branch 'sdxl' of https://github.com/kohya-ss/sd-scripts into dev2 2023-08-04 19:58:06 -04:00
Kohya S 9d855091bf make bitsandbytes optional 2023-08-04 22:29:14 +09:00
bmaltais ebcb6efcba Update requirements and others 2023-07-31 23:24:00 -04:00
Kohya S f61996b425 remove dependency for albumenations 2023-07-30 16:29:53 +09:00
青龍聖者@bdsqlsz 9ec70252d0
Add Paged/ adam8bit/lion8bit for Sdxl bitsandbytes 0.39.1 cuda118 on windows (#623) 
* ADD libbitsandbytes.dll for 0.38.1

* Delete libbitsandbytes_cuda116.dll

* Delete cextension.py

* add main.py

* Update requirements.txt for bitsandbytes 0.38.1

* Update README.md for bitsandbytes-windows

* Update README-ja.md  for bitsandbytes 0.38.1

* Update main.py for return cuda118

* Update train_util.py for lion8bit

* Update train_README-ja.md for lion8bit

* Update train_util.py for add DAdaptAdan and DAdaptSGD

* Update train_util.py for DAdaptadam

* Update train_network.py for dadapt

* Update train_README-ja.md for DAdapt

* Update train_util.py for DAdapt

* Update train_network.py for DAdaptAdaGrad

* Update train_db.py for DAdapt

* Update fine_tune.py for DAdapt

* Update train_textual_inversion.py for DAdapt

* Update train_textual_inversion_XTI.py for DAdapt

* Revert "Merge branch 'qinglong' into main"

This reverts commit b65c023083d6d1e8a30eb42eddd603d1aac97650, reversing
changes made to f6fda20caf5e773d56bcfb5c4575c650bb85362b.

* Revert "Update requirements.txt for bitsandbytes 0.38.1"

This reverts commit 83abc60dfaddb26845f54228425b98dd67997528.

* Revert "Delete cextension.py"

This reverts commit 3ba4dfe046874393f2a022a4cbef3628ada35391.

* Revert "Update README.md for bitsandbytes-windows"

This reverts commit 4642c52086b5e9791233007e2fdfd97f832cd897.

* Revert "Update README-ja.md  for bitsandbytes 0.38.1"

This reverts commit fa6d7485ac067ebc49e6f381afdb8dd2f12caa8f.

* Update train_util.py for DAdaptLion

* Update train_README-zh.md for dadaptlion

* Update train_README-ja.md for DAdaptLion

* add DAdatpt V3

* Alignment

* Update train_util.py for experimental

* Update train_util.py V3

* Update train_util.py

* Update requirements.txt

* Update train_README-zh.md

* Update train_README-ja.md

* Update train_util.py fix

* Update train_util.py

* support Prodigy

* add lower

* Update main.py

* support PagedAdamW8bit/PagedLion8bit

* Update requirements.txt

* update for PageAdamW8bit and PagedLion8bit

* Revert

* revert main

* Update train_util.py

* update for bitsandbytes 0.39.1

* Update requirements.txt

* vram leak fix

---------

Co-authored-by: Pam <pamhome21@gmail.com>
 2023-07-30 13:15:13 +09:00
bmaltais a3db8cd266
Update requirements.txt 
Reverting LyCORIS module uodate
 2023-07-27 12:46:21 -04:00
Bernard Maltais d55155e467 update 2023-07-27 08:58:12 -04:00
bmaltais b39fd33310 Merge branch 'sdxl' of https://github.com/kohya-ss/sd-scripts into dev2 2023-07-22 06:53:23 -04:00
bmaltais 90cbdb8a64 Merge branch 'sdxl' of https://github.com/kohya-ss/sd-scripts into dev2 2023-07-22 06:50:21 -04:00
Kohya S d1864e2430 add invisible watermark to req.txt 2023-07-22 19:34:22 +09:00
bmaltais 5d799f6f81 Updates to requirements 2023-07-21 08:10:15 -04:00
Kohya S c45d2f214b Merge branch 'main' into sdxl 2023-07-20 22:02:29 +09:00
bmaltais 4703c7fa83 Merge branch 'sdxl' of https://github.com/kohya-ss/sd-scripts into dev2 2023-07-13 21:43:46 -04:00
bmaltais b68b2f9691 Updates 2023-07-13 21:39:30 -04:00
Kohya S 8fa5fb2816 support diffusers format for SDXL 2023-07-12 21:57:14 +09:00
bmaltais 429d2f282f Update gradio release 2023-07-08 16:16:06 -04:00
bmaltais 79169efac5 Update models, Source model functionality 2023-07-01 20:27:12 -04:00
bmaltais ac04f95ae7 Merge branch 'sdxl' of https://github.com/kohya-ss/sd-scripts into sdxl 2023-06-30 14:25:20 -04:00
bmaltais e86bc980ed Update lycoris version 2023-06-29 19:28:20 -04:00
Kohya S 38e21f5c1a update transfomer to fix sdxl text model with bf16 2023-06-29 13:03:00 +09:00
bmaltais 0fe2df79b5 Updated lycoris version, gui fix for ia3 2023-06-28 19:47:41 -04:00
bmaltais fff34df6b5 Adding Lycoris 0.1.7 
Adding About tab
 2023-06-28 08:17:44 -04:00
Your Name 663fbd6f56 Update safetensors requirements 2023-06-25 19:28:31 -04:00
Bo Lu 7981ee186f
Update huggingface hub to resolve error in windows 
https://github.com/huggingface/huggingface_hub/issues/1423
 2023-06-26 01:53:23 +08:00
Kohya S f7f762c676 add minimal inference code for sdxl 2023-06-24 11:52:26 +09:00
bmaltais ae22e592a7 Backrev lyco 2023-06-23 13:50:15 -04:00
bmaltais e1ad9ebef6 Update bitsandbytes 2023-06-23 13:48:43 -04:00
bmaltais 980b5ac164 Merge branch 'dev2' into lyco-0.1.7 2023-06-23 13:26:18 -04:00
bmaltais 59ca38d2b3
Improve setup solution (#1043) 
Improve setup across platforms
 2023-06-23 11:56:13 -04:00
Kohya S 5114e8daf1 fix training scripts except controlnet not working 2023-06-22 08:46:53 +09:00
Kohya S 1c09867b3e update Diffusers, remove BLIP deps 2023-06-22 08:38:44 +09:00
Kohya S 92e50133f8
Merge branch 'original-u-net' into dev 2023-06-17 21:57:08 +09:00
ykume cc274fb7fb update diffusers ver, remove tensorflow 2023-06-11 16:54:10 +09:00
bmaltais 797e2b4433 Update unix based system requirements file 2023-06-07 13:38:12 -04:00
bmaltais 44632fff62 GUI Updates for LyCORIS 2023-06-07 11:57:22 -04:00
bmaltais 21c8b4a599 v21.6.4 2023-06-03 15:39:37 -04:00
bmaltais 30ad3cf936 Fix setup logic 2023-06-03 06:44:04 -04:00
bmaltais ed5bf88250 Fix issue with torch version 2023-06-02 23:34:16 -04:00
bmaltais 8a1dc38a91
Merge pull request #885 from rkfg/patch-1 
Downgrade bitsandbytes for Linux/Mac too
 2023-06-02 15:18:54 -04:00
bmaltais 36d643c01d Update requirements 2023-06-02 10:07:28 -04:00
rkfg 1cad17d5e4
Downgrade bitsandbytes for Linux/Mac too 
Otherwise training ends up with loss going up and becoming NaN (see #724)
 2023-06-02 11:55:30 +03:00
ddPn08 c8d209d36c
update diffusers to 1.16 | train_network 2023-06-01 20:39:26 +09:00
bmaltais 007c425bd3 Merge branch 'main' of https://github.com/kohya-ss/sd-scripts into dev2 2023-05-25 13:29:10 -04:00
bmaltais 6e7ced51a8 Upgrade gradio release to fix UI update 2023-05-24 08:14:26 -04:00
Kohya S 85df289190 remove gradio from requirements 2023-05-07 21:00:06 +09:00
Bernard Maltais 7daa164d53 Reverting to bitsandbytes 0.35.0 2023-05-06 11:26:59 -04:00
bmaltais 111527b490 Add support for Lion8bit 2023-05-03 08:49:48 -04:00
bmaltais ffac91653b
Merge pull request #697 from Trojaner/feature/docker-support 
Add accelerated NGC docker image
 2023-05-01 19:08:24 -04:00
Artificial Cleverness 49441ed572 Remove bitsandbytes version to fix CUDA version 12x compatible problem, tested on RTX4090, cu121, Ubuntu22.04 2023-04-29 11:49:11 -04:00
bmaltais 7bd1cb9d08 Merge branch 'main' of https://github.com/kohya-ss/sd-scripts into dev 2023-04-27 09:03:59 -04:00
bmaltais 2e07329088 Upgrading to latest gradio release 2023-04-17 20:54:55 -04:00
bmaltais 5eb3488511 Merge branch 'main' of https://github.com/kohya-ss/sd-scripts into dev 2023-04-07 08:31:06 -04:00
JSTayco 71f5965cbc lycoris-lora changed from git to a stable version 2023-04-03 11:09:32 -07:00
JSTayco f32ce0aead Removed tensorflow from requirements.txt for macOS 
Added CPU architecture detection for packages
 2023-04-02 12:32:56 -07:00
ddPn08 b5ff4e816f
resume from huggingface repository 2023-04-02 17:39:21 +09:00
bmaltais aae3263343 Update requirements 2023-04-01 16:35:50 -04:00
bmaltais 7150179155 Update missing setup files 2023-04-01 16:22:30 -04:00
bmaltais 97b004e756 Revert "Merge pull request #466 from jstayco/consolidated_install_scripts" 
This reverts commit b7a719b51a, reversing
changes made to 538752ccab.
 2023-04-01 06:29:45 -04:00
jstayco d8285a7040
Merge branch 'dev' into consolidated_install_scripts 2023-03-31 20:03:32 -07:00
JSTayco bd2e829ae3 More safeties around Python ops 
More safeties and more code consolidation. Now we try to exit the python venv after all the python operations. All the python operations were consolidated to facilitate this.
 2023-03-31 17:24:09 -07:00
JSTayco e5b2257d7d Integrated upgrade.sh 
Integrated upgrade.sh functionality, consolidated code to install dependencies, added ability to skip git operations, ensured the script can run from anywhere aimed at installation anywhere, ensured all git commnds worked from anywhere aimed at target folder, normalized specified install directory names (always get the absolute path).
 2023-03-31 16:39:28 -07:00
bmaltais 9f6e0c1c8f Fix issue with LyCORIS version 2023-03-30 07:23:37 -04:00
jstayco a062dabe86
Merge branch 'dev' into consolidated_install_scripts 2023-03-29 16:48:05 -07:00
bmaltais 13c4b1f73b v21.3.7 2023-03-29 19:43:23 -04:00
Vertana 4277645b2a Consolidated Install Scripts and Improve README 
Install scripts have been consolidated for every non-Windows OS. Python Requirements were consolidated. README improved to work locally and provide more information.
 2023-03-27 12:37:00 -07:00
bmaltais 91e19ca9d9 Fix issue with kohya locon not training the convolution layers 2023-03-12 20:36:58 -04:00
bmaltais e110d4b67d Update requirements 2023-03-09 12:11:17 -05:00
bmaltais ba9e26a99d LoHa support 2023-03-09 07:49:50 -05:00
bmaltais 7249b0baa8 Update to latest sd-script release 
add gui support for sample config
 2023-03-06 19:15:02 -05:00
bmaltais 29bb8599bb Fix issue 278 2023-03-03 07:41:44 -05:00
bmaltais 4c762e3abb Upgrade Gradio 
Fix Gradio issues
Fix missing LoCon new GUI
 2023-03-02 20:39:07 -05:00
fur0ut0 8abb8645ae
add detail dataset config feature by extra config file (#227) 
* add config file schema

* change config file specification

* refactor config utility

* unify batch_size to train_batch_size

* fix indent size

* use batch_size instead of train_batch_size

* make cache_latents configurable on subset

* rename options
* bucket_repo_range
* shuffle_keep_tokens

* update readme

* revert to min_bucket_reso & max_bucket_reso

* use subset structure in dataset

* format import lines

* split mode specific options

* use only valid subset

* change valid subsets name

* manage multiple datasets by dataset group

* update config file sanitizer

* prune redundant validation

* add comments

* update type annotation

* rename json_file_name to metadata_file

* ignore when image dir is invalid

* fix tag shuffle and dropout

* ignore duplicated subset

* add method to check latent cachability

* fix format

* fix bug

* update caption dropout default values

* update annotation

* fix bug

* add option to enable bucket shuffle across dataset

* update blueprint generate function

* use blueprint generator for dataset initialization

* delete duplicated function

* update config readme

* delete debug print

* print dataset and subset info as info

* enable bucket_shuffle_across_dataset option

* update config readme for clarification

* compensate quotes for string option example

* fix bug of bad usage of join

* conserve trained metadata backward compatibility

* enable shuffle in data loader by default

* delete resolved TODO

* add comment for image data handling

* fix reference bug

* fix undefined variable bug

* prevent raise overwriting

* assert image_dir and metadata_file validity

* add debug message for ignoring subset

* fix inconsistent import statement

* loosen too strict validation on float value

* sanitize argument parser separately

* make image_dir optional for fine tuning dataset

* fix import

* fix trailing characters in print

* parse flexible dataset config deterministically

* use relative import

* print supplementary message for parsing error

* add note about different methods

* add note of benefit of separate dataset

* add error example

* add note for english readme plan

---------

Co-authored-by: Kohya S <52813779+kohya-ss@users.noreply.github.com>
 2023-03-01 20:58:08 +09:00
bmaltais 60ad22733c Update to latest code version 2023-02-23 19:21:30 -05:00
bmaltais 758bfe85dc Adding support for Lion optimizer in gui 2023-02-19 20:13:03 -05:00
Kohya S a75baf9143 Add strict version no 2023-02-10 17:37:19 +09:00
bmaltais 7bc93821a0 2023/02/09 (v20.7.1) 
- Caption dropout is supported in ``train_db.py``, ``fine_tune.py`` and ``train_network.py``. Thanks to forestsource!
        - ``--caption_dropout_rate`` option specifies the dropout rate for captions (0~1.0, 0.1 means 10% chance for dropout). If dropout occurs, the image is trained with the empty caption. Default is 0 (no dropout).
        - ``--caption_dropout_every_n_epochs`` option specifies how many epochs to drop captions. If ``3`` is specified, in epoch 3, 6, 9 ..., images are trained with all captions empty. Default is None (no dropout).
        - ``--caption_tag_dropout_rate`` option specified the dropout rate for tags (comma separated tokens) (0~1.0, 0.1 means 10% chance for dropout). If dropout occurs, the tag is removed from the caption. If ``--keep_tokens`` option is set, these tokens (tags) are not dropped. Default is 0 (no droupout).
        - The bulk image downsampling script is added. Documentation is [here](https://github.com/kohya-ss/sd-scripts/blob/main/train_network_README-ja.md#%E7%94%BB%E5%83%8F%E3%83%AA%E3%82%B5%E3%82%A4%E3%82%BA%E3%82%B9%E3%82%AF%E3%83%AA%E3%83%97%E3%83%88) (in Jpanaese). Thanks to bmaltais!
        - Typo check is added. Thanks to shirayu!
    - Add option to autolaunch the GUI in a browser and set the server_port. USe either `gui.ps1 --inbrowser --server_port 3456`or `gui.cmd -inbrowser -server_port 3456`
 2023-02-09 19:17:24 -05:00
bmaltais 045750b46a v20.6.0 
- Increase max LoRA rank (dim) size to 1024.
    - Update finetune preprocessing scripts.
        - ``.bmp`` and ``.jpeg`` are supported. Thanks to breakcore2 and p1atdev!
        - The default weights of ``tag_images_by_wd14_tagger.py`` is now ``SmilingWolf/wd-v1-4-convnext-tagger-v2``. You can specify another model id from ``SmilingWolf`` by ``--repo_id`` option. Thanks to SmilingWolf for the great work.
        - To change the weight, remove ``wd14_tagger_model`` folder, and run the script again.
        - ``--max_data_loader_n_workers`` option is added to each script. This option uses the DataLoader for data loading to speed up loading, 20%~30% faster.
        - Please specify 2 or 4, depends on the number of CPU cores.
        - ``--recursive`` option is added to ``merge_dd_tags_to_metadata.py`` and ``merge_captions_to_metadata.py``, only works with ``--full_path``.
        - ``make_captions_by_git.py`` is added. It uses [GIT microsoft/git-large-textcaps](https://huggingface.co/microsoft/git-large-textcaps) for captioning.
        - ``requirements.txt`` is updated. If you use this script, [please update the libraries](https://github.com/kohya-ss/sd-scripts#upgrade).
        - Usage is almost the same as ``make_captions.py``, but batch size should be smaller.
        - ``--remove_words`` option removes as much text as possible (such as ``the word "XXXX" on it``).
        - ``--skip_existing`` option is added to ``prepare_buckets_latents.py``. Images with existing npz files are ignored by this option.
        - ``clean_captions_and_tags.py`` is updated to remove duplicated or conflicting tags, e.g. ``shirt`` is removed when ``white shirt`` exists. if ``black hair`` is with ``red hair``, both are removed.
    - Tag frequency is added to the metadata in ``train_network.py``. Thanks to space-nuko!
        - __All tags and number of occurrences of the tag are recorded.__ If you do not want it, disable metadata storing with ``--no_metadata`` option.
 2023-02-04 08:36:35 -05:00
bmaltais 20e62af1a6 Update to latest kohya_ss sd-script code 2023-02-03 14:40:03 -05:00
Kohya S 57d8483eaf add GIT captioning, refactoring, DataLoader 2023-02-03 08:45:33 +09:00
bmaltais 3e4b0ca720 Fix requirements file issue 2023-01-19 15:56:15 -05:00
bmaltais 9f95c8d830 New gui bat file 
Update README
 2023-01-17 17:54:20 -05:00
bmaltais 115ed35187 Emergency fix 2023-01-06 23:19:49 -05:00
bmaltais 600d78ae08 Merge all requirements into one 2022-12-20 10:17:22 -05:00
bmaltais c9a62dd038 Fix requirements file 2022-12-19 09:26:04 -05:00
bmaltais c90aa2cc61 - Fix file/folder opening behind the browser window 
- Add WD14 and BLIP captioning to utilities
- Improve overall GUI layout
 2022-12-19 09:22:52 -05:00
bmaltais 0ca93a7aa7 v18.1: Model conversion utility 2022-12-18 13:11:10 -05:00
bmaltais 3834e5dbab Adding improved elements to GUI 2022-12-14 14:40:24 -05:00
bmaltais 5f1a465a45 Update to v17 
New GUI
 2022-12-13 13:49:14 -05:00
bmaltais 379ab73496 1st cut at gradio UI 2022-12-13 09:20:25 -05:00
bmaltais e8db30b9d1 Publish v15 2022-12-05 10:49:02 -05:00
bmaltais 6c22f723e2
Update requirements.txt 2022-12-03 18:31:12 -05:00
bmaltais 5a68cd02e7 Update install instructions 2022-11-27 21:07:57 -05:00
bmaltais 7d0fb81f14 Update requirements 2022-11-27 09:57:31 -05:00
Bernard Maltais 9535d1248c 1st commit 2022-10-30 11:15:09 -04:00