Commit Graph

29 Commits (7aa226ccba67af4b585ca768cf78b9d17e26caed)

Author SHA1 Message Date
bmaltais 92a01a3890 Fix issue with tensorboard 2024-05-09 13:20:20 -04:00
bmaltais 7fac1e89dd Move env var config to common_gui 2024-05-07 07:58:11 -04:00
bmaltais 7bbc99d91b
2382 some incorrect usage related to the recent shell=false issue (#2417)
* Convert script back to no shell.

* Update rest of tools and update dreambooth to no shell

* Update rest of trainers to not use shell

* Allow the use of custom caption extension
2024-04-29 07:44:55 -04:00
bmaltais a97d3a94ee Fix issue with pre and post fix caption in subfolders 2024-04-29 07:13:34 -04:00
bmaltais 680ea75c0b
2346 wd14 captioning issue with undesired tags nor tag replacement (#2350)
* Improve how the code handle v3 (and other v2) models download and use

* Switch to shell=False always
2024-04-19 10:31:06 -04:00
bmaltais 85bdb37789 Improve PYTHON variable 2024-04-17 20:09:06 -04:00
bmaltais 84fb7ce8c9 Update utility paths and print toml file when clicking the Print training command button 2024-04-17 19:54:56 -04:00
bmaltais 9037fd0373
Improve process execution under Linux (and windows) (#2301)
* Update how process is executed

* Auto config use_shell=True on posix systems
2024-04-16 07:53:44 -04:00
bmaltais e6a8dec98d
Implement use_shell as parameter (#2297) 2024-04-15 20:26:09 -04:00
bmaltais 098be177e3 Fix wd14 caption accelerate path 2024-04-15 08:53:30 -04:00
bmaltais a093b783bc
Fix accelerate issue on linux (#2281)
* Fix issue discovered after removing shell=True. This is a significant rewrite... but will make things better for the future.
2024-04-13 16:52:27 -04:00
bmaltais 8bc67a7467
Find replace (#2258)
* Improve security to limit finding and replacing contents of any files on the system, that the attacker knows the contents of by specifying the list of acceptable extensions for captions.

* Update caption extension fields to Dropdown with restricted choices for security reasons
2024-04-11 08:32:17 -04:00
bmaltais 831af8babe
Remove shell=True from scripts (#2257)
* Remove shell=True from scripts
2024-04-11 08:00:31 -04:00
bmaltais 49c34a0ac2 Fix issue with WD14 prefix 2024-04-10 18:56:57 -04:00
bmaltais 55a11895ae Fix issue with wd14 prefix 2024-04-08 17:37:37 -04:00
bmaltais 36e9649b73 Update WD14 2024-04-07 19:45:34 -04:00
bmaltais d812b1f5ba Update WD14 captioning 2024-04-07 19:09:12 -04:00
bmaltais 49f76343b5 Format with black 2024-04-03 18:32:25 -04:00
bmaltais 8f04e04185
Merge branch 'dev' into master 2024-03-18 13:21:22 -04:00
Hina Chen ffb6430c9f Cleanup and bump localization to 23.0.11 2024-03-18 10:11:01 +08:00
bmaltais 33d5ca4935 Improve code 2024-03-17 20:37:13 -04:00
bmaltais e993788cf2 Fix issue with wd14 caption model selection 2024-03-17 20:21:48 -04:00
bmaltais 90a02984cf Cleanup .update deprecations warnings 2024-03-15 10:03:41 -04:00
bmaltais 2259129f33 Add "" at the begining of list_* to remove confusion and fix issues with optional field being set to a wroong default 2024-03-09 14:27:10 -05:00
Won-Kyu Park 696efdc893
add missing nonlocal scope keywords 2024-03-10 01:34:55 +09:00
bmaltais 3e023952df
Dev pure (#2039)
* Remove library folder, update setup_windows

* Cleanup sd-scripts files

* set sd-scripts release via file

* More cleanup

* Point to sd-scripts python files

* Fix blip captioning working directory

* Fix typo

* Fix issue with verify lora

* Improve git cloning of sd-scripts repo

* Integrate cloning in linux setup script

* Remove unnecessary folder

* Update linux setup

* Removing unnecessary code

* Fix validation issue under linux

* Update tensorboard version linux

* Updating linux requirements

* Update README

* Added submodule for sd-scripts

* Update for proper submodule handling

* Simplify submodule init

* Update comment

* Improve WSL2 LD_LIBRARY_PATH handling

* Update tensorboard handling of logging_dir

* chore(docker): update TensorFlow and TensorBoard versions

- Upgrade TensorFlow version in Dockerfile and requirements to 2.15.0.post1
- Update TensorBoard version in requirements to 2.15.2

Signed-off-by: 陳鈞 <jim60105@gmail.com>

* chore(docker): Add a mount for `sd-scripts` in the Dockerfile during pip install

- Add a mount step for `sd-scripts` in the Dockerfile during pip install.

Signed-off-by: 陳鈞 <jim60105@gmail.com>

* doc(docker): Update readme about docker

* Fix issue with TE LR

* Fix issue with TE LR

* Update sd-scripts to Feb 27 2024 commit

* Update version of bnb for windows

* Update windows setup

* Update windows setup

* Update bnb linux to match windows

* remove height:auto

* update UI

 * unify Quick Pick + custom model selection into gr.Dropdown()
 * add list_dirs(), list_files()
 * use gr.Accordion()
 * always show model + training image folder + output name + minimal default settings
 * do not show hidden files
 * clean up list_*()

* use PYTHONPATH env variable

* add "tool" classname to gr.Button() for sd-webui compatible

* update *_caption_gui.py using create_refresh_buttons()

* update Utilities->Group Images

* update Utilities->Convert model

* update dataset gui

* update Dreambooth/LoRA folders preparation

* update *lora*_gui UI using list_files(), create_refresh_button()

* more fixes for PYTHONPATH

* Minor edits to basic caption and common gui

* Optimising some code

* Fix path issue

* Fix issues with list_images_dir

* Update finetuning image folder label

* Minor updates to UI

---------

Signed-off-by: 陳鈞 <jim60105@gmail.com>
Co-authored-by: 陳鈞 <jim60105@gmail.com>
Co-authored-by: Won-Kyu Park <wkpark@gmail.com>
2024-03-09 09:30:20 -05:00
Won-Kyu Park d6120017aa
use subprocess.run(run_cmd, shell=True, env=env) 2024-03-02 14:10:03 +09:00
Won-Kyu Park 708245e1e6
more cleanup
- use sys.executable
 - check *_dir validity and remove doublequotes strip
 - set `scriptdir`
 - use gr.update()
 - unify Folders for finetune
 - use subprocess.run(run_cmd, shell=True, env=env)
2024-03-02 14:10:02 +09:00
Won-Kyu Park bdb98af295
move gui related files to kohya_gui/ 2024-02-27 21:54:38 +09:00