Commit Graph

47 Commits (eec6f9baf4e59bbb9bdac2ef24eff53e2d778bdc)

Author SHA1 Message Date
bmaltais eec6f9baf4 Convert str numbers to proper int or float 2024-04-15 08:02:39 -04:00
bmaltais a08c7c6ef1 Update parameters handling 2024-04-14 19:10:26 -04:00
bmaltais e98fc40a63
- Implement HuggingFace inputs in all training tabs (#2287)
- Switch to sd-scripts configuration files to pass most of the parameters in a secure way.
2024-04-14 18:43:45 -04:00
bmaltais fa5c65eade Update readme 2024-04-13 21:22:52 -04:00
bmaltais fddac3362e Make Stop training diseapear when training is done 2024-04-13 21:10:31 -04:00
bmaltais 4bfa486ed7 Improving args style 2024-04-13 16:46:40 -04:00
bmaltais 80afccc0e4 More fixes 2024-04-13 14:36:07 -04:00
bmaltais 1e7a263f79 Fix checkpoint name and sample prompt path 2024-04-13 14:23:46 -04:00
Bernard Maltais 835b6505c0 Fix running on linux 2024-04-13 14:03:55 -04:00
bmaltais 763eda2748 Update requirements for gradio
More shlex.quote fix
2024-04-13 12:21:26 -04:00
bmaltais 7581c4949f More fixes 2024-04-13 11:47:52 -04:00
bmaltais 62aa7ba8b6 Fix paths 2024-04-13 11:09:03 -04:00
bmaltais 79a78246a2 Rewrite run_cmd to list 2024-04-13 10:42:14 -04:00
bmaltais fef3dd2d12 Quick fix for other trainers 2024-04-13 08:43:57 -04:00
bmaltais f34eea41ca Fix issue for Dreambooth training... quick fix 2024-04-13 08:29:00 -04:00
bmaltais 25bb1303ff
Restrict extensions pre_postfix can use to improve security (#2259) 2024-04-11 08:55:03 -04:00
bmaltais 8bc67a7467
Find replace (#2258)
* Improve security to limit finding and replacing contents of any files on the system, that the attacker knows the contents of by specifying the list of acceptable extensions for captions.

* Update caption extension fields to Dropdown with restricted choices for security reasons
2024-04-11 08:32:17 -04:00
bmaltais 572dcd10ab Add Huber loss support 2024-04-07 10:35:07 -04:00
bmaltais 7b74dbfff8 Add code to check config file folder path existance 2024-04-05 07:21:17 -04:00
bmaltais ef1dcafbfe Fix warning messages 2024-04-03 20:20:59 -04:00
bmaltais 49f76343b5 Format with black 2024-04-03 18:32:25 -04:00
bmaltais c827268bf3 Cleanup old files and code 2024-04-03 18:17:59 -04:00
bmaltais b3a78febd1
Move Accelerate launch to own accordion (#2192)
* Move accelerate launch parameters to own accordion
2024-04-01 16:07:34 -04:00
Bernard Maltais ebc157bb68 Add support for Main process port 2024-03-29 20:56:37 -04:00
bmaltais 381e85296a Add support for masked_loss to the GUI 2024-03-26 20:14:07 -04:00
bmaltais b0139c751a Add gui support for save_state_on_train_end 2024-03-26 19:22:27 -04:00
bmaltais 0f889a8eb6 Add gui support for noise_offset_random_strength, ip_noise_gamma, ip_noise_gamma_random_strength 2024-03-26 19:12:48 -04:00
bmaltais 85c2b37a6a Fix max grad norm issue in DB 2024-03-25 10:54:51 -04:00
bmaltais 64360cec9e Fix issue where max_grad_norm = 0 would not show in the command line arguments 2024-03-24 20:46:38 -04:00
Bernard Maltais aaf0396d62 Fix vae path validation 2024-03-21 13:37:02 -04:00
bmaltais 99691b7b5d
Merge dev-toml (#2131)
* Integrate toml file option in GUI
2024-03-19 18:21:40 -04:00
bmaltais 5878bd6139 Move config for gui to seperate class
Add support for more config paths
2024-03-17 11:08:54 -04:00
bmaltais 6386a720b8 Add support for user managed path config 2024-03-16 20:58:22 -04:00
bmaltais 7186869c72
Code improvements (#2107)
* Fix incorrect float representation

* Improve code

* Improve code quality

* Improve code

* Updates for https://github.com/bmaltais/kohya_ss/issues/2103
2024-03-15 22:54:00 -04:00
bmaltais 90a02984cf Cleanup .update deprecations warnings 2024-03-15 10:03:41 -04:00
bmaltais 7081b22cba Add support for `wandb_run_name`, `log_tracker_name` and `log_tracker_config` parameters under the advanced section. 2024-03-14 19:41:34 -04:00
bmaltais d16be7b7c7 Update README, fix vae path validation 2024-03-13 07:11:41 -04:00
bmaltais dbc2cfec97 Create output and log folder if missing 2024-03-12 17:22:23 -04:00
bmaltais 130b01a2c0 Undo tkinter change 2024-03-11 10:56:15 -04:00
bmaltais a419b063f4 Trap Tk module issue 2024-03-10 21:08:13 -04:00
bmaltais 07e7d3acf8 Fix typos 2024-03-10 15:34:29 -04:00
bmaltais 40314706c4 Improve user file/folder input validation before running training scripts 2024-03-10 15:27:33 -04:00
bmaltais 3e023952df
Dev pure (#2039)
* Remove library folder, update setup_windows

* Cleanup sd-scripts files

* set sd-scripts release via file

* More cleanup

* Point to sd-scripts python files

* Fix blip captioning working directory

* Fix typo

* Fix issue with verify lora

* Improve git cloning of sd-scripts repo

* Integrate cloning in linux setup script

* Remove unnecessary folder

* Update linux setup

* Removing unnecessary code

* Fix validation issue under linux

* Update tensorboard version linux

* Updating linux requirements

* Update README

* Added submodule for sd-scripts

* Update for proper submodule handling

* Simplify submodule init

* Update comment

* Improve WSL2 LD_LIBRARY_PATH handling

* Update tensorboard handling of logging_dir

* chore(docker): update TensorFlow and TensorBoard versions

- Upgrade TensorFlow version in Dockerfile and requirements to 2.15.0.post1
- Update TensorBoard version in requirements to 2.15.2

Signed-off-by: 陳鈞 <jim60105@gmail.com>

* chore(docker): Add a mount for `sd-scripts` in the Dockerfile during pip install

- Add a mount step for `sd-scripts` in the Dockerfile during pip install.

Signed-off-by: 陳鈞 <jim60105@gmail.com>

* doc(docker): Update readme about docker

* Fix issue with TE LR

* Fix issue with TE LR

* Update sd-scripts to Feb 27 2024 commit

* Update version of bnb for windows

* Update windows setup

* Update windows setup

* Update bnb linux to match windows

* remove height:auto

* update UI

 * unify Quick Pick + custom model selection into gr.Dropdown()
 * add list_dirs(), list_files()
 * use gr.Accordion()
 * always show model + training image folder + output name + minimal default settings
 * do not show hidden files
 * clean up list_*()

* use PYTHONPATH env variable

* add "tool" classname to gr.Button() for sd-webui compatible

* update *_caption_gui.py using create_refresh_buttons()

* update Utilities->Group Images

* update Utilities->Convert model

* update dataset gui

* update Dreambooth/LoRA folders preparation

* update *lora*_gui UI using list_files(), create_refresh_button()

* more fixes for PYTHONPATH

* Minor edits to basic caption and common gui

* Optimising some code

* Fix path issue

* Fix issues with list_images_dir

* Update finetuning image folder label

* Minor updates to UI

---------

Signed-off-by: 陳鈞 <jim60105@gmail.com>
Co-authored-by: 陳鈞 <jim60105@gmail.com>
Co-authored-by: Won-Kyu Park <wkpark@gmail.com>
2024-03-09 09:30:20 -05:00
Kononenko Pavel 6872ca266c
Fix block_lr issue 2024-03-03 15:59:26 +03:00
Won-Kyu Park e2578cfe34
revert gr.update() and use gr.*.update() 2024-03-02 22:03:05 +09:00
Won-Kyu Park 708245e1e6
more cleanup
- use sys.executable
 - check *_dir validity and remove doublequotes strip
 - set `scriptdir`
 - use gr.update()
 - unify Folders for finetune
 - use subprocess.run(run_cmd, shell=True, env=env)
2024-03-02 14:10:02 +09:00
Won-Kyu Park bdb98af295
move gui related files to kohya_gui/ 2024-02-27 21:54:38 +09:00