Commit Graph

150 Commits (8fb9001a2c866a6796c8a34f3e7bb9d2d99ddb6a)

Author SHA1 Message Date
bmaltais 836417c3bb Fix issue with SD3 Lora training blocks_to_swap and fused_backward_pass 2025-02-24 18:36:13 -05:00
bmaltais a10986ad30 Fix network_module issue 2024-12-31 09:46:42 -05:00
bmaltais 8afcaf8be7 Fix train_t5xxl issue 2024-12-31 09:43:34 -05:00
bmaltais 4fd25ced85 Fix clip_l issue for missing path 2024-12-31 09:35:36 -05:00
bmaltais 65da590eab Add a bunch of missing SD3 parameters 2024-12-31 08:48:48 -05:00
bmaltais 4a741a8a4a Add support for sd3 lora disable_mmap_load_safetensors 2024-12-31 08:24:37 -05:00
bmaltais 3c860c4035 Make blocks_to_swap common 2024-12-31 08:11:42 -05:00
bmaltais 3eec4c9b32 SD3 LoRA training MVP 2024-12-31 07:59:55 -05:00
bmaltais fce89ad798 Add support for huber_scale 2024-12-30 19:21:03 -05:00
bmaltais d0cd9f547a Reverting all changes for max_train_steps 2024-11-18 19:31:51 -05:00
bmaltais 309a9bbc1b Fix max_train_steps_info error 2024-11-18 07:07:33 -05:00
bmaltais a6f0ff72a8 Fix issue with max_train_steps 2024-11-17 18:37:27 -05:00
bmaltais b332b1df9d Fix blocks_to_swap not properly working 2024-11-16 20:33:48 -05:00
bmaltais 021c6f5ae3 Add support for save_last_n_epochs 2024-10-29 20:14:02 -04:00
bmaltais b9fe58cd1e Add support for --save_last_n_epochs_state 2024-10-18 17:53:06 -04:00
bmaltais 5e10c380d4 Add support for LyCORIS LoRA when training Flux.1 2024-10-17 18:51:15 -04:00
bmaltais 3c3f1edfb6 Add --skip_cache_check option to GUI 2024-10-14 18:32:09 -04:00
bmaltais faa3d1920c Update Lycoris support 2024-10-06 20:26:33 -04:00
bmaltais 0ba8ab6c71
Merge pull request #2829 from iamrohitanshu/sd3-flux.1
Update 3 files in kohya_gui folder
2024-09-17 18:27:13 -04:00
bmaltais 8c11a08eb3 Add missing network parms 2024-09-16 18:51:09 -04:00
bmaltais 416ef0e19e Add support for Blocks to train 2024-09-16 18:48:07 -04:00
rohitanshu 9a37a0e197
Update lora_gui.py
Fixed minor typos of "Regularization"
2024-09-16 19:44:05 +05:30
bmaltais d24fae17b7 Add support for Rank for layers 2024-09-14 13:45:01 -04:00
bmaltais c554984a53 Fix logic typo 2024-09-14 09:24:13 -04:00
bmaltais 31c77d6d71 Preliminary support for Flux1 OFT 2024-09-14 09:13:26 -04:00
bmaltais f744479f9a Revert some changes 2024-09-13 15:53:30 -04:00
bmaltais 46b57ed635 Fix for max_train_steps 2024-09-13 15:35:30 -04:00
bmaltais 20d7e659e1 Update lr_warmup_steps code 2024-09-12 21:31:18 -04:00
bmaltais e655ebf2dd Add support for lr_warmup_steps override 2024-09-12 20:56:05 -04:00
bmaltais 7c190edef8 Fix issue with new text_encoder_lr parameter syntax 2024-09-12 07:03:45 -04:00
bmaltais f365b630ff Update sd-scripts and add support for t5xxl LR 2024-09-11 19:17:37 -04:00
bmaltais 63c1e48376 Improve visual sectioning of parameters for lora 2024-09-08 15:11:20 -04:00
bmaltais 4bae4fc2aa Validate if lora type is Flux1 when flux1_checkbox is true 2024-09-08 13:20:29 -04:00
bmaltais 8f6229f433 Grouping lora parameters 2024-09-07 09:58:38 -04:00
bmaltais d5b083aa5d Force t5xxl_max_token_length to be served as an integer 2024-09-05 20:05:24 -04:00
bmaltais a5fb38bd84 Add support for cpu_offload_checkpointing to GUI 2024-09-05 16:28:34 -04:00
bmaltais 3b6ed2cfc5 Add support for Train T5-XXL 2024-09-04 19:09:44 -04:00
bmaltais 8a524c7bae Removed unsupported parameters from flux lora network 2024-08-31 10:26:56 -04:00
bmaltais de38d2a50d Add support for fp8_base_unet 2024-08-27 13:59:44 -04:00
bmaltais f066bfdc44 Add missing network argument for split_qkv 2024-08-24 10:45:26 -04:00
bmaltais d2e0917099 Add support for split_qkv 2024-08-24 10:36:23 -04:00
bmaltais 33937c2284 Fix issue with split_mode and train_blocks 2024-08-21 07:52:46 -04:00
bmaltais f57973fbc5 Add mem_eff_save option to GUI for Flux.1 2024-08-19 10:35:25 -04:00
bmaltais 8aa658f7f0 Temporary fir for blockwise_fused_optimizers 2024-08-18 17:45:10 -04:00
bmaltais 3b2c622912 Fix issue with guidance scale not being passed as float for values like 1 2024-08-18 13:47:17 -04:00
bmaltais 647295aa88 Add dreambooth and finetuning support for flux.1 2024-08-18 11:29:15 -04:00
bmaltais 1e5ce98ee9 Adding guidance_scale option 2024-08-17 07:05:10 -04:00
bmaltais 0a49908f17 Adding new flux.1 options to GUI 2024-08-16 15:29:30 -04:00
bmaltais 2eb677d652 Fix issue with cache_text_encoder_outputs 2024-08-15 18:02:45 -04:00
bmaltais c036fdab37 Add missing Flux.1 GUI parameters 2024-08-13 11:12:02 -04:00