1580158
/
sd_dreambooth_extension
mirror of https://github.com/d8ahazard/sd_dreambooth_extension.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
1,529 Commits
7 Branches
6 Tags
17 MiB
Commit Graph

124 Commits (main)

Author SHA1 Message Date
Ross Morgan-Linial 573d1c92bc Add freeze_spectral_norm option 
See https://arxiv.org/abs/2303.06296

This adds an option to reparametrize the model weights using the spectral norm so that the overall norm of each weight can't change. This helps to stabilize training at high learning rates.
 2024-01-17 09:24:37 -08:00
Ross Morgan-Linial 93a6b5dc5e Add slider to control DREAM lambda 
This allows adjusting the tradeoff between faster learning and better composition vs better preservation of detail.
 2023-12-23 14:37:39 -08:00
Ross Morgan-Linial 44a520be28 Implement DREAM 
DREAM adds an additional forward pass during training to make the model more robust to errors in early sampling steps. See http://arxiv.org/abs/2312.00210
 2023-12-22 15:12:28 -08:00
d8ahazard 29db0f26fa UI Rework, continued. 2023-11-08 16:56:52 -06:00
d8ahazard 8dd24d6659 Begin UI Rework 2023-11-08 11:54:11 -06:00
d8ahazard 4acfe9ae48 Merge @saunderez optimizers/SDXL branch 
For testing, ya know?
 2023-09-05 20:29:12 -05:00
ArrowM 2c463931d6 Re-add lion 2023-05-30 17:15:38 -05:00
ArrowM 8541193626 Replace some optimizers 2023-05-29 15:37:14 -05:00
ExponentialML 913ad8e5de Add dynamic image normalization, change prior loss method 2023-04-30 14:21:59 -07:00
ArrowM 41bb036a95 Update Disable Class Matching tooltip 2023-04-17 15:21:02 -05:00
gammagoat 8a63f93f77 Add an option to use the old behavior in testing 2023-04-11 16:38:28 -04:00
ArrowM 2df8b9ba92 Add option to disable class matching 2023-04-09 11:06:31 -05:00
ArrowM 8278c7d084 Tooltips and remove tf32 2023-04-08 10:37:19 -05:00
ArrowM c6411efd9e Tooltips 2023-04-08 08:41:27 -05:00
saunderez fb8c73e3b4 Fix missing comma which broke model creation *sigh* 2023-04-05 21:01:25 +10:00
Chris Saunders 1bc4fc42bd
Documentation 2023-04-05 15:34:26 +10:00
gammagoat f37339e20f Merge remote-tracking branch 'upstream/dev' into shareddiff 2023-03-29 15:32:17 -04:00
gammagoat d18ab42384 Shared src models for LoRA 
Implement a new experimental option for using shared
base models for LoRA training so we don't need to copy 4GB every time we
train a LoRA model.
 2023-03-29 15:09:24 -04:00
ArrowM 753c3f6a3e Xformers installation updates & js fixes 2023-03-29 10:08:40 -05:00
ArrowM 6f28f72c76 remove redundant MutationObserver 2023-03-24 23:42:13 -05:00
ArrowM 7514b5d621 meaner and cleaner 2023-03-22 18:27:10 -05:00
ArrowM 24ece01ff0 shame on d8 2023-03-22 18:24:08 -05:00
ArrowM 07e4644b45 Rename some ui fields 2023-03-15 18:04:47 -05:00
saunderez c4fe807452 Add Adan dadaptation optmizer (Nesterov) 
Add UniPC to noise scheduler dropuk-dropdown
 2023-03-11 10:55:57 +10:00
ArrowM a972a84c4f Tools in hand, I feel alive. Fixing broken things, my drive. With each repair, a sense of pride. My passion to fix, I cannot hide. 
(this is actually a locon fix)
 2023-03-08 16:11:25 -06:00
Chris Saunders 4e2f017a44 Remove local dadaptation files 
New optimizer UI prep
 2023-03-08 11:31:45 +10:00
Chris Saunders a23d14833b Implementation of Dadpatation schedulers and start UI changes 2023-03-08 10:24:18 +10:00
ArrowM d6490b47aa Fix #1011 and re-enable changelog popup 2023-03-06 14:54:16 -06:00
ArrowM 5780b70fdc Merge branch 'dev' into 984-lora-saving 
# Conflicts:
#	dreambooth/train_dreambooth.py
 2023-03-04 10:18:41 -06:00
d8ahazard adcf15c264 Add scheduler option to the UI/api for sample generation 2023-03-01 14:12:56 -06:00
gammagoat 638587c45f Implement option to save extra_networks lora.py 
This change implements a new safetensor format for loras.
 - It does not support extended lora
 - We move .pt file generation to a new folder db_loras configured as
    db_lora_models_path. Introduce ui_lora_models_path for
    extra networks models.
 2023-03-01 13:59:39 -05:00
d8ahazard 7ec4ef0c9e Disable changelog modal 
It's not ready yet, and I don't feel like messing with Gradio to fix it.
 2023-02-28 20:32:55 -06:00
d8ahazard fe0bb0d13c Code Cleanup 
Basic reformatting
 2023-02-28 15:09:22 -06:00
d8ahazard 80175a5b94 UI WORK, bump requirements, Scheduler rework 2023-02-24 13:30:32 -06:00
d8ahazard 8737401b2e Add experimental pre-crop feature/preview 2023-02-23 09:17:18 -06:00
ArrowM 5039db1689 fix error spam 2023-02-16 00:29:26 -06:00
d8ahazard ee639b8c2b
Merge pull request #946 from ExponentialML/features/offset-noise 
Add offset noise feature
 2023-02-14 20:47:03 -06:00
d8ahazard e72a56fb55
Merge branch 'dev' into feature/dev-local-hf-repo 2023-02-14 18:38:41 -06:00
ExponentialML 5bd645789d Add offset noise feature 2023-02-14 12:48:15 -08:00
Fabio 'MrWHO' Torchetti f4c8d41f99 Update docs 2023-02-12 12:25:02 -06:00
d8ahazard b7134f96b4 Add EMA hints. 2023-02-12 10:43:51 -06:00
d8ahazard 5d6b53a198 Fix loss calculation, image loading 2023-02-11 18:08:24 -06:00
d8ahazard 7180ab46b0 Show logs when generating logs 2023-02-09 12:44:35 -06:00
d8ahazard f63a3fc1af Refactor "dreambooth.py", Stricter version checking 2023-02-06 09:44:27 -06:00
d8ahazard 6b02dbe0bc Add "testing" tab, shared db_model config 
Add a tab for testing the effects of various new features.
Use shared settings when training, meaning we can adjust some params on-the-fly.
 2023-02-05 15:53:47 -06:00
d8ahazard 984b4d8abe Add Torch2 flag, Add UI Disable until Model is Selected 2023-02-04 12:57:29 -06:00
d8ahazard 93779ed10d Remove unused center_crop option. 2023-02-03 17:03:36 -06:00
d8ahazard 100541fd72 No, really only show modal once. 2023-02-02 12:20:52 -06:00
d8ahazard e805443b49 Only show modal once. 2023-02-02 12:19:31 -06:00
d8ahazard 632b722d35 Show Changelog Modal on Update 2023-02-02 12:17:12 -06:00