Commit Graph

31 Commits (main)

Author SHA1 Message Date
d8ahazard 15513a0163 Bitsandbytes...PITA. 2023-11-18 14:03:35 -06:00
d8ahazard e9f8e4ee35 Installer fixes
It works!
2023-11-16 14:13:33 -06:00
d8ahazard 82d5bb858e Code cleanup 2023-09-05 21:06:08 -05:00
d8ahazard b57026ba98 Revert "Improve Auto1111 boot times."
This reverts commit cb33d114ad.
2023-08-29 20:24:40 -05:00
d8ahazard cb33d114ad Improve Auto1111 boot times.
Stop loading the SD Model on boot.
2023-08-29 16:36:34 -05:00
d8ahazard b4053defa6 Fix training, bump requirements. 2023-08-13 18:55:47 -05:00
d8ahazard 3c514580bb Fix dynamo on Linux 2023-05-09 15:31:52 -05:00
ArrowM fcf812495b With just a line of code we say,
Import and bring to life today,
Libraries of power, vast and wide,
A universe of functions to abide.
2023-03-08 18:34:51 -06:00
d8ahazard fe0bb0d13c Code Cleanup
Basic reformatting
2023-02-28 15:09:22 -06:00
d8ahazard c80085f9f9 Disable torch2 stuff (for now) 2023-02-11 13:50:15 -06:00
ArrowM da9fc2d1e2 lil fix 2023-02-10 16:47:29 -06:00
d8ahazard d80e07586f Fix docker install 2023-02-09 16:02:43 -06:00
d8ahazard a56dfad4c6 Update preload.py 2023-02-08 22:05:06 -06:00
d8ahazard a357116a1a Cleanup 2023-02-04 15:05:01 -06:00
d8ahazard f176a06623 Install fix for torch/torch2
Wheee!
2023-02-04 14:09:59 -06:00
d8ahazard 984b4d8abe Add Torch2 flag, Add UI Disable until Model is Selected 2023-02-04 12:57:29 -06:00
d8ahazard 97f03d93a9 Refactoring and cleanup and stuff, oh my.
Try to eliminate spaghetti by moving items to their own respective files.
Remove unused files, classes, methods.
Continue the good work of wrapping any dependencies on Auto1111 in the dreambooth/shared.py
2023-01-26 13:24:55 -06:00
d8ahazard 47470dfbbe LOAD ALL THE THINGS
Fix loading from hub, add force-cpu flag for people without CUDA.
2023-01-20 17:08:15 -06:00
d8ahazard eb51824fb3 Squashed commit of the following:
commit 3933b0b47ec546ecf8a57c81a002ac2583e332dc
Author: d8ahazard <d8ahazard@gmail.com>
Date:   Fri Jan 6 08:44:36 2023 -0600

    Ensure model params are set before creating new model.

commit 2d112955194c1094cdbe7f548b16cc131febb3e2
Author: d8ahazard <d8ahazard@gmail.com>
Date:   Fri Jan 6 08:43:35 2023 -0600

    Revert to old loss calculation method.

    Use original loss weight calc method from HF script, versus the version used in Kohya_SS.

    Only clip tenc params if training tenc.

commit 9f437e2d68da68e46675607504edeb400c5f4efa
Author: d8ahazard <d8ahazard@gmail.com>
Date:   Thu Jan 5 22:22:48 2023 -0600

    Python 3.8 fix

commit bdef26f0d00d6be4e0c0d5df9afcbb1d0e824463
Author: d8ahazard <d8ahazard@gmail.com>
Date:   Thu Jan 5 22:22:36 2023 -0600

    Update hints

commit c9773476a45e5b416875fb7ab6790d516bb88194
Author: d8ahazard <d8ahazard@gmail.com>
Date:   Thu Jan 5 22:22:24 2023 -0600

    Fix warnings and errors generating graphs

commit b071d59932febc83f947a349f0433b1d9e04c07b
Author: d8ahazard <d8ahazard@gmail.com>
Date:   Thu Jan 5 16:02:32 2023 -0600

    Code cleanup

    Fix typos, grammar.
    Remove unused vars.
    Optimize imports.
    Rename dupe/repeated vars.

commit df20e2278164eea3bb61f203c4e2b2cfa3d3a07a
Author: d8ahazard <d8ahazard@gmail.com>
Date:   Thu Jan 5 15:13:11 2023 -0600

    clean

commit 9477b2e55fdcc48eb1d2b73a57f34c99cdbff696
Author: d8ahazard <d8ahazard@gmail.com>
Date:   Thu Jan 5 14:07:06 2023 -0600

    Bippity Boppity Booyah!

    Remove "class_buckets" param.
    Remove excess imports.
    Fix saving chedkpoint counts during training.
    Ensure images returned to UI are images.
    Fix bucket matching, class images generation.
    Use same methods for bucketing and class generation.
    Add "Debug Buckets" button to UI.
    Fix sample image generation only generating samples for one concept.

commit 9ceb5c27980f19ec3e5ea50cb5186e28e3245d1c
Author: d8ahazard <d8ahazard@gmail.com>
Date:   Wed Jan 4 13:13:46 2023 -0600

    Bad Bucket Matching Is Bad

    This is betterbuckets! We can't have bad bucket batching up in this bio...logy class. Better bucket bucketing is all about bucketing the buckets better while batching the buckets with the best bucket browsing.

commit e643624aa2adc788422941253cb96453d2689327
Author: d8ahazard <d8ahazard@gmail.com>
Date:   Wed Jan 4 12:26:52 2023 -0600

    Building Better Bucket Resos

commit 690761f3a3bcdbb7a7ad99cec0f95a61ed0baf78
Author: d8ahazard <d8ahazard@gmail.com>
Date:   Wed Jan 4 11:34:33 2023 -0600

    This too

commit efb79859101b82e9a2deddd5d47147881e24cb9d
Author: d8ahazard <d8ahazard@gmail.com>
Date:   Wed Jan 4 11:34:15 2023 -0600

    More class generation work, fixes

commit 4325dfacf7fbb1de7c6eb671ea3f33a9ae5b6065
Author: d8ahazard <d8ahazard@gmail.com>
Date:   Tue Jan 3 13:51:01 2023 -0600

    Remove old finetuning_dataset

commit e99940ca215660e2eda1e2e4fe54421623197f58
Author: d8ahazard <d8ahazard@gmail.com>
Date:   Tue Jan 3 13:30:18 2023 -0600

    Cleanup print messages...

commit ff0ea01a965699d90bc8b949da8676ad34f39748
Merge: fe605c2 6d17489
Author: d8ahazard <d8ahazard@gmail.com>
Date:   Tue Jan 3 12:56:44 2023 -0600

    Merge pull request #675 from Zuxier/FriedChickenBuckets

    Rework of stop text encoder and fix to reported total batch size

commit 6d1748935d
Author: Zuxier <120954436+Zuxier@users.noreply.github.com>
Date:   Tue Jan 3 18:57:39 2023 +0100

    add tenc encoder ratio and total batch size fix

commit fe605c250e
Author: d8ahazard <d8ahazard@gmail.com>
Date:   Tue Jan 3 09:47:42 2023 -0600

    Cleanup

commit 9dfbebfc4c
Author: d8ahazard <d8ahazard@gmail.com>
Date:   Tue Jan 3 09:46:51 2023 -0600

    Better Bucketing

    Instead of randomly grabbing data out of one bucket, actually grab N instance images and N class images of matching resolution and caption, which should be more aligned with the ide of reg images.

    Refactor num_class_images to num_class_images_per - which ensures each instance image has N matching class images. Again, this should better align with the whole point of reg images.

    Better VRAM management while training as well.

    Add specific flag to allow debugging of vram stuff without constantly adding/removing print messages.
2023-01-06 08:49:26 -06:00
d8ahazard 88d1dfa5a8 UI Improvements, Fix Defaults, Moar
Fix weight mismatch (again).
Update default params.
Add warnings when saving without loading params first.
Delete vae if not needed.
Wizardy wizard stuff.
Adjust hidden UI elements on params load.
2022-12-31 17:14:22 -06:00
d8ahazard 4f496d8f75 LINT 2022-12-15 13:01:02 -06:00
d8ahazard ea1603eddc Imagebuilder+
Add generate class button.
Fix saving params on method calls.
Add tensorboard profiling/flag.
Add custom apply lora weights method.
Add option to generate classifiers with txt2img.
Add save/load optimizer checkpointing.
Update extract/compile checkpoint code from diffusers.
2022-12-14 22:43:06 -06:00
d8ahazard d1941edb92 Shhh.... 2022-12-09 18:01:01 -06:00
d8ahazard 82d78c43d4 Fixes and stuff 2022-12-09 14:28:19 -06:00
d8ahazard b2ab1067fb Finalize LORA implementation, other fixes...
Fix gitignore.
Add epoch to db_config.
Compile lora checkpoints when training.
Remove unused messages and files.
Detect 512 V2 models and save the appropriate config file.
Fix global step counter.
Cleanup startup script to not freak people out.
Use pypi diffusers version, bump transformers version.
2022-12-08 16:28:37 -06:00
d8ahazard 0344f9a12c It works(Mostly)
Waay too much to log. I changed a bunch of stuff.
2022-11-25 17:30:10 -06:00
d8ahazard 0158ca18dd Update preload.py 2022-11-19 19:13:54 -06:00
d8ahazard 16adb386c3 Add ckptfix flag to fix OOM when extracting checkpoints. 2022-11-19 19:00:31 -06:00
d8ahazard bc8c9b8779 Cleanup Installer
Only bump torch version on windows where we need it.
Only copy 8bit adam files if needed.
2022-11-15 12:05:36 -06:00
d8ahazard 4addc36900 Add option to skip install on launch (Offline mode) 2022-11-14 10:19:30 -06:00
d8ahazard 54882c6c05 Create preload (If Automatic wants to implement it) 2022-11-08 09:19:24 -06:00