Commit Graph

101 Commits (a5182880f9334f9fc3d46f153aca0cb4e8895cad)

Author SHA1 Message Date
aria1th a5182880f9 add noise scheduler for training
move to LatentDiffusion forward

unbind scheduler

unbind noise scheduler by option

minor fix?

minor fix for extreme case
2023-01-21 01:14:05 +09:00
aria1th 4b5c5cf800 use idx instead of long timestr
but collision might happen
2023-01-19 22:44:59 +09:00
aria1th e636a8353d Fixes for most recent webui
with ensuring compatibility for previous webui
2023-01-19 14:29:48 +09:00
aria1th c216a0fc7f compatibility with previous webui 2023-01-19 14:05:39 +09:00
aria1th da120135a8 add manual dataset seed option 2023-01-19 06:34:57 +09:00
aria1th 5d82d0d36e fix syntax 2023-01-18 23:02:03 +09:00
aria1th f0fc6fad7f fix manual seed for residual 2023-01-17 22:32:56 +09:00
aria1th b33fb8f21c fix residual connection multiplier 2023-01-17 22:32:27 +09:00
AngelBottomless 0892d70041
Update README.md 2023-01-17 20:50:20 +09:00
AngelBottomless bb875af507
Merge pull request #32 from aria1th/residual-connection
Residual connection
2023-01-17 17:42:28 +09:00
aria1th 28a4272fe5 prevent direct random module access 2023-01-17 17:42:01 +09:00
aria1th 72b7609c3f clip_ instead 2023-01-17 17:18:43 +09:00
aria1th 328692830c If someone is curious 2023-01-17 16:51:19 +09:00
AngelBottomless 67d95e983a
Update README.md 2023-01-17 15:52:59 +09:00
aria1th ed214c45c8 Fix loading residual 2023-01-17 15:17:00 +09:00
aria1th 065fcd110c implement ResBlock
its residual block
2023-01-17 14:24:25 +09:00
aria1th ca1f16e49b implement existing hn tuning
and maybe fix compat with other extension
2023-01-16 20:48:48 +09:00
aria1th 1b2857533d Compatibility with previous webui 2023-01-16 20:06:21 +09:00
aria1th efb0e6c3c5 fix lr logging for tensorboard
dynamic LR
2023-01-16 18:56:11 +09:00
aria1th 7409274cd4 fix images being overrided 2023-01-16 10:22:52 +09:00
aria1th c80d6b5d4c separate tensorflow related util
change saving directory for convenience

add hyperparameter logging
2023-01-16 09:53:55 +09:00
AngelBottomless aca968d489
add Hyperparameter tuning and CLIP Test 2023-01-16 08:50:25 +09:00
aria1th 3aa30df1e4 cleanup and some more safety 2023-01-16 08:47:20 +09:00
AngelBottomless b338aaa437
Merge pull request #29 from aria1th/hypernetwork-tuning
Hypernetwork tuning + some fixes
2023-01-16 08:00:10 +09:00
aria1th 43ef5c3218 clean up some code 2023-01-16 07:57:47 +09:00
aria1th 11728fbb3c Skip if OSError happens 2023-01-16 06:56:21 +09:00
aria1th 9d2e8bd963 fix minor errors 2023-01-16 06:49:46 +09:00
aria1th f75fd3bb97 Maybe finish tuning 2023-01-16 06:47:10 +09:00
aria1th dceaa667c2 maybe 2023-01-16 05:37:19 +09:00
aria1th 7631f51b42 add disabling grad for models
this just ensures no gradient can be generated through original models
2023-01-16 02:27:23 +09:00
aria1th 83fa587f39 Tensorboard integration and fixes
This only works with post-d8b90ac121
2023-01-16 01:50:43 +09:00
aria1th e42d2124c1 Compatibility for previous webui 2023-01-15 11:59:58 +09:00
aria1th 8f2e6aa10c Offer compatible module for previous webui 2023-01-14 23:22:40 +09:00
aria1th cd40e4dcaa Fix .shorthash() method related issue 2023-01-14 23:15:11 +09:00
aria1th 10d2622f64 Fix CLIP_test tab
Also it will only work for FrozenClip
2023-01-13 06:27:21 +09:00
aria1th 18d36bce6c add CLIP change test tab 2023-01-13 06:16:40 +09:00
AngelBottomless 847b07a74c
Update README.md 2023-01-13 03:13:53 +09:00
AngelBottomless 4c87144b5d
Merge pull request #22 from aria1th/beta-apply-bigger-batch-sizes
Beta apply bigger batch sizes
2023-01-11 10:36:19 +09:00
aria1th 6959fb27da maybe fix IndexError 2023-01-11 10:22:17 +09:00
aria1th 0b9075f39f Allow bigger batch size
referring to https://github.com/AUTOMATIC1111/stable-diffusion-webui/pull/6620

Cleaned up some code and forked RNG from module, to avoid some disasters
2023-01-11 09:46:48 +09:00
aria1th c845b0ad81 Implement LR Scheduler for TI
well.... not sure if its working correctly
Closes https://github.com/aria1th/Hypernetwork-MonkeyPatch-Extension/issues/21
2023-01-10 16:18:04 +09:00
aria1th 4661798eb1 Fix HNS structure
this is why the extension is named monkey-patching
2023-01-10 03:13:01 +09:00
aria1th 3c5acb3920 Recover rng state after generating image 2023-01-10 01:29:35 +09:00
AngelBottomless 3090ae500a
Update README.md 2023-01-08 20:57:53 +09:00
AngelBottomless 34b9693617
Update README.md 2023-01-06 08:17:15 +09:00
aria1th 022002a916 add Gradient clipping and fix https://github.com/aria1th/Hypernetwork-MonkeyPatch-Extension/issues/18 2023-01-06 00:41:48 +09:00
aria1th dd2e3bb88d Fix https://github.com/aria1th/Hypernetwork-MonkeyPatch-Extension/issues/16 2023-01-05 19:29:12 +09:00
aria1th 68bed7cdfb maybe allow big weight decay 2022-12-17 20:13:30 +09:00
aria1th 08e2bf683d add AdamW options
in future, add some more latent space encoding and proper batch extraction
2022-12-16 19:32:14 +09:00
aria1th f64e7d227c Fix scheduler multiplier 2022-12-09 16:02:18 +09:00