Commit Graph

119 Commits (13713bd2abc5673890ce72d3ca73aa9e9d5e3906)

Author SHA1 Message Date
aria1th 13713bd2ab get real LR for dadaptation 2023-02-17 05:54:19 +09:00
aria1th c4147cf319 try loading invalid dropouts
it should've been prevented...
2023-02-16 14:54:00 +09:00
AngelBottomless 99a8a781e8
TODO++ 2023-02-15 12:40:23 +09:00
AngelBottomless c9c107f2cf
introduce D-Adaptation 2023-02-15 12:38:13 +09:00
aria1th e5d9668531 Fix Indent mistake in importing 2023-02-15 01:22:59 +09:00
AngelBottomless 606e8635fc
Beta dadaptation (#45)
* Beta-Dadaptation

Based on https://github.com/facebookresearch/dadaptation/blob/main/dadaptation/dadapt_adam.py
2023-02-15 01:17:36 +09:00
aria1th 3657fd8fad optimize imports
and fix bugs from moved libs
2023-02-13 14:42:20 +09:00
aria1th 980b25f1bb fix bug with infotext
now seed is unused in infotext
Fixes https://github.com/aria1th/Hypernetwork-MonkeyPatch-Extension/issues/41
2023-01-30 18:54:45 +09:00
aria1th 0428c6e47a missing scripts.xy_grid
really?
2023-01-25 19:30:32 +09:00
aria1th a62a343643 add loss options
* loss_simple is same as basic loss, without VLB.
2023-01-24 23:45:49 +09:00
aria1th 07ac06beb2 fix and match with recent webui
also hypernetworks need manual collect now?
2023-01-24 00:38:04 +09:00
aria1th 710e02af79 fix for colaboratory env 2023-01-21 22:55:07 +09:00
AngelBottomless 3dbb5abae2
Merge pull request #37 from aria1th/latest-fix
Latest fix
2023-01-21 21:55:46 +09:00
aria1th 86d71904d4 compatibility 2023-01-21 21:54:54 +09:00
aria1th 82d66c5ced fix for tuning setup 2023-01-21 21:46:19 +09:00
aria1th 3003692706 Fixes for most recent version
at least gamma train and structure works
2023-01-21 21:44:06 +09:00
AngelBottomless 10fdc8b444
Merge pull request #35 from aria1th/noise-scheduler
Noise scheduler option
2023-01-21 10:34:08 +09:00
aria1th 835bb15dc9 some fixes 2023-01-21 09:59:10 +09:00
aria1th a5182880f9 add noise scheduler for training
move to LatentDiffusion forward

unbind scheduler

unbind noise scheduler by option

minor fix?

minor fix for extreme case
2023-01-21 01:14:05 +09:00
aria1th 4b5c5cf800 use idx instead of long timestr
but collision might happen
2023-01-19 22:44:59 +09:00
aria1th e636a8353d Fixes for most recent webui
with ensuring compatibility for previous webui
2023-01-19 14:29:48 +09:00
aria1th c216a0fc7f compatibility with previous webui 2023-01-19 14:05:39 +09:00
aria1th da120135a8 add manual dataset seed option 2023-01-19 06:34:57 +09:00
aria1th 5d82d0d36e fix syntax 2023-01-18 23:02:03 +09:00
aria1th f0fc6fad7f fix manual seed for residual 2023-01-17 22:32:56 +09:00
aria1th b33fb8f21c fix residual connection multiplier 2023-01-17 22:32:27 +09:00
AngelBottomless 0892d70041
Update README.md 2023-01-17 20:50:20 +09:00
AngelBottomless bb875af507
Merge pull request #32 from aria1th/residual-connection
Residual connection
2023-01-17 17:42:28 +09:00
aria1th 28a4272fe5 prevent direct random module access 2023-01-17 17:42:01 +09:00
aria1th 72b7609c3f clip_ instead 2023-01-17 17:18:43 +09:00
aria1th 328692830c If someone is curious 2023-01-17 16:51:19 +09:00
AngelBottomless 67d95e983a
Update README.md 2023-01-17 15:52:59 +09:00
aria1th ed214c45c8 Fix loading residual 2023-01-17 15:17:00 +09:00
aria1th 065fcd110c implement ResBlock
its residual block
2023-01-17 14:24:25 +09:00
aria1th ca1f16e49b implement existing hn tuning
and maybe fix compat with other extension
2023-01-16 20:48:48 +09:00
aria1th 1b2857533d Compatibility with previous webui 2023-01-16 20:06:21 +09:00
aria1th efb0e6c3c5 fix lr logging for tensorboard
dynamic LR
2023-01-16 18:56:11 +09:00
aria1th 7409274cd4 fix images being overrided 2023-01-16 10:22:52 +09:00
aria1th c80d6b5d4c separate tensorflow related util
change saving directory for convenience

add hyperparameter logging
2023-01-16 09:53:55 +09:00
AngelBottomless aca968d489
add Hyperparameter tuning and CLIP Test 2023-01-16 08:50:25 +09:00
aria1th 3aa30df1e4 cleanup and some more safety 2023-01-16 08:47:20 +09:00
AngelBottomless b338aaa437
Merge pull request #29 from aria1th/hypernetwork-tuning
Hypernetwork tuning + some fixes
2023-01-16 08:00:10 +09:00
aria1th 43ef5c3218 clean up some code 2023-01-16 07:57:47 +09:00
aria1th 11728fbb3c Skip if OSError happens 2023-01-16 06:56:21 +09:00
aria1th 9d2e8bd963 fix minor errors 2023-01-16 06:49:46 +09:00
aria1th f75fd3bb97 Maybe finish tuning 2023-01-16 06:47:10 +09:00
aria1th dceaa667c2 maybe 2023-01-16 05:37:19 +09:00
aria1th 7631f51b42 add disabling grad for models
this just ensures no gradient can be generated through original models
2023-01-16 02:27:23 +09:00
aria1th 83fa587f39 Tensorboard integration and fixes
This only works with post-d8b90ac121
2023-01-16 01:50:43 +09:00
aria1th e42d2124c1 Compatibility for previous webui 2023-01-15 11:59:58 +09:00