AngelBottomless
|
bb875af507
|
Merge pull request #32 from aria1th/residual-connection
Residual connection
|
2023-01-17 17:42:28 +09:00 |
|
aria1th
|
28a4272fe5
|
prevent direct random module access
|
2023-01-17 17:42:01 +09:00 |
|
aria1th
|
72b7609c3f
|
clip_ instead
|
2023-01-17 17:18:43 +09:00 |
|
aria1th
|
328692830c
|
If someone is curious
|
2023-01-17 16:51:19 +09:00 |
|
AngelBottomless
|
67d95e983a
|
Update README.md
|
2023-01-17 15:52:59 +09:00 |
|
aria1th
|
ed214c45c8
|
Fix loading residual
|
2023-01-17 15:17:00 +09:00 |
|
aria1th
|
065fcd110c
|
implement ResBlock
its residual block
|
2023-01-17 14:24:25 +09:00 |
|
aria1th
|
ca1f16e49b
|
implement existing hn tuning
and maybe fix compat with other extension
|
2023-01-16 20:48:48 +09:00 |
|
aria1th
|
1b2857533d
|
Compatibility with previous webui
|
2023-01-16 20:06:21 +09:00 |
|
aria1th
|
efb0e6c3c5
|
fix lr logging for tensorboard
dynamic LR
|
2023-01-16 18:56:11 +09:00 |
|
aria1th
|
7409274cd4
|
fix images being overrided
|
2023-01-16 10:22:52 +09:00 |
|
aria1th
|
c80d6b5d4c
|
separate tensorflow related util
change saving directory for convenience
add hyperparameter logging
|
2023-01-16 09:53:55 +09:00 |
|
AngelBottomless
|
aca968d489
|
add Hyperparameter tuning and CLIP Test
|
2023-01-16 08:50:25 +09:00 |
|
aria1th
|
3aa30df1e4
|
cleanup and some more safety
|
2023-01-16 08:47:20 +09:00 |
|
AngelBottomless
|
b338aaa437
|
Merge pull request #29 from aria1th/hypernetwork-tuning
Hypernetwork tuning + some fixes
|
2023-01-16 08:00:10 +09:00 |
|
aria1th
|
43ef5c3218
|
clean up some code
|
2023-01-16 07:57:47 +09:00 |
|
aria1th
|
11728fbb3c
|
Skip if OSError happens
|
2023-01-16 06:56:21 +09:00 |
|
aria1th
|
9d2e8bd963
|
fix minor errors
|
2023-01-16 06:49:46 +09:00 |
|
aria1th
|
f75fd3bb97
|
Maybe finish tuning
|
2023-01-16 06:47:10 +09:00 |
|
aria1th
|
dceaa667c2
|
maybe
|
2023-01-16 05:37:19 +09:00 |
|
aria1th
|
7631f51b42
|
add disabling grad for models
this just ensures no gradient can be generated through original models
|
2023-01-16 02:27:23 +09:00 |
|
aria1th
|
83fa587f39
|
Tensorboard integration and fixes
This only works with post-d8b90ac121
|
2023-01-16 01:50:43 +09:00 |
|
aria1th
|
e42d2124c1
|
Compatibility for previous webui
|
2023-01-15 11:59:58 +09:00 |
|
aria1th
|
8f2e6aa10c
|
Offer compatible module for previous webui
|
2023-01-14 23:22:40 +09:00 |
|
aria1th
|
cd40e4dcaa
|
Fix .shorthash() method related issue
|
2023-01-14 23:15:11 +09:00 |
|
aria1th
|
10d2622f64
|
Fix CLIP_test tab
Also it will only work for FrozenClip
|
2023-01-13 06:27:21 +09:00 |
|
aria1th
|
18d36bce6c
|
add CLIP change test tab
|
2023-01-13 06:16:40 +09:00 |
|
AngelBottomless
|
847b07a74c
|
Update README.md
|
2023-01-13 03:13:53 +09:00 |
|
AngelBottomless
|
4c87144b5d
|
Merge pull request #22 from aria1th/beta-apply-bigger-batch-sizes
Beta apply bigger batch sizes
|
2023-01-11 10:36:19 +09:00 |
|
aria1th
|
6959fb27da
|
maybe fix IndexError
|
2023-01-11 10:22:17 +09:00 |
|
aria1th
|
0b9075f39f
|
Allow bigger batch size
referring to https://github.com/AUTOMATIC1111/stable-diffusion-webui/pull/6620
Cleaned up some code and forked RNG from module, to avoid some disasters
|
2023-01-11 09:46:48 +09:00 |
|
aria1th
|
c845b0ad81
|
Implement LR Scheduler for TI
well.... not sure if its working correctly
Closes https://github.com/aria1th/Hypernetwork-MonkeyPatch-Extension/issues/21
|
2023-01-10 16:18:04 +09:00 |
|
aria1th
|
4661798eb1
|
Fix HNS structure
this is why the extension is named monkey-patching
|
2023-01-10 03:13:01 +09:00 |
|
aria1th
|
3c5acb3920
|
Recover rng state after generating image
|
2023-01-10 01:29:35 +09:00 |
|
AngelBottomless
|
3090ae500a
|
Update README.md
|
2023-01-08 20:57:53 +09:00 |
|
AngelBottomless
|
34b9693617
|
Update README.md
|
2023-01-06 08:17:15 +09:00 |
|
aria1th
|
022002a916
|
add Gradient clipping and fix https://github.com/aria1th/Hypernetwork-MonkeyPatch-Extension/issues/18
|
2023-01-06 00:41:48 +09:00 |
|
aria1th
|
dd2e3bb88d
|
Fix https://github.com/aria1th/Hypernetwork-MonkeyPatch-Extension/issues/16
|
2023-01-05 19:29:12 +09:00 |
|
aria1th
|
68bed7cdfb
|
maybe allow big weight decay
|
2022-12-17 20:13:30 +09:00 |
|
aria1th
|
08e2bf683d
|
add AdamW options
in future, add some more latent space encoding and proper batch extraction
|
2022-12-16 19:32:14 +09:00 |
|
aria1th
|
f64e7d227c
|
Fix scheduler multiplier
|
2022-12-09 16:02:18 +09:00 |
|
aria1th
|
858ba76acc
|
disable hyper_k, hyper_v assignment
Minor unused change
|
2022-12-07 14:05:02 +09:00 |
|
aria1th
|
f2c1ea8228
|
Fix rng again
|
2022-12-07 13:47:52 +09:00 |
|
AngelBottomless
|
10d7d8a174
|
Update README.md
|
2022-12-02 09:52:45 +09:00 |
|
aria1th
|
5bfa06d6bf
|
Fix HNS file
I think I was sleepy
|
2022-12-02 09:42:47 +09:00 |
|
aria1th
|
96e98a1a0b
|
try avoiding CUDA OOM
|
2022-12-02 00:31:08 +09:00 |
|
aria1th
|
0c40457b40
|
add print for structures
|
2022-12-02 00:13:11 +09:00 |
|
aria1th
|
36d3f1787e
|
fix Sequential Hypernetwork
|
2022-12-01 23:59:52 +09:00 |
|
aria1th
|
4dd988c5b7
|
Fix bug
I think I fixed this once...
|
2022-12-01 23:45:51 +09:00 |
|
aria1th
|
138a25b69f
|
fix again
should check if side effect exists...
|
2022-12-01 23:04:14 +09:00 |