aria1th
|
83fa587f39
|
Tensorboard integration and fixes
This only works with post-d8b90ac121
|
2023-01-16 01:50:43 +09:00 |
|
aria1th
|
022002a916
|
add Gradient clipping and fix https://github.com/aria1th/Hypernetwork-MonkeyPatch-Extension/issues/18
|
2023-01-06 00:41:48 +09:00 |
|
aria1th
|
68bed7cdfb
|
maybe allow big weight decay
|
2022-12-17 20:13:30 +09:00 |
|
aria1th
|
08e2bf683d
|
add AdamW options
in future, add some more latent space encoding and proper batch extraction
|
2022-12-16 19:32:14 +09:00 |
|
aria1th
|
f64e7d227c
|
Fix scheduler multiplier
|
2022-12-09 16:02:18 +09:00 |
|
aria1th
|
f2c1ea8228
|
Fix rng again
|
2022-12-07 13:47:52 +09:00 |
|
aria1th
|
b47fb21f3d
|
Fix bad original scheduler
Why, Why scheduler.step - apply does not work as expected?
|
2022-11-30 19:19:20 +09:00 |
|
aria1th
|
6e6e02aea6
|
Add loss statistics again
By request, it was working anyway
|
2022-11-29 19:45:21 +09:00 |
|
aria1th
|
e3d7c692af
|
Load/Unload optimizer state as option
maybe fix doggetx too?
|
2022-11-29 03:35:37 +09:00 |
|
aria1th
|
6ed92743fb
|
Update hypernetwork.py
|
2022-11-28 03:55:24 +09:00 |
|
aria1th
|
191eaf8d3d
|
Try fix https://github.com/aria1th/Hypernetwork-MonkeyPatch-Extension/issues/6
|
2022-11-28 03:54:31 +09:00 |
|
aria1th
|
6e88315590
|
Fix unused option causing Errors+Warmup
|
2022-11-27 21:27:47 +09:00 |
|
aria1th
|
983461f370
|
remove print()
|
2022-11-27 20:39:04 +09:00 |
|
aria1th
|
5467cd6ca6
|
Fix EOC again
|
2022-11-27 20:30:42 +09:00 |
|
aria1th
|
d2805d4598
|
UI Update and fix is_EOC
|
2022-11-27 20:13:35 +09:00 |
|
aria1th
|
a87e90e0dd
|
clean up code partially
|
2022-11-27 12:36:21 +09:00 |
|
aria1th
|
ad395f11b8
|
fix DivisionByZero and save
|
2022-11-27 11:07:38 +09:00 |
|
aria1th
|
3afe99d27e
|
Fix resuming, Add options
|
2022-11-27 10:57:43 +09:00 |
|
aria1th
|
0daf9874d0
|
FIx Scheduler
|
2022-11-27 10:23:43 +09:00 |
|
aria1th
|
daa2ee237a
|
amplify image, correct annealing, show correct lr
|
2022-11-26 10:31:37 +09:00 |
|
aria1th
|
40fd21ea8d
|
apply max steps when using beta scheduler
|
2022-11-25 14:19:10 +09:00 |
|
aria1th
|
730320e65f
|
Write float instead of list
|
2022-11-24 17:45:10 +09:00 |
|
aria1th
|
4af478f504
|
fix GradScaler
|
2022-11-24 14:15:38 +09:00 |
|
AngelBottomless
|
087040c9f8
|
fix loss save and CUDA memory
|
2022-11-24 13:17:15 +09:00 |
|
AngelBottomless
|
3b54b9ca58
|
Add external pr
|
2022-11-23 21:33:31 +09:00 |