Commit Graph

32 Commits (83fa587f396c358d5a4d30d7225e9e4e6b10d6ed)

Author SHA1 Message Date
aria1th 83fa587f39 Tensorboard integration and fixes
This only works with post-d8b90ac121
2023-01-16 01:50:43 +09:00
aria1th e42d2124c1 Compatibility for previous webui 2023-01-15 11:59:58 +09:00
aria1th cd40e4dcaa Fix .shorthash() method related issue 2023-01-14 23:15:11 +09:00
aria1th 6959fb27da maybe fix IndexError 2023-01-11 10:22:17 +09:00
aria1th 0b9075f39f Allow bigger batch size
referring to https://github.com/AUTOMATIC1111/stable-diffusion-webui/pull/6620

Cleaned up some code and forked RNG from module, to avoid some disasters
2023-01-11 09:46:48 +09:00
aria1th c845b0ad81 Implement LR Scheduler for TI
well.... not sure if its working correctly
Closes https://github.com/aria1th/Hypernetwork-MonkeyPatch-Extension/issues/21
2023-01-10 16:18:04 +09:00
aria1th 3c5acb3920 Recover rng state after generating image 2023-01-10 01:29:35 +09:00
aria1th 022002a916 add Gradient clipping and fix https://github.com/aria1th/Hypernetwork-MonkeyPatch-Extension/issues/18 2023-01-06 00:41:48 +09:00
aria1th dd2e3bb88d Fix https://github.com/aria1th/Hypernetwork-MonkeyPatch-Extension/issues/16 2023-01-05 19:29:12 +09:00
aria1th 68bed7cdfb maybe allow big weight decay 2022-12-17 20:13:30 +09:00
aria1th 08e2bf683d add AdamW options
in future, add some more latent space encoding and proper batch extraction
2022-12-16 19:32:14 +09:00
aria1th f64e7d227c Fix scheduler multiplier 2022-12-09 16:02:18 +09:00
aria1th f2c1ea8228 Fix rng again 2022-12-07 13:47:52 +09:00
aria1th b47fb21f3d Fix bad original scheduler
Why, Why scheduler.step - apply does not work as expected?
2022-11-30 19:19:20 +09:00
aria1th 6e6e02aea6 Add loss statistics again
By request, it was working anyway
2022-11-29 19:45:21 +09:00
aria1th e3d7c692af Load/Unload optimizer state as option
maybe fix doggetx too?
2022-11-29 03:35:37 +09:00
aria1th 6ed92743fb Update hypernetwork.py 2022-11-28 03:55:24 +09:00
aria1th 191eaf8d3d Try fix https://github.com/aria1th/Hypernetwork-MonkeyPatch-Extension/issues/6 2022-11-28 03:54:31 +09:00
aria1th 6e88315590 Fix unused option causing Errors+Warmup 2022-11-27 21:27:47 +09:00
aria1th 983461f370 remove print() 2022-11-27 20:39:04 +09:00
aria1th 5467cd6ca6 Fix EOC again 2022-11-27 20:30:42 +09:00
aria1th d2805d4598 UI Update and fix is_EOC 2022-11-27 20:13:35 +09:00
aria1th a87e90e0dd clean up code partially 2022-11-27 12:36:21 +09:00
aria1th ad395f11b8 fix DivisionByZero and save 2022-11-27 11:07:38 +09:00
aria1th 3afe99d27e Fix resuming, Add options 2022-11-27 10:57:43 +09:00
aria1th 0daf9874d0 FIx Scheduler 2022-11-27 10:23:43 +09:00
aria1th daa2ee237a amplify image, correct annealing, show correct lr 2022-11-26 10:31:37 +09:00
aria1th 40fd21ea8d apply max steps when using beta scheduler 2022-11-25 14:19:10 +09:00
aria1th 730320e65f Write float instead of list 2022-11-24 17:45:10 +09:00
aria1th 4af478f504 fix GradScaler 2022-11-24 14:15:38 +09:00
AngelBottomless 087040c9f8
fix loss save and CUDA memory 2022-11-24 13:17:15 +09:00
AngelBottomless 3b54b9ca58
Add external pr 2022-11-23 21:33:31 +09:00