Commit Graph

217 Commits (10bbbed218458b8a899aac2140ec738d8d716f05)

Author SHA1 Message Date
Disty0 f4e3a81a84 NNCF experimental direct INT8 MatMul support 2025-05-12 21:41:49 +03:00
Disty0 9cfdc3c079 Remove NNCF device hijack 2025-05-11 18:30:10 +03:00
Vladimir Mandic ff649291b5 lint fixes
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-04-28 10:55:21 -04:00
AI-Casanova d14b54efa3 Preliminary support for sd1.5/sdxl OMI lora 2025-04-27 16:53:22 -05:00
Vladimir Mandic f00824e7b5 add SD_LORA_DUMP
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-04-25 09:54:43 -04:00
Vladimir Mandic bcb7b24bf2 cleanup video tab
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-04-23 13:46:50 -04:00
Disty0 75d169bc1c Fix NNCF Lora with model offload 2025-04-23 17:13:08 +03:00
Disty0 f1d8543cae NNCF lora support 2025-04-23 15:44:09 +03:00
Vladimir Mandic a9969491ff fix hidream loader
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-04-22 11:04:35 -04:00
Vladimir Mandic 8d6c7510c2 fix lora
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-04-18 07:34:12 -04:00
Vladimir Mandic eaf37055ba nunchaku lora support
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-04-17 11:45:37 -04:00
Vladimir Mandic 38a3b62553 modularize hidream loader
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-04-16 09:11:43 -04:00
Vladimir Mandic 984aa8ec55 lint fixes
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-04-08 16:31:51 -04:00
Vladimir Mandic 6ab59230ba update ui
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-04-08 15:22:08 -04:00
Vladimir Mandic 97df5869a4 update requirements
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-04-07 09:30:03 -04:00
Vladimir Mandic 84a24fb681 lora restore weights to orig device on apply
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-04-07 07:49:18 -04:00
Vladimir Mandic d30b1cb1c8 lora improvements
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-04-06 13:02:58 -04:00
Vladimir Mandic 8f95477ad2 add teacache for flux
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-04-05 12:58:00 -04:00
Vladimir Mandic 538b81021c add generate context menu get server status
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-04-05 12:58:00 -04:00
Vladimir Mandic 8725cfc488 lora obey device
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-04-03 14:31:39 -04:00
Vladimir Mandic 5c6c1465f4 fix style apply params
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-04-03 10:03:48 -04:00
Vladimir Mandic 6430f7006f add monitor cli option and finish lora refactor
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-04-01 13:39:47 -04:00
Vladimir Mandic b5031a5eba lora modularize code
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-04-01 13:39:47 -04:00
Vladimir Mandic 032bd46de2 improve mp4 download
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-04-01 13:39:47 -04:00
Vladimir Mandic 5906eb6792 lora apply on gpu vs cpu settings option
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-04-01 13:39:47 -04:00
Vladimir Mandic 02f480bf32 add prompt enhance wiki
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-03-29 09:55:56 -04:00
Vladimir Mandic 8343469be0 improve prompt enhancer and update apply styles
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-03-28 21:03:27 -04:00
Vladimir Mandic 6a5e253ecf add infiniteyou
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-03-26 10:50:09 -04:00
Vladimir Mandic cd71fe51ff fix lora change with balanced offload
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-03-25 14:56:53 -04:00
Vladimir Mandic aa15ed1fa7 reapply offload after applying lora
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-03-25 14:09:34 -04:00
Vladimir Mandic 5c46904fd8 video tab alpha releasee
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-03-20 14:39:38 -04:00
Vladimir Mandic c5c3be04fb video tab first prototype
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-03-18 18:40:08 -04:00
Vladimir Mandic d4a67dd946 lora logging
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-03-15 19:04:03 -04:00
Vladimir Mandic 7d9b268655 update repo links
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-01-31 12:15:21 -05:00
Vladimir Mandic da6a1979ff cleanup lora overrides
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-01-28 18:47:48 -05:00
Vladimir Mandic ac2adaa299 cleanup
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-01-10 08:25:00 -05:00
Vladimir Mandic 2090a334b0 hunyuanvideo lora support
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-01-07 12:49:09 -05:00
Vladimir Mandic 0114b59470 refactor of progress monitoring
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-01-05 13:22:19 -05:00
Vladimir Mandic 699ed3a444 update lora changed
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2024-12-31 15:52:00 -05:00
Disty0 9adf777e38 OpenVINO fix Lora 2024-12-31 04:15:37 +03:00
Vladimir Mandic 25e5411a0e again
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2024-12-29 15:42:29 -05:00
Vladimir Mandic 40472eefe5 typo
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2024-12-29 15:41:34 -05:00
Vladimir Mandic 18f683b283 refactor lora add_weights
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2024-12-29 12:42:08 -05:00
Vladimir Mandic 910f5d0a73 lora direct on-demand apply/unapply
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2024-12-29 12:38:19 -05:00
Vladimir Mandic 8b910dbf02 cleanup
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2024-12-28 17:04:43 -05:00
Vladimir Mandic 53c4c84c40 quantization improvements and lora support
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2024-12-28 16:57:06 -05:00
Vladimir Mandic d49d470a89 hide disabled networks and add more previews
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2024-12-27 09:45:03 -05:00
Vladimir Mandic e7f0047d52 add granular vae tiling options
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2024-12-25 12:38:21 -05:00
Vladimir Mandic a5f94fe0dd remove experimental from consistory
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2024-12-24 16:09:25 -05:00
Vladimir Mandic ea6d3107ab update all todo statements
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2024-12-22 08:39:31 -05:00
Vladimir Mandic fc8a18df36 ruff updates
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2024-12-20 18:58:29 -05:00
Vladimir Mandic ed3e5f06d6 linting
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2024-12-20 18:48:06 -05:00
Vladimir Mandic dae181fefb lora-direct with bnb
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2024-12-20 18:26:25 -05:00
Vladimir Mandic b1f1864099 lint updates
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2024-12-15 13:12:35 -05:00
Vladimir Mandic bd540efb73 lora: absolute path, hf download, flux controlnet loras
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2024-12-11 18:10:51 -05:00
Vladimir Mandic 8cea43f7db lora add erorr handler for partial offload
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2024-12-11 13:10:05 -05:00
Vladimir Mandic beea969fd3 update lora
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2024-12-10 12:34:27 -05:00
Vladimir Mandic 383d7052ac lora split te apply
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2024-12-09 15:23:22 -05:00
Vladimir Mandic 1185950c4a yet another lora refactor
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2024-12-09 13:40:19 -05:00
AI-Casanova 6c9101dfaf
lora low memory mode: switching requires manual model reload 2024-12-06 22:54:08 -06:00
Vladimir Mandic 28eeb00432 remove non-blocking
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2024-12-06 09:15:37 -05:00
Vladimir Mandic 16ab1e2ae8 safer lora unapply
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2024-12-06 07:23:31 -05:00
Vladimir Mandic 2934948413 lora one more safe cast
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2024-12-05 09:04:42 -05:00
Vladimir Mandic ca06002602 lora maintain device
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2024-12-04 09:25:57 -05:00
Vladimir Mandic 4eac263055 add bdia sampler
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2024-12-02 11:21:39 -05:00
Vladimir Mandic 7e2034c4ff lora add fuse
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2024-12-02 10:51:41 -05:00
Vladimir Mandic 023b13b6cb balanced offload improvements
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2024-12-01 15:34:25 -05:00
Vladimir Mandic 507636d0a1 lora-refactor
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2024-12-01 10:54:51 -05:00
Vladimir Mandic e74c038f64 interruptible lora apply
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2024-11-30 19:53:10 -05:00
Disty0 4089af7c03 Fix NaNs on Intel with Lora + Offloading 2024-12-01 03:52:57 +03:00
Vladimir Mandic b7aff134a2 add low/high threshold to balanced offload
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2024-11-30 19:03:51 -05:00
Vladimir Mandic 22982f3126 update stats
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2024-11-30 18:10:10 -05:00
Vladimir Mandic bccb277dcb update lora apply weights and xyz
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2024-11-30 17:26:52 -05:00
Vladimir Mandic eee85e5a4e lora refactor in progress
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2024-11-30 12:29:58 -05:00
Vladimir Mandic eacd4e9357 add stats
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2024-11-30 09:02:47 -05:00
Vladimir Mandic 1e90312982 update lora
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2024-11-30 08:50:25 -05:00
Disty0 881fa1183c Fix offload issues with lora 2024-11-30 00:16:38 +03:00
Vladimir Mandic 797ad1f20f lora stats
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2024-11-29 15:40:23 -05:00
Disty0 9187418358 revert networs.py 2024-11-29 22:53:17 +03:00
Disty0 39b14a202e Fix sequential offload with lora 2024-11-29 22:35:00 +03:00
Vladimir Mandic b6963470a9 conditional imports and summary timer
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2024-11-29 10:05:06 -05:00
Vladimir Mandic 6aa7a4707e modules.lora full integration
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2024-11-29 09:39:38 -05:00
Vladimir Mandic a635421231 lint fixes
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2024-11-29 08:01:26 -05:00
AI-Casanova bf170ea08c
Fix multiple LoRA 2024-11-24 23:22:57 -06:00
AI-Casanova cb561fa486
Major lora refactor: works on my machine edition 2024-11-23 21:57:03 -06:00
Disty0 b76d9ce6a7 cleanup 2024-02-10 19:02:53 +03:00
Disty0 3bb80821ab Update changelog 2024-02-10 18:55:36 +03:00
Vladimir Mandic 1c4293ad92 remove obsolete kohya lora code 2024-02-10 10:53:41 -05:00
Vladimir Mandic 0bfb17ba72 implement complete face module 2024-01-27 08:07:34 -05:00
Vladimir Mandic 36578d61c2 fix mask invert 2024-01-23 08:37:30 -05:00
Vladimir Mandic c7c9a82e07 add option to load model direct to gpu 2024-01-18 12:04:20 -05:00
Vladimir Mandic b1fa002ea7 control mask: add auto-mask and auto-segment and support for algo masking and rembg masking 2024-01-16 13:12:46 -05:00
Vladimir Mandic b36208234f fix ui dummy comp 2024-01-04 08:58:54 -05:00
Vladimir Mandic 6bb73e1fd8 add support for lora oft, lyco oft, peft 2023-12-24 11:30:04 -05:00
Vladimir Mandic aeccc28d60 control set task args 2023-12-21 10:57:11 -05:00
Vladimir Mandic 439542d3df redesign profiler 2023-12-03 11:27:24 -05:00
Vladimir Mandic 2919774c01 improve en display 2023-11-05 08:09:40 -05:00
Vladimir Mandic 20c2d83ad7 refactor filename pattern handling 2023-10-11 11:38:23 -04:00
Vladimir Mandic 6b4df05b5c fix sampler eta 2023-10-09 07:27:00 -04:00
Vladimir Mandic 9a5f339082 add compact view 2023-10-02 07:56:11 -04:00