Commit Graph

57 Commits (5d1bfc2bfcb63d8e34c96b7d2a5d942e7e242aaf)

Author SHA1 Message Date
Disty0 6f2145fa57 revert offload_buffers 2025-09-28 16:47:31 +03:00
Disty0 02f03d56a7 set offload_buffers to true on balanced offload 2025-09-28 16:23:29 +03:00
Vladimir Mandic 5b43c66a92 nunchaku sdxl and sdxl-turbo support
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-09-20 21:01:21 -04:00
Vladimir Mandic cd79f92dff add opts models_not_to_offload
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-09-19 11:21:54 -04:00
Vladimir Mandic cc6101ecb2 jumbo update: add wan22-vace, improve offloading, add offloading-using-streams, change logging-levels, refactor some default packages
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-09-17 12:32:30 -04:00
Vladimir Mandic ad9d56f49e offload clean logging
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-09-16 09:03:03 -04:00
Vladimir Mandic 0d1275972c update changelog/todo
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-09-15 09:26:46 -04:00
Vladimir Mandic 7940217764 add models_not_to_quant option
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-09-11 12:31:07 -04:00
Vladimir Mandic 2bb96e6926 fix wan i2i
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-09-11 09:50:20 -04:00
Vladimir Mandic c5f1032b6c improve controlnet offloading
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-09-04 15:47:17 -04:00
Vladimir Mandic c41afe6b08 offloading hooks
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-08-27 22:28:07 -04:00
Vladimir Mandic 9e6928410f offloading improvements
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-08-25 10:16:38 -04:00
Vladimir Mandic dc8a72947d fix meissonic
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-08-11 16:05:39 -04:00
Vladimir Mandic 800521d885 update models current and list tabs
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-08-02 14:18:58 -04:00
Vladimir Mandic f7e433bd07 lint
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-08-01 18:26:57 -04:00
Vladimir Mandic 9394430aa3 cleanup
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-08-01 16:46:27 -04:00
Disty0 61a5e5ebca Fix module size detection 2025-08-01 23:45:24 +03:00
Vladimir Mandic 4be093b80f add diffusers_offload_nonblocking setting
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-08-01 16:38:31 -04:00
Disty0 52bef2871b Fix balanced offload pre forward with partial offload 2025-08-01 23:04:58 +03:00
Disty0 5809476e22 fix balanced offload pre_forward not offloading 2025-08-01 22:38:55 +03:00
Vladimir Mandic fbad5d87d6 add offload pre-forward
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-08-01 10:49:03 -04:00
Vladimir Mandic b291c337a1 refactor internal post loop
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-08-01 10:45:39 -04:00
Vladimir Mandic fa44521ea3 offload-never and offload-always per-module and new highvram profile
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-07-31 11:40:24 -04:00
Vladimir Mandic 04af23a3bc refactore pipeline apply/unapply optional components & features
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-07-26 20:04:07 -04:00
Vladimir Mandic ea0b84ffc0 group offloading (experimental)
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-07-20 09:33:02 -04:00
Vladimir Mandic 27ce0dea9a torch.compile use repeated blocks
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-07-20 08:44:25 -04:00
Vladimir Mandic e8b5ea3847 major refactor: remove backend original
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-07-05 13:16:46 -04:00
Disty0 4aeb9f004c Cleanup layerwise 2025-07-04 06:12:25 +03:00
Vladimir Mandic bff75f0db3 add omnigen2
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-06-27 20:20:43 -04:00
Vladimir Mandic d5a74d4a4a
Merge branch 'dev' into feature/chroma-support 2025-06-26 13:06:31 -04:00
Vladimir Mandic ada38d57b4 add nvidia-cosmos-predict-2
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-06-26 12:21:43 -04:00
Enes Sadık Özbek 21bdde12d3
Merge branch 'dev' into feature/chroma-support 2025-06-26 01:56:34 +03:00
Disty0 c9f49720c5 Cleanup 2025-06-25 23:37:41 +03:00
Vladimir Mandic 5b486a6ef1 sdnq add xyz grid support, improve offloading compatibility
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-06-25 15:32:37 -04:00
Disty0 eaa130463c Use Diffusers with OmniGen 2025-06-24 13:09:11 +03:00
Enes Sadık Özbek 4b3ce06916
Initial support for Chroma 2025-06-18 00:38:17 +00:00
Disty0 e4c7aa75f7 Fix balanced offload offload post not activating 2025-04-16 22:52:30 +03:00
Vladimir Mandic ee1a4c607d offload cleanup
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-04-15 10:06:34 -04:00
Disty0 1541a19d89 Offload the TE right away 2025-04-15 02:28:44 +03:00
Vladimir Mandic b63afc80fa explicitly flag h1 as large model
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-04-14 10:25:31 -04:00
Vladimir Mandic dc9a64d00b memmon detect gpu swapping
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-04-07 08:59:54 -04:00
Vladimir Mandic 68f3c203b1 remove non-blocking
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-04-04 15:49:50 -04:00
Vladimir Mandic ff4d57814e fix debug logging
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-04-04 09:14:48 -04:00
Vladimir Mandic 6430f7006f add monitor cli option and finish lora refactor
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-04-01 13:39:47 -04:00
Vladimir Mandic 2c58d3b36c fastercache and pyramidattentionbroadcast
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-03-27 11:49:30 -04:00
Vladimir Mandic c0a2ac9c23 update requirements
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-03-25 10:17:59 -04:00
Vladimir Mandic 5c46904fd8 video tab alpha releasee
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-03-20 14:39:38 -04:00
Vladimir Mandic dbfd59434f add gemma3
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-03-15 15:30:57 -04:00
Disty0 1914ad9011 IPEX fix performance with balanced offload 2025-03-11 18:59:38 +03:00
Seunghoon Lee 2be555dc82
fix directml backend 2025-03-12 00:50:27 +09:00