Commit Graph

68 Commits (3a65d561a70f60d2c67f607d2b00a944c7c427ed)

Author SHA1 Message Date
vladmandic ad6458aa7b add flux2
Signed-off-by: vladmandic <mandic00@live.com>
2025-11-26 15:47:17 +00:00
Disty0 8535efc14a Add WanTransformerBlock to no split 2025-11-02 18:33:44 +03:00
Vladimir Mandic 567b9e7014 add hunyuanimage3 loader
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-10-29 11:10:47 -04:00
Vladimir Mandic d9e8fb8e1e handle sparse controlnet
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-10-28 09:55:38 -04:00
Disty0 0861ce5d5d cleanup 2025-10-27 22:35:13 +03:00
Vladimir Mandic e4711bcb6c add hunyuanimage-2.1
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-10-24 10:29:58 -04:00
Vladimir Mandic 65e1d20e24 offline mode for controlnet/t2i/xs/lite/ipadapter/processors
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-10-23 09:40:53 -04:00
Vladimir Mandic 2e4e741d47 seedvt2
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-10-12 15:35:08 -04:00
Disty0 6bc83bc296 Prevent accelerate from splitting Linear and Conv layers and causing device mismatch errors 2025-10-11 03:19:30 +03:00
Vladimir Mandic 962cb7115d infra for full-model load/save with quant
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-10-07 14:30:45 -04:00
Vladimir Mandic 28e3ae0480 experimental xomni
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-10-05 20:17:32 -04:00
Disty0 6f2145fa57 revert offload_buffers 2025-09-28 16:47:31 +03:00
Disty0 02f03d56a7 set offload_buffers to true on balanced offload 2025-09-28 16:23:29 +03:00
Vladimir Mandic 5b43c66a92 nunchaku sdxl and sdxl-turbo support
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-09-20 21:01:21 -04:00
Vladimir Mandic cd79f92dff add opts models_not_to_offload
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-09-19 11:21:54 -04:00
Vladimir Mandic cc6101ecb2 jumbo update: add wan22-vace, improve offloading, add offloading-using-streams, change logging-levels, refactor some default packages
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-09-17 12:32:30 -04:00
Vladimir Mandic ad9d56f49e offload clean logging
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-09-16 09:03:03 -04:00
Vladimir Mandic 0d1275972c update changelog/todo
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-09-15 09:26:46 -04:00
Vladimir Mandic 7940217764 add models_not_to_quant option
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-09-11 12:31:07 -04:00
Vladimir Mandic 2bb96e6926 fix wan i2i
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-09-11 09:50:20 -04:00
Vladimir Mandic c5f1032b6c improve controlnet offloading
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-09-04 15:47:17 -04:00
Vladimir Mandic c41afe6b08 offloading hooks
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-08-27 22:28:07 -04:00
Vladimir Mandic 9e6928410f offloading improvements
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-08-25 10:16:38 -04:00
Vladimir Mandic dc8a72947d fix meissonic
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-08-11 16:05:39 -04:00
Vladimir Mandic 800521d885 update models current and list tabs
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-08-02 14:18:58 -04:00
Vladimir Mandic f7e433bd07 lint
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-08-01 18:26:57 -04:00
Vladimir Mandic 9394430aa3 cleanup
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-08-01 16:46:27 -04:00
Disty0 61a5e5ebca Fix module size detection 2025-08-01 23:45:24 +03:00
Vladimir Mandic 4be093b80f add diffusers_offload_nonblocking setting
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-08-01 16:38:31 -04:00
Disty0 52bef2871b Fix balanced offload pre forward with partial offload 2025-08-01 23:04:58 +03:00
Disty0 5809476e22 fix balanced offload pre_forward not offloading 2025-08-01 22:38:55 +03:00
Vladimir Mandic fbad5d87d6 add offload pre-forward
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-08-01 10:49:03 -04:00
Vladimir Mandic b291c337a1 refactor internal post loop
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-08-01 10:45:39 -04:00
Vladimir Mandic fa44521ea3 offload-never and offload-always per-module and new highvram profile
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-07-31 11:40:24 -04:00
Vladimir Mandic 04af23a3bc refactore pipeline apply/unapply optional components & features
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-07-26 20:04:07 -04:00
Vladimir Mandic ea0b84ffc0 group offloading (experimental)
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-07-20 09:33:02 -04:00
Vladimir Mandic 27ce0dea9a torch.compile use repeated blocks
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-07-20 08:44:25 -04:00
Vladimir Mandic e8b5ea3847 major refactor: remove backend original
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-07-05 13:16:46 -04:00
Disty0 4aeb9f004c Cleanup layerwise 2025-07-04 06:12:25 +03:00
Vladimir Mandic bff75f0db3 add omnigen2
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-06-27 20:20:43 -04:00
Vladimir Mandic d5a74d4a4a
Merge branch 'dev' into feature/chroma-support 2025-06-26 13:06:31 -04:00
Vladimir Mandic ada38d57b4 add nvidia-cosmos-predict-2
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-06-26 12:21:43 -04:00
Enes Sadık Özbek 21bdde12d3
Merge branch 'dev' into feature/chroma-support 2025-06-26 01:56:34 +03:00
Disty0 c9f49720c5 Cleanup 2025-06-25 23:37:41 +03:00
Vladimir Mandic 5b486a6ef1 sdnq add xyz grid support, improve offloading compatibility
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-06-25 15:32:37 -04:00
Disty0 eaa130463c Use Diffusers with OmniGen 2025-06-24 13:09:11 +03:00
Enes Sadık Özbek 4b3ce06916
Initial support for Chroma 2025-06-18 00:38:17 +00:00
Disty0 e4c7aa75f7 Fix balanced offload offload post not activating 2025-04-16 22:52:30 +03:00
Vladimir Mandic ee1a4c607d offload cleanup
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-04-15 10:06:34 -04:00
Disty0 1541a19d89 Offload the TE right away 2025-04-15 02:28:44 +03:00