Vladimir Mandic
|
e4711bcb6c
|
add hunyuanimage-2.1
Signed-off-by: Vladimir Mandic <mandic00@live.com>
|
2025-10-24 10:29:58 -04:00 |
Vladimir Mandic
|
65e1d20e24
|
offline mode for controlnet/t2i/xs/lite/ipadapter/processors
Signed-off-by: Vladimir Mandic <mandic00@live.com>
|
2025-10-23 09:40:53 -04:00 |
Vladimir Mandic
|
2e4e741d47
|
seedvt2
Signed-off-by: Vladimir Mandic <mandic00@live.com>
|
2025-10-12 15:35:08 -04:00 |
Disty0
|
6bc83bc296
|
Prevent accelerate from splitting Linear and Conv layers and causing device mismatch errors
|
2025-10-11 03:19:30 +03:00 |
Vladimir Mandic
|
962cb7115d
|
infra for full-model load/save with quant
Signed-off-by: Vladimir Mandic <mandic00@live.com>
|
2025-10-07 14:30:45 -04:00 |
Vladimir Mandic
|
28e3ae0480
|
experimental xomni
Signed-off-by: Vladimir Mandic <mandic00@live.com>
|
2025-10-05 20:17:32 -04:00 |
Disty0
|
6f2145fa57
|
revert offload_buffers
|
2025-09-28 16:47:31 +03:00 |
Disty0
|
02f03d56a7
|
set offload_buffers to true on balanced offload
|
2025-09-28 16:23:29 +03:00 |
Vladimir Mandic
|
5b43c66a92
|
nunchaku sdxl and sdxl-turbo support
Signed-off-by: Vladimir Mandic <mandic00@live.com>
|
2025-09-20 21:01:21 -04:00 |
Vladimir Mandic
|
cd79f92dff
|
add opts models_not_to_offload
Signed-off-by: Vladimir Mandic <mandic00@live.com>
|
2025-09-19 11:21:54 -04:00 |
Vladimir Mandic
|
cc6101ecb2
|
jumbo update: add wan22-vace, improve offloading, add offloading-using-streams, change logging-levels, refactor some default packages
Signed-off-by: Vladimir Mandic <mandic00@live.com>
|
2025-09-17 12:32:30 -04:00 |
Vladimir Mandic
|
ad9d56f49e
|
offload clean logging
Signed-off-by: Vladimir Mandic <mandic00@live.com>
|
2025-09-16 09:03:03 -04:00 |
Vladimir Mandic
|
0d1275972c
|
update changelog/todo
Signed-off-by: Vladimir Mandic <mandic00@live.com>
|
2025-09-15 09:26:46 -04:00 |
Vladimir Mandic
|
7940217764
|
add models_not_to_quant option
Signed-off-by: Vladimir Mandic <mandic00@live.com>
|
2025-09-11 12:31:07 -04:00 |
Vladimir Mandic
|
2bb96e6926
|
fix wan i2i
Signed-off-by: Vladimir Mandic <mandic00@live.com>
|
2025-09-11 09:50:20 -04:00 |
Vladimir Mandic
|
c5f1032b6c
|
improve controlnet offloading
Signed-off-by: Vladimir Mandic <mandic00@live.com>
|
2025-09-04 15:47:17 -04:00 |
Vladimir Mandic
|
c41afe6b08
|
offloading hooks
Signed-off-by: Vladimir Mandic <mandic00@live.com>
|
2025-08-27 22:28:07 -04:00 |
Vladimir Mandic
|
9e6928410f
|
offloading improvements
Signed-off-by: Vladimir Mandic <mandic00@live.com>
|
2025-08-25 10:16:38 -04:00 |
Vladimir Mandic
|
dc8a72947d
|
fix meissonic
Signed-off-by: Vladimir Mandic <mandic00@live.com>
|
2025-08-11 16:05:39 -04:00 |
Vladimir Mandic
|
800521d885
|
update models current and list tabs
Signed-off-by: Vladimir Mandic <mandic00@live.com>
|
2025-08-02 14:18:58 -04:00 |
Vladimir Mandic
|
f7e433bd07
|
lint
Signed-off-by: Vladimir Mandic <mandic00@live.com>
|
2025-08-01 18:26:57 -04:00 |
Vladimir Mandic
|
9394430aa3
|
cleanup
Signed-off-by: Vladimir Mandic <mandic00@live.com>
|
2025-08-01 16:46:27 -04:00 |
Disty0
|
61a5e5ebca
|
Fix module size detection
|
2025-08-01 23:45:24 +03:00 |
Vladimir Mandic
|
4be093b80f
|
add diffusers_offload_nonblocking setting
Signed-off-by: Vladimir Mandic <mandic00@live.com>
|
2025-08-01 16:38:31 -04:00 |
Disty0
|
52bef2871b
|
Fix balanced offload pre forward with partial offload
|
2025-08-01 23:04:58 +03:00 |
Disty0
|
5809476e22
|
fix balanced offload pre_forward not offloading
|
2025-08-01 22:38:55 +03:00 |
Vladimir Mandic
|
fbad5d87d6
|
add offload pre-forward
Signed-off-by: Vladimir Mandic <mandic00@live.com>
|
2025-08-01 10:49:03 -04:00 |
Vladimir Mandic
|
b291c337a1
|
refactor internal post loop
Signed-off-by: Vladimir Mandic <mandic00@live.com>
|
2025-08-01 10:45:39 -04:00 |
Vladimir Mandic
|
fa44521ea3
|
offload-never and offload-always per-module and new highvram profile
Signed-off-by: Vladimir Mandic <mandic00@live.com>
|
2025-07-31 11:40:24 -04:00 |
Vladimir Mandic
|
04af23a3bc
|
refactore pipeline apply/unapply optional components & features
Signed-off-by: Vladimir Mandic <mandic00@live.com>
|
2025-07-26 20:04:07 -04:00 |
Vladimir Mandic
|
ea0b84ffc0
|
group offloading (experimental)
Signed-off-by: Vladimir Mandic <mandic00@live.com>
|
2025-07-20 09:33:02 -04:00 |
Vladimir Mandic
|
27ce0dea9a
|
torch.compile use repeated blocks
Signed-off-by: Vladimir Mandic <mandic00@live.com>
|
2025-07-20 08:44:25 -04:00 |
Vladimir Mandic
|
e8b5ea3847
|
major refactor: remove backend original
Signed-off-by: Vladimir Mandic <mandic00@live.com>
|
2025-07-05 13:16:46 -04:00 |
Disty0
|
4aeb9f004c
|
Cleanup layerwise
|
2025-07-04 06:12:25 +03:00 |
Vladimir Mandic
|
bff75f0db3
|
add omnigen2
Signed-off-by: Vladimir Mandic <mandic00@live.com>
|
2025-06-27 20:20:43 -04:00 |
Vladimir Mandic
|
d5a74d4a4a
|
Merge branch 'dev' into feature/chroma-support
|
2025-06-26 13:06:31 -04:00 |
Vladimir Mandic
|
ada38d57b4
|
add nvidia-cosmos-predict-2
Signed-off-by: Vladimir Mandic <mandic00@live.com>
|
2025-06-26 12:21:43 -04:00 |
Enes Sadık Özbek
|
21bdde12d3
|
Merge branch 'dev' into feature/chroma-support
|
2025-06-26 01:56:34 +03:00 |
Disty0
|
c9f49720c5
|
Cleanup
|
2025-06-25 23:37:41 +03:00 |
Vladimir Mandic
|
5b486a6ef1
|
sdnq add xyz grid support, improve offloading compatibility
Signed-off-by: Vladimir Mandic <mandic00@live.com>
|
2025-06-25 15:32:37 -04:00 |
Disty0
|
eaa130463c
|
Use Diffusers with OmniGen
|
2025-06-24 13:09:11 +03:00 |
Enes Sadık Özbek
|
4b3ce06916
|
Initial support for Chroma
|
2025-06-18 00:38:17 +00:00 |
Disty0
|
e4c7aa75f7
|
Fix balanced offload offload post not activating
|
2025-04-16 22:52:30 +03:00 |
Vladimir Mandic
|
ee1a4c607d
|
offload cleanup
Signed-off-by: Vladimir Mandic <mandic00@live.com>
|
2025-04-15 10:06:34 -04:00 |
Disty0
|
1541a19d89
|
Offload the TE right away
|
2025-04-15 02:28:44 +03:00 |
Vladimir Mandic
|
b63afc80fa
|
explicitly flag h1 as large model
Signed-off-by: Vladimir Mandic <mandic00@live.com>
|
2025-04-14 10:25:31 -04:00 |
Vladimir Mandic
|
dc9a64d00b
|
memmon detect gpu swapping
Signed-off-by: Vladimir Mandic <mandic00@live.com>
|
2025-04-07 08:59:54 -04:00 |
Vladimir Mandic
|
68f3c203b1
|
remove non-blocking
Signed-off-by: Vladimir Mandic <mandic00@live.com>
|
2025-04-04 15:49:50 -04:00 |
Vladimir Mandic
|
ff4d57814e
|
fix debug logging
Signed-off-by: Vladimir Mandic <mandic00@live.com>
|
2025-04-04 09:14:48 -04:00 |
Vladimir Mandic
|
6430f7006f
|
add monitor cli option and finish lora refactor
Signed-off-by: Vladimir Mandic <mandic00@live.com>
|
2025-04-01 13:39:47 -04:00 |