Disty0
|
e68f9272e8
|
Disable custom atten processors for non SD 1.5 / SDXL models
|
2025-06-13 13:05:46 +03:00 |
Disty0
|
26545b6483
|
Add warning for incompatible attention processors
|
2025-06-11 21:59:59 +03:00 |
Disty0
|
c81b712ddb
|
Make VAE options not require model reload
|
2025-06-10 15:56:19 +03:00 |
Disty0
|
8e08ef0edc
|
Fix VAE Tiling with non-default tile sizes
|
2025-06-07 01:25:08 +03:00 |
Disty0
|
089e437708
|
Don't set attention processors with models outside of SD 1.5 and SDXL
|
2025-06-06 18:53:57 +03:00 |
Vladimir Mandic
|
8433f685e7
|
clear-cache on model unload
Signed-off-by: Vladimir Mandic <mandic00@live.com>
|
2025-05-07 20:22:30 -04:00 |
Vladimir Mandic
|
7aa09957dc
|
fix lllite
Signed-off-by: Vladimir Mandic <mandic00@live.com>
|
2025-05-04 13:55:45 -04:00 |
Vladimir Mandic
|
7ebc3fe94c
|
t2i-adapter
Signed-off-by: Vladimir Mandic <mandic00@live.com>
|
2025-05-04 12:53:04 -04:00 |
Vladimir Mandic
|
25470e5524
|
fix sdxl-refiner workflow
Signed-off-by: Vladimir Mandic <mandic00@live.com>
|
2025-05-04 12:12:09 -04:00 |
Vladimir Mandic
|
6608b9979f
|
add base flex.2 support
Signed-off-by: Vladimir Mandic <mandic00@live.com>
|
2025-04-24 10:18:18 -04:00 |
Vladimir Mandic
|
0fe0707cdd
|
add lodestone-chroma
Signed-off-by: Vladimir Mandic <mandic00@live.com>
|
2025-04-21 19:29:09 -04:00 |
Disty0
|
434bb660ce
|
Move post load quant functions to a single function in model_quant
|
2025-04-20 17:04:25 +03:00 |
Disty0
|
68d1262836
|
Fix live previews with HiDream
|
2025-04-16 18:40:50 +03:00 |
Vladimir Mandic
|
ee1a4c607d
|
offload cleanup
Signed-off-by: Vladimir Mandic <mandic00@live.com>
|
2025-04-15 10:06:34 -04:00 |
Disty0
|
7a4848dada
|
Fix NNCF not applying for TE only quant
|
2025-04-15 02:16:18 +03:00 |
Vladimir Mandic
|
a38f7cbca0
|
general te hijack
Signed-off-by: Vladimir Mandic <mandic00@live.com>
|
2025-04-14 09:46:03 -04:00 |
Vladimir Mandic
|
94848cbc2b
|
add native hf auth check
Signed-off-by: Vladimir Mandic <mandic00@live.com>
|
2025-04-13 10:05:15 -04:00 |
Vladimir Mandic
|
0f595d4cc5
|
cleanup multiple model loaders
Signed-off-by: Vladimir Mandic <mandic00@live.com>
|
2025-04-11 22:16:05 -04:00 |
Vladimir Mandic
|
92af0036c6
|
add hidream
Signed-off-by: Vladimir Mandic <mandic00@live.com>
|
2025-04-10 16:28:15 -04:00 |
Vladimir Mandic
|
dc9a64d00b
|
memmon detect gpu swapping
Signed-off-by: Vladimir Mandic <mandic00@live.com>
|
2025-04-07 08:59:54 -04:00 |
Vladimir Mandic
|
85a961aa49
|
add cmdopt status
Signed-off-by: Vladimir Mandic <mandic00@live.com>
|
2025-04-06 08:43:26 -04:00 |
Vladimir Mandic
|
d502e3510a
|
add softfill pipeline
Signed-off-by: Vladimir Mandic <mandic00@live.com>
|
2025-04-05 12:58:00 -04:00 |
Vladimir Mandic
|
ff4d57814e
|
fix debug logging
Signed-off-by: Vladimir Mandic <mandic00@live.com>
|
2025-04-04 09:14:48 -04:00 |
Vladimir Mandic
|
17fbadb0e8
|
reset memory stats between runs
Signed-off-by: Vladimir Mandic <mandic00@live.com>
|
2025-04-01 14:00:39 -04:00 |
Vladimir Mandic
|
6430f7006f
|
add monitor cli option and finish lora refactor
Signed-off-by: Vladimir Mandic <mandic00@live.com>
|
2025-04-01 13:39:47 -04:00 |
Vladimir Mandic
|
b5031a5eba
|
lora modularize code
Signed-off-by: Vladimir Mandic <mandic00@live.com>
|
2025-04-01 13:39:47 -04:00 |
Vladimir Mandic
|
f965e72515
|
fix nncf check
Signed-off-by: Vladimir Mandic <mandic00@live.com>
|
2025-03-31 09:40:02 -04:00 |
Vladimir Mandic
|
f4fdd496b9
|
more granular quantization modules options
Signed-off-by: Vladimir Mandic <mandic00@live.com>
|
2025-03-28 14:46:52 -04:00 |
Vladimir Mandic
|
06b0abc4f4
|
fix token counter error style with modernui
Signed-off-by: Vladimir Mandic <mandic00@live.com>
|
2025-03-24 18:08:33 -04:00 |
Vladimir Mandic
|
d7bab01df0
|
update video
Signed-off-by: Vladimir Mandic <mandic00@live.com>
|
2025-03-23 13:19:12 -04:00 |
Vladimir Mandic
|
942553a504
|
rename vae and unet none to default
Signed-off-by: Vladimir Mandic <mandic00@live.com>
|
2025-03-16 18:46:26 -04:00 |
Vladimir Mandic
|
a5d3a68107
|
add cogview4
Signed-off-by: Vladimir Mandic <mandic00@live.com>
|
2025-03-15 13:20:17 -04:00 |
Vladimir Mandic
|
30f76022b0
|
handle pipeline class switch error
Signed-off-by: Vladimir Mandic <mandic00@live.com>
|
2025-02-24 09:05:40 -05:00 |
Vladimir Mandic
|
a7ccea60ff
|
add lumina2
Signed-off-by: Vladimir Mandic <mandic00@live.com>
|
2025-02-12 08:54:00 -05:00 |
Vladimir Mandic
|
1c1657525c
|
cleanup logging
Signed-off-by: Vladimir Mandic <mandic00@live.com>
|
2025-02-04 09:02:45 -05:00 |
Vladimir Mandic
|
d50d467a33
|
multiple fixes
Signed-off-by: Vladimir Mandic <mandic00@live.com>
|
2025-01-30 09:41:11 -05:00 |
Vladimir Mandic
|
f0a2120368
|
fix typo
Signed-off-by: Vladimir Mandic <mandic00@live.com>
|
2025-01-27 16:13:32 -05:00 |
Vladimir Mandic
|
338e3a59da
|
port streaming load to diffusers
Signed-off-by: Vladimir Mandic <mandic00@live.com>
|
2025-01-27 09:01:24 -05:00 |
Vladimir Mandic
|
843011406f
|
obj trace
Signed-off-by: Vladimir Mandic <mandic00@live.com>
|
2025-01-25 11:41:34 -05:00 |
Disty0
|
9b579bfd96
|
Move quant functions to model_quant.py
|
2025-01-23 21:50:26 +03:00 |
Vladimir Mandic
|
5a7c1f50c1
|
add native torch fp8 storage dtype
Signed-off-by: Vladimir Mandic <mandic00@live.com>
|
2025-01-23 12:07:08 -05:00 |
Vladimir Mandic
|
311d402b0c
|
model component merge
Signed-off-by: Vladimir Mandic <mandic00@live.com>
|
2025-01-19 14:36:09 -05:00 |
Vladimir Mandic
|
0c8044070a
|
refactor: split legacy loaders
Signed-off-by: Vladimir Mandic <mandic00@live.com>
|
2025-01-13 13:00:30 -05:00 |
Vladimir Mandic
|
1c10e69276
|
update controlnet logic and start sd_models refactor
Signed-off-by: Vladimir Mandic <mandic00@live.com>
|
2025-01-13 10:09:15 -05:00 |
Vladimir Mandic
|
465d7caa3a
|
fix pulid
Signed-off-by: Vladimir Mandic <mandic00@live.com>
|
2025-01-10 08:00:19 -05:00 |
Vladimir Mandic
|
c2e88021eb
|
pipeline restore args after batch and restore pipeline after base
Signed-off-by: Vladimir Mandic <mandic00@live.com>
|
2025-01-09 11:12:39 -05:00 |
Vladimir Mandic
|
25babb7075
|
flux bnb on-the-fly for unet-only
Signed-off-by: Vladimir Mandic <mandic00@live.com>
|
2025-01-07 17:13:14 -05:00 |
Vladimir Mandic
|
19d56d3342
|
update diffusers and register mask_processor
Signed-off-by: Vladimir Mandic <mandic00@live.com>
|
2025-01-06 09:49:07 -05:00 |
Vladimir Mandic
|
bf5c47adb8
|
add pixelsmith
Signed-off-by: Vladimir Mandic <mandic00@live.com>
|
2025-01-03 11:55:43 -05:00 |
Vladimir Mandic
|
94a659ee1f
|
fix xyz with detailer, sd35 img2img
Signed-off-by: Vladimir Mandic <mandic00@live.com>
|
2025-01-02 11:00:10 -05:00 |
Vladimir Mandic
|
5c5c7e0d51
|
fix vae tiling defaults
Signed-off-by: Vladimir Mandic <mandic00@live.com>
|
2025-01-01 15:48:30 -05:00 |
Vladimir Mandic
|
9f95fcc46e
|
first update in 2025
Signed-off-by: Vladimir Mandic <mandic00@live.com>
|
2025-01-01 09:49:12 -05:00 |
Vladimir Mandic
|
73de099711
|
fix lora on model change
Signed-off-by: Vladimir Mandic <mandic00@live.com>
|
2024-12-31 10:41:58 -05:00 |
Vladimir Mandic
|
8110f06c3b
|
remove all ldm imports when running in native mode
Signed-off-by: Vladimir Mandic <mandic00@live.com>
|
2024-12-30 11:42:04 -05:00 |
Vladimir Mandic
|
f327b3aca6
|
fix kandinsky
Signed-off-by: Vladimir Mandic <mandic00@live.com>
|
2024-12-30 10:03:34 -05:00 |
Vladimir Mandic
|
910f5d0a73
|
lora direct on-demand apply/unapply
Signed-off-by: Vladimir Mandic <mandic00@live.com>
|
2024-12-29 12:38:19 -05:00 |
Vladimir Mandic
|
14f1cc2416
|
fix flux pipeline switches
Signed-off-by: Vladimir Mandic <mandic00@live.com>
|
2024-12-27 17:04:54 -05:00 |
Disty0
|
2693a46f67
|
Fix PuLID
|
2024-12-26 19:26:33 +03:00 |
Vladimir Mandic
|
9cb15a564c
|
update vae tiling defaults and allow hypertile min size setting
Signed-off-by: Vladimir Mandic <mandic00@live.com>
|
2024-12-25 18:59:56 -05:00 |
Vladimir Mandic
|
e7f0047d52
|
add granular vae tiling options
Signed-off-by: Vladimir Mandic <mandic00@live.com>
|
2024-12-25 12:38:21 -05:00 |
Disty0
|
917d9e6c86
|
Live previews add flow_prediction
|
2024-12-25 18:43:10 +03:00 |
Disty0
|
5e35d6c3a3
|
Better live previews
|
2024-12-25 18:19:43 +03:00 |
Vladimir Mandic
|
ea6d3107ab
|
update all todo statements
Signed-off-by: Vladimir Mandic <mandic00@live.com>
|
2024-12-22 08:39:31 -05:00 |
Vladimir Mandic
|
11b2a055c3
|
fix svd i2v
Signed-off-by: Vladimir Mandic <mandic00@live.com>
|
2024-12-21 11:31:08 -05:00 |
Vladimir Mandic
|
ed3e5f06d6
|
linting
Signed-off-by: Vladimir Mandic <mandic00@live.com>
|
2024-12-20 18:48:06 -05:00 |
Vladimir Mandic
|
58ad18ee58
|
on-the-fly quant for sd35, flux and sana
Signed-off-by: Vladimir Mandic <mandic00@live.com>
|
2024-12-20 17:28:33 -05:00 |
Vladimir Mandic
|
20f2554cec
|
add sd35-ipadapter and more balanced offload optimizations
Signed-off-by: Vladimir Mandic <mandic00@live.com>
|
2024-12-20 10:22:42 -05:00 |
Vladimir Mandic
|
fd7fe8cea5
|
add torchao
Signed-off-by: Vladimir Mandic <mandic00@live.com>
|
2024-12-17 13:29:36 -05:00 |
Vladimir Mandic
|
ab07788ab5
|
add sana
Signed-off-by: Vladimir Mandic <mandic00@live.com>
|
2024-12-16 11:30:15 -05:00 |
Vladimir Mandic
|
814161cb21
|
major controlnet work, xinsir promax and tiling support
Signed-off-by: Vladimir Mandic <mandic00@live.com>
|
2024-12-14 17:29:51 -05:00 |
Disty0
|
7d7bcb9684
|
Fix balanced offload with Cascade
|
2024-12-13 23:01:53 +03:00 |
Vladimir Mandic
|
e9f951b2c5
|
offload logging
Signed-off-by: Vladimir Mandic <mandic00@live.com>
|
2024-12-11 14:20:01 -05:00 |
Vladimir Mandic
|
9a588d9c91
|
update balanced offload
Signed-off-by: Vladimir Mandic <mandic00@live.com>
|
2024-12-11 12:06:03 -05:00 |
Vladimir Mandic
|
f4847f1b8a
|
optimize balanced offload
Signed-off-by: Vladimir Mandic <mandic00@live.com>
|
2024-12-10 15:49:20 -05:00 |
Vladimir Mandic
|
28eeb00432
|
remove non-blocking
Signed-off-by: Vladimir Mandic <mandic00@live.com>
|
2024-12-06 09:15:37 -05:00 |
Vladimir Mandic
|
ca06002602
|
lora maintain device
Signed-off-by: Vladimir Mandic <mandic00@live.com>
|
2024-12-04 09:25:57 -05:00 |
Vladimir Mandic
|
e41d9f52cd
|
add offload warning
Signed-off-by: Vladimir Mandic <mandic00@live.com>
|
2024-12-04 08:47:22 -05:00 |
Vladimir Mandic
|
106f93f079
|
memory optimizations
Signed-off-by: Vladimir Mandic <mandic00@live.com>
|
2024-12-01 17:13:55 -05:00 |
Vladimir Mandic
|
023b13b6cb
|
balanced offload improvements
Signed-off-by: Vladimir Mandic <mandic00@live.com>
|
2024-12-01 15:34:25 -05:00 |
Vladimir Mandic
|
c5cd3cb623
|
reinit offoad instance on change
Signed-off-by: Vladimir Mandic <mandic00@live.com>
|
2024-11-30 19:15:50 -05:00 |
Vladimir Mandic
|
b7aff134a2
|
add low/high threshold to balanced offload
Signed-off-by: Vladimir Mandic <mandic00@live.com>
|
2024-11-30 19:03:51 -05:00 |
Disty0
|
81a95d04cf
|
Skip apply_balanced_offload if not needed
|
2024-11-30 21:12:26 +03:00 |
Disty0
|
b55e746fca
|
Improve balanced offload pre forward performance
|
2024-11-30 20:49:57 +03:00 |
Vladimir Mandic
|
eee85e5a4e
|
lora refactor in progress
Signed-off-by: Vladimir Mandic <mandic00@live.com>
|
2024-11-30 12:29:58 -05:00 |
Disty0
|
6ec93f2d46
|
Disable load lora gpu with medvram too
|
2024-11-30 17:04:35 +03:00 |
Disty0
|
881fa1183c
|
Fix offload issues with lora
|
2024-11-30 00:16:38 +03:00 |
Disty0
|
e52019104d
|
revert sd_models.py
|
2024-11-29 22:55:15 +03:00 |
Disty0
|
39b14a202e
|
Fix sequential offload with lora
|
2024-11-29 22:35:00 +03:00 |
Vladimir Mandic
|
164ce252dc
|
add sd35 controlnets
Signed-off-by: Vladimir Mandic <mandic00@live.com>
|
2024-11-28 08:46:10 -05:00 |
Vladimir Mandic
|
e4038feff1
|
minor updates
Signed-off-by: Vladimir Mandic <mandic00@live.com>
|
2024-11-24 15:05:58 -05:00 |
Vladimir Mandic
|
67c6b93213
|
flux tools support
Signed-off-by: Vladimir Mandic <mandic00@live.com>
|
2024-11-23 15:27:01 -05:00 |
Vladimir Mandic
|
6bd25a6f90
|
js pbar improvements
Signed-off-by: Vladimir Mandic <mandic00@live.com>
|
2024-11-23 09:07:43 -05:00 |
Vladimir Mandic
|
62c53942e0
|
post release jumbo patch
Signed-off-by: Vladimir Mandic <mandic00@live.com>
|
2024-11-22 12:55:18 -05:00 |
AI-Casanova
|
9f65f8b8c3
|
Fix LoRA with balanced offload
|
2024-11-20 13:00:41 -06:00 |
Vladimir Mandic
|
7344a8c3d8
|
fix pulid attention
Signed-off-by: Vladimir Mandic <mandic00@live.com>
|
2024-11-14 17:08:11 -05:00 |
Vladimir Mandic
|
4033f2b63f
|
pulid enable inpaint mask only
Signed-off-by: Vladimir Mandic <mandic00@live.com>
|
2024-11-14 08:16:12 -05:00 |
Vladimir Mandic
|
c199e3e668
|
pulid optimizations: dtype, vae, offload
Signed-off-by: Vladimir Mandic <mandic00@live.com>
|
2024-11-12 11:18:33 -05:00 |
Vladimir Mandic
|
34bc7377d8
|
update pulid
Signed-off-by: Vladimir Mandic <mandic00@live.com>
|
2024-11-12 11:18:33 -05:00 |
Vladimir Mandic
|
8249865f41
|
fix pag switch pipeline
Signed-off-by: Vladimir Mandic <mandic00@live.com>
|
2024-11-12 11:18:06 -05:00 |
Vladimir Mandic
|
9492228175
|
improve auto-pipeline switch
Signed-off-by: Vladimir Mandic <mandic00@live.com>
|
2024-11-12 11:18:06 -05:00 |