Commit Graph

955 Commits (0e0b607cfaabf59167e3ab2a44d491b4e4e1b08e)

Author SHA1 Message Date
Vladimir Mandic 87bd347116 cleanup flux loader
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-08-11 16:05:39 -04:00
Vladimir Mandic dc8a72947d fix meissonic
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-08-11 16:05:39 -04:00
Vladimir Mandic e42a27a0e4 fix chroma
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-08-11 16:05:39 -04:00
Vladimir Mandic 2a85c05689 refactor pipeline loaders to generic methods and introduce `te_shared_t5` option
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-08-11 16:05:39 -04:00
Vladimir Mandic 41640773e5 fix global state tracking
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-08-10 09:19:49 -04:00
Vladimir Mandic 09cc584089 civitai downloader batch download all versions
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-08-08 18:06:36 -04:00
Vladimir Mandic 353d73e042 add chroma-v50 and chroma-v50-annealed
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-08-08 10:15:00 -04:00
Vladimir Mandic 7bba30e797 sdnq obey diffusers_to_gpu
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-08-06 10:12:27 -04:00
Vladimir Mandic fd842e275a add qwen-image
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-08-04 15:53:43 -04:00
Vladimir Mandic b291c337a1 refactor internal post loop
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-08-01 10:45:39 -04:00
Vladimir Mandic fa44521ea3 offload-never and offload-always per-module and new highvram profile
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-07-31 11:40:24 -04:00
Vladimir Mandic 74bb2b9ea6 autodetect v-pred
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-07-28 19:41:39 -04:00
Vladimir Mandic 8e40c5b0a9 add bigasp25 support
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-07-27 16:32:37 -04:00
Vladimir Mandic a1ef13098b fix processing skip
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-07-27 10:27:58 -04:00
Vladimir Mandic fd722311db css and logging tweaks
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-07-27 08:17:41 -04:00
Vladimir Mandic 04af23a3bc refactore pipeline apply/unapply optional components & features
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-07-26 20:04:07 -04:00
Vladimir Mandic 32e1787b47 add bria-3.2 model support
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-07-23 12:10:52 -04:00
Vladimir Mandic 935a4a0aa3 add wan 2.1 text-to-image
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-07-14 13:47:14 -04:00
Vladimir Mandic 98afdd0a8a add freepix f-lite
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-07-11 13:19:29 -04:00
Vladimir Mandic a5b77b8ee2 remove dead code
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-07-05 16:47:25 -04:00
Vladimir Mandic e8b5ea3847 major refactor: remove backend original
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-07-05 13:16:46 -04:00
Vladimir Mandic 2b9056179d add lbm background replace with relightining
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-07-04 15:33:16 -04:00
Disty0 1a3b6e3b9c Handle all in one flux safetensors with auto quant mode 2025-07-04 02:35:54 +03:00
Disty0 07a443c196 Fix auth check with Flux from single file 2025-07-03 23:47:41 +03:00
Vladimir Mandic 49c9a450f4 support manually downloaded diffuser models
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-07-03 15:52:54 -04:00
Vladimir Mandic c4d9338d2e major refactoring of modules
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-07-03 09:18:38 -04:00
Vladimir Mandic ff103bc849 fix LoRA change detection on pipeline type change
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-06-29 12:52:37 -04:00
Disty0 99f323d105 Fix Linfusiong with quantization / compile 2025-06-29 18:17:05 +03:00
Disty0 ab8b9b0eab Cleanup Omnigen 2 2025-06-28 13:53:37 +03:00
Vladimir Mandic bff75f0db3 add omnigen2
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-06-27 20:20:43 -04:00
Disty0 3b8ced444c Add auto quantization mode 2025-06-27 18:54:15 +03:00
Vladimir Mandic d5a74d4a4a
Merge branch 'dev' into feature/chroma-support 2025-06-26 13:06:31 -04:00
Vladimir Mandic ada38d57b4 add nvidia-cosmos-predict-2
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-06-26 12:21:43 -04:00
Enes Sadık Özbek e91208bea9
Merge branch 'dev' into feature/chroma-support 2025-06-26 17:02:00 +03:00
Vladimir Mandic 2714d29993 fix unapply texture tiling
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-06-26 09:30:15 -04:00
Enes Sadık Özbek 21bdde12d3
Merge branch 'dev' into feature/chroma-support 2025-06-26 01:56:34 +03:00
Vladimir Mandic 5b486a6ef1 sdnq add xyz grid support, improve offloading compatibility
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-06-25 15:32:37 -04:00
Disty0 ff5d7977a9 Fix Controlnet pipeline check on set atten 2025-06-18 19:35:57 +03:00
Enes Sadık Özbek 4b3ce06916
Initial support for Chroma 2025-06-18 00:38:17 +00:00
Disty0 bddd091300 Custom VAE loading support for Lumina 2 2025-06-16 22:34:02 +03:00
Disty0 e68f9272e8 Disable custom atten processors for non SD 1.5 / SDXL models 2025-06-13 13:05:46 +03:00
Disty0 26545b6483 Add warning for incompatible attention processors 2025-06-11 21:59:59 +03:00
Disty0 c81b712ddb Make VAE options not require model reload 2025-06-10 15:56:19 +03:00
Disty0 8e08ef0edc Fix VAE Tiling with non-default tile sizes 2025-06-07 01:25:08 +03:00
Disty0 089e437708 Don't set attention processors with models outside of SD 1.5 and SDXL 2025-06-06 18:53:57 +03:00
Vladimir Mandic 8433f685e7 clear-cache on model unload
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-05-07 20:22:30 -04:00
Vladimir Mandic 7aa09957dc fix lllite
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-05-04 13:55:45 -04:00
Vladimir Mandic 7ebc3fe94c t2i-adapter
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-05-04 12:53:04 -04:00
Vladimir Mandic 25470e5524 fix sdxl-refiner workflow
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-05-04 12:12:09 -04:00
Vladimir Mandic 6608b9979f add base flex.2 support
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-04-24 10:18:18 -04:00
Vladimir Mandic 0fe0707cdd add lodestone-chroma
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-04-21 19:29:09 -04:00
Disty0 434bb660ce Move post load quant functions to a single function in model_quant 2025-04-20 17:04:25 +03:00
Disty0 68d1262836 Fix live previews with HiDream 2025-04-16 18:40:50 +03:00
Vladimir Mandic ee1a4c607d offload cleanup
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-04-15 10:06:34 -04:00
Disty0 7a4848dada Fix NNCF not applying for TE only quant 2025-04-15 02:16:18 +03:00
Vladimir Mandic a38f7cbca0 general te hijack
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-04-14 09:46:03 -04:00
Vladimir Mandic 94848cbc2b add native hf auth check
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-04-13 10:05:15 -04:00
Vladimir Mandic 0f595d4cc5 cleanup multiple model loaders
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-04-11 22:16:05 -04:00
Vladimir Mandic 92af0036c6 add hidream
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-04-10 16:28:15 -04:00
Vladimir Mandic dc9a64d00b memmon detect gpu swapping
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-04-07 08:59:54 -04:00
Vladimir Mandic 85a961aa49 add cmdopt status
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-04-06 08:43:26 -04:00
Vladimir Mandic d502e3510a add softfill pipeline
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-04-05 12:58:00 -04:00
Vladimir Mandic ff4d57814e fix debug logging
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-04-04 09:14:48 -04:00
Vladimir Mandic 17fbadb0e8 reset memory stats between runs
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-04-01 14:00:39 -04:00
Vladimir Mandic 6430f7006f add monitor cli option and finish lora refactor
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-04-01 13:39:47 -04:00
Vladimir Mandic b5031a5eba lora modularize code
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-04-01 13:39:47 -04:00
Vladimir Mandic f965e72515 fix nncf check
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-03-31 09:40:02 -04:00
Vladimir Mandic f4fdd496b9 more granular quantization modules options
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-03-28 14:46:52 -04:00
Vladimir Mandic 06b0abc4f4 fix token counter error style with modernui
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-03-24 18:08:33 -04:00
Vladimir Mandic d7bab01df0 update video
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-03-23 13:19:12 -04:00
Vladimir Mandic 942553a504 rename vae and unet none to default
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-03-16 18:46:26 -04:00
Vladimir Mandic a5d3a68107 add cogview4
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-03-15 13:20:17 -04:00
Vladimir Mandic 30f76022b0 handle pipeline class switch error
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-02-24 09:05:40 -05:00
Vladimir Mandic a7ccea60ff add lumina2
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-02-12 08:54:00 -05:00
Vladimir Mandic 1c1657525c cleanup logging
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-02-04 09:02:45 -05:00
Vladimir Mandic d50d467a33 multiple fixes
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-01-30 09:41:11 -05:00
Vladimir Mandic f0a2120368 fix typo
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-01-27 16:13:32 -05:00
Vladimir Mandic 338e3a59da port streaming load to diffusers
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-01-27 09:01:24 -05:00
Vladimir Mandic 843011406f obj trace
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-01-25 11:41:34 -05:00
Disty0 9b579bfd96 Move quant functions to model_quant.py 2025-01-23 21:50:26 +03:00
Vladimir Mandic 5a7c1f50c1 add native torch fp8 storage dtype
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-01-23 12:07:08 -05:00
Vladimir Mandic 311d402b0c model component merge
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-01-19 14:36:09 -05:00
Vladimir Mandic 0c8044070a refactor: split legacy loaders
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-01-13 13:00:30 -05:00
Vladimir Mandic 1c10e69276 update controlnet logic and start sd_models refactor
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-01-13 10:09:15 -05:00
Vladimir Mandic 465d7caa3a fix pulid
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-01-10 08:00:19 -05:00
Vladimir Mandic c2e88021eb pipeline restore args after batch and restore pipeline after base
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-01-09 11:12:39 -05:00
Vladimir Mandic 25babb7075 flux bnb on-the-fly for unet-only
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-01-07 17:13:14 -05:00
Vladimir Mandic 19d56d3342 update diffusers and register mask_processor
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-01-06 09:49:07 -05:00
Vladimir Mandic bf5c47adb8 add pixelsmith
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-01-03 11:55:43 -05:00
Vladimir Mandic 94a659ee1f fix xyz with detailer, sd35 img2img
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-01-02 11:00:10 -05:00
Vladimir Mandic 5c5c7e0d51 fix vae tiling defaults
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-01-01 15:48:30 -05:00
Vladimir Mandic 9f95fcc46e first update in 2025
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-01-01 09:49:12 -05:00
Vladimir Mandic 73de099711 fix lora on model change
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2024-12-31 10:41:58 -05:00
Vladimir Mandic 8110f06c3b remove all ldm imports when running in native mode
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2024-12-30 11:42:04 -05:00
Vladimir Mandic f327b3aca6 fix kandinsky
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2024-12-30 10:03:34 -05:00
Vladimir Mandic 910f5d0a73 lora direct on-demand apply/unapply
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2024-12-29 12:38:19 -05:00
Vladimir Mandic 14f1cc2416 fix flux pipeline switches
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2024-12-27 17:04:54 -05:00
Disty0 2693a46f67 Fix PuLID 2024-12-26 19:26:33 +03:00
Vladimir Mandic 9cb15a564c update vae tiling defaults and allow hypertile min size setting
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2024-12-25 18:59:56 -05:00
Vladimir Mandic e7f0047d52 add granular vae tiling options
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2024-12-25 12:38:21 -05:00
Disty0 917d9e6c86 Live previews add flow_prediction 2024-12-25 18:43:10 +03:00
Disty0 5e35d6c3a3 Better live previews 2024-12-25 18:19:43 +03:00
Vladimir Mandic ea6d3107ab update all todo statements
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2024-12-22 08:39:31 -05:00
Vladimir Mandic 11b2a055c3 fix svd i2v
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2024-12-21 11:31:08 -05:00
Vladimir Mandic ed3e5f06d6 linting
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2024-12-20 18:48:06 -05:00
Vladimir Mandic 58ad18ee58 on-the-fly quant for sd35, flux and sana
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2024-12-20 17:28:33 -05:00
Vladimir Mandic 20f2554cec add sd35-ipadapter and more balanced offload optimizations
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2024-12-20 10:22:42 -05:00
Vladimir Mandic fd7fe8cea5 add torchao
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2024-12-17 13:29:36 -05:00
Vladimir Mandic ab07788ab5 add sana
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2024-12-16 11:30:15 -05:00
Vladimir Mandic 814161cb21 major controlnet work, xinsir promax and tiling support
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2024-12-14 17:29:51 -05:00
Disty0 7d7bcb9684 Fix balanced offload with Cascade 2024-12-13 23:01:53 +03:00
Vladimir Mandic e9f951b2c5 offload logging
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2024-12-11 14:20:01 -05:00
Vladimir Mandic 9a588d9c91 update balanced offload
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2024-12-11 12:06:03 -05:00
Vladimir Mandic f4847f1b8a optimize balanced offload
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2024-12-10 15:49:20 -05:00
Vladimir Mandic 28eeb00432 remove non-blocking
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2024-12-06 09:15:37 -05:00
Vladimir Mandic ca06002602 lora maintain device
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2024-12-04 09:25:57 -05:00
Vladimir Mandic e41d9f52cd add offload warning
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2024-12-04 08:47:22 -05:00
Vladimir Mandic 106f93f079 memory optimizations
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2024-12-01 17:13:55 -05:00
Vladimir Mandic 023b13b6cb balanced offload improvements
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2024-12-01 15:34:25 -05:00
Vladimir Mandic c5cd3cb623 reinit offoad instance on change
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2024-11-30 19:15:50 -05:00
Vladimir Mandic b7aff134a2 add low/high threshold to balanced offload
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2024-11-30 19:03:51 -05:00
Disty0 81a95d04cf Skip apply_balanced_offload if not needed 2024-11-30 21:12:26 +03:00
Disty0 b55e746fca Improve balanced offload pre forward performance 2024-11-30 20:49:57 +03:00
Vladimir Mandic eee85e5a4e lora refactor in progress
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2024-11-30 12:29:58 -05:00
Disty0 6ec93f2d46 Disable load lora gpu with medvram too 2024-11-30 17:04:35 +03:00
Disty0 881fa1183c Fix offload issues with lora 2024-11-30 00:16:38 +03:00
Disty0 e52019104d revert sd_models.py 2024-11-29 22:55:15 +03:00
Disty0 39b14a202e Fix sequential offload with lora 2024-11-29 22:35:00 +03:00
Vladimir Mandic 164ce252dc add sd35 controlnets
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2024-11-28 08:46:10 -05:00
Vladimir Mandic e4038feff1 minor updates
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2024-11-24 15:05:58 -05:00
Vladimir Mandic 67c6b93213 flux tools support
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2024-11-23 15:27:01 -05:00
Vladimir Mandic 6bd25a6f90 js pbar improvements
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2024-11-23 09:07:43 -05:00
Vladimir Mandic 62c53942e0 post release jumbo patch
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2024-11-22 12:55:18 -05:00
AI-Casanova 9f65f8b8c3
Fix LoRA with balanced offload 2024-11-20 13:00:41 -06:00
Vladimir Mandic 7344a8c3d8 fix pulid attention
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2024-11-14 17:08:11 -05:00
Vladimir Mandic 4033f2b63f pulid enable inpaint mask only
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2024-11-14 08:16:12 -05:00
Vladimir Mandic c199e3e668 pulid optimizations: dtype, vae, offload
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2024-11-12 11:18:33 -05:00
Vladimir Mandic 34bc7377d8 update pulid
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2024-11-12 11:18:33 -05:00
Vladimir Mandic 8249865f41 fix pag switch pipeline
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2024-11-12 11:18:06 -05:00
Vladimir Mandic 9492228175 improve auto-pipeline switch
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2024-11-12 11:18:06 -05:00
Vladimir Mandic 13cb5704b9 pulid img2img and inpaint placeholders
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2024-11-12 11:17:26 -05:00
Vladimir Mandic b42e9253e3 pullid offload compatibility and extra samplers
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2024-11-12 11:17:26 -05:00
Vladimir Mandic 29f5202811
Merge branch 'dev' into refactor-prompt 2024-11-06 10:58:03 -05:00
Vladimir Mandic 0a0c5cd85a add instantir
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2024-11-05 18:20:38 -05:00
Vladimir Mandic 3df0fb8008 apply balanced to recursive pipe
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2024-11-04 12:42:16 -05:00
Vladimir Mandic a2f9a4dbb0 refactor pulid
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2024-11-04 12:31:39 -05:00
Vladimir Mandic 51d6e1d559 update notes
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2024-11-03 11:14:51 -05:00
Vladimir Mandic abfb197504 sd35 all-in-one safetensors support
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2024-10-30 19:30:52 -04:00
Vladimir Mandic 8b5f510528 add sd3 controlnets
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2024-10-30 14:24:12 -04:00
Vladimir Mandic f9ca39c630 readd model_hash to sd_models
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2024-10-30 08:42:55 -04:00