1580158
/
automatic
mirror of https://github.com/vladmandic/automatic
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
12,597 Commits
3 Branches
29 Tags
109 MiB
Commit Graph

8091 Commits (0e0b607cfaabf59167e3ab2a44d491b4e4e1b08e)

Author SHA1 Message Date
Disty0 1d2775103f Fix Qwen VAE 2025-10-11 00:55:22 +03:00
Disty0 c7aba8589b SDNQ fix Qwen loading 2025-10-11 00:05:09 +03:00
Vladimir Mandic 5db54ffb55 set unique guidance labels 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-10-09 16:11:47 -04:00
Disty0 2a3deaa064 Check T5 keys before override 2025-10-09 22:46:27 +03:00
Disty0 6995d8c3c6 SDNQ fix T5 loading 2025-10-09 22:42:20 +03:00
Disty0 624e525fd1 Fix VAE config not being read correctly with SDNQ pre-quants 2025-10-09 20:30:23 +03:00
Disty0 612df3abbb cleanup 2025-10-09 20:09:34 +03:00
Disty0 a9de8ef152 cleanup 2025-10-09 19:58:57 +03:00
Disty0 e19fb2d833 SDNQ keep the quant configs inside the module subfolder, add dtype cast and don't send to GPU 2025-10-09 19:34:48 +03:00
Vladimir Mandic ee3e0aa978 add epoch to namegens and disable spellchecks 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-10-09 12:22:55 -04:00
Vladimir Mandic 70defe6d06 handle load shards 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-10-09 11:29:36 -04:00
Vladimir Mandic 9c4780a5e7 fix guidance metadata 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-10-09 09:25:49 -04:00
Vladimir Mandic 6907fcd320 speedup prequant model load 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-10-08 13:47:36 -04:00
Disty0 35277a79d3 cleanup x3 2025-10-08 01:21:11 +03:00
Disty0 9c16e2234a cleanup 2025-10-08 01:18:12 +03:00
Disty0 25303bb182 cleanup 2025-10-08 01:16:25 +03:00
Disty0 bdcd07f713 Add add_module_skip_keys to pre-load quant too 2025-10-08 01:11:40 +03:00
Disty0 7fdf400e8b cleanup 2025-10-08 00:41:04 +03:00
Disty0 df03ea9ba8 SDNQ add sdnq_post_load_quant and update Qwen keys 2025-10-08 00:29:36 +03:00
Vladimir Mandic 962cb7115d infra for full-model load/save with quant 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-10-07 14:30:45 -04:00
Vladimir Mandic e4120bd4d6 detect sdnq saved model 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-10-07 10:57:17 -04:00
Vladimir Mandic 0092a8b86b add quantization_config for post-load 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-10-07 10:14:31 -04:00
Vladimir Mandic 7fdc880a73 sdnq patches 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-10-07 09:43:34 -04:00
Vladimir Mandic 25e28050c3 update swagger docs 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-10-07 08:21:05 -04:00
Vladimir Mandic fe41d7da2a use shared llama 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-10-07 08:14:11 -04:00
Vladimir Mandic 3fe1d090e4 add configurable layers to taehv 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-10-06 19:13:30 -04:00
Disty0 1cd7b6d63a fix upcast scale check 2025-10-07 01:27:54 +03:00
Disty0 aa0c10440f SDNQ make the loader don't touch the model options by default 2025-10-07 00:15:23 +03:00
Disty0 5306376b2a improve contiguous mm performance 2025-10-06 19:05:46 +03:00
Disty0 be91bbff75 SDNQ add SVD support for Convs 2025-10-06 18:26:42 +03:00
Disty0 c931bf9efa SDNQ add dtype casting to loader 2025-10-06 17:44:52 +03:00
Disty0 5c042c5fb8 cleanup 2025-10-06 11:30:26 +03:00
Vladimir Mandic a315a004e9 linting 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-10-05 20:25:33 -04:00
Vladimir Mandic 28e3ae0480 experimental xomni 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-10-05 20:17:32 -04:00
Vladimir Mandic 3e47f3dd9a video prompt enhance 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-10-05 20:17:32 -04:00
Vladimir Mandic 58b0ab9da6 unified video save 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-10-05 20:17:32 -04:00
Vladimir Mandic d7d86ed286 ltx job tracking 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-10-05 20:17:32 -04:00
Vladimir Mandic 7dad90b385 video use shared t5 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-10-05 20:17:32 -04:00
Vladimir Mandic 50c3385cf9 fix ltx model selection 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-10-05 20:17:32 -04:00
Disty0 23f2deaa58 fix enable_quantized_mamtul 2025-10-06 02:04:28 +03:00
Disty0 1f81a37e8e Set the default svd rank to 32 2025-10-06 01:27:29 +03:00
Disty0 ebb26ac123 SDNQ make load file name configurable 2025-10-06 01:04:00 +03:00
Disty0 0acb571472 SDNQ ass load and save model funcs 2025-10-06 00:57:23 +03:00
Disty0 9e52d0c1fb SDNQ add SVDQuant quantization method 2025-10-05 22:50:30 +03:00
Vladimir Mandic 268798a24e add framepack granular job tracking 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-10-05 10:39:55 -04:00
Disty0 428600613a SDNQ fix new transformers again 2025-10-05 15:30:15 +03:00
Disty0 a164f3e0c2 SDNQ Improve UINT3 and below quant speed 2025-10-05 03:12:05 +03:00
Vladimir Mandic 8325e886c7 add typo to legacy compatibility options 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-10-04 18:11:52 -04:00
Vladimir Mandic c530167cbe qwen multi-image edits 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-10-04 18:06:50 -04:00
Vladimir Mandic 8b698ed67f upadte qwen pruning and allow hf models in subfolders 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-10-04 15:49:20 -04:00
Disty0 f2e12a682f SDNQ remove use_contiguous_mm path in re_quant 2025-10-04 19:17:05 +03:00
Disty0 df142afe81 don't use triton mm for nvidia 2025-10-04 18:48:03 +03:00
Disty0 5c5d7d5a86 cleanup 2025-10-04 18:38:18 +03:00
Disty0 99113947bf SDNQ add RDNA2 INT8 support via Triton 2025-10-04 18:31:25 +03:00
Vladimir Mandic 54ae18a611 update nunchaku 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-10-03 12:23:24 -04:00
Disty0 95a7da7e75 SDNQ use non-contiguous re-quantize 2025-10-03 18:54:58 +03:00
Vladimir Mandic a6108dd6df add qwen pruning variants 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-10-03 11:36:14 -04:00
Disty0 54acf1760b Make SDNQ scales compatible with balanced offload 2025-10-03 18:13:55 +03:00
Disty0 c5cab96223 SDNQ simplify check_mats 2025-10-03 02:58:17 +03:00
Vladimir Mandic 7325f9dbae dont import guiders until needed 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-10-02 16:28:34 -04:00
Disty0 34c2a624aa SDNQ autodetect fp8 tw fallback and disable dynamic compile 2025-10-02 19:40:07 +03:00
Vladimir Mandic f245506bf2 cleanup hf login 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-10-02 08:17:35 -04:00
CalamitousFelicitousness 78711fb1d4
Merge branch 'dev' into patch-2 2025-10-01 20:58:58 +01:00
CalamitousFelicitousness 78820a14dc
Allow VLM temp setting temperature to 0 
Allow VLM temp setting temperature to 0
 2025-10-01 20:52:04 +01:00
Disty0 81bb2b99ef update florence promptgen repo ids 2025-10-01 21:43:02 +03:00
Vladimir Mandic 22074f4727 cleanup vqa 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-10-01 12:02:55 -04:00
Vladimir Mandic 5d0a3e5e8a fix microsoft-florence 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-10-01 10:58:52 -04:00
Disty0 03382bdd4c SDNQ simplify check_mats 2025-10-01 01:35:51 +03:00
Vladimir Mandic 8c2b76a8da add buffers and cache info 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-09-30 14:36:55 -04:00
Vladimir Mandic 201ca28300 improve ram monitor 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-09-30 14:27:43 -04:00
Disty0 0c1d34721c SDNQ use contiguous for intel 2025-09-30 02:37:58 +03:00
Vladimir Mandic 2621aecacc interrrupt will now show last known preview image 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-09-29 19:25:50 -04:00
Disty0 6b67a9d0c4 SDNQ add check_mats to matmul 2025-09-30 01:58:13 +03:00
Vladimir Mandic 93bdca0670 fix image str decode and update requirements 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-09-29 10:56:03 -04:00
Vladimir Mandic 5d1bfc2bfc cleanup 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-09-28 21:36:16 -04:00
Vladimir Mandic c03a6928e4 reference models add size and release date info 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-09-28 21:19:36 -04:00
Vladimir Mandic 70a2c209b1 cleanup 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-09-28 20:22:25 -04:00
Vladimir Mandic 8cc9c23f98 add directml and rocm note to changelog 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-09-28 18:44:42 -04:00
Vladimir Mandic c661497b87 linting 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-09-28 18:09:09 -04:00
Vladimir Mandic eb025eaf31 remove split-attention and add attention slicing option 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-09-28 18:01:34 -04:00
Disty0 1b45c145e9 SDNQ re-enable dynamic compile 2025-09-28 20:40:24 +03:00
Disty0 6f2145fa57 revert offload_buffers 2025-09-28 16:47:31 +03:00
Vladimir Mandic 749878289f document vae changes 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-09-28 09:25:38 -04:00
Vladimir Mandic 9e6fdaa5cc vae slicing and tiling enabled on low and med vram, off otherwise 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-09-28 09:24:07 -04:00
Disty0 02f03d56a7 set offload_buffers to true on balanced offload 2025-09-28 16:23:29 +03:00
Disty0 4a70e82b0c ROCm always use numpy on cholesky 2025-09-28 14:05:20 +03:00
Disty0 a47959b114 move ROCm Windows hijacks outside of torch install 2025-09-28 13:33:15 +03:00
Seunghoon Lee 06b14b070b
hijack torch.linalg.cholesky() 2025-09-28 18:43:37 +09:00
Seunghoon Lee 9c19e8a9b8
return correct item 2025-09-28 18:34:10 +09:00
Seunghoon Lee 6e8abf8dc3
hijack cholesky decomposition for therock pytorch 2025-09-28 18:03:02 +09:00
Seunghoon Lee 95ee0ed29c
load amdhip64_6.dll instead of amdhip64.dll 2025-09-28 17:15:12 +09:00
Seunghoon Lee 0de3732884
prioritize python pacakage check over PATH 2025-09-28 11:31:43 +09:00
Disty0 587db51e9e Cleanup env vars and set TORCH_ROCM_AOTRITON_ENABLE_EXPERIMENTAL to 1 2025-09-28 00:22:00 +03:00
Seunghoon Lee 35b1c6b07d
windows install rocm if not installed 2025-09-28 05:39:41 +09:00
Seunghoon Lee 059392afc7
clean up 2025-09-27 17:51:59 +09:00
Disty0 503a178794 Don't load rocm hsa on non wsl envs and remove unused lib hijacks 2025-09-27 11:39:24 +03:00
Disty0 71fde8a897 ROCm and Zluda don't fallback to CPU and clenup strings 2025-09-27 11:32:46 +03:00
Seunghoon Lee 579b1f3175
do not load global amdhip64, let pytorch load it 2025-09-27 17:01:14 +09:00
Seunghoon Lee d52d84eda5
clean up 2025-09-27 16:49:29 +09:00
Luca Beltrame f00486c8f3
Fix HIP library detection 
The code unconditionally checked `lib`, but on modern Linux distributions, 64-bit binaries are under `lib64` instead. 

Note that this might be slightly different on Debian-based distributions, but as I don't have one I can't test it.
 2025-09-27 09:23:32 +02:00
Seunghoon Lee e3e41298d9
remove unused import 2025-09-27 11:29:55 +09:00
Seunghoon Lee 8d2aedd924
hotfix 2025-09-27 11:17:15 +09:00
Seunghoon Lee d63bc05b6c
update rocm.py to detect rocm-sdk packages 2025-09-27 11:12:13 +09:00
Vladimir Mandic bd048e8efc framepack: patch solver for unsupported gpus 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-09-26 12:28:52 -04:00
Vladimir Mandic c254835351 fix lora strength 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-09-26 10:14:02 -04:00
Vladimir Mandic ae25cb8880 linting 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-09-25 14:33:21 -04:00
Vladimir Mandic 01e8211d4b cleanup 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-09-25 14:17:40 -04:00
Vladimir Mandic ab82c172d5 handle nunchaku lora with unsupported models 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-09-25 14:02:21 -04:00
Vladimir Mandic 9cee2cd1ed fix metadata on batched images 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-09-25 13:45:23 -04:00
Vladimir Mandic 7a3001170b add daam script 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-09-24 20:16:07 -04:00
Disty0 a776c7c615 SDNQ fix new transformers 2025-09-24 21:32:30 +03:00
Vladimir Mandic 0d2579302e cleanup modular init 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-09-24 13:03:18 -04:00
Vladimir Mandic c96af0d428 fix lora filter by model type 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-09-24 12:55:11 -04:00
Vladimir Mandic 6f409deedf ui separate guidance and detail sections 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-09-24 12:33:57 -04:00
Vladimir Mandic 91dab5703a modular pipeline prototype 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-09-24 11:40:20 -04:00
Vladimir Mandic 35c319578d auto uninstall pynvml 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-09-24 09:38:35 -04:00
Vladimir Mandic a9a39cb64b ltx model selector 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-09-24 09:31:36 -04:00
Vladimir Mandic d71d540a62 allow lora specifier to select model component. see changelog/wiki for docs on how to. 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-09-23 15:25:13 -04:00
Vladimir Mandic a502cc2ae1 cache-dit support 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-09-23 10:13:32 -04:00
Vladimir Mandic 93659dff4d add qwen-image-edit-2509 and update requirements 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-09-23 10:13:32 -04:00
Disty0 41e297ba2c SDNQ fix new transformers 2025-09-23 16:17:09 +03:00
Vladimir Mandic 4130c6cc8b experimental cache-dit 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-09-22 15:55:26 -04:00
Vladimir Mandic 41bb446697 support configurable multi-stage models in video tab 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-09-22 13:18:39 -04:00
Vladimir Mandic d41bf3d673 add api to trigger civitai metadata update 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-09-21 20:06:45 -04:00
Vladimir Mandic 27846fe97d styles and wildcards use main seed 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-09-21 19:43:55 -04:00
Vladimir Mandic 82504e96d0 nunchaku flux.1-ipadapter 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-09-21 13:26:18 -04:00
Vladimir Mandic 5b43c66a92 nunchaku sdxl and sdxl-turbo support 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-09-20 21:01:21 -04:00
Vladimir Mandic 9667fffd3a fix download for sd15/sdxl reference models 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-09-20 19:39:43 -04:00
Disty0 e6715ba8d3 Cleanup SDNQ compile 2025-09-19 19:29:36 +03:00
Vladimir Mandic cd79f92dff add opts models_not_to_offload 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-09-19 11:21:54 -04:00
Vladimir Mandic 5606519085 wan init image fix 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-09-18 11:40:01 -04:00
Vladimir Mandic 94cb993e99 framepack add hf auth check 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-09-18 10:22:06 -04:00
Disty0 6f969958ae remove sdp_kernel hijack 2025-09-17 20:15:00 +03:00
Disty0 2842f5e3aa cleanup 2025-09-17 19:58:21 +03:00
Disty0 cc51f79508 IPEX remove outdated hijacks 2025-09-17 19:53:05 +03:00
Disty0 e83df50717 IPEX fix missing dtype from randn 2025-09-17 19:40:27 +03:00
Vladimir Mandic cc6101ecb2 jumbo update: add wan22-vace, improve offloading, add offloading-using-streams, change logging-levels, refactor some default packages 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-09-17 12:32:30 -04:00
Disty0 6a021e7743 ipex cleanup tensor_to hijack 2025-09-17 14:44:44 +03:00
Vladimir Mandic f8f958244f use new pydantic/albumentations/insightface 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-09-16 10:17:33 -04:00
Disty0 39027ccfea SDNQ fix conv matmul 2025-09-16 17:12:04 +03:00
Vladimir Mandic ad9d56f49e offload clean logging 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-09-16 09:03:03 -04:00
Vladimir Mandic 2aa503be55 report zluda-on-windows error, but do not exit 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-09-16 08:57:32 -04:00
Disty0 a12edc1e90 SDNQ use nan_to_num_ with fp8 quantization in case of zeros 2025-09-15 20:22:39 +03:00
Vladimir Mandic 0d1275972c update changelog/todo 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-09-15 09:26:46 -04:00
Vladimir Mandic 0f7d2e95ca fix state interrupted checks 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-09-14 13:03:03 -04:00
Vladimir Mandic e54065c3b3 update nvml 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-09-14 11:17:03 -04:00
Vladimir Mandic f09ccf35a6 zero-out loader time 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-09-14 11:13:38 -04:00
Vladimir Mandic 6f2adf3fde reference models indicate if ready or requires download 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-09-14 10:30:21 -04:00
Vladimir Mandic f976ed223d fix wan22-i2v 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-09-14 09:14:52 -04:00
Vladimir Mandic d351fdb98f add more job state updates and update history tab 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-09-13 10:54:04 -04:00
Vladimir Mandic 4e74172f3a fix typo 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-09-13 09:17:42 -04:00
Vladimir Mandic e529fcc546 fix exception 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-09-13 09:13:48 -04:00
Vladimir Mandic 1c5b3a47e2 job history 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-09-12 22:14:07 -04:00
Vladimir Mandic 8cd5fbc926 lint 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-09-12 16:28:53 -04:00
Vladimir Mandic 175e9cbe29 cleanup/refactor state history 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-09-12 16:12:45 -04:00
Disty0 a8b850adf4 move hf quantizer hijacks to sdnq 2025-09-12 20:54:44 +03:00
Vladimir Mandic 4956d94b97 allow denoise 0 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-09-12 13:10:52 -04:00
Vladimir Mandic 9bed503ce6 control handle override settings 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-09-11 16:06:03 -04:00
Disty0 ba7d76eb41 update gfpgan and basicsr commits 2025-09-11 21:18:24 +03:00
Vladimir Mandic 8ed04fb9a6 cleanup 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-09-11 13:02:52 -04:00
Vladimir Mandic 7940217764 add models_not_to_quant option 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-09-11 12:31:07 -04:00
Vladimir Mandic 2bb96e6926 fix wan i2i 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-09-11 09:50:20 -04:00
Vladimir Mandic 16670636d7 fix lora with nested pipeline 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-09-11 09:03:02 -04:00
Disty0 4f2b829450 cleanup 2025-09-11 15:42:36 +03:00
Vladimir Mandic 4093b6c040 allow custom detailer resolution 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-09-10 16:32:50 -04:00
Vladimir Mandic 65287eb402 add detailer prompt styling 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-09-10 15:48:45 -04:00
Disty0 6766563510 Add info log for Building CK Flash attention 2025-09-10 19:25:07 +03:00
Disty0 4b76049aed fix basicsr and gfpgan 2025-09-10 19:13:08 +03:00
Vladimir Mandic cc2c28241f linting 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-09-10 10:26:22 -04:00
Vladimir Mandic 6a0090714c add reference models to gallery 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-09-10 10:21:51 -04:00
Vladimir Mandic 4c684143a4 hyimage placeholder 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-09-10 10:09:58 -04:00
Disty0 ca2e5ae610 cleanup 2025-09-10 05:23:41 +03:00
Disty0 1b0c06bc71 IPEX add enable_gqa support and add result dtype check to sdpa 2025-09-10 05:20:49 +03:00
Disty0 de499bcdb6 cleanup 2025-09-10 04:45:37 +03:00
Disty0 bc7c89c070 add typing to sdpa hijacks 2025-09-10 04:43:57 +03:00
Disty0 251a1ce3d9 fix modules_to_not_convert and modules_dtype_dict not resetting 2025-09-10 04:20:57 +03:00
Vladimir Mandic d01dc111a8 reduce ui updates 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-09-08 15:40:58 -04:00
Disty0 dcaeed360d SDNQ set return device to gpu with shuffle weights option 2025-09-08 18:56:29 +03:00
Vladimir Mandic 2b26a3a21a fix detailer metadata 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-09-08 10:19:14 -04:00
Vladimir Mandic d673c58c10 fix drop image to prompt in modernui 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-09-08 09:42:26 -04:00
Disty0 f5109657b1 IPEX set UR_L0_ENABLE_RELAXED_ALLOCATION_LIMITS to 1 2025-09-08 15:47:42 +03:00
Vladimir Mandic 5b463fcab0 set min timesteps to 3 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-09-07 11:58:29 -04:00
Vladimir Mandic fbe612b2eb fix sampler set timesteps vs sigmas 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-09-07 10:50:04 -04:00
Vladimir Mandic ff9a7e5444 fix reprocess workflow for control with hires 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-09-06 11:28:44 -04:00
Vladimir Mandic 416a34bb22 fix network api 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-09-06 09:06:30 -04:00
Disty0 6a954ffcde SDNQ fuse repeating bitwise ops 2025-09-06 13:18:17 +03:00
Vladimir Mandic d665ac254e add apple-fastvlm 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-09-05 14:25:37 -04:00
Vladimir Mandic 78c2a629b6 add experimental tensorrt quantization 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-09-05 10:43:05 -04:00
Vladimir Mandic 64edb0787b update nunchaku 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-09-05 10:11:44 -04:00
Disty0 c210c93444 fix agent scheduler with pydantic 2 2025-09-04 23:38:45 +03:00
Vladimir Mandic aec30cc063 add --new flag 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-09-04 16:07:03 -04:00
Disty0 5160034b5a fix missing cmd_opts import 2025-09-04 22:57:24 +03:00
Vladimir Mandic c5f1032b6c improve controlnet offloading 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-09-04 15:47:17 -04:00
Vladimir Mandic 76a6a34b1a sdxl allow flow samplers 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-09-04 14:56:10 -04:00
Vladimir Mandic 86396f12cc lint fixes 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-09-04 14:56:10 -04:00
Disty0 729a41696e use name based flow detection 2025-09-04 21:35:26 +03:00
Vladimir Mandic 72a9094b42 better model version detect and experimental pydantic v2 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-09-04 12:41:40 -04:00
Vladimir Mandic 2124ab6879 trt experiment 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-09-04 10:53:32 -04:00
Vladimir Mandic 05dd0096c9 set default vqa model 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-09-04 08:38:29 -04:00
Disty0 afbc2d2a72 Fix OpenVINO loras 2025-09-03 21:10:45 +03:00
Disty0 19c8711132 Basic ControlNet support for OpenVINO 2025-09-03 19:06:26 +03:00
Disty0 5d01cb5c2c Unify compile Upscaler compile command 2025-09-03 18:51:21 +03:00
Disty0 c51552af90 Enable triton flash atten option for rocm linux too 2025-09-03 16:26:00 +03:00
Disty0 c42e0e0b37 Cleanup 2025-09-03 16:18:02 +03:00
Disty0 266c9c0d3d Move Zluda Triton flash atten hijack to Triton Flash attention option 2025-09-03 16:16:41 +03:00
Seunghoon Lee fe0ad11f0a
fix windows amd triton flash attention 2025-09-03 21:45:45 +09:00
Disty0 777b46f385 fix wan a14b quantization 2025-09-03 05:05:06 +03:00
Disty0 c598cdd2a7 Add transformer_2 and 3 to apply_function_to_model 2025-09-03 03:13:35 +03:00
Disty0 87a29642d3 IPEX Torch 2.10 support 2025-09-02 16:15:33 +03:00
Disty0 a4e51759b9 Force synchronize with ipex 2025-09-02 14:26:35 +03:00
dymil 72e162d3a7 Fix wildcard parents() termination guard 2025-09-02 01:27:58 -04:00
Vladimir Mandic e40275741d
Merge branch 'dev' into master 2025-09-01 11:41:07 -04:00
Chia-Jung Hsu c6689d9f20 Fix APIs for preview and log in reverse proxy 2025-09-01 15:30:40 +02:00
Vladimir Mandic 11c72d5402 remove standardui previews 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-08-31 16:35:49 -04:00
Vladimir Mandic 848f3421cc reorder system settings 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-08-31 16:29:57 -04:00
Vladimir Mandic 3493a4268c refactor reuse-seed 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-08-31 16:11:14 -04:00
Vladimir Mandic 9743c8e4bf keep previous processed state 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-08-31 15:20:15 -04:00
Vladimir Mandic b2dbef53e5 restyled all toolbuttons to be modernui native 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-08-31 15:01:50 -04:00
Vladimir Mandic dd7b69bea8 modernui configurable grid images size 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-08-31 12:39:59 -04:00
Vladimir Mandic e31fff9354 fix flex2 img2img denoise strength 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-08-31 11:31:28 -04:00
Vladimir Mandic 66b4b43f5d log batch 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-08-31 11:16:48 -04:00
Disty0 9035f4299c SDNQ fix new transformers 2025-08-30 22:44:57 +03:00
Vladimir Mandic 0697fb2287 update requirements 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-08-30 11:04:59 -04:00
Vladimir Mandic ffdd69117e fix skyreels 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-08-30 09:13:43 -04:00
Vladimir Mandic 1dc22650c2 remove samplers filtering 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-08-30 08:48:37 -04:00
Disty0 bbb345cf44 Fix bias dtype mismatch 2025-08-30 02:31:41 +03:00
Disty0 6c36433a14 SDNQ fix row-wise FP8 matmul with fp32 and fp16 inputs 2025-08-30 02:27:15 +03:00
Disty0 4ec8603f63 SDNQ re-add bitpacking for uint1 2025-08-29 23:06:11 +03:00
Disty0 a20ab65359 SDNQ override matmul group size with int8 as well 2025-08-29 22:54:38 +03:00
Disty0 d49e954918 SDNQ listen to dequantize_fp32 option with re_quantize 2025-08-29 22:48:28 +03:00
Disty0 a8de3f7282 SDNQ add quantized matmul support for all quantization types and group sizes 2025-08-29 22:26:47 +03:00
Vladimir Mandic 68e1065886 fix skyreels-v2 i2v 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-08-29 14:59:25 -04:00
Vladimir Mandic 45563515b3 fix kandinsky-3 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-08-29 12:07:20 -04:00
Disty0 d99777616b ROCm fix Segfault and remove the conflicting hipblaslt override 2025-08-29 19:03:49 +03:00
Disty0 36bf998302 cleanup 2025-08-29 18:15:28 +03:00
Disty0 6e68dff381 Fix AuraFlow quant 2025-08-29 18:13:53 +03:00
Vladimir Mandic 7e935743cd cleanup 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-08-29 11:08:07 -04:00
Vladimir Mandic f0415aba17 cleanup vae hijaacks 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-08-29 10:57:04 -04:00
Vladimir Mandic 032bf6972a uniform hf auth check 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-08-29 10:34:40 -04:00
Vladimir Mandic 928b8838b9 set modernui as default 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-08-29 10:23:05 -04:00
Vladimir Mandic 17c88606e1 add hdm-xut experiment 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-08-28 23:45:18 -04:00
Vladimir Mandic daae3ae97e add hunyuandit controlnets 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-08-28 15:22:16 -04:00
Vladimir Mandic 9c1b6d3f08 update cosmos 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-08-28 10:20:24 -04:00
Vladimir Mandic c41afe6b08 offloading hooks 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-08-27 22:28:07 -04:00
CalamitousFelicitousness 3beb0d2a21 Video gallery support in default UI 2025-08-27 00:45:39 +01:00
Vladimir Mandic a50f5c8faa handle missing version 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-08-25 19:39:40 -04:00
Vladimir Mandic ecf3df2aab style networks folders 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-08-25 13:19:34 -04:00
Vladimir Mandic c133b85fd1
Merge pull request #4152 from Artheriax/base-model-filtering 
Filter on base model in networks tab
 2025-08-25 12:53:17 -04:00
Vladimir Mandic 6ac9d31ef5 fix omnigen2 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-08-25 12:50:41 -04:00
Pablo Hellmann f22ebdbb95 Update ui_extra_networks_checkpoints.py 2025-08-25 18:44:25 +02:00
Pablo Hellmann 24faad6d47 Update ui_extra_networks_vae.py 2025-08-25 18:43:47 +02:00
Pablo Hellmann 0d6c17212e Update ui_extra_networks_checkpoints.py 2025-08-25 18:43:39 +02:00
Disty0 aac7df3713 fix extra networks startup 2025-08-25 19:41:55 +03:00
Vladimir Mandic 7f46d08a2c match network version 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-08-25 12:27:03 -04:00
Disty0 073d6cec77 Add auto detection based on model keys for v_pred and add auto detection for nyaflow 2025-08-25 18:32:45 +03:00
Vladimir Mandic 1ef07340ec update networks list 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-08-25 11:08:18 -04:00
Vladimir Mandic 9e6928410f offloading improvements 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-08-25 10:16:38 -04:00
Pablo Hellmann f30607715b Empty instead of N/A 2025-08-25 08:54:15 +02:00
Pablo Hellmann 03a0bf1300 Used Unknown instead of N/A 2025-08-24 16:49:20 +02:00
Pablo Hellmann dda6f912d3 re-add cleanup self.html 2025-08-24 16:41:31 +02:00
Pablo Hellmann 39d7d0334b First implementation 2025-08-24 16:31:45 +02:00
Vladimir Mandic 6572a78c51 update changelog and cleanup 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-08-24 09:27:45 -04:00
Vladimir Mandic 49fe21e253 qwen-image with hires 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-08-24 09:21:35 -04:00
Pablo Hellmann 714c7b813b l.sd_version as alternative when base model extraction fails 2025-08-24 14:44:42 +02:00
Pablo Hellmann b021f4a537 Implementation V3 of base model tags on model cards 2025-08-24 14:36:23 +02:00
Pablo Hellmann 389327c39b Revert "add base model tags" 
This reverts commit 2146979cc4.
 2025-08-24 14:12:17 +02:00
Pablo Hellmann ac725c1cd6 Revert "Update ui_extra_networks.py" 
This reverts commit 843b2b798d.
 2025-08-24 14:12:15 +02:00
Pablo Hellmann c4192c0d76 Revert "ported base_model info to version, removed base_model_box" 
This reverts commit ab5f863846.
 2025-08-24 14:12:03 +02:00
Pablo Hellmann ab5f863846 ported base_model info to version, removed base_model_box 2025-08-24 13:22:05 +02:00
Pablo Hellmann 843b2b798d Update ui_extra_networks.py 2025-08-23 21:47:43 +02:00
Pablo Hellmann 2146979cc4 add base model tags 2025-08-23 21:31:07 +02:00
Vladimir Mandic 191e36f188 update todo 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-08-23 13:10:36 -04:00
Vladimir Mandic e55d473374 lint 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-08-23 13:10:36 -04:00
Vladimir Mandic 7b13ce5be5 update chroma models and add qwen controlnet 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-08-23 13:10:36 -04:00
Vladimir Mandic b844250fb6 wan use correct pipeline for i2v models 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-08-23 09:42:17 -04:00
Vladimir Mandic 9898f522cd fix networks reference models display 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-08-23 09:12:04 -04:00
Vladimir Mandic 9c0d9bd766 enable offload pre-forward by default 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-08-23 08:51:45 -04:00
Vladimir Mandic d997ef95dd improve handling of pre-quantized flux 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-08-23 08:50:13 -04:00
Disty0 a073c63e09 pixelart fix np array as input 2025-08-22 22:53:29 +03:00
Vladimir Mandic 105b917d72 modernui improved image sizing 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-08-22 14:06:51 -04:00
Disty0 f324b7c0e5 SDNQ remove unnecessary .contiguous() 2025-08-21 02:21:05 +03:00
Vladimir Mandic 74da5095f0 fix and regenerate locales 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-08-20 14:40:39 -04:00
Disty0 6f96b17e6b Make PixelArt run faster 2025-08-20 20:49:20 +03:00
Disty0 e49814098e Add sdnq_modules_dtype_dict 2025-08-20 14:58:54 +03:00
Disty0 0946710662 Add sdnq_modules_to_not_convert to UI settings 2025-08-20 04:38:20 +03:00
Disty0 47ff01fd3b SDNQ add "*" support and upcast only the first and last layer's img_mod to 6 bit with Qwen Image 2025-08-20 03:24:19 +03:00
Vladimir Mandic c493dbaad7 exclude ModernUI from list of extensions 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-08-19 18:39:14 -04:00
Vladimir Mandic fc4fe49656 enum reference models on startup 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-08-19 18:34:18 -04:00
Vladimir Mandic 25af077227 install `hf_transfter` and `hf_xet` when needed 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-08-19 07:34:58 -04:00
Vladimir Mandic 54fb33b98d add nunchaku-qwen-image 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-08-18 20:24:24 -04:00
Vladimir Mandic 13195dadb9 rename wan a14b stages 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-08-18 16:13:59 -04:00
Vladimir Mandic 8f151b7e17 add qwen-image-edit 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-08-18 16:13:59 -04:00
Disty0 47154db8b1 SDNQ Flux lora, use shape from sdnq_dequantizer 2025-08-18 19:53:57 +03:00
Vladimir Mandic fc547a3ccd sdnq with diffusers lora loader 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-08-18 10:29:01 -04:00
Vladimir Mandic 2c740697c4 guard against null prompt 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-08-18 10:29:01 -04:00
Disty0 85d494ee84 revert .t_().contiguous().t_() 2025-08-17 05:19:44 +03:00
Disty0 8460be662c SDNQ use inplace transpose and use view instead of reshape 2025-08-17 05:07:55 +03:00
Vladimir Mandic fbc50ce3e1 setting for hf transfer mode 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-08-16 16:45:56 -04:00
Vladimir Mandic 0bb6603c2e cleanup diag logging 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-08-16 09:46:49 -04:00
Vladimir Mandic 192af76716 guard for onnxruntime 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-08-16 09:46:49 -04:00
Vladimir Mandic 7ef342933e cleanup onnx init 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-08-16 09:46:49 -04:00
Vladimir Mandic 63c88a0437 fix torch version check 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-08-16 09:46:49 -04:00
Disty0 6597a9111f Fix offload detection with CPU only envs 2025-08-16 16:12:43 +03:00
Vladimir Mandic 8af64b1e10 explicit te hijack in pipeline loaders 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-08-15 16:55:01 -04:00
Vladimir Mandic 65847bc022 conditional cache clear 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-08-15 15:49:58 -04:00
Vladimir Mandic f3eb7c00fa experiment: remote-t5 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-08-15 10:56:36 -04:00
Disty0 ac05301f9a Enable explicit synchronize for ROCm on Windows 2025-08-15 16:05:27 +03:00
Vladimir Mandic 32906a20ee update docker build 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-08-15 07:57:08 -04:00
Seunghoon Lee 83be0d77d7
zluda hip sdk 6.4 2025-08-15 20:24:50 +09:00
Vladimir Mandic 1ce9aae143 lint 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-08-14 16:57:20 -04:00
Vladimir Mandic 001716633d fix namegen 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-08-14 16:40:42 -04:00
Vladimir Mandic 2318f97991 manual set dtype via api 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-08-14 15:35:50 -04:00
Vladimir Mandic 1a59205cc1 add qwen-image taesd preview 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-08-14 11:23:25 -04:00
Vladimir Mandic ad5881b9ce add network delete 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-08-14 10:32:00 -04:00
Vladimir Mandic 4ef1e56622 simplify namegen seq 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-08-14 10:14:16 -04:00
Vladimir Mandic 1a60116dce fix zavychromaxl 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-08-14 09:45:49 -04:00
Vladimir Mandic e4cc2b1ee0 fix gallery mtime 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-08-14 09:42:58 -04:00
Vladimir Mandic 068f63badc add model parallel load option 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-08-13 21:18:57 -04:00
Vladimir Mandic 706bc9e2e7 cleanup 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-08-13 20:55:26 -04:00
Vladimir Mandic ff2c03538d add mtime to reference models 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-08-13 20:53:39 -04:00
Vladimir Mandic 5cd88e93ed
Merge pull request #4115 from CalamitousFelicitousness/patch-1 
LoRA load Torch tuple and string version checking
 2025-08-13 20:25:43 -04:00
Vladimir Mandic 114d097bb4 add wildcards to networks ui 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-08-13 20:23:35 -04:00
CalamitousFelicitousness 70672d3267
Move tuple/string versioning fix for BnB to loader.py 2025-08-14 00:31:10 +01:00
CalamitousFelicitousness afe900537d
Revert lora_load.py commit 2025-08-14 00:25:56 +01:00
CalamitousFelicitousness 6123655ac2
LoRA load Torch tuple and string version checking 
Due to BitsandBytes trying to use tuple and comparison to check Torch version which is given as a string, using LoRA with a quantized model results in a TypeError. This commit adds support for both.
 2025-08-13 23:39:18 +01:00
Vladimir Mandic e30e8cbf4f fix loading custom transformer safetensors 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-08-13 16:27:52 -04:00
Vladimir Mandic 41ae06bd90 fix loading custom t5 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-08-13 16:06:25 -04:00
Disty0 8ca74d0cd2 SDNQ rename unused param_name arg to op 2025-08-13 22:10:30 +03:00
Vladimir Mandic 4d95cf47ce restore default sampler on mismatch 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-08-13 14:49:11 -04:00
Vladimir Mandic 867c5abc5c add qwen img2img and inpaint 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-08-13 14:35:06 -04:00
Vladimir Mandic e8002df534 generate api endpoints allow set model 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-08-13 13:49:23 -04:00
Vladimir Mandic 562799314d change default hfcache folder 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-08-13 13:04:14 -04:00
Vladimir Mandic 8e9244939b calc folder size 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-08-13 12:23:29 -04:00
Disty0 cb0c5414a3 SDNQ use uint with minimum_bits <= 4 2025-08-13 00:37:44 +03:00
Disty0 7085db9add Update changelog 2025-08-13 00:17:15 +03:00
Disty0 15cb8fe9f8 SDNQ add modules_dtype_dict and fix Qwen Image with quants less than 5 bits 2025-08-13 00:07:36 +03:00
Vladimir Mandic a52316b24c fix flex.2 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-08-12 15:55:43 -04:00
Vladimir Mandic 863e172aad add Qwen/Qwen2.5-VL-3B-Instruct 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-08-12 15:09:08 -04:00
Vladimir Mandic 2aa917b58e add /sdapi/v1/modules endpoint 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-08-12 15:09:08 -04:00
Vladimir Mandic a36676a5a9 cleanup lora api 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-08-12 08:49:38 -04:00
Vladimir Mandic 669f9874a0 increase ui default timeouts 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-08-12 08:19:22 -04:00
Vladimir Mandic 6312b3d0ac add Qwen3-4B-Instruct-2507 llm and Flash-FlowMatch scheduler 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-08-11 16:35:16 -04:00
Disty0 9992338187 sdnq fix convs 2025-08-11 23:24:13 +03:00
Disty0 26461f1d8d fix conv in8 matmul 2025-08-11 23:15:30 +03:00
Vladimir Mandic 87bd347116 cleanup flux loader 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-08-11 16:05:39 -04:00
Vladimir Mandic dc8a72947d fix meissonic 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-08-11 16:05:39 -04:00
Vladimir Mandic e42a27a0e4 fix chroma 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-08-11 16:05:39 -04:00
Vladimir Mandic a181c18123 fix omnigen 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-08-11 16:05:39 -04:00
Vladimir Mandic d7daefb8ac update cogview links, fix auraflow and hidream loaders 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-08-11 16:05:39 -04:00
Vladimir Mandic 2a85c05689 refactor pipeline loaders to generic methods and introduce `te_shared_t5` option 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-08-11 16:05:39 -04:00
Disty0 f45e3342e6 Cleanup 2025-08-11 15:11:29 +03:00
Disty0 afb3a5a06d SDNQ move non_blocking to quant config 2025-08-11 15:07:02 +03:00
Disty0 dc7b25d387 Cleanup SDNQ and add SDNQ_USE_TENSORWISE_FP8_MATMUL env var 2025-08-11 14:50:17 +03:00
Vladimir Mandic abddac23d9 add qwen-lightning 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-08-10 15:40:15 -04:00
Disty0 3f45c4e570 Cleanup SDNQ and skip transpose on packed int8 matmul 2025-08-10 19:31:34 +03:00
Vladimir Mandic 3e0fee01f9 cleanup 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-08-10 11:06:37 -04:00
Vladimir Mandic 752d636324 add /sdapi/v1/network 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-08-10 10:53:28 -04:00
Vladimir Mandic 41640773e5 fix global state tracking 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-08-10 09:19:49 -04:00
Vladimir Mandic e5637c3e8d add pag to namegen 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-08-10 07:58:25 -04:00
Vladimir Mandic 73049f7bb8 add load-checkpoint api endpoint and test all models script 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-08-09 14:06:54 -04:00
Vladimir Mandic 44a20a47c1 update todo 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-08-09 12:15:36 -04:00
Vladimir Mandic 338129b7c1 calculate vae-scale-factor and use everywhere 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-08-09 11:31:13 -04:00
Vladimir Mandic 2efadd2630 add numpy error handler to loader 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-08-09 10:14:35 -04:00
Vladimir Mandic db6eb07230 update requirements and handle NEP50 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-08-09 10:03:11 -04:00
Vladimir Mandic 45d5189b83 add privacy blur for tokens in ui 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-08-09 09:03:02 -04:00
Disty0 69db77e365 SDNQ remove eps 2025-08-09 02:39:01 +03:00
Disty0 22d86acda3 Make SDNQ MatMul listen to the dequantize fp32 setting 2025-08-09 01:10:07 +03:00
Vladimir Mandic 0cc24a6d81 lint 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-08-08 18:09:46 -04:00
Vladimir Mandic 09cc584089 civitai downloader batch download all versions 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-08-08 18:06:36 -04:00
Vladimir Mandic 00e34ce0d3 cleanup reference models 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-08-08 14:07:33 -04:00
Vladimir Mandic 80f603f3ff fix sd35 width/height alignment 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-08-08 13:07:50 -04:00
Vladimir Mandic a345ae0e3b flux-kontext with variable resolution 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-08-08 11:44:21 -04:00
Vladimir Mandic 353d73e042 add chroma-v50 and chroma-v50-annealed 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-08-08 10:15:00 -04:00
Vladimir Mandic 9ef6baf2ed use `utf_16_be` as primary metadata decoding 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-08-08 07:36:11 -04:00
Vladimir Mandic c0b8c4e2cb update changelog 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-08-07 17:11:12 -04:00
Disty0 5ffb6e8b88 Cleanup 2025-08-07 23:36:38 +03:00
Disty0 3edb80e1be Add api/rocm_smi.py 2025-08-07 23:23:24 +03:00
Vladimir Mandic e111d151e5 lint 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-08-07 14:19:43 -04:00
Vladimir Mandic 7e5e9eb8bb add basic vace support 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-08-07 14:08:29 -04:00
Vladimir Mandic 5d9c0675e5 cleanup 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-08-07 13:56:13 -04:00
Vladimir Mandic 4b74fd26b5 redesign gpu monitor 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-08-07 13:56:13 -04:00
Vladimir Mandic 3e3adcee74 add skyreels-v2 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-08-07 13:56:13 -04:00
Disty0 31e6cfd91b Fix IPEX 2.8 2025-08-07 15:14:45 +03:00
Vladimir Mandic a9c65c0e8c move api-only to legacy options 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-08-06 19:27:57 -04:00
Vladimir Mandic a91ee36b5c fix settings components mismatch 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-08-06 18:35:43 -04:00
Disty0 aa0652caa9 SDNQ fix new transformers 2025-08-07 00:18:24 +03:00
Disty0 6207b6d841 Update ROCm and OpenVINO to Torch 2.8 2025-08-06 21:33:50 +03:00
Vladimir Mandic 6a6605191f configurable image fit in all image views 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-08-06 11:33:50 -04:00
Vladimir Mandic 7bba30e797 sdnq obey diffusers_to_gpu 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-08-06 10:12:27 -04:00
Disty0 ab8badfe0d SDNQ use non-blocking ops 2025-08-06 17:07:36 +03:00
Vladimir Mandic ba4bff08d6 remove ldsr and refactor sdnq device map 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-08-06 09:27:54 -04:00
Vladimir Mandic 31664864bf qwen cleanup and update changelog 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-08-06 08:54:56 -04:00
Vladimir Mandic e23ca199c0 networks indicator for active loras 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-08-06 07:25:28 -04:00
Vladimir Mandic 5fd44e473e fix networks scan 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-08-06 06:21:17 -04:00
Vladimir Mandic 11a6b1e14b rename size controls 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-08-05 13:35:50 -04:00
Vladimir Mandic 692c236831 modernui updates 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-08-05 13:28:55 -04:00
Vladimir Mandic c0de857b11 simlify extensions layout 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-08-05 09:21:40 -04:00
Vladimir Mandic 1d37a25495 add note on qwen blocker 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-08-04 15:53:43 -04:00
Vladimir Mandic 79db2f28d1 fix nunchaku download links for windows 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-08-04 15:53:43 -04:00
Vladimir Mandic 49e3ff163a lint 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-08-04 15:53:43 -04:00
Vladimir Mandic fd842e275a add qwen-image 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-08-04 15:53:43 -04:00
Vladimir Mandic 8aff68fe06 new models tab including civitai downloader 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-08-04 15:53:43 -04:00
Vladimir Mandic 895c7f41fb gallery bypass thumb cache and safer delete ops 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-08-04 15:53:43 -04:00
Vladimir Mandic 66456f3b4f civitai search redesign prototype 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-08-04 15:53:43 -04:00
Disty0 2cdb15b1ce IPEX enable int_mm fallback for torch 2.8 2025-08-03 18:38:13 +03:00
Vladimir Mandic 84bccc07ca update simple-table 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-08-03 08:43:36 -04:00
Vladimir Mandic ea9d8b2323 lint 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-08-02 19:27:07 -04:00
Vladimir Mandic 265cb5e8ba redo ui model metadata 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-08-02 18:46:40 -04:00
Vladimir Mandic e90ac68dcc lint 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-08-02 15:28:45 -04:00
Vladimir Mandic 800521d885 update models current and list tabs 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-08-02 14:18:58 -04:00
Vladimir Mandic 4a953a7e8d new models-list_models 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-08-02 14:18:58 -04:00
Vladimir Mandic f9b585d983 refactor ui_models 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-08-02 14:18:58 -04:00
Disty0 1d5dce1fb1 cleanup 2025-08-02 17:41:53 +03:00
Disty0 c3d007b02c SDNQ split forward.py into layers and cleanup 2025-08-02 17:36:55 +03:00
Vladimir Mandic 5f384a9de7 video save frames 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-08-02 08:22:32 -04:00
Vladimir Mandic 461bed5720 experimental sampler monkeypatch 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-08-02 07:06:34 -04:00
Vladimir Mandic f7e433bd07 lint 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-08-01 18:26:57 -04:00
Vladimir Mandic 9394430aa3 cleanup 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-08-01 16:46:27 -04:00
Disty0 61a5e5ebca Fix module size detection 2025-08-01 23:45:24 +03:00
Vladimir Mandic 4be093b80f add diffusers_offload_nonblocking setting 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-08-01 16:38:31 -04:00
Disty0 52bef2871b Fix balanced offload pre forward with partial offload 2025-08-01 23:04:58 +03:00
Disty0 5809476e22 fix balanced offload pre_forward not offloading 2025-08-01 22:38:55 +03:00
Vladimir Mandic fe4aa958f8 fix seed in file namegen 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-08-01 14:56:44 -04:00
Vladimir Mandic fbad5d87d6 add offload pre-forward 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-08-01 10:49:03 -04:00
Vladimir Mandic b291c337a1 refactor internal post loop 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-08-01 10:45:39 -04:00
Vladimir Mandic 5a9b72ec57 add quicksettings reset button 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-07-31 19:39:20 -04:00
Vladimir Mandic b120778c4f lint 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-07-31 17:33:44 -04:00
Vladimir Mandic 7167d9d82a api set default script-name 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-07-31 17:16:47 -04:00
Vladimir Mandic fa44521ea3 offload-never and offload-always per-module and new highvram profile 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-07-31 11:40:24 -04:00
Vladimir Mandic 1b3f5405a3 fix batch processing 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-07-31 09:56:40 -04:00
Vladimir Mandic a1fad27b0e embedded docs/wiki search 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-07-31 09:56:40 -04:00
Vladimir Mandic 43e30929ca fix ui wiki search 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-07-31 09:56:40 -04:00
Disty0 6a981358e7 Fix OpenVINO 2025-07-31 12:42:40 +03:00
Vladimir Mandic 052f097956 lint 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-07-30 13:14:04 -04:00
Vladimir Mandic 76504e5264 add explicit BOS/EOS handling in prompt parser 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-07-30 12:46:01 -04:00
Vladimir Mandic f53ee29366 infotext apply styles and fix progress bar 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-07-30 12:02:47 -04:00
Vladimir Mandic d8e03bb855 improve handling of wan22 stages 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-07-30 11:22:08 -04:00
Vladimir Mandic c36e8efd38 add missing interrogate in output panel 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-07-30 09:14:59 -04:00
Vladimir Mandic e8fedf0a73 fix api progress reporting endpoint 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-07-30 08:32:30 -04:00
Vladimir Mandic 473ea67fb4 fix processing image save loop 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-07-30 08:04:08 -04:00
Vladimir Mandic 77e0eecf58 fix inpaint image metadata 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-07-30 07:25:34 -04:00
Vladimir Mandic e980e39a35 fix token counter error state 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-07-29 14:43:24 -04:00
Vladimir Mandic 629e90814f cleanup 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-07-29 09:29:36 -04:00
Vladimir Mandic 8dae6d0c6d lint 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-07-29 09:24:23 -04:00
Vladimir Mandic c07e5d74ab control auto-determine save path 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-07-29 09:07:36 -04:00
Vladimir Mandic 636d261159 fix networks tags display 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-07-29 06:47:22 -04:00
Vladimir Mandic 7dcc5b67f6 fix yolo model refresh 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-07-29 06:04:14 -04:00
Vladimir Mandic 7cbc59567a reduce taesd error reporting 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-07-28 20:22:31 -04:00
Vladimir Mandic 74bb2b9ea6 autodetect v-pred 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-07-28 19:41:39 -04:00
Vladimir Mandic db9e2127c1 fix lora with hidiffusion blocks 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-07-28 16:25:22 -04:00
Vladimir Mandic 8ec16d5b8c update modernui 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-07-28 13:47:13 -04:00
Vladimir Mandic b34324eeb2 lora error logging 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-07-27 16:40:01 -04:00
Vladimir Mandic 8e40c5b0a9 add bigasp25 support 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-07-27 16:32:37 -04:00
Disty0 f02cfeaef9 Rename SDNQ TE dtype default to Same as model 2025-07-27 23:06:41 +03:00
Vladimir Mandic a1ef13098b fix processing skip 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-07-27 10:27:58 -04:00
Vladimir Mandic fd722311db css and logging tweaks 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-07-27 08:17:41 -04:00
Vladimir Mandic ec547d60d1 cleanup 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-07-26 20:08:59 -04:00
Vladimir Mandic 04af23a3bc refactore pipeline apply/unapply optional components & features 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-07-26 20:04:07 -04:00
Vladimir Mandic b5a87c4828 modify installer checks 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-07-26 18:40:28 -04:00
Disty0 41b4e79280 IPEX add torch._int_mm fallback via onednn qlinear 2025-07-26 15:54:18 +03:00
Vladimir Mandic 896c3ce9c2 fix detailer min/max thresholds 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-07-26 08:41:12 -04:00
Disty0 c21c7e545a cleanup 2025-07-26 04:52:56 +03:00
Disty0 9afb122367 Fix prompt parser with Flux 2025-07-26 04:25:43 +03:00
Disty0 ad716b118b fix enable_gqa with dyn atten 2025-07-26 01:49:17 +03:00
Vladimir Mandic e8bec2823a css fonts update 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-07-25 14:55:24 -04:00
Vladimir Mandic a298173cf0 handle batch when saving images 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-07-25 13:13:32 -04:00
Vladimir Mandic b311bdf91e fix prompt encoding if prompts within batch have different segment counts 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-07-25 12:59:14 -04:00
Vladimir Mandic 0b8001c0fa prompt error handling 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-07-25 12:38:25 -04:00
Vladimir Mandic fd2dde9154 sorry 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-07-25 11:46:28 -04:00
Vladimir Mandic f90e8d7118 error handling 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-07-25 11:41:20 -04:00
Vladimir Mandic 97c537a9c2 fix metadata handler 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-07-25 08:35:01 -04:00
Vladimir Mandic 5179255ff7 lint 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-07-24 17:42:13 -04:00
Vladimir Mandic 17fbc96a8c detect invokeai metadata 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-07-24 17:35:52 -04:00
Vladimir Mandic 2656d3aa68 lint 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-07-24 15:42:29 -04:00
Vladimir Mandic fc0e0635b5 detailer add option to merge multiple results into composite mask 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-07-24 15:32:07 -04:00
Vladimir Mandic aed0086cb7 update styles and add simple gallery separator click option 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-07-24 12:48:03 -04:00
Vladimir Mandic 7365b2e632 unique ui labels 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-07-24 09:14:22 -04:00
Vladimir Mandic 32e1787b47 add bria-3.2 model support 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-07-23 12:10:52 -04:00
Disty0 444974a6ff cleanup 2025-07-23 19:02:44 +03:00
Disty0 7a08e1a7f2 SDNQ always use custom tensorwise fp8 matmul 2025-07-23 19:01:10 +03:00
Vladimir Mandic 094647b373 fix missing ui components 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-07-23 08:38:12 -04:00
Vladimir Mandic bf6ba07478 update css and lint 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-07-22 13:45:09 -04:00
Vladimir Mandic 143aa202e6 fix modernui txt2img sampler 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-07-22 13:21:31 -04:00
Vladimir Mandic 0602bedd13 fix modules merge 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-07-22 10:46:35 -04:00
Vladimir Mandic 41269b05c0 handle startup errors 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-07-22 10:19:30 -04:00
Vladimir Mandic 36c356785e modernui updates 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-07-22 10:07:17 -04:00
Vladimir Mandic 159a5c9fac linting 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-07-21 19:24:20 -04:00
Vladimir Mandic f243c35892 improve traceback display 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-07-21 19:07:35 -04:00
Vladimir Mandic 0cc48bb429 improve details model parser 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-07-21 13:42:16 -04:00
Vladimir Mandic 23a4e6f97f cleanup 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-07-21 11:15:15 -04:00
Vladimir Mandic a852d1cea9 add detailer expert mode 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-07-21 10:39:19 -04:00
Vladimir Mandic 287c3600d7 torch compile for llm 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-07-20 12:07:30 -04:00
Vladimir Mandic ea0b84ffc0 group offloading (experimental) 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-07-20 09:33:02 -04:00
Disty0 25a4731a97 SDNQ use static compile 2025-07-20 16:25:57 +03:00
Vladimir Mandic 27ce0dea9a torch.compile use repeated blocks 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-07-20 08:44:25 -04:00
Vladimir Mandic 7d91f7e662 process batch warn and continue 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-07-20 07:33:42 -04:00
Vladimir Mandic 3bf31eb4fd linting 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-07-19 11:33:16 -04:00
Vladimir Mandic 74d3f0bdd5 integrate nudenet 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-07-19 11:17:10 -04:00
Vladimir Mandic e576ea4319 cn always generate blended processed image 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-07-18 18:19:56 -04:00
Vladimir Mandic 1b36607bce restore pipeline before hires 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-07-18 17:55:45 -04:00
Vladimir Mandic 4ef0a4d5a1 fix styles logging 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-07-18 10:46:20 -04:00
Vladimir Mandic da90c0c7ff reduce memory leak on control unit change 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-07-18 09:50:36 -04:00
Vladimir Mandic ee57eb6b45 fix control handling of init images 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-07-18 07:31:59 -04:00
Vladimir Mandic efd86ef901 fix styles logging 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-07-18 07:13:05 -04:00
Vladimir Mandic b61118ffc8 detect comfyui metadata 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-07-17 09:02:23 -04:00
Vladimir Mandic 89ec1c09db improve git error logging 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-07-17 08:18:52 -04:00
Vladimir Mandic 54bdf011ed more linting and update diffusers 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-07-16 13:12:40 -04:00
Vladimir Mandic 17b8fcd902 lint fixes 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-07-16 12:59:40 -04:00
Vladimir Mandic 85fedbaf12 add styles debug 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-07-16 12:54:22 -04:00
Vladimir Mandic ed7e150051 fix control batch-input processing 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-07-16 12:45:29 -04:00
Vladimir Mandic e2a443c885 control xyz support 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-07-16 12:07:43 -04:00
Vladimir Mandic 878fda65ab refactor control processing 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-07-16 11:04:48 -04:00
Vladimir Mandic cd84cfec11 xyzgrid with control tab 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-07-15 14:35:27 -04:00
Vladimir Mandic a77975165c fix xyz with control enabled 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-07-15 09:11:54 -04:00
Vladimir Mandic 251c919c51 auto-handle sampler flow detection 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-07-14 22:07:39 -04:00
Vladimir Mandic 935a4a0aa3 add wan 2.1 text-to-image 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-07-14 13:47:14 -04:00
Vladimir Mandic 79d0fb81af fix inpainting 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-07-14 09:11:17 -04:00
Disty0 655c74da73 Add post load quant support to video 2025-07-14 16:01:13 +03:00
Vladimir Mandic 84df2f8ce6 force gc at processing end 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-07-14 08:59:42 -04:00
Vladimir Mandic 0f2f164245 add smollm3, add auraflow-0.2, enable taesd for auraflox 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-07-14 07:24:20 -04:00
Disty0 30af1f8fb0 Use inference_context with SDNQ 2025-07-14 13:07:44 +03:00
Disty0 3087b8d8cd Do not ignore offload with FramePack 2025-07-13 20:41:55 +03:00
Vladimir Mandic 4e449ca9b2 refactor monolithic shared.py and separate legacy options with logging 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-07-12 13:35:41 -04:00
Vladimir Mandic 4cec2db9a3 allow resize non-pil 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-07-12 09:44:42 -04:00
Vladimir Mandic 98afdd0a8a add freepix f-lite 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-07-11 13:19:29 -04:00
Vladimir Mandic 118a84813c fix directml by locking torch and transformers versions 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-07-11 10:39:35 -04:00
Vladimir Mandic 97de8ee5bf fix flux download 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-07-10 17:54:42 -04:00
Vladimir Mandic 286924c00a update 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-07-10 17:48:21 -04:00
Vladimir Mandic 25c56c2bde fixed omnigen flowmatch scheduler 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-07-10 17:44:30 -04:00
Vladimir Mandic c7ef692563 replace boundry with boundary 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-07-10 14:26:16 -04:00
Vladimir Mandic b1dfe19a37 fix omnigen2 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-07-10 14:19:35 -04:00
Vladimir Mandic 091bbd7bc6 video tab redesign and optimized ltxvideo 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-07-10 11:43:44 -04:00
Vladimir Mandic 8062345874 linting 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-07-09 18:19:20 -04:00
Vladimir Mandic 3f5ab15f64 ltx-conditioned prototype 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-07-09 18:11:51 -04:00
Vladimir Mandic feca1c653f video ui update with modernui support 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-07-09 11:54:58 -04:00
Vladimir Mandic 71a18dcf74 update precommit hooks 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-07-08 16:16:08 -04:00
Vladimir Mandic c559e26616 add builtin framepack 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-07-08 15:47:07 -04:00
Vladimir Mandic 9700cc765d cleanup gen infotext 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-07-07 20:09:19 -04:00
Vladimir Mandic e6d97f4d44 monkeypatch numpy for gradio 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-07-07 19:45:30 -04:00
Vladimir Mandic b625884031 add gemma3n to caption/vlm and promptenhance 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-07-07 10:01:02 -04:00
Vladimir Mandic 9246f447df fix resize visibility 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-07-06 22:13:42 -04:00
Vladimir Mandic a12f8cbc8d improve infotext param parsing 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-07-06 17:31:21 -04:00
Vladimir Mandic 4dc56c6813 allow styles to modify settings and improve parser 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-07-06 16:42:29 -04:00
Vladimir Mandic 6246047963 fix hypernetwork dir 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-07-06 15:43:28 -04:00
Vladimir Mandic ed1e59464e update requirements 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-07-06 14:53:25 -04:00
Vladimir Mandic b2a52a146b fix ansi controle output and add model locking 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-07-06 12:50:09 -04:00
Vladimir Mandic 8dc5dac308 add face-yolo8m 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-07-06 11:47:27 -04:00
Disty0 148b011692 IPEX fix bicubic upsample with torchvision 2025-07-06 18:19:55 +03:00
Disty0 526976eb64
Merge pull request #4019 from vladmandic/master 
PixelArt
 2025-07-06 14:19:19 +03:00
Disty0 d5d857aa96 Add sharpen filter to pixelart 2025-07-06 03:17:54 +03:00
Disty0 e255d89fd8 Add PixelArt filter to postprocess 2025-07-06 02:30:55 +03:00
Vladimir Mandic 68708b6b8f refactor codeformer 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-07-05 18:33:55 -04:00
Vladimir Mandic edefa8cb14 improve extensions compatibility 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-07-05 17:42:13 -04:00
Vladimir Mandic d688514d0d set taesd as default preview type 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-07-05 17:30:54 -04:00
Vladimir Mandic 8c676d0a61 lint formatting 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-07-05 17:13:31 -04:00
Vladimir Mandic a5b77b8ee2 remove dead code 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-07-05 16:47:25 -04:00
Vladimir Mandic 748ec564ad fix invalid model name on initial install 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-07-05 16:00:34 -04:00
Vladimir Mandic e8b5ea3847 major refactor: remove backend original 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-07-05 13:16:46 -04:00
Vladimir Mandic f408e5f315 major refactor: remove backend original 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-07-05 13:16:37 -04:00
Vladimir Mandic 2b9056179d add lbm background replace with relightining 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-07-04 15:33:16 -04:00
Disty0 4aeb9f004c Cleanup layerwise 2025-07-04 06:12:25 +03:00
Disty0 9d5571f4f8 Use layerwise casting with Flux FP8 models 2025-07-04 04:26:43 +03:00
Disty0 1a3b6e3b9c Handle all in one flux safetensors with auto quant mode 2025-07-04 02:35:54 +03:00
Disty0 fe9a3b8506 Add device map support to Flux and Chroma and add custom UNet support to Chroma 2025-07-04 02:22:42 +03:00
Disty0 f257cc2b40 Enable TAESD and Remote VAE for HunyuanDiT 2025-07-04 00:11:46 +03:00
Disty0 cf90e5621a Add _skip_layerwise_casting_patterns to SDNQ skip list 2025-07-04 00:04:01 +03:00
Disty0 07a443c196 Fix auth check with Flux from single file 2025-07-03 23:47:41 +03:00
Vladimir Mandic 49c9a450f4 support manually downloaded diffuser models 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-07-03 15:52:54 -04:00
Enes Sadık Özbek 9b82288fea
Fix xhinker padding for Chroma 2025-07-03 18:17:16 +03:00
Disty0 22e24b267c Update pillow jxl plugin 2025-07-03 17:48:52 +03:00
Enes Sadık Özbek e3beea1864
Fix colliding hashes for direct download diffusers models 2025-07-03 17:24:21 +03:00
Vladimir Mandic c4d9338d2e major refactoring of modules 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-07-03 09:18:38 -04:00
Vladimir Mandic 9b38a5dc58 add kontext inpainting 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-07-02 08:14:47 -04:00
Disty0 3406083d14 Override lumina2 to use diffusers lora loading 2025-07-02 06:40:27 +03:00
Vladimir Mandic 7736382028 major requirements refactor 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-07-01 13:12:21 -04:00
Vladimir Mandic 4c43c1cc5e update cuda max memory limit 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-06-30 16:49:43 -04:00
Vladimir Mandic 5d2f5dd6e7 fix typo 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-06-30 08:28:11 -04:00
Enes Sadık Özbek f3d6245511
Fix not applying text encoders of LoRAs on prompts which caused the related LoRAs to load 2025-06-29 22:20:31 +03:00
Vladimir Mandic 198382c027 cleanup 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-06-29 12:58:54 -04:00
Vladimir Mandic ff103bc849 fix LoRA change detection on pipeline type change 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-06-29 12:52:37 -04:00
Vladimir Mandic 1b4e1ff0ef enable quants for vlm-captioning 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-06-29 11:48:05 -04:00
Disty0 99f323d105 Fix Linfusiong with quantization / compile 2025-06-29 18:17:05 +03:00
Disty0 bcea748d56 Omnigen 2 use LuminaFeedForward from diffusers 2025-06-28 18:35:57 +03:00
Vladimir Mandic 7fbac675fe api update default sampler 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-06-28 09:36:33 -04:00
Vladimir Mandic 69f71cc32a update nunchaku 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-06-28 07:50:35 -04:00
Disty0 ba45de1a08 Remove empty file 2025-06-28 14:14:50 +03:00
Disty0 1d9fe88528 Cleanup 2025-06-28 14:05:51 +03:00
Disty0 cb2fa7e1b4 Omnigen2 use SDPA 2025-06-28 14:02:15 +03:00
Disty0 ab8b9b0eab Cleanup Omnigen 2 2025-06-28 13:53:37 +03:00
Vladimir Mandic bff75f0db3 add omnigen2 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-06-27 20:20:43 -04:00
Vladimir Mandic 533aa04bbd improve taesd live preview downscaling 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-06-27 18:16:32 -04:00
Vladimir Mandic 1d8551788a update changelog and cleanup samplers 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-06-27 17:02:25 -04:00
Disty0 71f7474de2 Unify quant options 2025-06-27 21:05:14 +03:00
Disty0 3b8ced444c Add auto quantization mode 2025-06-27 18:54:15 +03:00
Vladimir Mandic 15cbffeb97 cleanup 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-06-27 09:52:31 -04:00
Vladimir Mandic 78330142ae add moondream2, sdnq xyzgrid timing info 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-06-27 09:41:32 -04:00
Vladimir Mandic f9480a1047 add --trace for trace-logging and suppress empty torch logging 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-06-27 09:04:32 -04:00
Vladimir Mandic 518015d0d1 fix lumina2 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-06-27 08:30:25 -04:00
Vladimir Mandic 1147f9ec56 add flux.1-kontext-dev 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-06-26 17:09:53 -04:00
Vladimir Mandic d6a8d2b173 cleanup 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-06-26 15:00:27 -04:00
Vladimir Mandic 46387d0c01 cleanup chroma 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-06-26 14:48:17 -04:00
Disty0 0e4d712f27 Chroma fixes 2025-06-26 21:25:50 +03:00
Vladimir Mandic d5a74d4a4a
Merge branch 'dev' into feature/chroma-support 2025-06-26 13:06:31 -04:00
Vladimir Mandic ada38d57b4 add nvidia-cosmos-predict-2 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-06-26 12:21:43 -04:00
Disty0 61e949c1cc Update OpenVINO to 2025.2.0 2025-06-26 18:33:04 +03:00
Enes Sadık Özbek e91208bea9
Merge branch 'dev' into feature/chroma-support 2025-06-26 17:02:00 +03:00
Vladimir Mandic 2714d29993 fix unapply texture tiling 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-06-26 09:30:15 -04:00
Vladimir Mandic 931650c43f fix process batch 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-06-26 09:17:10 -04:00
Vladimir Mandic 82aaff9d70 gallery trace file fetch 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-06-26 07:59:51 -04:00
Vladimir Mandic 4de160608e fix prompt parser with batch size 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-06-26 07:47:03 -04:00
Vladimir Mandic 7380c08f8e lint fix 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-06-26 06:51:59 -04:00
Disty0 0f6eb624c9 Use llm_int8_skip_modules with bnb 2025-06-26 03:10:26 +03:00
Disty0 dc8fd006b2 Add modules_to_not_convert to pre-mode quants 2025-06-26 02:47:10 +03:00
Vladimir Mandic c254c8c1ec fix hypertile for img2img and inpaint operations 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-06-25 19:14:46 -04:00
Enes Sadık Özbek fb0d354c4e
reuse f1 remote vae for chroma 2025-06-26 02:04:03 +03:00
Enes Sadık Özbek f040d67f64
another merge conflict 2025-06-26 01:58:09 +03:00
Enes Sadık Özbek 943b45fdb6
fix the previous merge conflict 2025-06-26 01:57:15 +03:00
Enes Sadık Özbek 21bdde12d3
Merge branch 'dev' into feature/chroma-support 2025-06-26 01:56:34 +03:00
Disty0 c25d15398f SDNQ pre-mode don't quant if weights_dtype == 'none' 2025-06-26 01:48:01 +03:00
Vladimir Mandic 2c629246d4
Merge branch 'dev' into fix-lycoris-wrong-errors 2025-06-25 18:45:04 -04:00
Vladimir Mandic 42b3e08e65 Control add setting to run hires with or without control 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-06-25 18:43:29 -04:00
Disty0 c9f49720c5 Cleanup 2025-06-25 23:37:41 +03:00
Disty0 e43d1d2ba7 SDNQ use strings as target_dtype 2025-06-25 23:25:49 +03:00
Disty0 81e55f0459 Fix SDNQ pre-mode 2025-06-25 22:58:40 +03:00
Vladimir Mandic f8977d2f01 add /sdapi/v1/controlnets api endpoint 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-06-25 15:54:43 -04:00
Vladimir Mandic 5b486a6ef1 sdnq add xyz grid support, improve offloading compatibility 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-06-25 15:32:37 -04:00
Vladimir Mandic 6c3f0dd43b add `SD_SAVE_DEBUG` env variable 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-06-25 11:23:39 -04:00
Vladimir Mandic 3d52e3fe9f add /sdapi/v1/lora endpoint 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-06-25 10:54:02 -04:00
Vladimir Mandic a5d784f073 fix delete file from main gallery view 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-06-25 10:30:59 -04:00
Vladimir Mandic b650618b27 fix params.txt 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-06-25 09:11:17 -04:00
Disty0 77db759d88 Cleanup 2025-06-24 13:15:31 +03:00
Disty0 eaa130463c Use Diffusers with OmniGen 2025-06-24 13:09:11 +03:00
Disty0 bbf986d3a5 Fix LTXVideo 2025-06-23 17:37:20 +03:00
Enes Sadık Özbek 4870605f4a
Update prompt_parser_xhinker.py 2025-06-23 13:41:49 +03:00
Enes Sadık Özbek 9238150a56
fix eos token not added correctly 2025-06-23 10:15:35 +00:00
Enes Sadık Özbek 71869a3181
xhinker improvements 2025-06-23 08:41:15 +00:00
Enes Sadık Özbek 405416871f
fix chroma teacache 2025-06-23 08:35:05 +00:00
Enes Sadık Özbek 106f6a9bc1
xhinker padding fixes 2025-06-23 02:18:50 +00:00
Enes Sadık Özbek 954138bfc1
add attention masks 2025-06-23 01:27:40 +00:00
Disty0 87e6d3f4fc SDNQ add modules_to_not_convert and don't quant _keep_in_fp32_modules layers in post mode 2025-06-20 20:41:11 +03:00
Disty0 4491d26a18 IPEX fix fp64 hijack 2025-06-19 22:55:28 +03:00
Disty0 7fc7797a1d SDNQ fix group size calc on odd shapes 2025-06-19 11:36:41 +03:00
Disty0 ff5d7977a9 Fix Controlnet pipeline check on set atten 2025-06-18 19:35:57 +03:00
Disty0 2c4850cc2b Log more info with SDNQ 2025-06-18 18:03:46 +03:00
Disty0 86cd272b96 SDNQ fix Dora 2025-06-18 16:24:42 +03:00
Enes Sadık Özbek 7025ac8c36
Merge branch 'dev' into feature/chroma-support 2025-06-18 10:08:38 +03:00
Enes Sadık Özbek 4b3ce06916
Initial support for Chroma 2025-06-18 00:38:17 +00:00
Disty0 e657cf790d SDNQ fix int8 matmul with qwen 2025-06-18 02:12:34 +03:00
Disty0 71c2714edf Cleanup 2025-06-17 20:04:15 +03:00
Disty0 d8aaffbc27 IPEX fix DPM2++ FlowMatch 2025-06-17 19:58:20 +03:00
Disty0 26800a1ef9 Cleanup sdnq 2025-06-17 02:05:13 +03:00
Disty0 bddd091300 Custom VAE loading support for Lumina 2 2025-06-16 22:34:02 +03:00
Disty0 319af31d25 Custom UNet loading support for Lumina 2 2025-06-16 13:28:30 +03:00
Disty0 892dd456f7 Fix Nunchaku 2025-06-16 02:43:49 +03:00
Disty0 4fa48e4084 Use te hijcak for with lumina 2 2025-06-15 22:19:56 +03:00
Disty0 a7811da267 Teacache support for Lumina 2 2025-06-15 22:07:58 +03:00
Disty0 d31df8c1eb SDNQ fuse bias into dequantizer with matmul 2025-06-14 22:10:10 +03:00
Disty0 25fc0094a9 SDNQ use quantize_device and return_device args and fix decompress_fp32 always being on 2025-06-14 21:29:08 +03:00
Disty0 24194201cf Fix OmniGen 2025-06-14 19:55:43 +03:00
Disty0 c01802d9ff SDNQ fix transformers llm 2025-06-14 01:13:51 +03:00
Disty0 8f8e5ce1b0 Cleanup x2 2025-06-14 01:08:25 +03:00
Disty0 2ba64abcde Cleanup 2025-06-14 00:54:18 +03:00
Disty0 45827a923f IPEX fix torch.cuda.set_device 2025-06-13 16:20:21 +03:00
Disty0 90e76b2023 Cleanup 2025-06-13 13:42:13 +03:00
Disty0 fb7280c3f4 Flux quanto fix logged dtype 2025-06-13 13:40:44 +03:00
Disty0 1fca565178 Cleanup 2025-06-13 13:37:12 +03:00
Disty0 e68f9272e8 Disable custom atten processors for non SD 1.5 / SDXL models 2025-06-13 13:05:46 +03:00
Disty0 cb4684cbeb SNDQ add separate quant mode option for Text Encoders 2025-06-13 12:42:57 +03:00
Disty0 c8f947827b IPEX fix Lumina2 2025-06-12 19:46:05 +03:00
Disty0 41f14df8f5 Fix TAESD and double downloading with Lumina2 2025-06-12 14:17:36 +03:00
Disty0 5e013fb154 SDNQ optimize input quantization and use the word quantize instead of compress 2025-06-12 12:06:57 +03:00
Disty0 2d05396b4e SDNQ simplify sym scale formula 2025-06-12 02:26:04 +03:00
Disty0 26545b6483 Add warning for incompatible attention processors 2025-06-11 21:59:59 +03:00
Disty0 dd84fb541f Always set sdpa params 2025-06-11 21:43:48 +03:00
Disty0 5cefa64a60 SDNQ update accepted dtypes 2025-06-11 20:58:54 +03:00
Disty0 74b6edf2df revert gfx1101 2025-06-11 19:25:05 +03:00
Disty0 6aa5c08fb0 Cleanup and update changelog 2025-06-11 16:03:33 +03:00
Disty0 71be3c7d45 ROCm don't override gfx with gfx1100 and gfx1101 + rocm 6.4 2025-06-11 15:47:25 +03:00
Disty0 df6b13ea47 Don't set gfx override with RX 9000 and above 2025-06-11 15:09:03 +03:00
Disty0 c81b712ddb Make VAE options not require model reload 2025-06-10 15:56:19 +03:00
Disty0 78f99abec8 SDNQ use group_size / 2 for convs 2025-06-10 15:29:24 +03:00
Disty0 33fadf946b SDNQ add 7 bit support 2025-06-10 11:33:06 +03:00
Disty0 5bd7a08877 don't use inplace ops in quant layer 2025-06-10 03:29:07 +03:00
Disty0 5eed9135e3 Split SDNQ into multiple files and linting 2025-06-10 03:18:25 +03:00
Disty0 58b646e7f2 SDNQ add 5-bit and 3-bit quantization support 2025-06-10 01:48:51 +03:00
Disty0 bd2d9d1677 Python 3.13 support 2025-06-09 22:58:08 +03:00
Disty0 8e08ef0edc Fix VAE Tiling with non-default tile sizes 2025-06-07 01:25:08 +03:00
Enes Sadık Özbek 3868a9184b
Fix incorrectly reported lycoris load error 2025-06-07 00:36:08 +03:00
Disty0 2f7aff5250 Fix TAESD previews with PixArt 2025-06-06 19:43:00 +03:00
Disty0 5624671191 Fix PixArt Sigma Small and Large 2025-06-06 19:25:26 +03:00
Disty0 089e437708 Don't set attention processors with models outside of SD 1.5 and SDXL 2025-06-06 18:53:57 +03:00
Disty0 c039ba90f6 Fix Meissonic by adding multiple generator support 2025-06-06 18:02:49 +03:00
Disty0 7679028c1a Override CPU to use FP32 by default 2025-06-06 15:33:51 +03:00
Disty0 2ccc76ab91 Increase medvram mode to 12 GB and update wiki 2025-06-06 15:27:30 +03:00
Disty0 9a54efda9b Cleanup 2025-06-06 01:55:35 +03:00
Disty0 06fcc3cf85 SDNQ add quantized matmul support for Conv1d and Conv3d too 2025-06-06 00:19:54 +03:00
Disty0 976f0ba61f Cleanup 2025-06-05 20:59:58 +03:00
Disty0 413cf54cb6 Update changelog 2025-06-05 18:11:36 +03:00
Disty0 8c03f78197 Fix bias is None 2025-06-05 14:37:00 +03:00
Disty0 1a00517338 SDNQ FP8 matmul support for Conv2d 2025-06-05 14:32:26 +03:00
Disty0 9b55ffe449 SDNQ fix VAE x2 2025-06-05 14:17:59 +03:00
Disty0 ad2a4ad616 Cleanup 2025-06-05 13:38:04 +03:00
Disty0 e25890bb1d SDNQ INT8 matmul support for Conv2d 2025-06-05 13:36:49 +03:00
Disty0 c7fb5b1690 SDNQ fix VAE quant 2025-06-05 13:24:02 +03:00
Disty0 ce3a6e27fa SDNQ use channelwise only quant 2025-06-03 12:30:19 +03:00
Disty0 79ec23dd9d SDNQ override conv dtype 2025-06-03 02:37:29 +03:00
Disty0 e9ff242e03 SDNQ add group size support for convs 2025-06-03 02:16:52 +03:00
Disty0 6f637f41cc Use tensorwise fp8 matmul with torch < 2.5 2025-06-02 23:28:49 +03:00
Disty0 3f3a986c0e SDNQ fix scale staying in fp32 with tensorwise fp8 matmul 2025-06-02 23:18:28 +03:00
Disty0 4e3795a0a5 SDNQ fix packed int8 matmul 2025-06-02 03:31:51 +03:00
Disty0 82f5634d53 SDNQ use torch.bool for uint1 2025-06-02 01:39:51 +03:00
Disty0 ea7fe3bb73 OpenVINO update dtype_mapping 2025-06-02 01:11:41 +03:00
Disty0 e8588c91ea SDNQ enable matmul support for float8_e5m2 2025-06-02 00:53:10 +03:00
Disty0 8f1a1d7311 SDNQ expand quantized_matmul_dtypes for CPU 2025-06-02 00:28:29 +03:00
Disty0 b146025a5e SDNQ add int2 2025-06-02 00:17:39 +03:00
Disty0 9669b36010 SDNQ fix older PyTorch with FP8 matmul 2025-06-01 23:29:16 +03:00
Disty0 acefa58834 SDNQ don't force fp32 with fp8 tensorwise matmul 2025-06-01 23:16:00 +03:00
Disty0 839295f79a Add fp8 fnuz to sdnq options 2025-06-01 23:10:08 +03:00
Disty0 539fae3234 Update naming 2025-06-01 21:01:56 +03:00
Disty0 cefe460052 SDNQ skip FP8 matmul for input len < 32 2025-05-31 01:27:59 +03:00
Disty0 046840c8be Fix HiDream sampling 2025-05-31 00:52:56 +03:00
Disty0 109c0d7e49 SDNQ use tensorwise FP8 matmul on CPU 2025-05-30 21:09:53 +03:00
Disty0 959b759721 Cleanup 2025-05-30 16:45:59 +03:00
Disty0 b5d588fa45 SDNQ remove unnecessary bitwise ands 2025-05-30 16:29:59 +03:00
Disty0 db816d7088 Cleanup 2025-05-30 16:02:26 +03:00
Disty0 c85cc6b397 SDNQ enable quant with GPU by default and don't do unnecessary clones 2025-05-30 15:21:29 +03:00
Disty0 4654acde3c SDNQ re-enable memory fix for diffusers 2025-05-30 14:59:45 +03:00
Disty0 87a801e24d SDNQ remove memory fix hijack 2025-05-30 13:54:49 +03:00
Disty0 f81cb22c00 SDNQ fix new transformers 2025-05-30 13:32:03 +03:00
Disty0 36febda6e6 SDNQ update supported dtypes 2025-05-30 13:07:23 +03:00
Disty0 29bd2af779 SDNQ add 6-bit support 2025-05-30 12:20:13 +03:00
Vladimir Mandic 98a11fc86c fix gallery duplicate entries 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-05-30 11:04:56 +02:00
Disty0 d1491962d9 One bit 2025-05-30 05:41:02 +03:00
Disty0 3c8be0f55f SDNQ add uint2 2025-05-30 04:47:29 +03:00
Disty0 599224d392 SDNQ reduce 5 reshape ops to 2 with quantized input 2025-05-30 01:31:41 +03:00
Disty0 d8dea9031f SDNQ do FP8 matmul shape check only once 2025-05-30 01:13:37 +03:00
Disty0 b4e615e760 SDNQ add FP8 row wise scaling workaround for SM89 on Windows 2025-05-30 00:16:54 +03:00
Disty0 54154cf698 Cleanup 2025-05-29 20:22:49 +03:00
Disty0 90324f9c8c SDNQ fix lora with quant matmul 2025-05-29 18:25:12 +03:00
Disty0 df8b31fcfc Don't downcast scale with fp8 matmul 2025-05-29 16:35:40 +03:00
Disty0 2351efb8f7 Remove redundant shape check 2025-05-29 14:58:00 +03:00
Disty0 14893b7617 Don't make the weights contiguous with int8 matmul 2025-05-29 03:43:57 +03:00
Disty0 2cc5a58b0f Update changelog 2025-05-29 03:26:47 +03:00
Disty0 67e0f4d833 Cleanup 2025-05-29 03:22:40 +03:00
Disty0 3698f8bb84 SDNQ add experimental FP8 matmul 2025-05-29 03:11:59 +03:00
Disty0 dd33c4d583 Fix scale and zero_point not being moved by tensor.to 2025-05-28 17:46:06 +03:00
Disty0 dd0dbc476f SDNQ fix asym quant formula for dtypes with non zero minimums 2025-05-28 17:25:38 +03:00
Disty0 e06cbea7aa Cleanup 2025-05-28 15:55:08 +03:00
Disty0 d8e8f47ce5 SDNQ add an option to toggle quantize with GPU 2025-05-28 15:18:39 +03:00
Disty0 1961e88c13 Set SDPA as the default on all backends and enable Dyn SDPA on ROCm, DML, CPU and MPS 2025-05-28 13:42:29 +03:00
Disty0 569e9099d7 Use torch.amax instead of torch.max 2025-05-28 12:44:07 +03:00
Disty0 0b564e2373 Cleanup 2025-05-28 04:07:45 +03:00
Disty0 1433dfe3de SDNQ fix high RAM usage with pre mode 2025-05-28 03:16:29 +03:00
Disty0 4ed15f5cce SDNQ revert device_map = gpu 2025-05-27 23:32:58 +03:00
Disty0 d3e3fb98b0 Don't override user set device_map 2025-05-27 21:45:52 +03:00
Disty0 b1b29e9001 SDNQ disable device_map = gpu with TE and LLM 2025-05-27 21:32:32 +03:00
Disty0 b724cd7c57 Update changelog 2025-05-27 21:21:42 +03:00
Disty0 5d3c1832b2 SDNQ add FP8 quants 2025-05-27 20:29:15 +03:00
Disty0 3618e39cff SDNQ use device_map = gpu 2025-05-27 19:46:30 +03:00
Disty0 73999ac710 Add soft gc to nncf quant layer 2025-05-27 16:24:04 +03:00
Disty0 e94128a02e SDNQ add force torch_gc to pre load mode 2025-05-27 16:11:04 +03:00
Disty0 dece497f10 Refactor SDNQ to use weights_dtype and rename decompress_int8_matmul to use_quantized_matmul 2025-05-27 15:49:21 +03:00
Disty0 79bb348927 SDNQ sort quant schemes by recommended order 2025-05-27 13:06:17 +03:00
Disty0 dec460e665 SDNQ use torch.bitwise ops instead of python 2025-05-27 03:02:36 +03:00
Disty0 280be31883 SDNQ fix Lora change 2025-05-27 00:08:32 +03:00
Disty0 4d9c2a8608 Cleanup 2025-05-26 22:41:12 +03:00
Disty0 84ddfb2868 SDNQ fix lora apply 2025-05-26 22:39:20 +03:00
Disty0 6dee9f5ac7 Fix HiDream teacache not reseting 2025-05-26 21:21:01 +03:00
Disty0 742cd61d1f Add TeaCache for HiDream 2025-05-26 19:59:43 +03:00
Disty0 687c50dcc8 SDNQ fix Lora 2025-05-26 19:48:45 +03:00
Disty0 ccf9deaf28 Move SDNQ to the top of the settings list 2025-05-26 18:30:50 +03:00
Disty0 02f15b28cc Cleanup 2025-05-26 15:57:17 +03:00
Disty0 91bb07f650 SDNQ remove unused args and simplify decompressors 2025-05-26 15:51:53 +03:00
Disty0 d2159af10e cleanup 2025-05-26 04:24:28 +03:00
Disty0 4ad404182d cleanup 2025-05-26 04:17:22 +03:00
Disty0 46e9a9a631 IPEX disable Dynamic Attention by default on PyTorch 2.7 2025-05-26 03:03:17 +03:00
Disty0 4453efee76 Rename NNCF to SDNQ and rename quant schemes 2025-05-26 02:39:51 +03:00
Disty0 9c2e15433e NNCF set required_packages to None 2025-05-26 01:39:09 +03:00
Disty0 cbc1bfe710 Cleanup 2025-05-26 01:24:06 +03:00
Disty0 2d79380bd7 NNCF implement better layer hijacks and remove all NNCF imports 2025-05-26 01:12:28 +03:00
Vladimir Mandic af3a44ccbe optional skimage 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-05-24 08:58:04 +02:00
Disty0 85f00f9edb Enable dyn atten by default for ROCm 2025-05-23 18:24:50 +03:00
Disty0 3d8390de9b IPEX return devices.dtype instead of bf16 2025-05-18 04:44:51 +03:00
Disty0 d0e6f01286 IPEX remove GradScaler and use torch.amp instead 2025-05-18 04:39:48 +03:00
Disty0 a009e17d2b NNCF use per token input quantization with int8 matmul 2025-05-17 19:46:47 +03:00
Disty0 219970d47d Add Anisora 5B RL 2025-05-16 12:00:54 +03:00
Disty0 8487b5f263 Add Anisora 5B 2025-05-15 23:21:39 +03:00
Disty0 cf716e1c97 NNCF fix CogVideo 2025-05-15 22:51:35 +03:00
Vladimir Mandic c371ec91b4 fix nncf with controlnet 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-05-15 15:26:55 -04:00
Disty0 0ab28a6106 IPEX fix cogvideo 2025-05-15 22:08:50 +03:00
Vladimir Mandic 4157336238 rename vae 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-05-15 08:59:49 -04:00
Vladimir Mandic 39135c1d0a ui-defaults match correct prompt component 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-05-15 08:51:03 -04:00
Vladimir Mandic 5c0e3b635c update diffusers and lint/changelog/todo 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-05-14 13:30:52 -04:00
Seunghoon Lee 8330052d19
zluda 3.9.5 & torch 2.7.0 2025-05-14 13:22:26 +09:00
Disty0 18c10883b8 Move NNCF above in the settings list 2025-05-14 05:19:11 +03:00
Vladimir Mandic 8473bae0fc 1000 papercuts 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-05-13 21:51:33 -04:00
Disty0 115d81cc8c NNCF change zero_point formula and use torch.addcmul on decompress_asym 2025-05-14 00:58:33 +03:00
Disty0 361e952a64 Cleanup 2025-05-14 00:14:24 +03:00
Vladimir Mandic f07c2e6117 nncf-lint 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-05-13 12:35:33 -04:00
Vladimir Mandic bfda37903c update nncf linting and changelog 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-05-13 12:11:10 -04:00
Disty0 4e4557d81c NNCF set min matmul shape to 32 2025-05-13 18:50:23 +03:00
Disty0 b9ad55857d NNCF INT8 MatMul don't force FP32 with FP16 scales 2025-05-13 05:08:22 +03:00
Disty0 129c701b3d NNCF use torch.compile directly on int8_matmul instead of sub functions 2025-05-13 04:28:37 +03:00
Disty0 f1eefe97a4 NNCF use inplace ops 2025-05-13 03:49:30 +03:00
Vladimir Mandic 47862fef08 prompt enhance nsfw allow/disallow 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-05-12 20:33:16 -04:00
Disty0 98ccce68a1
Merge branch 'master' into master 2025-05-13 03:28:51 +03:00
chrismuzyn 299d189276 When using the openvino backend, do not look for an nvidia gpu. 2025-05-12 19:14:26 -04:00
Disty0 f4e3a81a84 NNCF experimental direct INT8 MatMul support 2025-05-12 21:41:49 +03:00
Vladimir Mandic 91080f349f latent-diffusion-upscale n-steps 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-05-12 11:12:36 -04:00
Vladimir Mandic a6e6c6ce5e support sdxl packaged without vae 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-05-11 14:49:27 -04:00
Disty0 4eedeab9f8 NNCF use group size instead of number of groups and set default group size for int4 to 64 2025-05-11 20:38:01 +03:00
Disty0 03d05b6243 NNCF fix very large number of groups 2025-05-11 18:43:19 +03:00
Disty0 9cfdc3c079 Remove NNCF device hijack 2025-05-11 18:30:10 +03:00
Disty0 0673689d5b NNCF set the default group size to 128 for INT4 2025-05-11 08:45:27 +03:00
Disty0 4af570bfd4 Cleanup 2025-05-11 08:10:13 +03:00
Disty0 8d27d34969 NNCF don't clip the zero_point 2025-05-11 07:57:51 +03:00
Disty0 98308fa187 NNCF fix group size calculation 2025-05-11 07:08:21 +03:00
Disty0 020e1aa374 Cleanup 2025-05-11 06:56:36 +03:00
Disty0 03a6d7f9bf NNCF add number of quantization groups 2025-05-11 05:55:58 +03:00
Vladimir Mandic 6036ff2105 modernui framepack and history tabs 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-05-10 10:21:37 -04:00
Vladimir Mandic aa04dd900a fix modernui disabled 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-05-10 08:53:30 -04:00
Vladimir Mandic f0d81ee1e0 cleanup 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-05-10 08:28:19 -04:00
Seunghoon Lee 6d2b5fc37c
Merge pull request #3921 from alexsarmiento/patch-1 
Update fwd_prefill.py
 2025-05-10 11:47:26 +09:00
Disty0 a1491a660c Cleanup 2025-05-09 23:36:50 +03:00
Disty0 1ee9832e05 NNCF silence the pytorch version warning 2025-05-09 23:16:55 +03:00
Disty0 b0e5a6c4df Add devices.has_triton() and enable NNCF compile if triton is available 2025-05-09 22:24:36 +03:00
AS 399a630778
Merge branch 'dev' into patch-1 2025-05-09 11:18:25 -07:00
Disty0 a4d4462e2a NNCF add decompress using toch.compile option 2025-05-09 21:02:24 +03:00
Seunghoon Lee 45c0bd6ec6
basic windows native pytorch support 2025-05-09 22:23:07 +09:00
Vladimir Mandic 51716bbaba update diffusers 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-05-09 09:04:21 -04:00
Vladimir Mandic 808462fdab update changelog 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-05-09 08:18:40 -04:00
Seunghoon Lee a27abf7363
zluda fix old cards 2025-05-09 20:02:45 +09:00
Disty0 9b641becd5 IPEX fix torch.compile with tensor.to 2025-05-09 11:07:51 +03:00
Seunghoon Lee 18f58e13f8
Update fwd_prefill.py 2025-05-09 13:36:01 +09:00
Vladimir Mandic 9e18d2f658
Merge branch 'dev' into patch-1 2025-05-08 23:21:24 -04:00
AS 5e561560ea
Update fwd_prefill.py 
Remove cudagraph from triton autotune. Buggy under zluda
 2025-05-08 19:32:51 -07:00
Vladimir Mandic 6489e4c37d prompt-enhance api support and img2img support 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-05-08 15:31:07 -04:00
Vladimir Mandic 55b1cb8c8b lower default teacache threshold 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-05-08 10:14:15 -04:00
Vladimir Mandic 432a5977a7 adetailer fix enable-disable 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-05-08 10:10:43 -04:00
Disty0 f3aa3b4574 NNCF remove T5 hijack from pre quant mode 2025-05-08 14:11:19 +03:00
Disty0 dfebc909eb Disable cuDNN benchmark on ROCm and add cudnn_benchmark_limit option 2025-05-08 13:27:06 +03:00
Vladimir Mandic 8433f685e7 clear-cache on model unload 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-05-07 20:22:30 -04:00
Disty0 b6d2aa7fd8 NNCF more optimizations 2025-05-07 21:50:31 +03:00
Disty0 a57c7087b8 Make NNCF INT4 quant run 75% faster and don't force fp32 decompress 2025-05-07 20:34:07 +03:00
Vladimir Mandic 5261c55890 fix lora legacy disabled 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-05-07 11:48:21 -04:00
Vladimir Mandic 78e22350b9 add api get-checkpoint 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-05-07 10:31:06 -04:00
Seunghoon Lee 2a4eb86d10
zluda 3.9.4 & update flash attention 2 2025-05-07 00:39:40 +09:00
Vladimir Mandic 83fc68ece3 update requirements 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-05-06 09:47:13 -04:00
Vladimir Mandic 02fd0aee06 fix control refiner 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-05-06 09:06:50 -04:00
Vladimir Mandic 1da43e4f62 api b64 error handler 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-05-05 22:28:03 -04:00
Vladimir Mandic 66b2505422 fix cmdargs 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-05-05 16:52:01 -04:00
Vladimir Mandic d12cfdb537 add vlm prompt enhancer 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-05-05 12:39:45 -04:00
Vladimir Mandic 5971f67e4f fix cn steps 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-05-04 15:04:20 -04:00
Vladimir Mandic 7aa09957dc fix lllite 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-05-04 13:55:45 -04:00
Vladimir Mandic 7ebc3fe94c t2i-adapter 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-05-04 12:53:04 -04:00
Vladimir Mandic 25470e5524 fix sdxl-refiner workflow 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-05-04 12:12:09 -04:00
Disty0 f4dfe20bc1 Add sigmoid beta scheduler 2025-05-04 17:42:22 +03:00
Vladimir Mandic 0ef2249d55
Merge pull request #3903 from TsarFox/fix-vlm-api 
Add `system` field to `ReqVQA`
 2025-05-02 13:21:03 -04:00
Jakob L. Kreuze e6be2a6cdc
Add `system` field to `ReqVQA` 2025-05-02 11:13:29 -04:00
Vladimir Mandic 2db573e625 log gated access 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-05-01 12:56:07 -04:00
Disty0 dca11dd806 Add jxl to image extension lists 2025-05-01 16:02:50 +03:00
Disty0 5cb8bad576 IPEX fix diffusers hijacks 2025-04-30 22:35:52 +03:00
Vladimir Mandic a84b77d396 fix texture tiling 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-04-30 09:44:34 -04:00
Vladimir Mandic 473f394f97 fix save style 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-04-30 09:18:41 -04:00
Vladimir Mandic 57da399a1e fix api checkpoint list 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-04-29 17:20:29 -04:00
Vladimir Mandic 52b6111b23 cleanup and update todo 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-04-29 12:19:03 -04:00
Vladimir Mandic c6cc1476c6 add hidream-e1 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-04-29 10:08:51 -04:00
Vladimir Mandic ff649291b5 lint fixes 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-04-28 10:55:21 -04:00
Vladimir Mandic 1b341dd809 setting to enable/disable clip skip editing 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-04-28 09:44:51 -04:00
Vladimir Mandic 59bdec09dc refactor ui server restart 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-04-28 09:44:51 -04:00
Seunghoon Lee 854b49f7b4
remove redundant parts zluda fa 2025-04-28 13:52:24 +09:00
AI-Casanova d14b54efa3 Preliminary support for sd1.5/sdxl OMI lora 2025-04-27 16:53:22 -05:00
Vladimir Mandic 09eac2a748 set default task 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-04-27 12:01:29 -04:00
Vladimir Mandic 4d40e11312 fix sdxl-inpaint loader 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-04-27 09:21:38 -04:00
Vladimir Mandic 5b68979226 update option names 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-04-26 13:46:33 -04:00
Vladimir Mandic 5647d782f8 configurable restore metadata settings and params 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-04-26 10:45:49 -04:00
Vladimir Mandic 15ea60b569 redo flux2 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-04-26 10:45:49 -04:00
Disty0 131c9043f6 OpenVINO fix hetero device when CPU not selected 2025-04-26 04:12:22 +03:00
Vladimir Mandic cfcfa4e4d2 fix video vae selector 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-04-25 21:05:56 -04:00
Vladimir Mandic 8c37607b82 add histrory ui 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-04-25 13:51:58 -04:00
Vladimir Mandic 10fb362bdc server state history 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-04-25 12:25:30 -04:00
Disty0 e1c1b6c447 Update OpenVINO to 2025.1.0 and Torch to 2.7 2025-04-25 17:21:21 +03:00
Vladimir Mandic f00824e7b5 add SD_LORA_DUMP 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-04-25 09:54:43 -04:00
Disty0 43a5cfba79 NNCF use .to instead of .type 2025-04-25 16:16:08 +03:00
Vladimir Mandic 2b4962182f fix model type 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-04-24 13:18:45 -04:00
Vladimir Mandic 06d5d498fc flex.2 control 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-04-24 13:04:50 -04:00
Vladimir Mandic 6608b9979f add base flex.2 support 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-04-24 10:18:18 -04:00
Disty0 c8cda80183 Fix PYTHONPATH on Linux 2025-04-24 00:25:27 +03:00
Disty0 778de4d295 NNCF do quant on GPU 2025-04-23 23:07:23 +03:00
Vladimir Mandic 789d7e8a52 pathsep typo 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-04-23 15:59:48 -04:00
Vladimir Mandic bcb7b24bf2 cleanup video tab 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-04-23 13:46:50 -04:00
Disty0 491ea6eea4 NNCF fix Conv layers remains in fp32 2025-04-23 19:04:43 +03:00
Disty0 75d169bc1c Fix NNCF Lora with model offload 2025-04-23 17:13:08 +03:00
Vladimir Mandic d9aa9674cd fix recursive wildcards 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-04-23 09:32:07 -04:00
Disty0 74d4093e74 NNCF disable quant conv by default 2025-04-23 16:31:27 +03:00
Vladimir Mandic 641e1e52b3 fix config save 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-04-23 09:10:53 -04:00
Disty0 f1d8543cae NNCF lora support 2025-04-23 15:44:09 +03:00
Disty0 9e133a5044 Cleanup 2025-04-23 04:16:24 +03:00
Disty0 7a9ddf52a3 Fix HiDream previews 2025-04-23 03:52:37 +03:00
Disty0 677bdd8611 HiDream fix prompt parser 2025-04-23 03:14:58 +03:00