1580158
/
automatic
mirror of https://github.com/vladmandic/automatic
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
11,243 Commits
3 Branches
29 Tags
109 MiB
Commit Graph

7327 Commits (10bbbed218458b8a899aac2140ec738d8d716f05)

Author SHA1 Message Date
Vladimir Mandic e8bec2823a css fonts update 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-07-25 14:55:24 -04:00
Vladimir Mandic a298173cf0 handle batch when saving images 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-07-25 13:13:32 -04:00
Vladimir Mandic b311bdf91e fix prompt encoding if prompts within batch have different segment counts 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-07-25 12:59:14 -04:00
Vladimir Mandic 0b8001c0fa prompt error handling 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-07-25 12:38:25 -04:00
Vladimir Mandic fd2dde9154 sorry 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-07-25 11:46:28 -04:00
Vladimir Mandic f90e8d7118 error handling 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-07-25 11:41:20 -04:00
Vladimir Mandic 97c537a9c2 fix metadata handler 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-07-25 08:35:01 -04:00
Vladimir Mandic 5179255ff7 lint 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-07-24 17:42:13 -04:00
Vladimir Mandic 17fbc96a8c detect invokeai metadata 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-07-24 17:35:52 -04:00
Vladimir Mandic 2656d3aa68 lint 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-07-24 15:42:29 -04:00
Vladimir Mandic fc0e0635b5 detailer add option to merge multiple results into composite mask 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-07-24 15:32:07 -04:00
Vladimir Mandic aed0086cb7 update styles and add simple gallery separator click option 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-07-24 12:48:03 -04:00
Vladimir Mandic 7365b2e632 unique ui labels 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-07-24 09:14:22 -04:00
Vladimir Mandic 32e1787b47 add bria-3.2 model support 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-07-23 12:10:52 -04:00
Disty0 444974a6ff cleanup 2025-07-23 19:02:44 +03:00
Disty0 7a08e1a7f2 SDNQ always use custom tensorwise fp8 matmul 2025-07-23 19:01:10 +03:00
Vladimir Mandic 094647b373 fix missing ui components 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-07-23 08:38:12 -04:00
Vladimir Mandic bf6ba07478 update css and lint 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-07-22 13:45:09 -04:00
Vladimir Mandic 143aa202e6 fix modernui txt2img sampler 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-07-22 13:21:31 -04:00
Vladimir Mandic 0602bedd13 fix modules merge 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-07-22 10:46:35 -04:00
Vladimir Mandic 41269b05c0 handle startup errors 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-07-22 10:19:30 -04:00
Vladimir Mandic 36c356785e modernui updates 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-07-22 10:07:17 -04:00
Vladimir Mandic 159a5c9fac linting 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-07-21 19:24:20 -04:00
Vladimir Mandic f243c35892 improve traceback display 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-07-21 19:07:35 -04:00
Vladimir Mandic 0cc48bb429 improve details model parser 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-07-21 13:42:16 -04:00
Vladimir Mandic 23a4e6f97f cleanup 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-07-21 11:15:15 -04:00
Vladimir Mandic a852d1cea9 add detailer expert mode 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-07-21 10:39:19 -04:00
Vladimir Mandic 287c3600d7 torch compile for llm 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-07-20 12:07:30 -04:00
Vladimir Mandic ea0b84ffc0 group offloading (experimental) 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-07-20 09:33:02 -04:00
Disty0 25a4731a97 SDNQ use static compile 2025-07-20 16:25:57 +03:00
Vladimir Mandic 27ce0dea9a torch.compile use repeated blocks 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-07-20 08:44:25 -04:00
Vladimir Mandic 7d91f7e662 process batch warn and continue 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-07-20 07:33:42 -04:00
Vladimir Mandic 3bf31eb4fd linting 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-07-19 11:33:16 -04:00
Vladimir Mandic 74d3f0bdd5 integrate nudenet 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-07-19 11:17:10 -04:00
Vladimir Mandic e576ea4319 cn always generate blended processed image 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-07-18 18:19:56 -04:00
Vladimir Mandic 1b36607bce restore pipeline before hires 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-07-18 17:55:45 -04:00
Vladimir Mandic 4ef0a4d5a1 fix styles logging 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-07-18 10:46:20 -04:00
Vladimir Mandic da90c0c7ff reduce memory leak on control unit change 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-07-18 09:50:36 -04:00
Vladimir Mandic ee57eb6b45 fix control handling of init images 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-07-18 07:31:59 -04:00
Vladimir Mandic efd86ef901 fix styles logging 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-07-18 07:13:05 -04:00
Vladimir Mandic b61118ffc8 detect comfyui metadata 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-07-17 09:02:23 -04:00
Vladimir Mandic 89ec1c09db improve git error logging 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-07-17 08:18:52 -04:00
Vladimir Mandic 54bdf011ed more linting and update diffusers 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-07-16 13:12:40 -04:00
Vladimir Mandic 17b8fcd902 lint fixes 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-07-16 12:59:40 -04:00
Vladimir Mandic 85fedbaf12 add styles debug 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-07-16 12:54:22 -04:00
Vladimir Mandic ed7e150051 fix control batch-input processing 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-07-16 12:45:29 -04:00
Vladimir Mandic e2a443c885 control xyz support 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-07-16 12:07:43 -04:00
Vladimir Mandic 878fda65ab refactor control processing 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-07-16 11:04:48 -04:00
Vladimir Mandic cd84cfec11 xyzgrid with control tab 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-07-15 14:35:27 -04:00
Vladimir Mandic a77975165c fix xyz with control enabled 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-07-15 09:11:54 -04:00
Vladimir Mandic 251c919c51 auto-handle sampler flow detection 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-07-14 22:07:39 -04:00
Vladimir Mandic 935a4a0aa3 add wan 2.1 text-to-image 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-07-14 13:47:14 -04:00
Vladimir Mandic 79d0fb81af fix inpainting 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-07-14 09:11:17 -04:00
Disty0 655c74da73 Add post load quant support to video 2025-07-14 16:01:13 +03:00
Vladimir Mandic 84df2f8ce6 force gc at processing end 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-07-14 08:59:42 -04:00
Vladimir Mandic 0f2f164245 add smollm3, add auraflow-0.2, enable taesd for auraflox 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-07-14 07:24:20 -04:00
Disty0 30af1f8fb0 Use inference_context with SDNQ 2025-07-14 13:07:44 +03:00
Disty0 3087b8d8cd Do not ignore offload with FramePack 2025-07-13 20:41:55 +03:00
Vladimir Mandic 4e449ca9b2 refactor monolithic shared.py and separate legacy options with logging 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-07-12 13:35:41 -04:00
Vladimir Mandic 4cec2db9a3 allow resize non-pil 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-07-12 09:44:42 -04:00
Vladimir Mandic 98afdd0a8a add freepix f-lite 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-07-11 13:19:29 -04:00
Vladimir Mandic 118a84813c fix directml by locking torch and transformers versions 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-07-11 10:39:35 -04:00
Vladimir Mandic 97de8ee5bf fix flux download 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-07-10 17:54:42 -04:00
Vladimir Mandic 286924c00a update 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-07-10 17:48:21 -04:00
Vladimir Mandic 25c56c2bde fixed omnigen flowmatch scheduler 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-07-10 17:44:30 -04:00
Vladimir Mandic c7ef692563 replace boundry with boundary 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-07-10 14:26:16 -04:00
Vladimir Mandic b1dfe19a37 fix omnigen2 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-07-10 14:19:35 -04:00
Vladimir Mandic 091bbd7bc6 video tab redesign and optimized ltxvideo 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-07-10 11:43:44 -04:00
Vladimir Mandic 8062345874 linting 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-07-09 18:19:20 -04:00
Vladimir Mandic 3f5ab15f64 ltx-conditioned prototype 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-07-09 18:11:51 -04:00
Vladimir Mandic feca1c653f video ui update with modernui support 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-07-09 11:54:58 -04:00
Vladimir Mandic 71a18dcf74 update precommit hooks 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-07-08 16:16:08 -04:00
Vladimir Mandic c559e26616 add builtin framepack 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-07-08 15:47:07 -04:00
Vladimir Mandic 9700cc765d cleanup gen infotext 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-07-07 20:09:19 -04:00
Vladimir Mandic e6d97f4d44 monkeypatch numpy for gradio 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-07-07 19:45:30 -04:00
Vladimir Mandic b625884031 add gemma3n to caption/vlm and promptenhance 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-07-07 10:01:02 -04:00
Vladimir Mandic 9246f447df fix resize visibility 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-07-06 22:13:42 -04:00
Vladimir Mandic a12f8cbc8d improve infotext param parsing 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-07-06 17:31:21 -04:00
Vladimir Mandic 4dc56c6813 allow styles to modify settings and improve parser 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-07-06 16:42:29 -04:00
Vladimir Mandic 6246047963 fix hypernetwork dir 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-07-06 15:43:28 -04:00
Vladimir Mandic ed1e59464e update requirements 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-07-06 14:53:25 -04:00
Vladimir Mandic b2a52a146b fix ansi controle output and add model locking 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-07-06 12:50:09 -04:00
Vladimir Mandic 8dc5dac308 add face-yolo8m 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-07-06 11:47:27 -04:00
Disty0 148b011692 IPEX fix bicubic upsample with torchvision 2025-07-06 18:19:55 +03:00
Disty0 526976eb64
Merge pull request #4019 from vladmandic/master 
PixelArt
 2025-07-06 14:19:19 +03:00
Disty0 d5d857aa96 Add sharpen filter to pixelart 2025-07-06 03:17:54 +03:00
Disty0 e255d89fd8 Add PixelArt filter to postprocess 2025-07-06 02:30:55 +03:00
Vladimir Mandic 68708b6b8f refactor codeformer 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-07-05 18:33:55 -04:00
Vladimir Mandic edefa8cb14 improve extensions compatibility 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-07-05 17:42:13 -04:00
Vladimir Mandic d688514d0d set taesd as default preview type 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-07-05 17:30:54 -04:00
Vladimir Mandic 8c676d0a61 lint formatting 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-07-05 17:13:31 -04:00
Vladimir Mandic a5b77b8ee2 remove dead code 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-07-05 16:47:25 -04:00
Vladimir Mandic 748ec564ad fix invalid model name on initial install 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-07-05 16:00:34 -04:00
Vladimir Mandic e8b5ea3847 major refactor: remove backend original 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-07-05 13:16:46 -04:00
Vladimir Mandic f408e5f315 major refactor: remove backend original 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-07-05 13:16:37 -04:00
Vladimir Mandic 2b9056179d add lbm background replace with relightining 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-07-04 15:33:16 -04:00
Disty0 4aeb9f004c Cleanup layerwise 2025-07-04 06:12:25 +03:00
Disty0 9d5571f4f8 Use layerwise casting with Flux FP8 models 2025-07-04 04:26:43 +03:00
Disty0 1a3b6e3b9c Handle all in one flux safetensors with auto quant mode 2025-07-04 02:35:54 +03:00
Disty0 fe9a3b8506 Add device map support to Flux and Chroma and add custom UNet support to Chroma 2025-07-04 02:22:42 +03:00
Disty0 f257cc2b40 Enable TAESD and Remote VAE for HunyuanDiT 2025-07-04 00:11:46 +03:00
Disty0 cf90e5621a Add _skip_layerwise_casting_patterns to SDNQ skip list 2025-07-04 00:04:01 +03:00
Disty0 07a443c196 Fix auth check with Flux from single file 2025-07-03 23:47:41 +03:00
Vladimir Mandic 49c9a450f4 support manually downloaded diffuser models 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-07-03 15:52:54 -04:00
Enes Sadık Özbek 9b82288fea
Fix xhinker padding for Chroma 2025-07-03 18:17:16 +03:00
Disty0 22e24b267c Update pillow jxl plugin 2025-07-03 17:48:52 +03:00
Enes Sadık Özbek e3beea1864
Fix colliding hashes for direct download diffusers models 2025-07-03 17:24:21 +03:00
Vladimir Mandic c4d9338d2e major refactoring of modules 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-07-03 09:18:38 -04:00
Vladimir Mandic 9b38a5dc58 add kontext inpainting 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-07-02 08:14:47 -04:00
Disty0 3406083d14 Override lumina2 to use diffusers lora loading 2025-07-02 06:40:27 +03:00
Vladimir Mandic 7736382028 major requirements refactor 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-07-01 13:12:21 -04:00
Vladimir Mandic 4c43c1cc5e update cuda max memory limit 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-06-30 16:49:43 -04:00
Vladimir Mandic 5d2f5dd6e7 fix typo 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-06-30 08:28:11 -04:00
Enes Sadık Özbek f3d6245511
Fix not applying text encoders of LoRAs on prompts which caused the related LoRAs to load 2025-06-29 22:20:31 +03:00
Vladimir Mandic 198382c027 cleanup 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-06-29 12:58:54 -04:00
Vladimir Mandic ff103bc849 fix LoRA change detection on pipeline type change 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-06-29 12:52:37 -04:00
Vladimir Mandic 1b4e1ff0ef enable quants for vlm-captioning 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-06-29 11:48:05 -04:00
Disty0 99f323d105 Fix Linfusiong with quantization / compile 2025-06-29 18:17:05 +03:00
Disty0 bcea748d56 Omnigen 2 use LuminaFeedForward from diffusers 2025-06-28 18:35:57 +03:00
Vladimir Mandic 7fbac675fe api update default sampler 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-06-28 09:36:33 -04:00
Vladimir Mandic 69f71cc32a update nunchaku 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-06-28 07:50:35 -04:00
Disty0 ba45de1a08 Remove empty file 2025-06-28 14:14:50 +03:00
Disty0 1d9fe88528 Cleanup 2025-06-28 14:05:51 +03:00
Disty0 cb2fa7e1b4 Omnigen2 use SDPA 2025-06-28 14:02:15 +03:00
Disty0 ab8b9b0eab Cleanup Omnigen 2 2025-06-28 13:53:37 +03:00
Vladimir Mandic bff75f0db3 add omnigen2 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-06-27 20:20:43 -04:00
Vladimir Mandic 533aa04bbd improve taesd live preview downscaling 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-06-27 18:16:32 -04:00
Vladimir Mandic 1d8551788a update changelog and cleanup samplers 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-06-27 17:02:25 -04:00
Disty0 71f7474de2 Unify quant options 2025-06-27 21:05:14 +03:00
Disty0 3b8ced444c Add auto quantization mode 2025-06-27 18:54:15 +03:00
Vladimir Mandic 15cbffeb97 cleanup 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-06-27 09:52:31 -04:00
Vladimir Mandic 78330142ae add moondream2, sdnq xyzgrid timing info 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-06-27 09:41:32 -04:00
Vladimir Mandic f9480a1047 add --trace for trace-logging and suppress empty torch logging 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-06-27 09:04:32 -04:00
Vladimir Mandic 518015d0d1 fix lumina2 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-06-27 08:30:25 -04:00
Vladimir Mandic 1147f9ec56 add flux.1-kontext-dev 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-06-26 17:09:53 -04:00
Vladimir Mandic d6a8d2b173 cleanup 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-06-26 15:00:27 -04:00
Vladimir Mandic 46387d0c01 cleanup chroma 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-06-26 14:48:17 -04:00
Disty0 0e4d712f27 Chroma fixes 2025-06-26 21:25:50 +03:00
Vladimir Mandic d5a74d4a4a
Merge branch 'dev' into feature/chroma-support 2025-06-26 13:06:31 -04:00
Vladimir Mandic ada38d57b4 add nvidia-cosmos-predict-2 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-06-26 12:21:43 -04:00
Disty0 61e949c1cc Update OpenVINO to 2025.2.0 2025-06-26 18:33:04 +03:00
Enes Sadık Özbek e91208bea9
Merge branch 'dev' into feature/chroma-support 2025-06-26 17:02:00 +03:00
Vladimir Mandic 2714d29993 fix unapply texture tiling 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-06-26 09:30:15 -04:00
Vladimir Mandic 931650c43f fix process batch 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-06-26 09:17:10 -04:00
Vladimir Mandic 82aaff9d70 gallery trace file fetch 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-06-26 07:59:51 -04:00
Vladimir Mandic 4de160608e fix prompt parser with batch size 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-06-26 07:47:03 -04:00
Vladimir Mandic 7380c08f8e lint fix 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-06-26 06:51:59 -04:00
Disty0 0f6eb624c9 Use llm_int8_skip_modules with bnb 2025-06-26 03:10:26 +03:00
Disty0 dc8fd006b2 Add modules_to_not_convert to pre-mode quants 2025-06-26 02:47:10 +03:00
Vladimir Mandic c254c8c1ec fix hypertile for img2img and inpaint operations 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-06-25 19:14:46 -04:00
Enes Sadık Özbek fb0d354c4e
reuse f1 remote vae for chroma 2025-06-26 02:04:03 +03:00
Enes Sadık Özbek f040d67f64
another merge conflict 2025-06-26 01:58:09 +03:00
Enes Sadık Özbek 943b45fdb6
fix the previous merge conflict 2025-06-26 01:57:15 +03:00
Enes Sadık Özbek 21bdde12d3
Merge branch 'dev' into feature/chroma-support 2025-06-26 01:56:34 +03:00
Disty0 c25d15398f SDNQ pre-mode don't quant if weights_dtype == 'none' 2025-06-26 01:48:01 +03:00
Vladimir Mandic 2c629246d4
Merge branch 'dev' into fix-lycoris-wrong-errors 2025-06-25 18:45:04 -04:00
Vladimir Mandic 42b3e08e65 Control add setting to run hires with or without control 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-06-25 18:43:29 -04:00
Disty0 c9f49720c5 Cleanup 2025-06-25 23:37:41 +03:00
Disty0 e43d1d2ba7 SDNQ use strings as target_dtype 2025-06-25 23:25:49 +03:00
Disty0 81e55f0459 Fix SDNQ pre-mode 2025-06-25 22:58:40 +03:00
Vladimir Mandic f8977d2f01 add /sdapi/v1/controlnets api endpoint 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-06-25 15:54:43 -04:00
Vladimir Mandic 5b486a6ef1 sdnq add xyz grid support, improve offloading compatibility 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-06-25 15:32:37 -04:00
Vladimir Mandic 6c3f0dd43b add `SD_SAVE_DEBUG` env variable 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-06-25 11:23:39 -04:00
Vladimir Mandic 3d52e3fe9f add /sdapi/v1/lora endpoint 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-06-25 10:54:02 -04:00
Vladimir Mandic a5d784f073 fix delete file from main gallery view 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-06-25 10:30:59 -04:00
Vladimir Mandic b650618b27 fix params.txt 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-06-25 09:11:17 -04:00
Disty0 77db759d88 Cleanup 2025-06-24 13:15:31 +03:00
Disty0 eaa130463c Use Diffusers with OmniGen 2025-06-24 13:09:11 +03:00
Disty0 bbf986d3a5 Fix LTXVideo 2025-06-23 17:37:20 +03:00
Enes Sadık Özbek 4870605f4a
Update prompt_parser_xhinker.py 2025-06-23 13:41:49 +03:00
Enes Sadık Özbek 9238150a56
fix eos token not added correctly 2025-06-23 10:15:35 +00:00
Enes Sadık Özbek 71869a3181
xhinker improvements 2025-06-23 08:41:15 +00:00
Enes Sadık Özbek 405416871f
fix chroma teacache 2025-06-23 08:35:05 +00:00
Enes Sadık Özbek 106f6a9bc1
xhinker padding fixes 2025-06-23 02:18:50 +00:00
Enes Sadık Özbek 954138bfc1
add attention masks 2025-06-23 01:27:40 +00:00
Disty0 87e6d3f4fc SDNQ add modules_to_not_convert and don't quant _keep_in_fp32_modules layers in post mode 2025-06-20 20:41:11 +03:00
Disty0 4491d26a18 IPEX fix fp64 hijack 2025-06-19 22:55:28 +03:00
Disty0 7fc7797a1d SDNQ fix group size calc on odd shapes 2025-06-19 11:36:41 +03:00
Disty0 ff5d7977a9 Fix Controlnet pipeline check on set atten 2025-06-18 19:35:57 +03:00
Disty0 2c4850cc2b Log more info with SDNQ 2025-06-18 18:03:46 +03:00
Disty0 86cd272b96 SDNQ fix Dora 2025-06-18 16:24:42 +03:00
Enes Sadık Özbek 7025ac8c36
Merge branch 'dev' into feature/chroma-support 2025-06-18 10:08:38 +03:00
Enes Sadık Özbek 4b3ce06916
Initial support for Chroma 2025-06-18 00:38:17 +00:00
Disty0 e657cf790d SDNQ fix int8 matmul with qwen 2025-06-18 02:12:34 +03:00
Disty0 71c2714edf Cleanup 2025-06-17 20:04:15 +03:00
Disty0 d8aaffbc27 IPEX fix DPM2++ FlowMatch 2025-06-17 19:58:20 +03:00
Disty0 26800a1ef9 Cleanup sdnq 2025-06-17 02:05:13 +03:00
Disty0 bddd091300 Custom VAE loading support for Lumina 2 2025-06-16 22:34:02 +03:00
Disty0 319af31d25 Custom UNet loading support for Lumina 2 2025-06-16 13:28:30 +03:00
Disty0 892dd456f7 Fix Nunchaku 2025-06-16 02:43:49 +03:00
Disty0 4fa48e4084 Use te hijcak for with lumina 2 2025-06-15 22:19:56 +03:00
Disty0 a7811da267 Teacache support for Lumina 2 2025-06-15 22:07:58 +03:00
Disty0 d31df8c1eb SDNQ fuse bias into dequantizer with matmul 2025-06-14 22:10:10 +03:00
Disty0 25fc0094a9 SDNQ use quantize_device and return_device args and fix decompress_fp32 always being on 2025-06-14 21:29:08 +03:00
Disty0 24194201cf Fix OmniGen 2025-06-14 19:55:43 +03:00
Disty0 c01802d9ff SDNQ fix transformers llm 2025-06-14 01:13:51 +03:00
Disty0 8f8e5ce1b0 Cleanup x2 2025-06-14 01:08:25 +03:00
Disty0 2ba64abcde Cleanup 2025-06-14 00:54:18 +03:00
Disty0 45827a923f IPEX fix torch.cuda.set_device 2025-06-13 16:20:21 +03:00
Disty0 90e76b2023 Cleanup 2025-06-13 13:42:13 +03:00
Disty0 fb7280c3f4 Flux quanto fix logged dtype 2025-06-13 13:40:44 +03:00
Disty0 1fca565178 Cleanup 2025-06-13 13:37:12 +03:00
Disty0 e68f9272e8 Disable custom atten processors for non SD 1.5 / SDXL models 2025-06-13 13:05:46 +03:00
Disty0 cb4684cbeb SNDQ add separate quant mode option for Text Encoders 2025-06-13 12:42:57 +03:00
Disty0 c8f947827b IPEX fix Lumina2 2025-06-12 19:46:05 +03:00
Disty0 41f14df8f5 Fix TAESD and double downloading with Lumina2 2025-06-12 14:17:36 +03:00
Disty0 5e013fb154 SDNQ optimize input quantization and use the word quantize instead of compress 2025-06-12 12:06:57 +03:00
Disty0 2d05396b4e SDNQ simplify sym scale formula 2025-06-12 02:26:04 +03:00
Disty0 26545b6483 Add warning for incompatible attention processors 2025-06-11 21:59:59 +03:00
Disty0 dd84fb541f Always set sdpa params 2025-06-11 21:43:48 +03:00
Disty0 5cefa64a60 SDNQ update accepted dtypes 2025-06-11 20:58:54 +03:00
Disty0 74b6edf2df revert gfx1101 2025-06-11 19:25:05 +03:00
Disty0 6aa5c08fb0 Cleanup and update changelog 2025-06-11 16:03:33 +03:00
Disty0 71be3c7d45 ROCm don't override gfx with gfx1100 and gfx1101 + rocm 6.4 2025-06-11 15:47:25 +03:00
Disty0 df6b13ea47 Don't set gfx override with RX 9000 and above 2025-06-11 15:09:03 +03:00
Disty0 c81b712ddb Make VAE options not require model reload 2025-06-10 15:56:19 +03:00
Disty0 78f99abec8 SDNQ use group_size / 2 for convs 2025-06-10 15:29:24 +03:00
Disty0 33fadf946b SDNQ add 7 bit support 2025-06-10 11:33:06 +03:00
Disty0 5bd7a08877 don't use inplace ops in quant layer 2025-06-10 03:29:07 +03:00
Disty0 5eed9135e3 Split SDNQ into multiple files and linting 2025-06-10 03:18:25 +03:00
Disty0 58b646e7f2 SDNQ add 5-bit and 3-bit quantization support 2025-06-10 01:48:51 +03:00
Disty0 bd2d9d1677 Python 3.13 support 2025-06-09 22:58:08 +03:00
Disty0 8e08ef0edc Fix VAE Tiling with non-default tile sizes 2025-06-07 01:25:08 +03:00
Enes Sadık Özbek 3868a9184b
Fix incorrectly reported lycoris load error 2025-06-07 00:36:08 +03:00
Disty0 2f7aff5250 Fix TAESD previews with PixArt 2025-06-06 19:43:00 +03:00
Disty0 5624671191 Fix PixArt Sigma Small and Large 2025-06-06 19:25:26 +03:00
Disty0 089e437708 Don't set attention processors with models outside of SD 1.5 and SDXL 2025-06-06 18:53:57 +03:00
Disty0 c039ba90f6 Fix Meissonic by adding multiple generator support 2025-06-06 18:02:49 +03:00
Disty0 7679028c1a Override CPU to use FP32 by default 2025-06-06 15:33:51 +03:00
Disty0 2ccc76ab91 Increase medvram mode to 12 GB and update wiki 2025-06-06 15:27:30 +03:00
Disty0 9a54efda9b Cleanup 2025-06-06 01:55:35 +03:00
Disty0 06fcc3cf85 SDNQ add quantized matmul support for Conv1d and Conv3d too 2025-06-06 00:19:54 +03:00
Disty0 976f0ba61f Cleanup 2025-06-05 20:59:58 +03:00
Disty0 413cf54cb6 Update changelog 2025-06-05 18:11:36 +03:00
Disty0 8c03f78197 Fix bias is None 2025-06-05 14:37:00 +03:00
Disty0 1a00517338 SDNQ FP8 matmul support for Conv2d 2025-06-05 14:32:26 +03:00
Disty0 9b55ffe449 SDNQ fix VAE x2 2025-06-05 14:17:59 +03:00
Disty0 ad2a4ad616 Cleanup 2025-06-05 13:38:04 +03:00
Disty0 e25890bb1d SDNQ INT8 matmul support for Conv2d 2025-06-05 13:36:49 +03:00
Disty0 c7fb5b1690 SDNQ fix VAE quant 2025-06-05 13:24:02 +03:00
Disty0 ce3a6e27fa SDNQ use channelwise only quant 2025-06-03 12:30:19 +03:00
Disty0 79ec23dd9d SDNQ override conv dtype 2025-06-03 02:37:29 +03:00
Disty0 e9ff242e03 SDNQ add group size support for convs 2025-06-03 02:16:52 +03:00
Disty0 6f637f41cc Use tensorwise fp8 matmul with torch < 2.5 2025-06-02 23:28:49 +03:00
Disty0 3f3a986c0e SDNQ fix scale staying in fp32 with tensorwise fp8 matmul 2025-06-02 23:18:28 +03:00
Disty0 4e3795a0a5 SDNQ fix packed int8 matmul 2025-06-02 03:31:51 +03:00
Disty0 82f5634d53 SDNQ use torch.bool for uint1 2025-06-02 01:39:51 +03:00
Disty0 ea7fe3bb73 OpenVINO update dtype_mapping 2025-06-02 01:11:41 +03:00
Disty0 e8588c91ea SDNQ enable matmul support for float8_e5m2 2025-06-02 00:53:10 +03:00
Disty0 8f1a1d7311 SDNQ expand quantized_matmul_dtypes for CPU 2025-06-02 00:28:29 +03:00
Disty0 b146025a5e SDNQ add int2 2025-06-02 00:17:39 +03:00
Disty0 9669b36010 SDNQ fix older PyTorch with FP8 matmul 2025-06-01 23:29:16 +03:00
Disty0 acefa58834 SDNQ don't force fp32 with fp8 tensorwise matmul 2025-06-01 23:16:00 +03:00
Disty0 839295f79a Add fp8 fnuz to sdnq options 2025-06-01 23:10:08 +03:00
Disty0 539fae3234 Update naming 2025-06-01 21:01:56 +03:00
Disty0 cefe460052 SDNQ skip FP8 matmul for input len < 32 2025-05-31 01:27:59 +03:00
Disty0 046840c8be Fix HiDream sampling 2025-05-31 00:52:56 +03:00
Disty0 109c0d7e49 SDNQ use tensorwise FP8 matmul on CPU 2025-05-30 21:09:53 +03:00
Disty0 959b759721 Cleanup 2025-05-30 16:45:59 +03:00
Disty0 b5d588fa45 SDNQ remove unnecessary bitwise ands 2025-05-30 16:29:59 +03:00
Disty0 db816d7088 Cleanup 2025-05-30 16:02:26 +03:00
Disty0 c85cc6b397 SDNQ enable quant with GPU by default and don't do unnecessary clones 2025-05-30 15:21:29 +03:00
Disty0 4654acde3c SDNQ re-enable memory fix for diffusers 2025-05-30 14:59:45 +03:00
Disty0 87a801e24d SDNQ remove memory fix hijack 2025-05-30 13:54:49 +03:00
Disty0 f81cb22c00 SDNQ fix new transformers 2025-05-30 13:32:03 +03:00
Disty0 36febda6e6 SDNQ update supported dtypes 2025-05-30 13:07:23 +03:00
Disty0 29bd2af779 SDNQ add 6-bit support 2025-05-30 12:20:13 +03:00
Vladimir Mandic 98a11fc86c fix gallery duplicate entries 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-05-30 11:04:56 +02:00
Disty0 d1491962d9 One bit 2025-05-30 05:41:02 +03:00
Disty0 3c8be0f55f SDNQ add uint2 2025-05-30 04:47:29 +03:00
Disty0 599224d392 SDNQ reduce 5 reshape ops to 2 with quantized input 2025-05-30 01:31:41 +03:00
Disty0 d8dea9031f SDNQ do FP8 matmul shape check only once 2025-05-30 01:13:37 +03:00
Disty0 b4e615e760 SDNQ add FP8 row wise scaling workaround for SM89 on Windows 2025-05-30 00:16:54 +03:00
Disty0 54154cf698 Cleanup 2025-05-29 20:22:49 +03:00
Disty0 90324f9c8c SDNQ fix lora with quant matmul 2025-05-29 18:25:12 +03:00
Disty0 df8b31fcfc Don't downcast scale with fp8 matmul 2025-05-29 16:35:40 +03:00
Disty0 2351efb8f7 Remove redundant shape check 2025-05-29 14:58:00 +03:00
Disty0 14893b7617 Don't make the weights contiguous with int8 matmul 2025-05-29 03:43:57 +03:00
Disty0 2cc5a58b0f Update changelog 2025-05-29 03:26:47 +03:00
Disty0 67e0f4d833 Cleanup 2025-05-29 03:22:40 +03:00
Disty0 3698f8bb84 SDNQ add experimental FP8 matmul 2025-05-29 03:11:59 +03:00
Disty0 dd33c4d583 Fix scale and zero_point not being moved by tensor.to 2025-05-28 17:46:06 +03:00
Disty0 dd0dbc476f SDNQ fix asym quant formula for dtypes with non zero minimums 2025-05-28 17:25:38 +03:00
Disty0 e06cbea7aa Cleanup 2025-05-28 15:55:08 +03:00
Disty0 d8e8f47ce5 SDNQ add an option to toggle quantize with GPU 2025-05-28 15:18:39 +03:00
Disty0 1961e88c13 Set SDPA as the default on all backends and enable Dyn SDPA on ROCm, DML, CPU and MPS 2025-05-28 13:42:29 +03:00
Disty0 569e9099d7 Use torch.amax instead of torch.max 2025-05-28 12:44:07 +03:00
Disty0 0b564e2373 Cleanup 2025-05-28 04:07:45 +03:00
Disty0 1433dfe3de SDNQ fix high RAM usage with pre mode 2025-05-28 03:16:29 +03:00
Disty0 4ed15f5cce SDNQ revert device_map = gpu 2025-05-27 23:32:58 +03:00
Disty0 d3e3fb98b0 Don't override user set device_map 2025-05-27 21:45:52 +03:00
Disty0 b1b29e9001 SDNQ disable device_map = gpu with TE and LLM 2025-05-27 21:32:32 +03:00
Disty0 b724cd7c57 Update changelog 2025-05-27 21:21:42 +03:00
Disty0 5d3c1832b2 SDNQ add FP8 quants 2025-05-27 20:29:15 +03:00
Disty0 3618e39cff SDNQ use device_map = gpu 2025-05-27 19:46:30 +03:00
Disty0 73999ac710 Add soft gc to nncf quant layer 2025-05-27 16:24:04 +03:00
Disty0 e94128a02e SDNQ add force torch_gc to pre load mode 2025-05-27 16:11:04 +03:00
Disty0 dece497f10 Refactor SDNQ to use weights_dtype and rename decompress_int8_matmul to use_quantized_matmul 2025-05-27 15:49:21 +03:00
Disty0 79bb348927 SDNQ sort quant schemes by recommended order 2025-05-27 13:06:17 +03:00
Disty0 dec460e665 SDNQ use torch.bitwise ops instead of python 2025-05-27 03:02:36 +03:00
Disty0 280be31883 SDNQ fix Lora change 2025-05-27 00:08:32 +03:00
Disty0 4d9c2a8608 Cleanup 2025-05-26 22:41:12 +03:00
Disty0 84ddfb2868 SDNQ fix lora apply 2025-05-26 22:39:20 +03:00
Disty0 6dee9f5ac7 Fix HiDream teacache not reseting 2025-05-26 21:21:01 +03:00
Disty0 742cd61d1f Add TeaCache for HiDream 2025-05-26 19:59:43 +03:00
Disty0 687c50dcc8 SDNQ fix Lora 2025-05-26 19:48:45 +03:00
Disty0 ccf9deaf28 Move SDNQ to the top of the settings list 2025-05-26 18:30:50 +03:00
Disty0 02f15b28cc Cleanup 2025-05-26 15:57:17 +03:00
Disty0 91bb07f650 SDNQ remove unused args and simplify decompressors 2025-05-26 15:51:53 +03:00
Disty0 d2159af10e cleanup 2025-05-26 04:24:28 +03:00
Disty0 4ad404182d cleanup 2025-05-26 04:17:22 +03:00
Disty0 46e9a9a631 IPEX disable Dynamic Attention by default on PyTorch 2.7 2025-05-26 03:03:17 +03:00
Disty0 4453efee76 Rename NNCF to SDNQ and rename quant schemes 2025-05-26 02:39:51 +03:00
Disty0 9c2e15433e NNCF set required_packages to None 2025-05-26 01:39:09 +03:00
Disty0 cbc1bfe710 Cleanup 2025-05-26 01:24:06 +03:00
Disty0 2d79380bd7 NNCF implement better layer hijacks and remove all NNCF imports 2025-05-26 01:12:28 +03:00
Vladimir Mandic af3a44ccbe optional skimage 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-05-24 08:58:04 +02:00
Disty0 85f00f9edb Enable dyn atten by default for ROCm 2025-05-23 18:24:50 +03:00
Disty0 3d8390de9b IPEX return devices.dtype instead of bf16 2025-05-18 04:44:51 +03:00
Disty0 d0e6f01286 IPEX remove GradScaler and use torch.amp instead 2025-05-18 04:39:48 +03:00
Disty0 a009e17d2b NNCF use per token input quantization with int8 matmul 2025-05-17 19:46:47 +03:00
Disty0 219970d47d Add Anisora 5B RL 2025-05-16 12:00:54 +03:00
Disty0 8487b5f263 Add Anisora 5B 2025-05-15 23:21:39 +03:00
Disty0 cf716e1c97 NNCF fix CogVideo 2025-05-15 22:51:35 +03:00
Vladimir Mandic c371ec91b4 fix nncf with controlnet 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-05-15 15:26:55 -04:00
Disty0 0ab28a6106 IPEX fix cogvideo 2025-05-15 22:08:50 +03:00
Vladimir Mandic 4157336238 rename vae 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-05-15 08:59:49 -04:00
Vladimir Mandic 39135c1d0a ui-defaults match correct prompt component 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-05-15 08:51:03 -04:00
Vladimir Mandic 5c0e3b635c update diffusers and lint/changelog/todo 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-05-14 13:30:52 -04:00
Seunghoon Lee 8330052d19
zluda 3.9.5 & torch 2.7.0 2025-05-14 13:22:26 +09:00
Disty0 18c10883b8 Move NNCF above in the settings list 2025-05-14 05:19:11 +03:00
Vladimir Mandic 8473bae0fc 1000 papercuts 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-05-13 21:51:33 -04:00
Disty0 115d81cc8c NNCF change zero_point formula and use torch.addcmul on decompress_asym 2025-05-14 00:58:33 +03:00
Disty0 361e952a64 Cleanup 2025-05-14 00:14:24 +03:00
Vladimir Mandic f07c2e6117 nncf-lint 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-05-13 12:35:33 -04:00
Vladimir Mandic bfda37903c update nncf linting and changelog 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-05-13 12:11:10 -04:00
Disty0 4e4557d81c NNCF set min matmul shape to 32 2025-05-13 18:50:23 +03:00
Disty0 b9ad55857d NNCF INT8 MatMul don't force FP32 with FP16 scales 2025-05-13 05:08:22 +03:00
Disty0 129c701b3d NNCF use torch.compile directly on int8_matmul instead of sub functions 2025-05-13 04:28:37 +03:00
Disty0 f1eefe97a4 NNCF use inplace ops 2025-05-13 03:49:30 +03:00
Vladimir Mandic 47862fef08 prompt enhance nsfw allow/disallow 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-05-12 20:33:16 -04:00
Disty0 98ccce68a1
Merge branch 'master' into master 2025-05-13 03:28:51 +03:00
chrismuzyn 299d189276 When using the openvino backend, do not look for an nvidia gpu. 2025-05-12 19:14:26 -04:00
Disty0 f4e3a81a84 NNCF experimental direct INT8 MatMul support 2025-05-12 21:41:49 +03:00
Vladimir Mandic 91080f349f latent-diffusion-upscale n-steps 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-05-12 11:12:36 -04:00
Vladimir Mandic a6e6c6ce5e support sdxl packaged without vae 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-05-11 14:49:27 -04:00
Disty0 4eedeab9f8 NNCF use group size instead of number of groups and set default group size for int4 to 64 2025-05-11 20:38:01 +03:00
Disty0 03d05b6243 NNCF fix very large number of groups 2025-05-11 18:43:19 +03:00
Disty0 9cfdc3c079 Remove NNCF device hijack 2025-05-11 18:30:10 +03:00
Disty0 0673689d5b NNCF set the default group size to 128 for INT4 2025-05-11 08:45:27 +03:00
Disty0 4af570bfd4 Cleanup 2025-05-11 08:10:13 +03:00
Disty0 8d27d34969 NNCF don't clip the zero_point 2025-05-11 07:57:51 +03:00
Disty0 98308fa187 NNCF fix group size calculation 2025-05-11 07:08:21 +03:00
Disty0 020e1aa374 Cleanup 2025-05-11 06:56:36 +03:00
Disty0 03a6d7f9bf NNCF add number of quantization groups 2025-05-11 05:55:58 +03:00
Vladimir Mandic 6036ff2105 modernui framepack and history tabs 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-05-10 10:21:37 -04:00
Vladimir Mandic aa04dd900a fix modernui disabled 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-05-10 08:53:30 -04:00
Vladimir Mandic f0d81ee1e0 cleanup 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-05-10 08:28:19 -04:00
Seunghoon Lee 6d2b5fc37c
Merge pull request #3921 from alexsarmiento/patch-1 
Update fwd_prefill.py
 2025-05-10 11:47:26 +09:00
Disty0 a1491a660c Cleanup 2025-05-09 23:36:50 +03:00
Disty0 1ee9832e05 NNCF silence the pytorch version warning 2025-05-09 23:16:55 +03:00
Disty0 b0e5a6c4df Add devices.has_triton() and enable NNCF compile if triton is available 2025-05-09 22:24:36 +03:00
AS 399a630778
Merge branch 'dev' into patch-1 2025-05-09 11:18:25 -07:00
Disty0 a4d4462e2a NNCF add decompress using toch.compile option 2025-05-09 21:02:24 +03:00
Seunghoon Lee 45c0bd6ec6
basic windows native pytorch support 2025-05-09 22:23:07 +09:00
Vladimir Mandic 51716bbaba update diffusers 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-05-09 09:04:21 -04:00
Vladimir Mandic 808462fdab update changelog 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-05-09 08:18:40 -04:00
Seunghoon Lee a27abf7363
zluda fix old cards 2025-05-09 20:02:45 +09:00
Disty0 9b641becd5 IPEX fix torch.compile with tensor.to 2025-05-09 11:07:51 +03:00
Seunghoon Lee 18f58e13f8
Update fwd_prefill.py 2025-05-09 13:36:01 +09:00
Vladimir Mandic 9e18d2f658
Merge branch 'dev' into patch-1 2025-05-08 23:21:24 -04:00
AS 5e561560ea
Update fwd_prefill.py 
Remove cudagraph from triton autotune. Buggy under zluda
 2025-05-08 19:32:51 -07:00
Vladimir Mandic 6489e4c37d prompt-enhance api support and img2img support 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-05-08 15:31:07 -04:00
Vladimir Mandic 55b1cb8c8b lower default teacache threshold 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-05-08 10:14:15 -04:00
Vladimir Mandic 432a5977a7 adetailer fix enable-disable 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-05-08 10:10:43 -04:00
Disty0 f3aa3b4574 NNCF remove T5 hijack from pre quant mode 2025-05-08 14:11:19 +03:00
Disty0 dfebc909eb Disable cuDNN benchmark on ROCm and add cudnn_benchmark_limit option 2025-05-08 13:27:06 +03:00
Vladimir Mandic 8433f685e7 clear-cache on model unload 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-05-07 20:22:30 -04:00
Disty0 b6d2aa7fd8 NNCF more optimizations 2025-05-07 21:50:31 +03:00
Disty0 a57c7087b8 Make NNCF INT4 quant run 75% faster and don't force fp32 decompress 2025-05-07 20:34:07 +03:00
Vladimir Mandic 5261c55890 fix lora legacy disabled 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-05-07 11:48:21 -04:00
Vladimir Mandic 78e22350b9 add api get-checkpoint 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-05-07 10:31:06 -04:00
Seunghoon Lee 2a4eb86d10
zluda 3.9.4 & update flash attention 2 2025-05-07 00:39:40 +09:00
Vladimir Mandic 83fc68ece3 update requirements 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-05-06 09:47:13 -04:00
Vladimir Mandic 02fd0aee06 fix control refiner 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-05-06 09:06:50 -04:00
Vladimir Mandic 1da43e4f62 api b64 error handler 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-05-05 22:28:03 -04:00
Vladimir Mandic 66b2505422 fix cmdargs 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-05-05 16:52:01 -04:00
Vladimir Mandic d12cfdb537 add vlm prompt enhancer 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-05-05 12:39:45 -04:00
Vladimir Mandic 5971f67e4f fix cn steps 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-05-04 15:04:20 -04:00
Vladimir Mandic 7aa09957dc fix lllite 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-05-04 13:55:45 -04:00
Vladimir Mandic 7ebc3fe94c t2i-adapter 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-05-04 12:53:04 -04:00
Vladimir Mandic 25470e5524 fix sdxl-refiner workflow 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-05-04 12:12:09 -04:00
Disty0 f4dfe20bc1 Add sigmoid beta scheduler 2025-05-04 17:42:22 +03:00
Vladimir Mandic 0ef2249d55
Merge pull request #3903 from TsarFox/fix-vlm-api 
Add `system` field to `ReqVQA`
 2025-05-02 13:21:03 -04:00
Jakob L. Kreuze e6be2a6cdc
Add `system` field to `ReqVQA` 2025-05-02 11:13:29 -04:00
Vladimir Mandic 2db573e625 log gated access 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-05-01 12:56:07 -04:00
Disty0 dca11dd806 Add jxl to image extension lists 2025-05-01 16:02:50 +03:00
Disty0 5cb8bad576 IPEX fix diffusers hijacks 2025-04-30 22:35:52 +03:00
Vladimir Mandic a84b77d396 fix texture tiling 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-04-30 09:44:34 -04:00
Vladimir Mandic 473f394f97 fix save style 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-04-30 09:18:41 -04:00
Vladimir Mandic 57da399a1e fix api checkpoint list 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-04-29 17:20:29 -04:00
Vladimir Mandic 52b6111b23 cleanup and update todo 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-04-29 12:19:03 -04:00
Vladimir Mandic c6cc1476c6 add hidream-e1 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-04-29 10:08:51 -04:00
Vladimir Mandic ff649291b5 lint fixes 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-04-28 10:55:21 -04:00
Vladimir Mandic 1b341dd809 setting to enable/disable clip skip editing 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-04-28 09:44:51 -04:00
Vladimir Mandic 59bdec09dc refactor ui server restart 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-04-28 09:44:51 -04:00
Seunghoon Lee 854b49f7b4
remove redundant parts zluda fa 2025-04-28 13:52:24 +09:00
AI-Casanova d14b54efa3 Preliminary support for sd1.5/sdxl OMI lora 2025-04-27 16:53:22 -05:00
Vladimir Mandic 09eac2a748 set default task 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-04-27 12:01:29 -04:00
Vladimir Mandic 4d40e11312 fix sdxl-inpaint loader 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-04-27 09:21:38 -04:00
Vladimir Mandic 5b68979226 update option names 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-04-26 13:46:33 -04:00
Vladimir Mandic 5647d782f8 configurable restore metadata settings and params 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-04-26 10:45:49 -04:00
Vladimir Mandic 15ea60b569 redo flux2 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-04-26 10:45:49 -04:00
Disty0 131c9043f6 OpenVINO fix hetero device when CPU not selected 2025-04-26 04:12:22 +03:00
Vladimir Mandic cfcfa4e4d2 fix video vae selector 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-04-25 21:05:56 -04:00
Vladimir Mandic 8c37607b82 add histrory ui 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-04-25 13:51:58 -04:00
Vladimir Mandic 10fb362bdc server state history 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-04-25 12:25:30 -04:00
Disty0 e1c1b6c447 Update OpenVINO to 2025.1.0 and Torch to 2.7 2025-04-25 17:21:21 +03:00
Vladimir Mandic f00824e7b5 add SD_LORA_DUMP 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-04-25 09:54:43 -04:00
Disty0 43a5cfba79 NNCF use .to instead of .type 2025-04-25 16:16:08 +03:00
Vladimir Mandic 2b4962182f fix model type 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-04-24 13:18:45 -04:00
Vladimir Mandic 06d5d498fc flex.2 control 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-04-24 13:04:50 -04:00
Vladimir Mandic 6608b9979f add base flex.2 support 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-04-24 10:18:18 -04:00
Disty0 c8cda80183 Fix PYTHONPATH on Linux 2025-04-24 00:25:27 +03:00
Disty0 778de4d295 NNCF do quant on GPU 2025-04-23 23:07:23 +03:00
Vladimir Mandic 789d7e8a52 pathsep typo 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-04-23 15:59:48 -04:00
Vladimir Mandic bcb7b24bf2 cleanup video tab 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-04-23 13:46:50 -04:00
Disty0 491ea6eea4 NNCF fix Conv layers remains in fp32 2025-04-23 19:04:43 +03:00
Disty0 75d169bc1c Fix NNCF Lora with model offload 2025-04-23 17:13:08 +03:00
Vladimir Mandic d9aa9674cd fix recursive wildcards 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-04-23 09:32:07 -04:00
Disty0 74d4093e74 NNCF disable quant conv by default 2025-04-23 16:31:27 +03:00
Vladimir Mandic 641e1e52b3 fix config save 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-04-23 09:10:53 -04:00
Disty0 f1d8543cae NNCF lora support 2025-04-23 15:44:09 +03:00
Disty0 9e133a5044 Cleanup 2025-04-23 04:16:24 +03:00
Disty0 7a9ddf52a3 Fix HiDream previews 2025-04-23 03:52:37 +03:00
Disty0 677bdd8611 HiDream fix prompt parser 2025-04-23 03:14:58 +03:00
Disty0 16935ec08b NNCF pre-load fix HiDream LLM quant 2025-04-23 02:52:46 +03:00
Disty0 bb0329f54f Update and refactor NNCF and add more quant options 2025-04-23 02:03:30 +03:00
Vladimir Mandic 710870f92c validate model-vs-pipeline 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-04-22 13:36:06 -04:00
Vladimir Mandic 9cc3f2f2f0 fix video 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-04-22 11:40:30 -04:00
Vladimir Mandic a9969491ff fix hidream loader 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-04-22 11:04:35 -04:00
Disty0 13c3f070e8 Cleanup 2025-04-22 04:51:25 +03:00
Disty0 2264d8087b Pre-load support for NNCF 2025-04-22 04:35:36 +03:00
Vladimir Mandic 4533acdd21 update memmon 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-04-21 20:20:04 -04:00
Vladimir Mandic 0fe0707cdd add lodestone-chroma 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-04-21 19:29:09 -04:00
Vladimir Mandic 487ded74ee update changelog 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-04-20 20:01:04 -04:00
Disty0 4c5cbde1f5 Make ROCm listen to the gc config and set the minimum gc threshold to 1 2025-04-21 01:53:07 +03:00
Vladimir Mandic de3cb6b85f interpolate pure-torch 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-04-20 14:29:39 -04:00
Vladimir Mandic 3b39a5b5a4 framepack state management 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-04-20 11:21:27 -04:00
Disty0 434bb660ce Move post load quant functions to a single function in model_quant 2025-04-20 17:04:25 +03:00
Seunghoon Lee bd0f906c88
zluda use cdll 2025-04-19 15:37:50 +09:00
Seunghoon Lee d5b3662e21
onnx 2025-04-19 13:54:45 +09:00
Seunghoon Lee 712530341a
fix onnx 2025-04-19 13:25:05 +09:00
Vladimir Mandic 5347b5701d add wan21-flv2v-720p 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-04-18 17:42:36 -04:00
Vladimir Mandic d3203253ad add hf auth checks for flux and sd35 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-04-18 17:22:05 -04:00
Vladimir Mandic 80a6b3aafc fix installer nightly 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-04-18 13:21:13 -04:00
Vladimir Mandic 75756ac6ea add new ltx 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-04-18 08:32:41 -04:00
Vladimir Mandic 8d6c7510c2 fix lora 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-04-18 07:34:12 -04:00
Seunghoon Lee 6b66d09632
fix zluda hipblaslt logging 2025-04-18 11:52:36 +09:00
Vladimir Mandic cbef571f90 svdquant and others stuff 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-04-17 22:14:11 -04:00
Vladimir Mandic 1fd746c75e fix sd35-ipadapter 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-04-17 15:45:44 -04:00
Vladimir Mandic 75ebf1e196 hidream add llm info to metadata 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-04-17 14:44:37 -04:00
Vladimir Mandic eaf37055ba nunchaku lora support 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-04-17 11:45:37 -04:00
Disty0 e4c7aa75f7 Fix balanced offload offload post not activating 2025-04-16 22:52:30 +03:00
Disty0 a6ea26fb8d Use transformers QuantoConfig for TE and LLM 2025-04-16 19:16:35 +03:00
Disty0 68d1262836 Fix live previews with HiDream 2025-04-16 18:40:50 +03:00
Vladimir Mandic ebe62a30a6 lint fixes and update requirements 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-04-16 09:24:39 -04:00
Vladimir Mandic 38a3b62553 modularize hidream loader 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-04-16 09:11:43 -04:00
Vladimir Mandic 87defaac61 add lcm-flowmatch sampler and fix hunyuanvideo-i2v 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-04-16 07:29:41 -04:00
Vladimir Mandic 15f8e70e89 add nunchaku prototype 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-04-15 14:39:24 -04:00
Vladimir Mandic ee1a4c607d offload cleanup 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-04-15 10:06:34 -04:00
Disty0 1541a19d89 Offload the TE right away 2025-04-15 02:28:44 +03:00
Disty0 7a4848dada Fix NNCF not applying for TE only quant 2025-04-15 02:16:18 +03:00
Disty0 3564b34e0d Prompt cache support for HiDream 2025-04-15 00:59:46 +03:00
Vladimir Mandic b63afc80fa explicitly flag h1 as large model 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-04-14 10:25:31 -04:00
Vladimir Mandic 762be6e369 cleanup te hijack 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-04-14 10:16:16 -04:00
Vladimir Mandic 8f7a397a32 fix unipc-flowmatch 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-04-14 10:14:26 -04:00
Vladimir Mandic 59efc95e00 flux-cfgzero map autopipeline 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-04-14 10:03:33 -04:00
Vladimir Mandic a38f7cbca0 general te hijack 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-04-14 09:46:03 -04:00
Vladimir Mandic cf1606ea11 update diffusers 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-04-14 09:10:01 -04:00
Vladimir Mandic 76b5709f51 add unipc-flowmatch, cfgzero for hidream 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-04-14 08:50:01 -04:00
Vladimir Mandic 06f4879be9 fix logging 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-04-14 08:28:35 -04:00
Vladimir Mandic 94848cbc2b add native hf auth check 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-04-13 10:05:15 -04:00
Vladimir Mandic e9a31a92c9 hidream warn on gated model 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-04-13 09:53:25 -04:00
Vladimir Mandic 4aa17ca745 networks regex pattern(s) for skip-scan 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-04-13 09:10:11 -04:00
Vladimir Mandic a8abed125e xyz grid allow bool 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-04-13 08:39:31 -04:00
Vladimir Mandic 90415a7469 add cfgzero to additional pipelines 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-04-13 07:56:32 -04:00
Vladimir Mandic 9b82bf900e fix typo 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-04-13 07:25:47 -04:00
Vladimir Mandic 6f2891afbd add cfgzero for flux 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-04-12 19:20:27 -04:00
Vladimir Mandic 054a28d25a cleanup logging 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-04-12 18:07:17 -04:00
Vladimir Mandic d9a72be74c display reference models with subdued color 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-04-12 17:59:24 -04:00
Vladimir Mandic 7364bc364b cleanup cogview loader 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-04-12 17:36:51 -04:00
Vladimir Mandic fb48f5e60b hidream remote-vae 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-04-12 11:11:25 -04:00
Vladimir Mandic 6dd37753db hidream bump max-token-length from 128 to 256 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-04-12 09:24:38 -04:00
Vladimir Mandic 3533258980 hidream whitelist samplers 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-04-11 22:32:57 -04:00
Vladimir Mandic 0f595d4cc5 cleanup multiple model loaders 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-04-11 22:16:05 -04:00
Vladimir Mandic 78d8bfeba7 hidream allow custom llama 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-04-11 21:27:48 -04:00
Disty0 51c46339d6 IPEX fix Flux and HiDream 2025-04-11 22:17:18 +03:00
Vladimir Mandic 0439e5652d add shared.opts.device_map 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-04-11 14:53:42 -04:00
Disty0 72918eb94d Fix quanto needing to re-quant when moving to gpu 2025-04-11 21:50:06 +03:00
Disty0 8e567f3ab0 Fix and update TorchAO 2025-04-11 20:08:03 +03:00
Disty0 bd1d8d44dc Fix quanto with transformers 2025-04-11 19:15:23 +03:00
Vladimir Mandic 92af0036c6 add hidream 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-04-10 16:28:15 -04:00
Vladimir Mandic f2a4ef1eb0 loader basic gguf support 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-04-09 08:59:23 -04:00
Vladimir Mandic 984aa8ec55 lint fixes 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-04-08 16:31:51 -04:00
Vladimir Mandic 6ab59230ba update ui 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-04-08 15:22:08 -04:00
Vladimir Mandic 84fe068070 custom model loader 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-04-08 14:56:07 -04:00
Vladimir Mandic 26193b6c22 update changelog 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-04-08 07:52:10 -04:00
Vladimir Mandic b5e421018b fix prompt scheduling 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-04-08 07:46:25 -04:00
Disty0 748bdbf437 Update rocm flash attention repo with navi rotary fix 2025-04-08 00:15:57 +03:00
Vladimir Mandic 97df5869a4 update requirements 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-04-07 09:30:03 -04:00
Vladimir Mandic dc9a64d00b memmon detect gpu swapping 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-04-07 08:59:54 -04:00
Vladimir Mandic 84a24fb681 lora restore weights to orig device on apply 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-04-07 07:49:18 -04:00
Vladimir Mandic f414ea1139 set offload default 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-04-06 13:10:32 -04:00
Vladimir Mandic d30b1cb1c8 lora improvements 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-04-06 13:02:58 -04:00
Vladimir Mandic 000a689428 ui custom model loader 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-04-06 11:37:23 -04:00
Vladimir Mandic 85a961aa49 add cmdopt status 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-04-06 08:43:26 -04:00
Vladimir Mandic 95d055c191 live preview and progress polling now depend if page is visible 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-04-05 20:31:46 -04:00
Vladimir Mandic 228da75a2e add teacache 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-04-05 20:15:48 -04:00
Vladimir Mandic 8f95477ad2 add teacache for flux 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-04-05 12:58:00 -04:00
Vladimir Mandic d502e3510a add softfill pipeline 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-04-05 12:58:00 -04:00
Vladimir Mandic 538b81021c add generate context menu get server status 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-04-05 12:58:00 -04:00
Vladimir Mandic 263b841129 logging cleanup 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-04-05 12:58:00 -04:00
Seunghoon Lee 69ec66f58a
fix zluda-python.py 
closes #3857

Co-authored-by: ackhack <christoph.fuerbacher@gmail.com>
 2025-04-05 22:26:07 +09:00
Vladimir Mandic 68f3c203b1 remove non-blocking 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-04-04 15:49:50 -04:00
Vladimir Mandic ff4d57814e fix debug logging 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-04-04 09:14:48 -04:00
Vladimir Mandic 7520be4874 styles resize and bring quick-ui forward on hover 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-04-04 09:05:32 -04:00
Vladimir Mandic 1f446bc8ed progress use batch info 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-04-04 08:22:25 -04:00
Seunghoon Lee 64bc5cea6a
zluda triton add more gpus 2025-04-04 21:20:02 +09:00
Vladimir Mandic cd8357f1f4 add detailer renoise feature 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-04-03 21:12:58 -04:00
Vladimir Mandic ea0389162f check for init and call 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-04-03 19:23:33 -04:00
Vladimir Mandic 8725cfc488 lora obey device 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-04-03 14:31:39 -04:00
Vladimir Mandic a5f796a166 change field used for true cfg 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-04-03 10:24:55 -04:00
Vladimir Mandic 5c6c1465f4 fix style apply params 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-04-03 10:03:48 -04:00
Vladimir Mandic 5bdc87b68a fix server restart 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-04-03 08:22:43 -04:00
Vladimir Mandic 6c29c3fb4d edit built-in styles 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-04-03 07:04:59 -04:00
Seunghoon Lee 8e3ef40014
zluda llm/vlm temp fix 2025-04-02 23:19:41 +09:00
Vladimir Mandic 760b41e99f update requirements and changelog 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-04-02 09:33:09 -04:00
Vladimir Mandic 73cd4727e6 fix paste incorrect float to int cast 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-04-02 08:59:27 -04:00
Vladimir Mandic e5a256e74d prompt enhance add prefix and suffix 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-04-01 21:31:19 -04:00
Vladimir Mandic d3633be484 add job info to monitor stats 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-04-01 14:19:40 -04:00
Vladimir Mandic 17fbadb0e8 reset memory stats between runs 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-04-01 14:00:39 -04:00
Vladimir Mandic 6430f7006f add monitor cli option and finish lora refactor 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-04-01 13:39:47 -04:00
Vladimir Mandic c208175c0f fix flux partial quantization 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-04-01 13:39:47 -04:00
Vladimir Mandic b5031a5eba lora modularize code 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-04-01 13:39:47 -04:00
Vladimir Mandic 032bd46de2 improve mp4 download 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-04-01 13:39:47 -04:00
Vladimir Mandic 6b8299eac8 lora mpt4 preview support 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-04-01 13:39:47 -04:00
Vladimir Mandic 5906eb6792 lora apply on gpu vs cpu settings option 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-04-01 13:39:47 -04:00
Seunghoon Lee 0eaa2c0378
rocm wsl better arch detection 2025-04-01 21:14:02 +09:00
Vladimir Mandic e8ae79cc49 hdr detect packed latents 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-03-31 13:59:46 -04:00
Seunghoon Lee f46ee37f3a
zluda log & install improvements 2025-03-31 22:50:25 +09:00
Vladimir Mandic f965e72515 fix nncf check 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-03-31 09:40:02 -04:00
Vladimir Mandic daec94a9e9 settings css improvements 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-03-30 15:39:44 -04:00
Vladimir Mandic def571dae9 fix settings save 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-03-30 15:29:18 -04:00
Vladimir Mandic a467e23d72 full ui-settings refactor 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-03-30 15:04:17 -04:00
Vladimir Mandic 1137297e3a fix latte1-t2v 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-03-29 13:43:53 -04:00
Vladimir Mandic 2cd89378bd styles change settings on-the-fly 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-03-29 12:54:48 -04:00
Vladimir Mandic ac61fce526 prompt enhance add censor detection and debugging 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-03-29 11:43:22 -04:00
Vladimir Mandic 02f480bf32 add prompt enhance wiki 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-03-29 09:55:56 -04:00
Vladimir Mandic 8014c6381d interpolate dont skip duplicate frames 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-03-28 21:31:52 -04:00
Vladimir Mandic 8343469be0 improve prompt enhancer and update apply styles 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-03-28 21:03:27 -04:00
Vladimir Mandic 720d8a8df6 improve video interpolation logging 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-03-28 20:37:09 -04:00
Vladimir Mandic 5ce834c362 fix missing quant options 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-03-28 14:50:37 -04:00
Vladimir Mandic f4fdd496b9 more granular quantization modules options 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-03-28 14:46:52 -04:00
Vladimir Mandic a6e8e88974 fix wan2.1-i2v 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-03-28 14:23:54 -04:00
Vladimir Mandic d1c3b97c65 add prompt enhance 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-03-28 14:05:28 -04:00
Vladimir Mandic 0d6301ff25 samplers add manual sigma adjustment 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-03-27 16:26:11 -04:00
Vladimir Mandic ecb6730838 fix sampler metadata when using default sampler 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-03-27 13:22:09 -04:00
Vladimir Mandic 2a18890235 update changelog and cleanup 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-03-27 11:53:03 -04:00
Vladimir Mandic 2c58d3b36c fastercache and pyramidattentionbroadcast 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-03-27 11:49:30 -04:00
Vladimir Mandic 068daa1e09 add manual module move for video models 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-03-27 09:13:10 -04:00
Vladimir Mandic 8bcc4527ea add vlm ByteDance/Sa2VA 1b and 4b 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-03-26 11:10:23 -04:00
Vladimir Mandic 6a5e253ecf add infiniteyou 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-03-26 10:50:09 -04:00
Seunghoon Lee d74e06cba3
zluda v3.9.2 2025-03-26 17:13:43 +09:00
Vladimir Mandic cd71fe51ff fix lora change with balanced offload 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-03-25 14:56:53 -04:00
Vladimir Mandic aa15ed1fa7 reapply offload after applying lora 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-03-25 14:09:34 -04:00
Vladimir Mandic c0a2ac9c23 update requirements 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-03-25 10:17:59 -04:00
Disty0 90f887ac4a Add dim checks to ck flash atten and fix dim check on dyn atten 2025-03-25 03:50:21 +03:00
Vladimir Mandic 7a84a5e8ef cleanup video code 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-03-24 19:17:44 -04:00
Vladimir Mandic 06b0abc4f4 fix token counter error style with modernui 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-03-24 18:08:33 -04:00
Vladimir Mandic 93b731e0cf add sana 1.5 support 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-03-24 17:27:48 -04:00
Seunghoon Lee 6b1d83d2e6
zluda catch attributeerror 2025-03-24 21:20:51 +09:00
Vladimir Mandic ec488d2a36 cleanup 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-03-23 14:34:55 -04:00
Vladimir Mandic d4c8de99f5 cleanup 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-03-23 14:26:57 -04:00
Vladimir Mandic d7bab01df0 update video 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-03-23 13:19:12 -04:00
Vladimir Mandic 2c77a16195 video updates 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-03-22 10:34:04 -04:00
Seunghoon Lee ab9e87d848
zluda flash attention 2 via triton 2025-03-22 23:10:59 +09:00
Vladimir Mandic 85bda171f4 update video notes and todo 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-03-22 09:26:05 -04:00
Seunghoon Lee 8fdcc5711c
zluda fix bug 2025-03-22 11:37:43 +09:00
Vladimir Mandic c9391d67eb video tab modernui layout 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-03-21 21:17:41 -04:00
Vladimir Mandic 990822c69c fix video model change logic 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-03-21 18:55:33 -04:00
Vladimir Mandic 8930d1dcb0 fix video-i2v 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-03-21 18:22:00 -04:00
Vladimir Mandic 46bc0834b1 video tab major update 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-03-21 14:53:52 -04:00
Vladimir Mandic b2432db88e fix wan and add latte 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-03-21 09:39:05 -04:00
Seunghoon Lee e5f6250153
fix zluda nightly 2025-03-21 17:42:35 +09:00
Seunghoon Lee 2a077414bc
zluda experimental torch.compile 2025-03-21 14:56:58 +09:00
Vladimir Mandic c358006987 add wan21 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-03-20 14:48:41 -04:00
Vladimir Mandic 1b51f32251 update changelog 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-03-20 14:39:38 -04:00
Vladimir Mandic 5c46904fd8 video tab alpha releasee 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-03-20 14:39:38 -04:00
Vladimir Mandic 79a5391e47 video unified component loader 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-03-20 14:39:38 -04:00