1580158
/
automatic
mirror of https://github.com/vladmandic/automatic
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
11,243 Commits
3 Branches
29 Tags
109 MiB
Commit Graph

7327 Commits (10bbbed218458b8a899aac2140ec738d8d716f05)

Author SHA1 Message Date
Disty0 b146025a5e SDNQ add int2 2025-06-02 00:17:39 +03:00
Disty0 9669b36010 SDNQ fix older PyTorch with FP8 matmul 2025-06-01 23:29:16 +03:00
Disty0 acefa58834 SDNQ don't force fp32 with fp8 tensorwise matmul 2025-06-01 23:16:00 +03:00
Disty0 839295f79a Add fp8 fnuz to sdnq options 2025-06-01 23:10:08 +03:00
Disty0 539fae3234 Update naming 2025-06-01 21:01:56 +03:00
Disty0 cefe460052 SDNQ skip FP8 matmul for input len < 32 2025-05-31 01:27:59 +03:00
Disty0 046840c8be Fix HiDream sampling 2025-05-31 00:52:56 +03:00
Disty0 109c0d7e49 SDNQ use tensorwise FP8 matmul on CPU 2025-05-30 21:09:53 +03:00
Disty0 959b759721 Cleanup 2025-05-30 16:45:59 +03:00
Disty0 b5d588fa45 SDNQ remove unnecessary bitwise ands 2025-05-30 16:29:59 +03:00
Disty0 db816d7088 Cleanup 2025-05-30 16:02:26 +03:00
Disty0 c85cc6b397 SDNQ enable quant with GPU by default and don't do unnecessary clones 2025-05-30 15:21:29 +03:00
Disty0 4654acde3c SDNQ re-enable memory fix for diffusers 2025-05-30 14:59:45 +03:00
Disty0 87a801e24d SDNQ remove memory fix hijack 2025-05-30 13:54:49 +03:00
Disty0 f81cb22c00 SDNQ fix new transformers 2025-05-30 13:32:03 +03:00
Disty0 36febda6e6 SDNQ update supported dtypes 2025-05-30 13:07:23 +03:00
Disty0 29bd2af779 SDNQ add 6-bit support 2025-05-30 12:20:13 +03:00
Vladimir Mandic 98a11fc86c fix gallery duplicate entries 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-05-30 11:04:56 +02:00
Disty0 d1491962d9 One bit 2025-05-30 05:41:02 +03:00
Disty0 3c8be0f55f SDNQ add uint2 2025-05-30 04:47:29 +03:00
Disty0 599224d392 SDNQ reduce 5 reshape ops to 2 with quantized input 2025-05-30 01:31:41 +03:00
Disty0 d8dea9031f SDNQ do FP8 matmul shape check only once 2025-05-30 01:13:37 +03:00
Disty0 b4e615e760 SDNQ add FP8 row wise scaling workaround for SM89 on Windows 2025-05-30 00:16:54 +03:00
Disty0 54154cf698 Cleanup 2025-05-29 20:22:49 +03:00
Disty0 90324f9c8c SDNQ fix lora with quant matmul 2025-05-29 18:25:12 +03:00
Disty0 df8b31fcfc Don't downcast scale with fp8 matmul 2025-05-29 16:35:40 +03:00
Disty0 2351efb8f7 Remove redundant shape check 2025-05-29 14:58:00 +03:00
Disty0 14893b7617 Don't make the weights contiguous with int8 matmul 2025-05-29 03:43:57 +03:00
Disty0 2cc5a58b0f Update changelog 2025-05-29 03:26:47 +03:00
Disty0 67e0f4d833 Cleanup 2025-05-29 03:22:40 +03:00
Disty0 3698f8bb84 SDNQ add experimental FP8 matmul 2025-05-29 03:11:59 +03:00
Disty0 dd33c4d583 Fix scale and zero_point not being moved by tensor.to 2025-05-28 17:46:06 +03:00
Disty0 dd0dbc476f SDNQ fix asym quant formula for dtypes with non zero minimums 2025-05-28 17:25:38 +03:00
Disty0 e06cbea7aa Cleanup 2025-05-28 15:55:08 +03:00
Disty0 d8e8f47ce5 SDNQ add an option to toggle quantize with GPU 2025-05-28 15:18:39 +03:00
Disty0 1961e88c13 Set SDPA as the default on all backends and enable Dyn SDPA on ROCm, DML, CPU and MPS 2025-05-28 13:42:29 +03:00
Disty0 569e9099d7 Use torch.amax instead of torch.max 2025-05-28 12:44:07 +03:00
Disty0 0b564e2373 Cleanup 2025-05-28 04:07:45 +03:00
Disty0 1433dfe3de SDNQ fix high RAM usage with pre mode 2025-05-28 03:16:29 +03:00
Disty0 4ed15f5cce SDNQ revert device_map = gpu 2025-05-27 23:32:58 +03:00
Disty0 d3e3fb98b0 Don't override user set device_map 2025-05-27 21:45:52 +03:00
Disty0 b1b29e9001 SDNQ disable device_map = gpu with TE and LLM 2025-05-27 21:32:32 +03:00
Disty0 b724cd7c57 Update changelog 2025-05-27 21:21:42 +03:00
Disty0 5d3c1832b2 SDNQ add FP8 quants 2025-05-27 20:29:15 +03:00
Disty0 3618e39cff SDNQ use device_map = gpu 2025-05-27 19:46:30 +03:00
Disty0 73999ac710 Add soft gc to nncf quant layer 2025-05-27 16:24:04 +03:00
Disty0 e94128a02e SDNQ add force torch_gc to pre load mode 2025-05-27 16:11:04 +03:00
Disty0 dece497f10 Refactor SDNQ to use weights_dtype and rename decompress_int8_matmul to use_quantized_matmul 2025-05-27 15:49:21 +03:00
Disty0 79bb348927 SDNQ sort quant schemes by recommended order 2025-05-27 13:06:17 +03:00
Disty0 dec460e665 SDNQ use torch.bitwise ops instead of python 2025-05-27 03:02:36 +03:00
Disty0 280be31883 SDNQ fix Lora change 2025-05-27 00:08:32 +03:00
Disty0 4d9c2a8608 Cleanup 2025-05-26 22:41:12 +03:00
Disty0 84ddfb2868 SDNQ fix lora apply 2025-05-26 22:39:20 +03:00
Disty0 6dee9f5ac7 Fix HiDream teacache not reseting 2025-05-26 21:21:01 +03:00
Disty0 742cd61d1f Add TeaCache for HiDream 2025-05-26 19:59:43 +03:00
Disty0 687c50dcc8 SDNQ fix Lora 2025-05-26 19:48:45 +03:00
Disty0 ccf9deaf28 Move SDNQ to the top of the settings list 2025-05-26 18:30:50 +03:00
Disty0 02f15b28cc Cleanup 2025-05-26 15:57:17 +03:00
Disty0 91bb07f650 SDNQ remove unused args and simplify decompressors 2025-05-26 15:51:53 +03:00
Disty0 d2159af10e cleanup 2025-05-26 04:24:28 +03:00
Disty0 4ad404182d cleanup 2025-05-26 04:17:22 +03:00
Disty0 46e9a9a631 IPEX disable Dynamic Attention by default on PyTorch 2.7 2025-05-26 03:03:17 +03:00
Disty0 4453efee76 Rename NNCF to SDNQ and rename quant schemes 2025-05-26 02:39:51 +03:00
Disty0 9c2e15433e NNCF set required_packages to None 2025-05-26 01:39:09 +03:00
Disty0 cbc1bfe710 Cleanup 2025-05-26 01:24:06 +03:00
Disty0 2d79380bd7 NNCF implement better layer hijacks and remove all NNCF imports 2025-05-26 01:12:28 +03:00
Vladimir Mandic af3a44ccbe optional skimage 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-05-24 08:58:04 +02:00
Disty0 85f00f9edb Enable dyn atten by default for ROCm 2025-05-23 18:24:50 +03:00
Disty0 3d8390de9b IPEX return devices.dtype instead of bf16 2025-05-18 04:44:51 +03:00
Disty0 d0e6f01286 IPEX remove GradScaler and use torch.amp instead 2025-05-18 04:39:48 +03:00
Disty0 a009e17d2b NNCF use per token input quantization with int8 matmul 2025-05-17 19:46:47 +03:00
Disty0 219970d47d Add Anisora 5B RL 2025-05-16 12:00:54 +03:00
Disty0 8487b5f263 Add Anisora 5B 2025-05-15 23:21:39 +03:00
Disty0 cf716e1c97 NNCF fix CogVideo 2025-05-15 22:51:35 +03:00
Vladimir Mandic c371ec91b4 fix nncf with controlnet 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-05-15 15:26:55 -04:00
Disty0 0ab28a6106 IPEX fix cogvideo 2025-05-15 22:08:50 +03:00
Vladimir Mandic 4157336238 rename vae 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-05-15 08:59:49 -04:00
Vladimir Mandic 39135c1d0a ui-defaults match correct prompt component 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-05-15 08:51:03 -04:00
Vladimir Mandic 5c0e3b635c update diffusers and lint/changelog/todo 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-05-14 13:30:52 -04:00
Seunghoon Lee 8330052d19
zluda 3.9.5 & torch 2.7.0 2025-05-14 13:22:26 +09:00
Disty0 18c10883b8 Move NNCF above in the settings list 2025-05-14 05:19:11 +03:00
Vladimir Mandic 8473bae0fc 1000 papercuts 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-05-13 21:51:33 -04:00
Disty0 115d81cc8c NNCF change zero_point formula and use torch.addcmul on decompress_asym 2025-05-14 00:58:33 +03:00
Disty0 361e952a64 Cleanup 2025-05-14 00:14:24 +03:00
Vladimir Mandic f07c2e6117 nncf-lint 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-05-13 12:35:33 -04:00
Vladimir Mandic bfda37903c update nncf linting and changelog 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-05-13 12:11:10 -04:00
Disty0 4e4557d81c NNCF set min matmul shape to 32 2025-05-13 18:50:23 +03:00
Disty0 b9ad55857d NNCF INT8 MatMul don't force FP32 with FP16 scales 2025-05-13 05:08:22 +03:00
Disty0 129c701b3d NNCF use torch.compile directly on int8_matmul instead of sub functions 2025-05-13 04:28:37 +03:00
Disty0 f1eefe97a4 NNCF use inplace ops 2025-05-13 03:49:30 +03:00
Vladimir Mandic 47862fef08 prompt enhance nsfw allow/disallow 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-05-12 20:33:16 -04:00
Disty0 98ccce68a1
Merge branch 'master' into master 2025-05-13 03:28:51 +03:00
chrismuzyn 299d189276 When using the openvino backend, do not look for an nvidia gpu. 2025-05-12 19:14:26 -04:00
Disty0 f4e3a81a84 NNCF experimental direct INT8 MatMul support 2025-05-12 21:41:49 +03:00
Vladimir Mandic 91080f349f latent-diffusion-upscale n-steps 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-05-12 11:12:36 -04:00
Vladimir Mandic a6e6c6ce5e support sdxl packaged without vae 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-05-11 14:49:27 -04:00
Disty0 4eedeab9f8 NNCF use group size instead of number of groups and set default group size for int4 to 64 2025-05-11 20:38:01 +03:00
Disty0 03d05b6243 NNCF fix very large number of groups 2025-05-11 18:43:19 +03:00
Disty0 9cfdc3c079 Remove NNCF device hijack 2025-05-11 18:30:10 +03:00
Disty0 0673689d5b NNCF set the default group size to 128 for INT4 2025-05-11 08:45:27 +03:00
Disty0 4af570bfd4 Cleanup 2025-05-11 08:10:13 +03:00
Disty0 8d27d34969 NNCF don't clip the zero_point 2025-05-11 07:57:51 +03:00
Disty0 98308fa187 NNCF fix group size calculation 2025-05-11 07:08:21 +03:00
Disty0 020e1aa374 Cleanup 2025-05-11 06:56:36 +03:00
Disty0 03a6d7f9bf NNCF add number of quantization groups 2025-05-11 05:55:58 +03:00
Vladimir Mandic 6036ff2105 modernui framepack and history tabs 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-05-10 10:21:37 -04:00
Vladimir Mandic aa04dd900a fix modernui disabled 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-05-10 08:53:30 -04:00
Vladimir Mandic f0d81ee1e0 cleanup 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-05-10 08:28:19 -04:00
Seunghoon Lee 6d2b5fc37c
Merge pull request #3921 from alexsarmiento/patch-1 
Update fwd_prefill.py
 2025-05-10 11:47:26 +09:00
Disty0 a1491a660c Cleanup 2025-05-09 23:36:50 +03:00
Disty0 1ee9832e05 NNCF silence the pytorch version warning 2025-05-09 23:16:55 +03:00
Disty0 b0e5a6c4df Add devices.has_triton() and enable NNCF compile if triton is available 2025-05-09 22:24:36 +03:00
AS 399a630778
Merge branch 'dev' into patch-1 2025-05-09 11:18:25 -07:00
Disty0 a4d4462e2a NNCF add decompress using toch.compile option 2025-05-09 21:02:24 +03:00
Seunghoon Lee 45c0bd6ec6
basic windows native pytorch support 2025-05-09 22:23:07 +09:00
Vladimir Mandic 51716bbaba update diffusers 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-05-09 09:04:21 -04:00
Vladimir Mandic 808462fdab update changelog 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-05-09 08:18:40 -04:00
Seunghoon Lee a27abf7363
zluda fix old cards 2025-05-09 20:02:45 +09:00
Disty0 9b641becd5 IPEX fix torch.compile with tensor.to 2025-05-09 11:07:51 +03:00
Seunghoon Lee 18f58e13f8
Update fwd_prefill.py 2025-05-09 13:36:01 +09:00
Vladimir Mandic 9e18d2f658
Merge branch 'dev' into patch-1 2025-05-08 23:21:24 -04:00
AS 5e561560ea
Update fwd_prefill.py 
Remove cudagraph from triton autotune. Buggy under zluda
 2025-05-08 19:32:51 -07:00
Vladimir Mandic 6489e4c37d prompt-enhance api support and img2img support 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-05-08 15:31:07 -04:00
Vladimir Mandic 55b1cb8c8b lower default teacache threshold 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-05-08 10:14:15 -04:00
Vladimir Mandic 432a5977a7 adetailer fix enable-disable 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-05-08 10:10:43 -04:00
Disty0 f3aa3b4574 NNCF remove T5 hijack from pre quant mode 2025-05-08 14:11:19 +03:00
Disty0 dfebc909eb Disable cuDNN benchmark on ROCm and add cudnn_benchmark_limit option 2025-05-08 13:27:06 +03:00
Vladimir Mandic 8433f685e7 clear-cache on model unload 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-05-07 20:22:30 -04:00
Disty0 b6d2aa7fd8 NNCF more optimizations 2025-05-07 21:50:31 +03:00
Disty0 a57c7087b8 Make NNCF INT4 quant run 75% faster and don't force fp32 decompress 2025-05-07 20:34:07 +03:00
Vladimir Mandic 5261c55890 fix lora legacy disabled 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-05-07 11:48:21 -04:00
Vladimir Mandic 78e22350b9 add api get-checkpoint 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-05-07 10:31:06 -04:00
Seunghoon Lee 2a4eb86d10
zluda 3.9.4 & update flash attention 2 2025-05-07 00:39:40 +09:00
Vladimir Mandic 83fc68ece3 update requirements 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-05-06 09:47:13 -04:00
Vladimir Mandic 02fd0aee06 fix control refiner 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-05-06 09:06:50 -04:00
Vladimir Mandic 1da43e4f62 api b64 error handler 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-05-05 22:28:03 -04:00
Vladimir Mandic 66b2505422 fix cmdargs 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-05-05 16:52:01 -04:00
Vladimir Mandic d12cfdb537 add vlm prompt enhancer 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-05-05 12:39:45 -04:00
Vladimir Mandic 5971f67e4f fix cn steps 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-05-04 15:04:20 -04:00
Vladimir Mandic 7aa09957dc fix lllite 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-05-04 13:55:45 -04:00
Vladimir Mandic 7ebc3fe94c t2i-adapter 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-05-04 12:53:04 -04:00
Vladimir Mandic 25470e5524 fix sdxl-refiner workflow 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-05-04 12:12:09 -04:00
Disty0 f4dfe20bc1 Add sigmoid beta scheduler 2025-05-04 17:42:22 +03:00
Vladimir Mandic 0ef2249d55
Merge pull request #3903 from TsarFox/fix-vlm-api 
Add `system` field to `ReqVQA`
 2025-05-02 13:21:03 -04:00
Jakob L. Kreuze e6be2a6cdc
Add `system` field to `ReqVQA` 2025-05-02 11:13:29 -04:00
Vladimir Mandic 2db573e625 log gated access 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-05-01 12:56:07 -04:00
Disty0 dca11dd806 Add jxl to image extension lists 2025-05-01 16:02:50 +03:00
Disty0 5cb8bad576 IPEX fix diffusers hijacks 2025-04-30 22:35:52 +03:00
Vladimir Mandic a84b77d396 fix texture tiling 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-04-30 09:44:34 -04:00
Vladimir Mandic 473f394f97 fix save style 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-04-30 09:18:41 -04:00
Vladimir Mandic 57da399a1e fix api checkpoint list 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-04-29 17:20:29 -04:00
Vladimir Mandic 52b6111b23 cleanup and update todo 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-04-29 12:19:03 -04:00
Vladimir Mandic c6cc1476c6 add hidream-e1 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-04-29 10:08:51 -04:00
Vladimir Mandic ff649291b5 lint fixes 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-04-28 10:55:21 -04:00
Vladimir Mandic 1b341dd809 setting to enable/disable clip skip editing 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-04-28 09:44:51 -04:00
Vladimir Mandic 59bdec09dc refactor ui server restart 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-04-28 09:44:51 -04:00
Seunghoon Lee 854b49f7b4
remove redundant parts zluda fa 2025-04-28 13:52:24 +09:00
AI-Casanova d14b54efa3 Preliminary support for sd1.5/sdxl OMI lora 2025-04-27 16:53:22 -05:00
Vladimir Mandic 09eac2a748 set default task 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-04-27 12:01:29 -04:00
Vladimir Mandic 4d40e11312 fix sdxl-inpaint loader 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-04-27 09:21:38 -04:00
Vladimir Mandic 5b68979226 update option names 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-04-26 13:46:33 -04:00
Vladimir Mandic 5647d782f8 configurable restore metadata settings and params 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-04-26 10:45:49 -04:00
Vladimir Mandic 15ea60b569 redo flux2 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-04-26 10:45:49 -04:00
Disty0 131c9043f6 OpenVINO fix hetero device when CPU not selected 2025-04-26 04:12:22 +03:00
Vladimir Mandic cfcfa4e4d2 fix video vae selector 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-04-25 21:05:56 -04:00
Vladimir Mandic 8c37607b82 add histrory ui 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-04-25 13:51:58 -04:00
Vladimir Mandic 10fb362bdc server state history 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-04-25 12:25:30 -04:00
Disty0 e1c1b6c447 Update OpenVINO to 2025.1.0 and Torch to 2.7 2025-04-25 17:21:21 +03:00
Vladimir Mandic f00824e7b5 add SD_LORA_DUMP 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-04-25 09:54:43 -04:00
Disty0 43a5cfba79 NNCF use .to instead of .type 2025-04-25 16:16:08 +03:00
Vladimir Mandic 2b4962182f fix model type 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-04-24 13:18:45 -04:00
Vladimir Mandic 06d5d498fc flex.2 control 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-04-24 13:04:50 -04:00
Vladimir Mandic 6608b9979f add base flex.2 support 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-04-24 10:18:18 -04:00
Disty0 c8cda80183 Fix PYTHONPATH on Linux 2025-04-24 00:25:27 +03:00
Disty0 778de4d295 NNCF do quant on GPU 2025-04-23 23:07:23 +03:00
Vladimir Mandic 789d7e8a52 pathsep typo 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-04-23 15:59:48 -04:00
Vladimir Mandic bcb7b24bf2 cleanup video tab 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-04-23 13:46:50 -04:00
Disty0 491ea6eea4 NNCF fix Conv layers remains in fp32 2025-04-23 19:04:43 +03:00
Disty0 75d169bc1c Fix NNCF Lora with model offload 2025-04-23 17:13:08 +03:00
Vladimir Mandic d9aa9674cd fix recursive wildcards 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-04-23 09:32:07 -04:00
Disty0 74d4093e74 NNCF disable quant conv by default 2025-04-23 16:31:27 +03:00
Vladimir Mandic 641e1e52b3 fix config save 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-04-23 09:10:53 -04:00
Disty0 f1d8543cae NNCF lora support 2025-04-23 15:44:09 +03:00
Disty0 9e133a5044 Cleanup 2025-04-23 04:16:24 +03:00
Disty0 7a9ddf52a3 Fix HiDream previews 2025-04-23 03:52:37 +03:00
Disty0 677bdd8611 HiDream fix prompt parser 2025-04-23 03:14:58 +03:00
Disty0 16935ec08b NNCF pre-load fix HiDream LLM quant 2025-04-23 02:52:46 +03:00
Disty0 bb0329f54f Update and refactor NNCF and add more quant options 2025-04-23 02:03:30 +03:00
Vladimir Mandic 710870f92c validate model-vs-pipeline 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-04-22 13:36:06 -04:00
Vladimir Mandic 9cc3f2f2f0 fix video 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-04-22 11:40:30 -04:00
Vladimir Mandic a9969491ff fix hidream loader 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-04-22 11:04:35 -04:00
Disty0 13c3f070e8 Cleanup 2025-04-22 04:51:25 +03:00
Disty0 2264d8087b Pre-load support for NNCF 2025-04-22 04:35:36 +03:00
Vladimir Mandic 4533acdd21 update memmon 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-04-21 20:20:04 -04:00
Vladimir Mandic 0fe0707cdd add lodestone-chroma 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-04-21 19:29:09 -04:00
Vladimir Mandic 487ded74ee update changelog 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-04-20 20:01:04 -04:00
Disty0 4c5cbde1f5 Make ROCm listen to the gc config and set the minimum gc threshold to 1 2025-04-21 01:53:07 +03:00
Vladimir Mandic de3cb6b85f interpolate pure-torch 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-04-20 14:29:39 -04:00
Vladimir Mandic 3b39a5b5a4 framepack state management 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-04-20 11:21:27 -04:00
Disty0 434bb660ce Move post load quant functions to a single function in model_quant 2025-04-20 17:04:25 +03:00
Seunghoon Lee bd0f906c88
zluda use cdll 2025-04-19 15:37:50 +09:00
Seunghoon Lee d5b3662e21
onnx 2025-04-19 13:54:45 +09:00
Seunghoon Lee 712530341a
fix onnx 2025-04-19 13:25:05 +09:00
Vladimir Mandic 5347b5701d add wan21-flv2v-720p 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-04-18 17:42:36 -04:00
Vladimir Mandic d3203253ad add hf auth checks for flux and sd35 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-04-18 17:22:05 -04:00
Vladimir Mandic 80a6b3aafc fix installer nightly 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-04-18 13:21:13 -04:00
Vladimir Mandic 75756ac6ea add new ltx 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-04-18 08:32:41 -04:00
Vladimir Mandic 8d6c7510c2 fix lora 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-04-18 07:34:12 -04:00
Seunghoon Lee 6b66d09632
fix zluda hipblaslt logging 2025-04-18 11:52:36 +09:00
Vladimir Mandic cbef571f90 svdquant and others stuff 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-04-17 22:14:11 -04:00
Vladimir Mandic 1fd746c75e fix sd35-ipadapter 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-04-17 15:45:44 -04:00
Vladimir Mandic 75ebf1e196 hidream add llm info to metadata 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-04-17 14:44:37 -04:00
Vladimir Mandic eaf37055ba nunchaku lora support 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-04-17 11:45:37 -04:00
Disty0 e4c7aa75f7 Fix balanced offload offload post not activating 2025-04-16 22:52:30 +03:00
Disty0 a6ea26fb8d Use transformers QuantoConfig for TE and LLM 2025-04-16 19:16:35 +03:00
Disty0 68d1262836 Fix live previews with HiDream 2025-04-16 18:40:50 +03:00
Vladimir Mandic ebe62a30a6 lint fixes and update requirements 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-04-16 09:24:39 -04:00
Vladimir Mandic 38a3b62553 modularize hidream loader 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-04-16 09:11:43 -04:00
Vladimir Mandic 87defaac61 add lcm-flowmatch sampler and fix hunyuanvideo-i2v 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-04-16 07:29:41 -04:00
Vladimir Mandic 15f8e70e89 add nunchaku prototype 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-04-15 14:39:24 -04:00
Vladimir Mandic ee1a4c607d offload cleanup 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-04-15 10:06:34 -04:00
Disty0 1541a19d89 Offload the TE right away 2025-04-15 02:28:44 +03:00
Disty0 7a4848dada Fix NNCF not applying for TE only quant 2025-04-15 02:16:18 +03:00
Disty0 3564b34e0d Prompt cache support for HiDream 2025-04-15 00:59:46 +03:00
Vladimir Mandic b63afc80fa explicitly flag h1 as large model 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-04-14 10:25:31 -04:00
Vladimir Mandic 762be6e369 cleanup te hijack 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-04-14 10:16:16 -04:00
Vladimir Mandic 8f7a397a32 fix unipc-flowmatch 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-04-14 10:14:26 -04:00
Vladimir Mandic 59efc95e00 flux-cfgzero map autopipeline 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-04-14 10:03:33 -04:00
Vladimir Mandic a38f7cbca0 general te hijack 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-04-14 09:46:03 -04:00
Vladimir Mandic cf1606ea11 update diffusers 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-04-14 09:10:01 -04:00
Vladimir Mandic 76b5709f51 add unipc-flowmatch, cfgzero for hidream 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-04-14 08:50:01 -04:00
Vladimir Mandic 06f4879be9 fix logging 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-04-14 08:28:35 -04:00
Vladimir Mandic 94848cbc2b add native hf auth check 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-04-13 10:05:15 -04:00
Vladimir Mandic e9a31a92c9 hidream warn on gated model 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-04-13 09:53:25 -04:00
Vladimir Mandic 4aa17ca745 networks regex pattern(s) for skip-scan 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-04-13 09:10:11 -04:00
Vladimir Mandic a8abed125e xyz grid allow bool 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-04-13 08:39:31 -04:00
Vladimir Mandic 90415a7469 add cfgzero to additional pipelines 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-04-13 07:56:32 -04:00
Vladimir Mandic 9b82bf900e fix typo 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-04-13 07:25:47 -04:00
Vladimir Mandic 6f2891afbd add cfgzero for flux 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-04-12 19:20:27 -04:00
Vladimir Mandic 054a28d25a cleanup logging 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-04-12 18:07:17 -04:00
Vladimir Mandic d9a72be74c display reference models with subdued color 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-04-12 17:59:24 -04:00
Vladimir Mandic 7364bc364b cleanup cogview loader 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-04-12 17:36:51 -04:00
Vladimir Mandic fb48f5e60b hidream remote-vae 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-04-12 11:11:25 -04:00
Vladimir Mandic 6dd37753db hidream bump max-token-length from 128 to 256 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-04-12 09:24:38 -04:00
Vladimir Mandic 3533258980 hidream whitelist samplers 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-04-11 22:32:57 -04:00
Vladimir Mandic 0f595d4cc5 cleanup multiple model loaders 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-04-11 22:16:05 -04:00
Vladimir Mandic 78d8bfeba7 hidream allow custom llama 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-04-11 21:27:48 -04:00
Disty0 51c46339d6 IPEX fix Flux and HiDream 2025-04-11 22:17:18 +03:00
Vladimir Mandic 0439e5652d add shared.opts.device_map 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-04-11 14:53:42 -04:00
Disty0 72918eb94d Fix quanto needing to re-quant when moving to gpu 2025-04-11 21:50:06 +03:00
Disty0 8e567f3ab0 Fix and update TorchAO 2025-04-11 20:08:03 +03:00
Disty0 bd1d8d44dc Fix quanto with transformers 2025-04-11 19:15:23 +03:00
Vladimir Mandic 92af0036c6 add hidream 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-04-10 16:28:15 -04:00
Vladimir Mandic f2a4ef1eb0 loader basic gguf support 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-04-09 08:59:23 -04:00
Vladimir Mandic 984aa8ec55 lint fixes 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-04-08 16:31:51 -04:00
Vladimir Mandic 6ab59230ba update ui 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-04-08 15:22:08 -04:00
Vladimir Mandic 84fe068070 custom model loader 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-04-08 14:56:07 -04:00
Vladimir Mandic 26193b6c22 update changelog 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-04-08 07:52:10 -04:00
Vladimir Mandic b5e421018b fix prompt scheduling 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-04-08 07:46:25 -04:00
Disty0 748bdbf437 Update rocm flash attention repo with navi rotary fix 2025-04-08 00:15:57 +03:00
Vladimir Mandic 97df5869a4 update requirements 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-04-07 09:30:03 -04:00
Vladimir Mandic dc9a64d00b memmon detect gpu swapping 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-04-07 08:59:54 -04:00
Vladimir Mandic 84a24fb681 lora restore weights to orig device on apply 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-04-07 07:49:18 -04:00
Vladimir Mandic f414ea1139 set offload default 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-04-06 13:10:32 -04:00
Vladimir Mandic d30b1cb1c8 lora improvements 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-04-06 13:02:58 -04:00
Vladimir Mandic 000a689428 ui custom model loader 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-04-06 11:37:23 -04:00
Vladimir Mandic 85a961aa49 add cmdopt status 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-04-06 08:43:26 -04:00
Vladimir Mandic 95d055c191 live preview and progress polling now depend if page is visible 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-04-05 20:31:46 -04:00
Vladimir Mandic 228da75a2e add teacache 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-04-05 20:15:48 -04:00
Vladimir Mandic 8f95477ad2 add teacache for flux 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-04-05 12:58:00 -04:00
Vladimir Mandic d502e3510a add softfill pipeline 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-04-05 12:58:00 -04:00
Vladimir Mandic 538b81021c add generate context menu get server status 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-04-05 12:58:00 -04:00
Vladimir Mandic 263b841129 logging cleanup 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-04-05 12:58:00 -04:00
Seunghoon Lee 69ec66f58a
fix zluda-python.py 
closes #3857

Co-authored-by: ackhack <christoph.fuerbacher@gmail.com>
 2025-04-05 22:26:07 +09:00
Vladimir Mandic 68f3c203b1 remove non-blocking 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-04-04 15:49:50 -04:00
Vladimir Mandic ff4d57814e fix debug logging 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-04-04 09:14:48 -04:00
Vladimir Mandic 7520be4874 styles resize and bring quick-ui forward on hover 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-04-04 09:05:32 -04:00
Vladimir Mandic 1f446bc8ed progress use batch info 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-04-04 08:22:25 -04:00
Seunghoon Lee 64bc5cea6a
zluda triton add more gpus 2025-04-04 21:20:02 +09:00
Vladimir Mandic cd8357f1f4 add detailer renoise feature 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-04-03 21:12:58 -04:00
Vladimir Mandic ea0389162f check for init and call 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-04-03 19:23:33 -04:00
Vladimir Mandic 8725cfc488 lora obey device 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-04-03 14:31:39 -04:00
Vladimir Mandic a5f796a166 change field used for true cfg 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-04-03 10:24:55 -04:00
Vladimir Mandic 5c6c1465f4 fix style apply params 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-04-03 10:03:48 -04:00
Vladimir Mandic 5bdc87b68a fix server restart 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-04-03 08:22:43 -04:00
Vladimir Mandic 6c29c3fb4d edit built-in styles 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-04-03 07:04:59 -04:00
Seunghoon Lee 8e3ef40014
zluda llm/vlm temp fix 2025-04-02 23:19:41 +09:00
Vladimir Mandic 760b41e99f update requirements and changelog 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-04-02 09:33:09 -04:00
Vladimir Mandic 73cd4727e6 fix paste incorrect float to int cast 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-04-02 08:59:27 -04:00
Vladimir Mandic e5a256e74d prompt enhance add prefix and suffix 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-04-01 21:31:19 -04:00
Vladimir Mandic d3633be484 add job info to monitor stats 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-04-01 14:19:40 -04:00
Vladimir Mandic 17fbadb0e8 reset memory stats between runs 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-04-01 14:00:39 -04:00
Vladimir Mandic 6430f7006f add monitor cli option and finish lora refactor 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-04-01 13:39:47 -04:00
Vladimir Mandic c208175c0f fix flux partial quantization 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-04-01 13:39:47 -04:00
Vladimir Mandic b5031a5eba lora modularize code 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-04-01 13:39:47 -04:00
Vladimir Mandic 032bd46de2 improve mp4 download 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-04-01 13:39:47 -04:00
Vladimir Mandic 6b8299eac8 lora mpt4 preview support 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-04-01 13:39:47 -04:00
Vladimir Mandic 5906eb6792 lora apply on gpu vs cpu settings option 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-04-01 13:39:47 -04:00
Seunghoon Lee 0eaa2c0378
rocm wsl better arch detection 2025-04-01 21:14:02 +09:00
Vladimir Mandic e8ae79cc49 hdr detect packed latents 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-03-31 13:59:46 -04:00
Seunghoon Lee f46ee37f3a
zluda log & install improvements 2025-03-31 22:50:25 +09:00
Vladimir Mandic f965e72515 fix nncf check 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-03-31 09:40:02 -04:00
Vladimir Mandic daec94a9e9 settings css improvements 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-03-30 15:39:44 -04:00
Vladimir Mandic def571dae9 fix settings save 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-03-30 15:29:18 -04:00
Vladimir Mandic a467e23d72 full ui-settings refactor 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-03-30 15:04:17 -04:00
Vladimir Mandic 1137297e3a fix latte1-t2v 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-03-29 13:43:53 -04:00
Vladimir Mandic 2cd89378bd styles change settings on-the-fly 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-03-29 12:54:48 -04:00
Vladimir Mandic ac61fce526 prompt enhance add censor detection and debugging 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-03-29 11:43:22 -04:00
Vladimir Mandic 02f480bf32 add prompt enhance wiki 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-03-29 09:55:56 -04:00
Vladimir Mandic 8014c6381d interpolate dont skip duplicate frames 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-03-28 21:31:52 -04:00
Vladimir Mandic 8343469be0 improve prompt enhancer and update apply styles 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-03-28 21:03:27 -04:00
Vladimir Mandic 720d8a8df6 improve video interpolation logging 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-03-28 20:37:09 -04:00
Vladimir Mandic 5ce834c362 fix missing quant options 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-03-28 14:50:37 -04:00
Vladimir Mandic f4fdd496b9 more granular quantization modules options 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-03-28 14:46:52 -04:00
Vladimir Mandic a6e8e88974 fix wan2.1-i2v 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-03-28 14:23:54 -04:00
Vladimir Mandic d1c3b97c65 add prompt enhance 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-03-28 14:05:28 -04:00
Vladimir Mandic 0d6301ff25 samplers add manual sigma adjustment 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-03-27 16:26:11 -04:00
Vladimir Mandic ecb6730838 fix sampler metadata when using default sampler 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-03-27 13:22:09 -04:00
Vladimir Mandic 2a18890235 update changelog and cleanup 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-03-27 11:53:03 -04:00
Vladimir Mandic 2c58d3b36c fastercache and pyramidattentionbroadcast 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-03-27 11:49:30 -04:00
Vladimir Mandic 068daa1e09 add manual module move for video models 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-03-27 09:13:10 -04:00
Vladimir Mandic 8bcc4527ea add vlm ByteDance/Sa2VA 1b and 4b 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-03-26 11:10:23 -04:00
Vladimir Mandic 6a5e253ecf add infiniteyou 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-03-26 10:50:09 -04:00
Seunghoon Lee d74e06cba3
zluda v3.9.2 2025-03-26 17:13:43 +09:00
Vladimir Mandic cd71fe51ff fix lora change with balanced offload 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-03-25 14:56:53 -04:00
Vladimir Mandic aa15ed1fa7 reapply offload after applying lora 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-03-25 14:09:34 -04:00
Vladimir Mandic c0a2ac9c23 update requirements 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-03-25 10:17:59 -04:00
Disty0 90f887ac4a Add dim checks to ck flash atten and fix dim check on dyn atten 2025-03-25 03:50:21 +03:00
Vladimir Mandic 7a84a5e8ef cleanup video code 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-03-24 19:17:44 -04:00
Vladimir Mandic 06b0abc4f4 fix token counter error style with modernui 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-03-24 18:08:33 -04:00
Vladimir Mandic 93b731e0cf add sana 1.5 support 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-03-24 17:27:48 -04:00
Seunghoon Lee 6b1d83d2e6
zluda catch attributeerror 2025-03-24 21:20:51 +09:00
Vladimir Mandic ec488d2a36 cleanup 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-03-23 14:34:55 -04:00
Vladimir Mandic d4c8de99f5 cleanup 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-03-23 14:26:57 -04:00
Vladimir Mandic d7bab01df0 update video 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-03-23 13:19:12 -04:00
Vladimir Mandic 2c77a16195 video updates 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-03-22 10:34:04 -04:00
Seunghoon Lee ab9e87d848
zluda flash attention 2 via triton 2025-03-22 23:10:59 +09:00
Vladimir Mandic 85bda171f4 update video notes and todo 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-03-22 09:26:05 -04:00
Seunghoon Lee 8fdcc5711c
zluda fix bug 2025-03-22 11:37:43 +09:00
Vladimir Mandic c9391d67eb video tab modernui layout 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-03-21 21:17:41 -04:00
Vladimir Mandic 990822c69c fix video model change logic 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-03-21 18:55:33 -04:00
Vladimir Mandic 8930d1dcb0 fix video-i2v 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-03-21 18:22:00 -04:00
Vladimir Mandic 46bc0834b1 video tab major update 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-03-21 14:53:52 -04:00
Vladimir Mandic b2432db88e fix wan and add latte 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-03-21 09:39:05 -04:00
Seunghoon Lee e5f6250153
fix zluda nightly 2025-03-21 17:42:35 +09:00
Seunghoon Lee 2a077414bc
zluda experimental torch.compile 2025-03-21 14:56:58 +09:00
Vladimir Mandic c358006987 add wan21 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-03-20 14:48:41 -04:00
Vladimir Mandic 1b51f32251 update changelog 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-03-20 14:39:38 -04:00
Vladimir Mandic 5c46904fd8 video tab alpha releasee 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-03-20 14:39:38 -04:00
Vladimir Mandic 79a5391e47 video unified component loader 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-03-20 14:39:38 -04:00
Vladimir Mandic 9bf6838962 update video tab 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-03-20 14:39:38 -04:00
Seunghoon Lee 135631bdea
zluda enable triton experimentally 2025-03-20 23:03:50 +09:00
Seunghoon Lee 878fb9f75b
zluda 3.9.1 2025-03-20 23:03:43 +09:00
Seunghoon Lee 0c890b50e0
proper zluda detection 2025-03-20 23:03:23 +09:00
Vladimir Mandic d5cfd61e50 fix sd35 with batch 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-03-19 10:49:45 -04:00
Disty0 1e0f512ccb ROCm disable FP16 for gfx1102 2025-03-19 15:42:36 +03:00
Vladimir Mandic 1569dc6d07 fix api-grid 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-03-19 08:37:44 -04:00
Vladimir Mandic a88f919cee continuing on video tab 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-03-18 19:18:46 -04:00
Vladimir Mandic c5c3be04fb video tab first prototype 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-03-18 18:40:08 -04:00
Vladimir Mandic d8044136b9 prototype video tab 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-03-17 22:29:03 -04:00
Vladimir Mandic d8c82eddd9 lint fixes 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-03-17 12:21:39 -04:00
Vladimir Mandic 4f56f4aa33 add new optimum-quanto on-the-fly and simplify quantization loading 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-03-16 21:45:05 -04:00
Vladimir Mandic d4dff967b3 asymmetric vae v2 and libvips support 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-03-16 19:51:38 -04:00
Vladimir Mandic 942553a504 rename vae and unet none to default 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-03-16 18:46:26 -04:00
Vladimir Mandic ed602b173d fix legacy diffusion latent upscalers 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-03-16 13:37:32 -04:00
Vladimir Mandic a4b26e7ddb fix hires with latent upscale 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-03-16 13:25:26 -04:00
Vladimir Mandic 2c726c1d5e fix remote vae for flux 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-03-16 12:42:13 -04:00
Vladimir Mandic 86e55ef11d rename vae none to default 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-03-16 12:27:41 -04:00
Vladimir Mandic f113efc6f5 insightface loader 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-03-16 12:14:13 -04:00
Vladimir Mandic a3e10fd24c fix progress eta reporting 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-03-16 11:22:29 -04:00
Vladimir Mandic f9a692daf6 update changelog and wiki 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-03-15 22:10:41 -04:00
Vladimir Mandic d4a67dd946 lora logging 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-03-15 19:04:03 -04:00
Vladimir Mandic a91c95870d remote vae encode 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-03-15 17:03:37 -04:00
Vladimir Mandic b766680254 remote vae scaling-factor and shift-factor 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-03-15 15:55:33 -04:00
Vladimir Mandic dbfd59434f add gemma3 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-03-15 15:30:57 -04:00
Vladimir Mandic a5d3a68107 add cogview4 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-03-15 13:20:17 -04:00
Disty0 c82d5a8a8a Fix get_runpod_limit 2025-03-14 19:44:00 +03:00
Disty0 4fce7c279e IPEX add dg2 to arch list 2025-03-14 18:56:03 +03:00
Disty0 f2409d38c4 IPEX use get_arch_list from torch.xpu 2025-03-14 18:52:13 +03:00
Disty0 75c1dcb892 Update changelog 2025-03-14 17:57:14 +03:00
Disty0 851fb9d307 Fix runpod limit 2025-03-14 17:48:44 +03:00
Disty0 463024c749 fix control memstats 2025-03-14 14:36:13 +03:00
Disty0 75ff932e79 Add safety check for total ram available 2025-03-14 13:48:31 +03:00
Disty0 cd9cb51a05 IPEX fix torch.compile on PyTorch 2.8 2025-03-14 02:03:33 +03:00
Disty0 1974172296 IPEX fix triton 2025-03-13 23:53:04 +03:00
Disty0 aad6bfca3a Don't restore remove vae type 2025-03-13 23:18:20 +03:00
iDeNoh 7e63b389c9 Added remote vae type to infotext.py and processing_info.py 2025-03-13 13:56:36 -05:00
Disty0 dabd89a8b3 Fix memstats 2025-03-12 22:02:19 +03:00
Disty0 1914ad9011 IPEX fix performance with balanced offload 2025-03-11 18:59:38 +03:00
Seunghoon Lee 2be555dc82
fix directml backend 2025-03-12 00:50:27 +09:00
Disty0 9b7bb5f213 Add XPU to profiler 2025-03-11 17:43:48 +03:00
Disty0 30afbd036d Fix circular import between sd_models.py and shared.py 2025-03-11 17:03:33 +03:00
Disty0 953a15a218 IPEX fix PyTorch 2.7 compatibility 2025-03-11 16:35:48 +03:00
Disty0 67f495454c IPEX fix torch.cuda.device 2025-03-06 22:55:03 +03:00
Disty0 88a2f95fe4 Fix IPEX 2.3 x2 2025-03-06 20:36:53 +03:00
Disty0 04f61d8355 IPEX fix PyTorch 2.3 2025-03-06 20:24:22 +03:00
Disty0 0e01c1b9f0 IPEX fix UntypedStorage 2025-03-06 19:49:08 +03:00
Disty0 955acaa149 IPEX fix dtype mismatch on tensor.to when input is a tensor 2025-03-05 23:02:49 +03:00
Disty0 6f68f91efe IPEX cleanup hijacks and add torch.eye 2025-03-05 22:27:29 +03:00
Disty0 5d18bd6fe3 IPEX fix Flux 2025-02-27 23:52:25 +03:00
Vladimir Mandic 44a4f43a01 fix scripts 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-02-24 21:16:49 -05:00
Vladimir Mandic 68e42649c4 improve extensions options compatibility 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-02-24 14:39:33 -05:00
Vladimir Mandic 30f76022b0 handle pipeline class switch error 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-02-24 09:05:40 -05:00
Vladimir Mandic c11952ad5b update logs styles infotext 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-02-24 08:24:14 -05:00
Disty0 10626270c0 Disable compile for AutoencoderKLOutput 2025-02-24 02:16:14 +03:00
Vladimir Mandic 881b28395b infotext parse force params delimiter 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-02-23 16:58:07 -05:00
Vladimir Mandic 8a997f3ed3 lint fix and refresh modernui 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-02-23 15:17:17 -05:00
Vladimir Mandic f39ae70eed remote vae support raw/png/jpg 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-02-23 15:01:43 -05:00
Vladimir Mandic eee4d1acfe modernui control tab reorg and styling 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-02-23 13:32:28 -05:00
Vladimir Mandic a57e865a04 scripts param check 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-02-23 10:31:32 -05:00
Disty0 2b3435a0ec OpenVINO fix Img2Img 2025-02-23 17:48:32 +03:00
Disty0 cf97c9fbe8 Add synchronize call for zluda 2025-02-22 23:01:44 +03:00
Vladimir Mandic 660e4d27b4 add vae remote to ui 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-02-22 14:25:58 -05:00
Vladimir Mandic 80d9070f09 skip control ui for legacy extensions 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-02-22 14:25:58 -05:00
Vladimir Mandic 1b2d4286b5 add remote vae 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-02-22 14:25:58 -05:00
Seunghoon Lee f8f987fed6
zluda miopen temp 2025-02-23 01:19:40 +09:00
Seunghoon Lee cef2322b2e
zluda 3.9.0 2025-02-22 21:40:09 +09:00
Seunghoon Lee 3253ec9c99
zluda flash attention 2 2025-02-22 21:40:09 +09:00
Seunghoon Lee cb0eb55516
zluda hotfix 2025-02-21 12:12:57 +09:00
Vladimir Mandic bf61c189a1 logging improvements and configurable extensions folder 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-02-20 12:54:53 -05:00
Vladimir Mandic 6cf445d317 add ras-sd35 experimental 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-02-18 18:47:42 -05:00
Vladimir Mandic 041f0bbf97 regenerate locales and rerun all translations 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-02-18 10:32:39 -05:00
Vladimir Mandic 1ee151b533 update diffusers 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-02-18 08:23:33 -05:00
Vladimir Mandic d6cb50f9d2 style fix 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-02-17 12:58:25 -05:00
Vladimir Mandic 60a7549614 configurable card sizes 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-02-17 12:04:34 -05:00
Vladimir Mandic b6990151c4 caption tab modernui support 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-02-17 10:59:22 -05:00
Vladimir Mandic a4b3dc269e modernize clip interrogate 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-02-16 19:37:09 -05:00
Vladimir Mandic 5e12985c52 configurable request timeout 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-02-16 17:54:21 -05:00
Vladimir Mandic f3dd9b9646 vlm advanced settings and batch processing 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-02-15 14:34:28 -05:00
Vladimir Mandic e95bd93f67 caption ui redesign 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-02-15 12:57:19 -05:00
Vladimir Mandic 8906f962ad deepseek-vl2 experiments 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-02-15 10:10:04 -05:00
Vladimir Mandic abd439d97c add joycaption 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-02-15 10:10:04 -05:00
Vladimir Mandic 1f2fc929f7 add joytag 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-02-15 10:10:04 -05:00
Disty0 dc551bfd85 Set blaslt_tensile_libpath to empty string instead of None 2025-02-15 18:04:42 +03:00
Seunghoon Lee 09fa34047b
remove unused import 2025-02-15 23:46:14 +09:00
Seunghoon Lee 9f59967c6b
fix bug 2025-02-15 23:44:48 +09:00
Vladimir Mandic 227a419f7a quick controlnet fix 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-02-15 06:44:07 -05:00
Seunghoon Lee 23134eba6a
use symlink if possible 2025-02-15 16:37:20 +09:00
Seunghoon Lee 067512b8a3
fix 2025-02-15 11:42:49 +09:00
Seunghoon Lee f8de92ed3f
fix zluda installer bug 2025-02-15 11:38:57 +09:00
Vladimir Mandic 32fe60b594 update aci 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-02-14 16:26:25 -05:00
Vladimir Mandic b437fe40d7 prompt parsing with explicit masking 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-02-14 15:14:40 -05:00
Disty0 878cab085f Reverse the sdpa hijcak order 2025-02-14 19:56:39 +03:00
Vladimir Mandic dbf20d1388 api refactor: force access control and handle subpaths 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-02-14 11:27:21 -05:00
Vladimir Mandic 877c488fa8 pulid with hidiffusion 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-02-14 11:27:21 -05:00
Disty0 bb8368e52e Revert torch.xpu.mem_get_info 2025-02-14 18:04:50 +03:00
Disty0 1ffa12430c IPEX use native torch.xpu.mem_get_info 2025-02-14 17:54:17 +03:00
Seunghoon Lee 65641747d0
zluda v3.8.8 2025-02-14 23:22:09 +09:00
Seunghoon Lee 13e9f4f3e1
flash attn triton is already merged into main 2025-02-14 23:21:56 +09:00
Vladimir Mandic d73a18543c interposer prototype 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-02-13 17:45:53 -05:00
Disty0 f94196bcd1 Rename ROCm Flash atten hijack to CK Flash atten and enable AOTriton memory and flash atten by default 2025-02-13 22:01:06 +03:00
Vladimir Mandic 49712ab9e7 update requirements 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-02-13 12:03:08 -05:00
Vladimir Mandic 00be489030 modernui fixes 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-02-13 09:10:55 -05:00
Vladimir Mandic 9ce34b4c8c multi controlnet-union 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-02-13 07:54:47 -05:00
Vladimir Mandic 0204eacea3 force pydantic reinstall/reload 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-02-12 18:55:08 -05:00
Vladimir Mandic 260bfc406a update changelog 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-02-12 17:35:58 -05:00
Vladimir Mandic 7d76f825a2 mod handle prompt-list 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-02-12 16:41:18 -05:00
Vladimir Mandic d9583df8de modernui fix sampler advanced options 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-02-12 16:28:17 -05:00
Vladimir Mandic 761d04dd87 add mod regional tiling 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-02-12 11:15:19 -05:00
Vladimir Mandic a7ccea60ff add lumina2 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-02-12 08:54:00 -05:00
Vladimir Mandic 1d533544d2 add flex.1-alpha 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-02-12 07:45:16 -05:00
Vladimir Mandic 82ff8681cc update docker info 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-02-11 18:51:15 -05:00
Vladimir Mandic 78125d8fd0 validate base before hires/refine 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-02-11 11:45:26 -05:00
Vladimir Mandic c608674fb0 styles support parsed and upparsed save and apply 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-02-11 11:33:37 -05:00
Vladimir Mandic 640aff898c global lancosz 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-02-10 11:24:05 -05:00
Vladimir Mandic 92e7e74d00 persist hf and civitai tokens 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-02-10 08:47:57 -05:00
Vladimir Mandic ca7db287a6 cleanup extension installer 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-02-09 16:29:04 -05:00
Vladimir Mandic b4881ae082 ui fix send to inpaint/sketch 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-02-09 14:45:36 -05:00
Vladimir Mandic 92f494c111 update outpaint 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-02-09 13:23:01 -05:00
Vladimir Mandic d01fefdb30 add locale override capabilities 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-02-09 09:27:06 -05:00
Disty0 a34d331967 Correct DPM++ 1S naming and add DPM++ SDE preset 2025-02-09 13:20:41 +03:00
Disty0 a77bd98997 Don't force VAE compile with OpenVINO and set min detected memory for dyn atten to 4 2025-02-09 02:39:30 +03:00
Disty0 c79d12502f Fix messed up logging with OpenVINO 2025-02-09 02:01:54 +03:00
Disty0 59911b776b OpenVINO enable Upscaler compile by default 2025-02-09 01:33:20 +03:00
Disty0 1acbabb276 Upate OpenVINO to PyTorch 2.6 and fix mismatched shapes error on too many resolution changes 2025-02-09 01:17:06 +03:00
Vladimir Mandic a19ec070cf massive update to hints and add localization engine 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-02-08 15:16:04 -05:00
Vladimir Mandic 8873b2f696 massive hints update 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-02-08 15:16:04 -05:00
Seunghoon Lee 4f09014ec8
zluda torch 2.6.0 2025-02-07 15:56:42 +09:00
Vladimir Mandic e018ed627d ui quality-of-life improvements 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-02-06 16:48:31 -05:00
Vladimir Mandic 8e65cf18cb add cn active label 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-02-05 08:25:05 -05:00
Vladimir Mandic aa1a5650e1 lint 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-02-04 09:20:30 -05:00
Vladimir Mandic 1c1657525c cleanup logging 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-02-04 09:02:45 -05:00
Vladimir Mandic 372b464e3e improve python 3.12 compatibility 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-02-04 08:54:41 -05:00
Vladimir Mandic ce92a0b4f0 update changelog 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-02-03 09:23:33 -05:00
Vladimir Mandic 7831ee10db remove-background: ben2 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-02-03 09:08:36 -05:00
Vladimir Mandic e40b33d237 add vlms: qwen-vl2, smol-vl2, toriigate 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-02-02 17:07:43 -05:00
Vladimir Mandic 61a98b0b7b fix bnb version 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-02-01 16:09:31 -05:00
Vladimir Mandic 2963ce127c refactor interrogate/caption 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-02-01 15:40:19 -05:00
Vladimir Mandic 654f44f66f refactor interrogate/analyze/vqa code 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-02-01 11:47:20 -05:00
Vladimir Mandic ceaf0238fa update nvml 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-02-01 10:36:12 -05:00
Vladimir Mandic 19b01e5000 make nvml work in cli 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-02-01 10:31:07 -05:00
Vladimir Mandic 8e03755d4b add setting for prompt linebreaks 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-02-01 09:41:52 -05:00
Disty0 64a5ca6471 Set default balanced offload min gpu memory to 0 on medvram and lowvram systems 2025-02-01 15:44:09 +03:00
Vladimir Mandic 780ceb0131 fix wildcards with path sequence 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-01-31 18:45:25 -05:00
Vladimir Mandic 7d2d4ffe9a simplify file wildcard matching 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-01-31 18:31:00 -05:00
Vladimir Mandic e28b8cd920 add torch gc debug 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-01-31 13:12:59 -05:00
Disty0 d2fee97e24 Update changelog 2025-01-31 20:27:22 +03:00
Vladimir Mandic 7d9b268655 update repo links 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-01-31 12:15:21 -05:00
Vladimir Mandic f5336005e0 cleanup duplicate ui labels 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-01-31 11:32:59 -05:00
Vladimir Mandic 61dd1fa122 improve networks visual search/filter 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-01-31 11:15:09 -05:00
Disty0 039746914f Add check for missing cuda and ipex params 2025-01-31 19:12:56 +03:00
Disty0 e193a92fe1 IPEX fix torch.cuda.synchronize 2025-01-31 18:46:07 +03:00
Disty0 62e1826faf OpenVINO safety check for compiled_model_state 2025-01-31 18:35:36 +03:00
Vladimir Mandic ac1d278af4 fix late init 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-01-31 10:14:14 -05:00
Vladimir Mandic 3a6471d984 configurable tracebacks 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-01-31 10:02:21 -05:00
Vladimir Mandic 3dcb70e8a2 device init logging 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-01-31 09:31:12 -05:00
Vladimir Mandic d0d9759840 compile traceback 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-01-31 09:11:11 -05:00
Vladimir Mandic e3bb57cdfc update dwpose installer and notes 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-01-30 13:58:05 -05:00
Vladimir Mandic 1697fb1508 add tunable ops path 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-01-30 13:35:09 -05:00
Vladimir Mandic 0ea7840608 add tunable ops 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-01-30 13:08:49 -05:00
Disty0 675956010f Multiply the slice rate for dyn bmm by 4 2025-01-30 18:44:26 +03:00
Vladimir Mandic b081b3aec3 multiple fixes and update requirements 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-01-30 10:25:21 -05:00
Vladimir Mandic d50d467a33 multiple fixes 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-01-30 09:41:11 -05:00
Vladimir Mandic 04ad0caa0c photomaker with offloading 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-01-30 08:38:06 -05:00
Vladimir Mandic da6a1979ff cleanup lora overrides 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-01-28 18:47:48 -05:00
Disty0 50f73c9553 Update ipex dyn atten defaults 2025-01-29 00:43:22 +03:00
Disty0 b141d266f6 Update dyn atten defaults 2025-01-29 00:31:00 +03:00
Vladimir Mandic 6960b05129 lint and update changelog 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-01-28 09:02:44 -05:00
Vladimir Mandic a7c0219577 pab: pyramid attention broadcast 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-01-28 08:25:55 -05:00
Vladimir Mandic f0a2120368 fix typo 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-01-27 16:13:32 -05:00
Vladimir Mandic 79416af994 parse cgroups 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-01-27 10:00:06 -05:00
Vladimir Mandic 338e3a59da port streaming load to diffusers 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-01-27 09:01:24 -05:00
Vladimir Mandic a83497cd82 moondream2, controlnetunion, etc. 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-01-26 14:58:55 -05:00
Disty0 b0ecdf2f1c Better dyn atten sdpa usage estimation logic 2025-01-26 16:57:26 +03:00
Disty0 a21bc9d9cd Make IPEX dyn atten care only about the sdpa memory usage 2025-01-26 04:45:05 +03:00
Disty0 bb07dd7a8f Add trigger rate control to dyn atten 2025-01-26 03:48:01 +03:00
Disty0 3f2c9c4e22 Fix dyn atten not registering slice rate changes 2025-01-25 22:44:29 +03:00
Disty0 d266143f20 Cleanup 2025-01-25 21:46:23 +03:00
Disty0 02ecc6710d Fix missing unsqueeze 2025-01-25 21:43:38 +03:00
Disty0 58a3f7c393 Fix OmniGen and update Changelog 2025-01-25 21:39:08 +03:00
Disty0 a770b1c888 More correct Dynamic Atten SDPA implementation and deprecate IPEX Diffusers attention 2025-01-25 21:33:42 +03:00
Vladimir Mandic 843011406f obj trace 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-01-25 11:41:34 -05:00
Vladimir Mandic 68115410ff unified standar and modernui auth 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-01-24 11:09:24 -05:00
Vladimir Mandic 8b787ec721 image metadata civitai compatibility 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-01-24 09:20:10 -05:00
Vladimir Mandic 06ba03cf80 settings option to disable reference models 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-01-23 15:19:43 -05:00
Disty0 9b579bfd96 Move quant functions to model_quant.py 2025-01-23 21:50:26 +03:00
Vladimir Mandic 5a7c1f50c1 add native torch fp8 storage dtype 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-01-23 12:07:08 -05:00
Disty0 e58b9b50e9 Don't force bnb version outside of cuda 2025-01-23 01:10:53 +03:00
Disty0 40e7dcd5a4 OpenVINO add group_size option to compression 2025-01-23 00:15:27 +03:00
Vladimir Mandic bda45d865e perflow 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-01-22 11:03:23 -05:00
Disty0 af35296a68 IPEX 4GB alloc detection and log driver version 2025-01-22 18:15:25 +03:00
Disty0 9f3a34d0a3 IPEX enable FP64 emulation 2025-01-22 17:02:22 +03:00
Vladimir Mandic e9853ec0ca add para-attention first-block-cache 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-01-21 17:10:12 -05:00
Vladimir Mandic 73aaaca858 add photomaker v1 and v2 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-01-21 12:41:32 -05:00
Vladimir Mandic f5a910f719 experimental reswapper 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-01-20 16:57:55 -05:00
Vladimir Mandic 0d67a6d979 add asymmetric vae upscaler 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-01-19 15:00:26 -05:00
Vladimir Mandic 311d402b0c model component merge 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-01-19 14:36:09 -05:00
Vladimir Mandic de1063275c extract thumbnail from model metadata 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-01-19 10:04:48 -05:00
Vladimir Mandic e26de8cdba detailer support for face restorer models 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-01-18 14:29:40 -05:00
Vladimir Mandic bdf8ca7e27 add legacy mode indicator on splash screen 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-01-18 14:29:40 -05:00
Vladimir Mandic ae9b40c688 refactor to unify latent, resize and model based upscalers 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-01-18 14:29:40 -05:00
Disty0 facfe2be6b IPEX make IPEX_FORCE_ATTENTION_SLICE=-1 disable Dynamic Atten 2025-01-18 22:10:34 +03:00
Vladimir Mandic bfe8ece749 unique font family registration 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-01-17 16:20:46 -05:00
Vladimir Mandic b22e3d66fc update modernui 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-01-17 09:19:00 -05:00
Vladimir Mandic 27e087ecea update element ids 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-01-16 11:51:36 -05:00
Vladimir Mandic 6b225d0bc2 gallery add http fallback 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-01-16 11:00:23 -05:00
Vladimir Mandic 1bc4229fdf increase gallery timeouts 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-01-16 10:31:46 -05:00
Vladimir Mandic 042aaa2b4b fix image transfer between tabs 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-01-16 09:33:57 -05:00
Vladimir Mandic f07aca667e cleanup vae decode 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-01-16 09:18:42 -05:00
Vladimir Mandic f69159ee53 fix log view 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-01-15 13:11:35 -05:00
Vladimir Mandic 5a59054eec refactor video file create and save 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-01-15 13:03:40 -05:00
Seunghoon Lee f0463cda5b
break backward compatibility and force upgrading 2025-01-15 15:14:19 +09:00
Seunghoon Lee a67639db3e
fix zluda<3.8.5 compatibility 2025-01-15 11:53:55 +09:00
Seunghoon Lee c0482d2f40
fix zluda installer bug 2025-01-14 17:33:48 +09:00
Vladimir Mandic e4fbf5f0dc fix hf cache setting override 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-01-13 14:08:40 -05:00
Vladimir Mandic 0c8044070a refactor: split legacy loaders 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-01-13 13:00:30 -05:00
Vladimir Mandic 1c10e69276 update controlnet logic and start sd_models refactor 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-01-13 10:09:15 -05:00
Seunghoon Lee 71aae3aba4
fix zluda installer bug 2025-01-13 15:33:43 +09:00
Vladimir Mandic 49f5c8ab12 refactor taesd and add multiple variants in settings 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-01-12 14:09:55 -05:00
Vladimir Mandic e81db4cdfe cleanup args copy 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-01-12 08:55:55 -05:00
Vladimir Mandic 583e4b8ad1 change args copy to image-only 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-01-12 08:55:32 -05:00
Vladimir Mandic b4575ad839 update 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-01-11 18:51:33 -05:00
Vladimir Mandic ca6092e9bc fix flux controlnet 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-01-11 18:21:11 -05:00
Disty0 705556d68d JPEG XL support 2025-01-12 00:38:13 +03:00
Seunghoon Lee 389bb78b8e
Fix bug. 2025-01-11 23:41:17 +09:00
Seunghoon Lee e43d8e9448
check hipblaslt availability in windows 2025-01-11 23:36:51 +09:00
Vladimir Mandic dc26d32aed load thread locks 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-01-10 13:21:09 -05:00
Vladimir Mandic 85a6aca1cc controlnet load lock 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-01-10 12:18:33 -05:00
Vladimir Mandic 55b7f02563 reduce control logging 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-01-10 10:00:57 -05:00
Vladimir Mandic ac2adaa299 cleanup 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-01-10 08:25:00 -05:00
Vladimir Mandic df60fe202d control processor handle null output 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-01-10 08:16:08 -05:00
Vladimir Mandic 465d7caa3a fix pulid 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-01-10 08:00:19 -05:00
Seunghoon Lee 6030e95016
add zluda nightly flag 2025-01-10 15:52:07 +09:00
Seunghoon Lee 361583cf31
ZLUDA 3.8.6 2025-01-10 14:30:42 +09:00
Vladimir Mandic c2e88021eb pipeline restore args after batch and restore pipeline after base 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-01-09 11:12:39 -05:00
Vladimir Mandic e632031190 correct log message 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-01-08 10:40:49 -05:00
Vladimir Mandic aa1ff725c6 startup tracing 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-01-08 09:35:49 -05:00
Vladimir Mandic 9763c6bbe8 fix pbar error 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-01-08 08:22:53 -05:00
Vladimir Mandic 25babb7075 flux bnb on-the-fly for unet-only 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-01-07 17:13:14 -05:00
Vladimir Mandic 685386ae7d add detailer to modernui 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-01-07 12:58:16 -05:00
Vladimir Mandic 2090a334b0 hunyuanvideo lora support 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-01-07 12:49:09 -05:00
Vladimir Mandic 7461507ecb apply settings skip hidden 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-01-07 11:04:34 -05:00
Vladimir Mandic 3d5cab66a7 settings debug 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-01-07 10:32:32 -05:00
Vladimir Mandic 5593ea78a9 refactor detailer 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-01-07 10:12:47 -05:00
Vladimir Mandic 19d56d3342 update diffusers and register mask_processor 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-01-06 09:49:07 -05:00
Vladimir Mandic 61f605bb62 add tdd scheduler and lint updates 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-01-06 09:35:36 -05:00
Vladimir Mandic 1f150ef466 fix controlnet with batch count 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-01-05 15:12:20 -05:00
Vladimir Mandic 17760cf75b remove legacy restore resolution 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-01-05 14:50:52 -05:00
Vladimir Mandic 702d887102 fix controlnet with hires 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-01-05 14:02:22 -05:00
Vladimir Mandic 0114b59470 refactor of progress monitoring 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-01-05 13:22:19 -05:00
Vladimir Mandic 669799bfcc fix pulid 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-01-05 08:13:41 -05:00
Vladimir Mandic 3047f92a4a improve metadata 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-01-04 13:56:00 -05:00
Seunghoon Lee e72d13c11c
zluda experimental hipblaslt support 2025-01-04 02:22:29 +09:00
Vladimir Mandic bf5c47adb8 add pixelsmith 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-01-03 11:55:43 -05:00
Vladimir Mandic 9f30abbad5 fix scheduler api 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-01-02 16:45:08 -05:00
Vladimir Mandic 94a659ee1f fix xyz with detailer, sd35 img2img 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-01-02 11:00:10 -05:00
Vladimir Mandic 5c5c7e0d51 fix vae tiling defaults 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-01-01 15:48:30 -05:00
Vladimir Mandic e677e62e88 allegro 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-01-01 12:29:31 -05:00
Vladimir Mandic 9f95fcc46e first update in 2025 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-01-01 09:49:12 -05:00
Vladimir Mandic 699ed3a444 update lora changed 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-12-31 15:52:00 -05:00
Vladimir Mandic 935cac62a8 lint fixes 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-12-31 12:28:53 -05:00
Vladimir Mandic c201695af3 preview use per-job lock instead of global 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-12-31 12:08:20 -05:00
Disty0 8f35f09117 Don't reset dynamo on upcaler compile 2024-12-31 19:56:03 +03:00
Disty0 945c57c433 Fix ESRGAN with CPU 2024-12-31 19:42:24 +03:00
Disty0 efbe5bff54 OpenVINO use model hash for signature 2024-12-31 19:20:30 +03:00
Vladimir Mandic 73de099711 fix lora on model change 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-12-31 10:41:58 -05:00
Disty0 3a959a4d7a Cleanup 2024-12-31 18:39:34 +03:00
Disty0 1998997189 OpenVINO fix shapes resolution change and disable re-compile 2024-12-31 17:45:23 +03:00
Vladimir Mandic cd32b966b2 torch 2.6.0 support 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-12-31 09:15:36 -05:00
Vladimir Mandic 5f69cd092d fix processing with nested calls 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-12-31 09:15:36 -05:00
Vladimir Mandic bb97e695da log cleanup 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-12-31 09:15:36 -05:00
Vladimir Mandic 05d5ac03be fix hires and corrections with batch processing 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-12-31 09:15:36 -05:00
Vladimir Mandic 86ac38d94f enable debug by default and optimize startup 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-12-31 09:15:36 -05:00
Disty0 9adf777e38 OpenVINO fix Lora 2024-12-31 04:15:37 +03:00
Vladimir Mandic 9ca7c18f40 cleanup hdr logging 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-12-30 14:41:53 -05:00
Vladimir Mandic 4b28f52384 update changelog 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-12-30 14:19:15 -05:00
Vladimir Mandic 1f0ad43c50 teacache for ltxvideo 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-12-30 14:08:14 -05:00
Vladimir Mandic 8dd249799a cleanup 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-12-30 12:43:42 -05:00
Vladimir Mandic 7cd745992a fix flux unet override load with bnb 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-12-30 12:40:35 -05:00
Vladimir Mandic 8397e5ef2d samplers autodetect if sigma is required and available 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-12-30 12:21:47 -05:00
Vladimir Mandic 8110f06c3b remove all ldm imports when running in native mode 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-12-30 11:42:04 -05:00
Vladimir Mandic 2b5334aa86 reenable preview sigma calculations 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-12-30 11:18:17 -05:00
Vladimir Mandic 27d3a312aa update live preview 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-12-30 10:17:00 -05:00
Vladimir Mandic f327b3aca6 fix kandinsky 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-12-30 10:03:34 -05:00
Vladimir Mandic 02f833b2db update live preview 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-12-30 09:21:02 -05:00
Vladimir Mandic 85cc55af51 fix hires batch, sdxl refiner 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-12-30 09:07:44 -05:00
Disty0 2ecc95c571 Fix live previews with Flux 2024-12-30 16:49:58 +03:00
Disty0 5d950a0164 Fix quanto logging with model offload 2024-12-30 16:44:07 +03:00
Vladimir Mandic bb87afbc2f livepreview fixes and debug 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-12-29 17:01:14 -05:00
Vladimir Mandic 25e5411a0e again 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-12-29 15:42:29 -05:00
Vladimir Mandic 40472eefe5 typo 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-12-29 15:41:34 -05:00
Vladimir Mandic e010c57749 live preview error handling 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-12-29 13:54:14 -05:00
Vladimir Mandic 18f683b283 refactor lora add_weights 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-12-29 12:42:08 -05:00
Vladimir Mandic 910f5d0a73 lora direct on-demand apply/unapply 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-12-29 12:38:19 -05:00
Vladimir Mandic 8b910dbf02 cleanup 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-12-28 17:04:43 -05:00
Vladimir Mandic 53c4c84c40 quantization improvements and lora support 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-12-28 16:57:06 -05:00
Vladimir Mandic b1f4f9203a fix interrogate caption with t5 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-12-28 08:43:35 -05:00
Vladimir Mandic 43b1035324 fix lora legacy loader 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-12-28 08:14:37 -05:00
Vladimir Mandic 14f1cc2416 fix flux pipeline switches 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-12-27 17:04:54 -05:00
Vladimir Mandic 7b7f121a96 sampler flow shift options and fix img2img 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-12-27 16:33:19 -05:00
Vladimir Mandic 282e77f99b ltxvideo optimizations 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-12-27 09:45:03 -05:00
Vladimir Mandic d49d470a89 hide disabled networks and add more previews 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-12-27 09:45:03 -05:00
Disty0 d4f04dbd73 Fix live preview sigmas with img2img 2024-12-27 15:39:58 +03:00
Disty0 2693a46f67 Fix PuLID 2024-12-26 19:26:33 +03:00
Vladimir Mandic 3359792762 - HunyuanVideo optimizations: full offload, quantization and tiling support 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-12-26 10:06:30 -05:00
Vladimir Mandic 9cb15a564c update vae tiling defaults and allow hypertile min size setting 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-12-25 18:59:56 -05:00
Vladimir Mandic e36c764d8c set detailer job 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-12-25 16:50:33 -05:00
Disty0 2b0836fcf5 Fix live previews with detailer 2024-12-25 23:53:53 +03:00
Vladimir Mandic e7f0047d52 add granular vae tiling options 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-12-25 12:38:21 -05:00
Disty0 5db51d1adc Live previews add a check for txt2img 2024-12-25 20:37:16 +03:00
Disty0 422b2bbebd Move simga calcs to do_set_current_image 2024-12-25 20:06:20 +03:00
Disty0 917d9e6c86 Live previews add flow_prediction 2024-12-25 18:43:10 +03:00
Disty0 5e35d6c3a3 Better live previews 2024-12-25 18:19:43 +03:00
Vladimir Mandic a5f94fe0dd remove experimental from consistory 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-12-24 16:09:25 -05:00
Vladimir Mandic f7d95c401c cleanup 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-12-24 08:57:39 -05:00
Vladimir Mandic a71bae4f42 update requirements and changelog 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-12-24 08:40:46 -05:00
Vladimir Mandic 7d663249e8 move postprocessing scripts to accordions 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-12-23 12:23:18 -05:00
Vladimir Mandic 2794b1abc4 new ltxvideo, offloading, quantization 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-12-23 11:56:51 -05:00
Vladimir Mandic b15cf4adae fix pag with batch count 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-12-22 17:38:53 -05:00
Disty0 6d3d23bddd OpenVINO disable model caching by default 2024-12-23 00:16:34 +03:00
Vladimir Mandic ea6d3107ab update all todo statements 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-12-22 08:39:31 -05:00
Vladimir Mandic dff846182f fix wildcards 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-12-22 08:20:17 -05:00
Disty0 042f5f9fed IPEX disable interpolate cpu fallback with IPEX 2.5 2024-12-22 03:04:40 +03:00
Vladimir Mandic bf67ffd34a flux true-scale and flux ipadapters 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-12-21 16:01:35 -05:00
Vladimir Mandic 11b2a055c3 fix svd i2v 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-12-21 11:31:08 -05:00
Vladimir Mandic c3f02f11e4 fix xyz with lora none 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-12-21 10:56:24 -05:00
Vladimir Mandic 8924e5bc5d fix 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-12-21 10:36:24 -05:00
Vladimir Mandic 29c76cd8fa batch image processing use captions 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-12-21 10:16:33 -05:00
Vladimir Mandic 76755c6b6e switch gguf loader 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-12-21 09:19:51 -05:00
Vladimir Mandic fc8a18df36 ruff updates 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-12-20 18:58:29 -05:00
Vladimir Mandic ed3e5f06d6 linting 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-12-20 18:48:06 -05:00
Vladimir Mandic dae181fefb lora-direct with bnb 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-12-20 18:26:25 -05:00
Vladimir Mandic 58ad18ee58 on-the-fly quant for sd35, flux and sana 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-12-20 17:28:33 -05:00
Disty0 1649e4e3c4 IPEX dupe conv2d fix for conv1d and conv3d too 2024-12-21 01:25:49 +03:00
Vladimir Mandic 20f2554cec add sd35-ipadapter and more balanced offload optimizations 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-12-20 10:22:42 -05:00
Vladimir Mandic 0803946c08 update changelog and cleanup 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-12-19 11:34:19 -05:00
Vladimir Mandic 01edcb0c3a add ltx-video 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-12-18 17:36:42 -05:00
Vladimir Mandic a7e0723dcf profiling 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-12-18 13:02:22 -05:00
Vladimir Mandic 85805f969a add sana chi 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-12-18 09:16:14 -05:00
Seunghoon Lee 4b35dfc2a2
zluda HIP SDK 6.2 support 2024-12-18 23:06:18 +09:00
Vladimir Mandic ecf6aff1c2 update wiki 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-12-18 08:29:14 -05:00
Disty0 fc63de6958 IPEX enable empty_cache fix for WSL on PyTorch 2024-12-17 22:43:30 +03:00
Disty0 468c7d6bc8 Use apply_compile_model with torchao 2024-12-17 22:24:25 +03:00
Vladimir Mandic fd7fe8cea5 add torchao 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-12-17 13:29:36 -05:00
Vladimir Mandic 191a720902 update sana and changelog 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-12-17 09:05:06 -05:00
Vladimir Mandic 84f6ec7189 update sana 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-12-16 15:55:52 -05:00
Vladimir Mandic 7b258468f0 add ufogen 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-12-16 15:40:54 -05:00
Vladimir Mandic ab07788ab5 add sana 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-12-16 11:30:15 -05:00
Vladimir Mandic b1f1864099 lint updates 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-12-15 13:12:35 -05:00
Vladimir Mandic 3e8dec9297 add freescale 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-12-15 12:40:54 -05:00
Vladimir Mandic 814161cb21 major controlnet work, xinsir promax and tiling support 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-12-14 17:29:51 -05:00
Disty0 7d7bcb9684 Fix balanced offload with Cascade 2024-12-13 23:01:53 +03:00
Disty0 8a6e5617ba Fix IPEX 2.5 2024-12-13 22:05:13 +03:00
Disty0 7a213fe69a IPEX fix Flux 2024-12-13 00:12:40 +03:00
Vladimir Mandic bd540efb73 lora: absolute path, hf download, flux controlnet loras 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-12-11 18:10:51 -05:00
Vladimir Mandic 8f21e96f73 update bnb and increase ui timeouts 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-12-11 15:22:51 -05:00
Vladimir Mandic e9f951b2c5 offload logging 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-12-11 14:20:01 -05:00
Vladimir Mandic 8cea43f7db lora add erorr handler for partial offload 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-12-11 13:10:05 -05:00
Vladimir Mandic c3b0c0a3bf add SD_NO_CACHE env variable 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-12-11 12:32:34 -05:00
Vladimir Mandic 9a588d9c91 update balanced offload 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-12-11 12:06:03 -05:00
Vladimir Mandic f4847f1b8a optimize balanced offload 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-12-10 15:49:20 -05:00
Vladimir Mandic beea969fd3 update lora 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-12-10 12:34:27 -05:00
Vladimir Mandic 944408e93b warn on quanto with offload 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-12-10 10:39:13 -05:00
Vladimir Mandic 042178fedb reorg settings 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-12-10 10:20:00 -05:00
Vladimir Mandic 383d7052ac lora split te apply 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-12-09 15:23:22 -05:00
Vladimir Mandic 7c88bfb60a fix preview choice 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-12-09 14:16:26 -05:00
Vladimir Mandic 1185950c4a yet another lora refactor 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-12-09 13:40:19 -05:00
AI-Casanova 6c9101dfaf
lora low memory mode: switching requires manual model reload 2024-12-06 22:54:08 -06:00
Vladimir Mandic 28eeb00432 remove non-blocking 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-12-06 09:15:37 -05:00
Vladimir Mandic 2a1fbd904f handle os err 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-12-06 07:36:20 -05:00
Vladimir Mandic 16ab1e2ae8 safer lora unapply 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-12-06 07:23:31 -05:00
Vladimir Mandic 2934948413 lora one more safe cast 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-12-05 09:04:42 -05:00
Vladimir Mandic 2965045993 change offload and upcast defaults 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-12-05 07:58:55 -05:00
Disty0 6f6ba0b598
Merge pull request #3617 from vladmandic/master 
Pin ultralytics
 2024-12-05 11:44:44 +03:00
Disty0 0f714c6339
pin ultralytics 2024-12-05 11:42:24 +03:00
Vladimir Mandic ca06002602 lora maintain device 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-12-04 09:25:57 -05:00
Vladimir Mandic e41d9f52cd add offload warning 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-12-04 08:47:22 -05:00
Vladimir Mandic e3f06734d0 samplers add custom sigma 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-12-03 08:52:53 -05:00
Vladimir Mandic bd192d2991 remove tracemalloc 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-12-02 16:27:22 -05:00
Vladimir Mandic cfafa2b271
Merge branch 'dev' into lora-refactor 2024-12-02 11:23:15 -05:00
Vladimir Mandic 4eac263055 add bdia sampler 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-12-02 11:21:39 -05:00
Vladimir Mandic 7e2034c4ff lora add fuse 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-12-02 10:51:41 -05:00
Vladimir Mandic f3761032cf cleanup 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-12-01 17:26:34 -05:00
Vladimir Mandic 106f93f079 memory optimizations 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-12-01 17:13:55 -05:00
Disty0 82eb924486 Reduce balanced offload max gpu memory to 0.70 2024-12-02 00:29:01 +03:00
Vladimir Mandic 023b13b6cb balanced offload improvements 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-12-01 15:34:25 -05:00
Vladimir Mandic 507636d0a1 lora-refactor 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-12-01 10:54:51 -05:00
Vladimir Mandic e74c038f64 interruptible lora apply 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-11-30 19:53:10 -05:00
Disty0 4089af7c03 Fix NaNs on Intel with Lora + Offloading 2024-12-01 03:52:57 +03:00
Vladimir Mandic c5cd3cb623 reinit offoad instance on change 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-11-30 19:15:50 -05:00
Vladimir Mandic b7aff134a2 add low/high threshold to balanced offload 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-11-30 19:03:51 -05:00
Vladimir Mandic 22982f3126 update stats 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-11-30 18:10:10 -05:00
Vladimir Mandic bccb277dcb update lora apply weights and xyz 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-11-30 17:26:52 -05:00
Disty0 81a95d04cf Skip apply_balanced_offload if not needed 2024-11-30 21:12:26 +03:00
Disty0 b55e746fca Improve balanced offload pre forward performance 2024-11-30 20:49:57 +03:00
Vladimir Mandic eee85e5a4e lora refactor in progress 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-11-30 12:29:58 -05:00
Disty0 6ec93f2d46 Disable load lora gpu with medvram too 2024-11-30 17:04:35 +03:00
Vladimir Mandic eacd4e9357 add stats 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-11-30 09:02:47 -05:00
Vladimir Mandic 1e90312982 update lora 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-11-30 08:50:25 -05:00
Disty0 63ba83d361 ZLUDA enable Dynamic attention by default 2024-11-30 01:15:49 +03:00
Disty0 881fa1183c Fix offload issues with lora 2024-11-30 00:16:38 +03:00
Vladimir Mandic 797ad1f20f lora stats 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-11-29 15:40:23 -05:00
Disty0 e52019104d revert sd_models.py 2024-11-29 22:55:15 +03:00
Disty0 9187418358 revert networs.py 2024-11-29 22:53:17 +03:00
Disty0 39b14a202e Fix sequential offload with lora 2024-11-29 22:35:00 +03:00
Vladimir Mandic 493c953d49 cleanup 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-11-29 10:22:47 -05:00
Vladimir Mandic b6963470a9 conditional imports and summary timer 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-11-29 10:05:06 -05:00
Vladimir Mandic 6aa7a4707e modules.lora full integration 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-11-29 09:39:38 -05:00
Vladimir Mandic a635421231 lint fixes 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-11-29 08:01:26 -05:00
Vladimir Mandic d6c1487f9a
Merge branch 'dev' into lora-refactor 2024-11-29 07:50:55 -05:00
Vladimir Mandic b74166f9cb detailer add augment setting 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-11-29 07:18:07 -05:00
Disty0 75dd6219c6 Fix Cascade and add full_vqgan_decode 2024-11-28 22:12:25 +03:00
Vladimir Mandic 425f51bb25 simplify impaint/sketch canvas handling 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-11-28 13:28:48 -05:00
Vladimir Mandic 964b4c9e5a euler flowmatch add sigma methods 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-11-28 13:28:48 -05:00
Disty0 41a63008dc Fix memmon 2024-11-28 19:18:41 +03:00
Vladimir Mandic 164ce252dc add sd35 controlnets 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-11-28 08:46:10 -05:00
Vladimir Mandic a2dc3670a1 model-loader allow absolsute path 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-11-27 15:36:22 -05:00
Vladimir Mandic 00ebdf3476 fix api scripts callbacks 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-11-27 10:07:37 -05:00
Vladimir Mandic 49e6c1564c add style aligned 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-11-26 13:13:04 -05:00
Vladimir Mandic 14c8414025 update stats and previews 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-11-25 21:02:46 -05:00
Vladimir Mandic 58146c0fc7 correct preview stats 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-11-25 14:42:46 -05:00
Vladimir Mandic 23b6309800 ui updates 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-11-25 14:37:25 -05:00
Vladimir Mandic 9e56a8f0a7 avoid live-preview during vae-decode 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-11-25 08:49:02 -05:00
Vladimir Mandic d76365e227 xyz improvements 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-11-25 08:01:02 -05:00
AI-Casanova bf170ea08c
Fix multiple LoRA 2024-11-24 23:22:57 -06:00
AI-Casanova fccd1ed364
Enable stepwise LoRA (untested) 2024-11-24 14:16:33 -06:00
Vladimir Mandic e4038feff1 minor updates 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-11-24 15:05:58 -05:00
Vladimir Mandic fdb8cb509e force move te when using xhinker 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-11-24 13:49:27 -05:00
AI-Casanova cb561fa486
Major lora refactor: works on my machine edition 2024-11-23 21:57:03 -06:00
Vladimir Mandic a2590222ed flux tools 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-11-23 18:16:18 -05:00
Vladimir Mandic 67c6b93213 flux tools support 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-11-23 15:27:01 -05:00
Vladimir Mandic 8a1eaedc82 browser to server logging 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-11-23 10:47:06 -05:00
Vladimir Mandic 6bd25a6f90 js pbar improvements 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-11-23 09:07:43 -05:00
Vladimir Mandic 62c53942e0 post release jumbo patch 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-11-22 12:55:18 -05:00
Vladimir Mandic c5b1fb36a5 relax settings validator 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-11-21 20:29:16 -05:00
Vladimir Mandic 9188ecf4d6 scripts cleanup 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-11-21 13:45:27 -05:00
Vladimir Mandic fa5de3dc22 api resiliency improvements 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-11-21 11:28:19 -05:00
Vladimir Mandic a5c8bb57c7 improve api scripts resiliency 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-11-21 10:17:44 -05:00
AI-Casanova 9f65f8b8c3
Fix LoRA with balanced offload 2024-11-20 13:00:41 -06:00
Luca Beltrame 2554870dc8
Temporarily change the NoobAI-SDXL OpenPose repo 
The upstream repository by Laxhar Labs does not provide a config.json.
Due to huggingface/diffusers#9976, the single-file safetensors provided
can't be loaded. As such, use a mirror which provides the model in
diffusers format (the model file is in that format already anyway).

Workarounds #3578 for this specific model.
 2024-11-20 16:19:38 +01:00
Vladimir Mandic b3eb03b7ba add slg 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-11-19 18:07:06 -05:00
Vladimir Mandic 91a3867ed9 update controlnets to fp16 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-11-19 16:31:54 -05:00
Vladimir Mandic 58b37c9d64
Merge branch 'dev' into add-noobaixl-controlnet 2024-11-19 10:56:05 -05:00
Luca Beltrame 9f15fe3cc8
Address review comments 2024-11-19 15:34:56 +01:00
Luca Beltrame 729afc6e27
Add ControlNet models for NoobAI-SDXL 2024-11-19 14:47:26 +01:00
Vladimir Mandic 31f219e3f3 cleanup custom schedulers 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-11-19 07:43:30 -05:00
Vladimir Mandic 96ae1ec019 set default flowmatch shift value 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-11-18 14:26:08 -05:00
Vladimir Mandic 013efaf14c add lambdas sigma method 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-11-18 11:55:07 -05:00
Vladimir Mandic aa52feb757 dpm flowmatch 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-11-17 12:43:46 -05:00
Vladimir Mandic bbd224c9f0 fix xyz grid with scripts/detailer 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-11-17 07:58:21 -05:00
Vladimir Mandic 59cd08f5da update docker and progress monitoring 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-11-16 10:49:08 -05:00
Vladimir Mandic 7344a8c3d8 fix pulid attention 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-11-14 17:08:11 -05:00
Vladimir Mandic 4110bc746b param validation 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-11-14 13:19:34 -05:00
Vladimir Mandic bdd885eab4 multiple param validation fixes 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-11-14 12:37:38 -05:00
Vladimir Mandic f36c4d8a2b cleanup 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-11-14 11:22:20 -05:00
Vladimir Mandic 4f1c9cf5c7 api validation 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-11-14 11:18:24 -05:00
Vladimir Mandic 94b71003e0 custom swagger docs 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-11-14 10:11:20 -05:00
Vladimir Mandic 4033f2b63f pulid enable inpaint mask only 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-11-14 08:16:12 -05:00
Seunghoon Lee b59a21f924
zluda hijack rfftn 2024-11-14 12:48:29 +09:00
Vladimir Mandic a0d55a5956 pulid with refine pass 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-11-13 18:22:20 -05:00
Vladimir Mandic c77370ef26 filter sd_metadata_file 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-11-13 17:30:52 -05:00
Vladimir Mandic 8d50661291 add docker support 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-11-13 17:28:04 -05:00
Vladimir Mandic 880f6f6c4b fix denoising strength 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-11-13 13:23:24 -05:00
Vladimir Mandic 8654e3e1bd update 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-11-13 08:07:40 -05:00
Vladimir Mandic bea12ee6f2 fix api 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-11-12 13:33:50 -05:00
Vladimir Mandic adec80861b fix validation 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-11-12 13:20:01 -05:00
Vladimir Mandic aabe523a5f update changelog 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-11-12 12:12:46 -05:00
Vladimir Mandic 17a5f34cce update dependencies and changelog 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-11-12 11:42:02 -05:00
Vladimir Mandic f590445cd6 img2img refine upscale 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-11-12 11:19:12 -05:00
Vladimir Mandic b8cbe10c83 add bnb and quanto version info 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-11-12 11:19:12 -05:00
Vladimir Mandic 910b88e632 add refine/hires to img2img 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-11-12 11:19:12 -05:00
Vladimir Mandic e2c7c8cf2e refactor processing class 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-11-12 11:19:12 -05:00
Vladimir Mandic 70eec4349e fix pulid vae 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-11-12 11:18:33 -05:00
Vladimir Mandic 15381eb103 add pulid debug 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-11-12 11:18:33 -05:00
Vladimir Mandic 3cd21d6b74 css fix margin 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-11-12 11:18:33 -05:00
Vladimir Mandic 1c74d36e29 pullid support sdpa add both v1.0 and v1.1 models 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-11-12 11:18:33 -05:00
Vladimir Mandic c199e3e668 pulid optimizations: dtype, vae, offload 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-11-12 11:18:33 -05:00
Vladimir Mandic 94e188eab3 pulid fix seed 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-11-12 11:18:33 -05:00
Vladimir Mandic 34bc7377d8 update pulid 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-11-12 11:18:33 -05:00
Vladimir Mandic 5de457bb18 sort and describe all scripts 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-11-12 11:18:33 -05:00
Vladimir Mandic ba3a32ae47 add api override field 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-11-12 11:18:33 -05:00
Vladimir Mandic 0cf3283ac8 update docs 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-11-12 11:18:33 -05:00
Vladimir Mandic 3077aaf4c0 add info tab 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-11-12 11:18:33 -05:00
Vladimir Mandic 3f2d3d208d wiki search 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-11-12 11:18:06 -05:00
AI-Casanova 9fef22735f pulid inpaint, XYZ broken 2024-11-12 11:18:06 -05:00
Vladimir Mandic 8249865f41 fix pag switch pipeline 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-11-12 11:18:06 -05:00
AI-Casanova 6fa55332b8 pulid img2img, no inpaint yet 2024-11-12 11:18:06 -05:00
Vladimir Mandic 9492228175 improve auto-pipeline switch 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-11-12 11:18:06 -05:00
Vladimir Mandic 49f1ca2880 cleanup 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-11-12 11:17:26 -05:00
Vladimir Mandic 0160b703f3 fix xyz duplicate classes 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-11-12 11:17:26 -05:00
Vladimir Mandic 13cb5704b9 pulid img2img and inpaint placeholders 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-11-12 11:17:26 -05:00
Vladimir Mandic 3046417584 package logging 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-11-12 11:17:26 -05:00
Vladimir Mandic b42e9253e3 pullid offload compatibility and extra samplers 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-11-12 11:17:26 -05:00
Vladimir Mandic 66820edb63 update 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-11-12 11:02:34 -05:00
AI-Casanova 2635906742
fix scheduled prompt because diffusers callback is broken 2024-11-11 18:37:08 -06:00
AI-Casanova fb4638288b
fix IndexError, change callback type 2024-11-08 23:31:52 -06:00
Vladimir Mandic 34d6d5f92b update 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-11-08 08:53:42 -05:00
Vladimir Mandic e06ee1008a fix check 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-11-06 11:05:00 -05:00
Vladimir Mandic 29f5202811
Merge branch 'dev' into refactor-prompt 2024-11-06 10:58:03 -05:00
Vladimir Mandic f9076a253a add consistory 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-11-06 10:47:23 -05:00