1580158
/
automatic
mirror of https://github.com/vladmandic/automatic
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
12,597 Commits
3 Branches
29 Tags
109 MiB
Commit Graph

1527 Commits (0e0b607cfaabf59167e3ab2a44d491b4e4e1b08e)

Author SHA1 Message Date
Vladimir Mandic 4093b6c040 allow custom detailer resolution 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-09-10 16:32:50 -04:00
Vladimir Mandic 78c2a629b6 add experimental tensorrt quantization 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-09-05 10:43:05 -04:00
Vladimir Mandic 2124ab6879 trt experiment 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-09-04 10:53:32 -04:00
Vladimir Mandic 05dd0096c9 set default vqa model 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-09-04 08:38:29 -04:00
Disty0 19c8711132 Basic ControlNet support for OpenVINO 2025-09-03 19:06:26 +03:00
Disty0 266c9c0d3d Move Zluda Triton flash atten hijack to Triton Flash attention option 2025-09-03 16:16:41 +03:00
Vladimir Mandic dd7b69bea8 modernui configurable grid images size 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-08-31 12:39:59 -04:00
Vladimir Mandic 928b8838b9 set modernui as default 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-08-29 10:23:05 -04:00
Vladimir Mandic c41afe6b08 offloading hooks 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-08-27 22:28:07 -04:00
Vladimir Mandic 9c0d9bd766 enable offload pre-forward by default 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-08-23 08:51:45 -04:00
Vladimir Mandic 105b917d72 modernui improved image sizing 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-08-22 14:06:51 -04:00
Vladimir Mandic 74da5095f0 fix and regenerate locales 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-08-20 14:40:39 -04:00
Disty0 e49814098e Add sdnq_modules_dtype_dict 2025-08-20 14:58:54 +03:00
Disty0 0946710662 Add sdnq_modules_to_not_convert to UI settings 2025-08-20 04:38:20 +03:00
Vladimir Mandic 13195dadb9 rename wan a14b stages 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-08-18 16:13:59 -04:00
Vladimir Mandic fbc50ce3e1 setting for hf transfer mode 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-08-16 16:45:56 -04:00
Disty0 6597a9111f Fix offload detection with CPU only envs 2025-08-16 16:12:43 +03:00
Vladimir Mandic 068f63badc add model parallel load option 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-08-13 21:18:57 -04:00
Vladimir Mandic ff2c03538d add mtime to reference models 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-08-13 20:53:39 -04:00
Vladimir Mandic 562799314d change default hfcache folder 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-08-13 13:04:14 -04:00
Vladimir Mandic 669f9874a0 increase ui default timeouts 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-08-12 08:19:22 -04:00
Vladimir Mandic d7daefb8ac update cogview links, fix auraflow and hidream loaders 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-08-11 16:05:39 -04:00
Vladimir Mandic 2a85c05689 refactor pipeline loaders to generic methods and introduce `te_shared_t5` option 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-08-11 16:05:39 -04:00
Vladimir Mandic 4b74fd26b5 redesign gpu monitor 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-08-07 13:56:13 -04:00
Vladimir Mandic a91ee36b5c fix settings components mismatch 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-08-06 18:35:43 -04:00
Vladimir Mandic ba4bff08d6 remove ldsr and refactor sdnq device map 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-08-06 09:27:54 -04:00
Vladimir Mandic 8aff68fe06 new models tab including civitai downloader 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-08-04 15:53:43 -04:00
Vladimir Mandic 265cb5e8ba redo ui model metadata 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-08-02 18:46:40 -04:00
Vladimir Mandic f9b585d983 refactor ui_models 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-08-02 14:18:58 -04:00
Vladimir Mandic 4be093b80f add diffusers_offload_nonblocking setting 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-08-01 16:38:31 -04:00
Vladimir Mandic b291c337a1 refactor internal post loop 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-08-01 10:45:39 -04:00
Vladimir Mandic b120778c4f lint 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-07-31 17:33:44 -04:00
Vladimir Mandic fa44521ea3 offload-never and offload-always per-module and new highvram profile 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-07-31 11:40:24 -04:00
Vladimir Mandic 1b3f5405a3 fix batch processing 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-07-31 09:56:40 -04:00
Disty0 6a981358e7 Fix OpenVINO 2025-07-31 12:42:40 +03:00
Vladimir Mandic d8e03bb855 improve handling of wan22 stages 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-07-30 11:22:08 -04:00
Vladimir Mandic 636d261159 fix networks tags display 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-07-29 06:47:22 -04:00
Vladimir Mandic 74bb2b9ea6 autodetect v-pred 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-07-28 19:41:39 -04:00
Disty0 f02cfeaef9 Rename SDNQ TE dtype default to Same as model 2025-07-27 23:06:41 +03:00
Vladimir Mandic 896c3ce9c2 fix detailer min/max thresholds 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-07-26 08:41:12 -04:00
Vladimir Mandic fc0e0635b5 detailer add option to merge multiple results into composite mask 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-07-24 15:32:07 -04:00
Vladimir Mandic a852d1cea9 add detailer expert mode 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-07-21 10:39:19 -04:00
Vladimir Mandic 287c3600d7 torch compile for llm 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-07-20 12:07:30 -04:00
Vladimir Mandic ea0b84ffc0 group offloading (experimental) 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-07-20 09:33:02 -04:00
Vladimir Mandic 27ce0dea9a torch.compile use repeated blocks 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-07-20 08:44:25 -04:00
Vladimir Mandic 4e449ca9b2 refactor monolithic shared.py and separate legacy options with logging 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-07-12 13:35:41 -04:00
Vladimir Mandic c7ef692563 replace boundry with boundary 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-07-10 14:26:16 -04:00
Vladimir Mandic d688514d0d set taesd as default preview type 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-07-05 17:30:54 -04:00
Vladimir Mandic 8c676d0a61 lint formatting 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-07-05 17:13:31 -04:00
Vladimir Mandic e8b5ea3847 major refactor: remove backend original 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-07-05 13:16:46 -04:00
Vladimir Mandic 7736382028 major requirements refactor 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-07-01 13:12:21 -04:00
Vladimir Mandic 4c43c1cc5e update cuda max memory limit 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-06-30 16:49:43 -04:00
Vladimir Mandic bff75f0db3 add omnigen2 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-06-27 20:20:43 -04:00
Disty0 71f7474de2 Unify quant options 2025-06-27 21:05:14 +03:00
Disty0 3b8ced444c Add auto quantization mode 2025-06-27 18:54:15 +03:00
Vladimir Mandic 42b3e08e65 Control add setting to run hires with or without control 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-06-25 18:43:29 -04:00
Vladimir Mandic 5b486a6ef1 sdnq add xyz grid support, improve offloading compatibility 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-06-25 15:32:37 -04:00
Disty0 cb4684cbeb SNDQ add separate quant mode option for Text Encoders 2025-06-13 12:42:57 +03:00
Disty0 5e013fb154 SDNQ optimize input quantization and use the word quantize instead of compress 2025-06-12 12:06:57 +03:00
Disty0 33fadf946b SDNQ add 7 bit support 2025-06-10 11:33:06 +03:00
Disty0 58b646e7f2 SDNQ add 5-bit and 3-bit quantization support 2025-06-10 01:48:51 +03:00
Disty0 2ccc76ab91 Increase medvram mode to 12 GB and update wiki 2025-06-06 15:27:30 +03:00
Disty0 e25890bb1d SDNQ INT8 matmul support for Conv2d 2025-06-05 13:36:49 +03:00
Disty0 b146025a5e SDNQ add int2 2025-06-02 00:17:39 +03:00
Disty0 839295f79a Add fp8 fnuz to sdnq options 2025-06-01 23:10:08 +03:00
Disty0 539fae3234 Update naming 2025-06-01 21:01:56 +03:00
Disty0 c85cc6b397 SDNQ enable quant with GPU by default and don't do unnecessary clones 2025-05-30 15:21:29 +03:00
Disty0 29bd2af779 SDNQ add 6-bit support 2025-05-30 12:20:13 +03:00
Disty0 d1491962d9 One bit 2025-05-30 05:41:02 +03:00
Disty0 3c8be0f55f SDNQ add uint2 2025-05-30 04:47:29 +03:00
Disty0 d8e8f47ce5 SDNQ add an option to toggle quantize with GPU 2025-05-28 15:18:39 +03:00
Disty0 1961e88c13 Set SDPA as the default on all backends and enable Dyn SDPA on ROCm, DML, CPU and MPS 2025-05-28 13:42:29 +03:00
Disty0 b724cd7c57 Update changelog 2025-05-27 21:21:42 +03:00
Disty0 5d3c1832b2 SDNQ add FP8 quants 2025-05-27 20:29:15 +03:00
Disty0 dece497f10 Refactor SDNQ to use weights_dtype and rename decompress_int8_matmul to use_quantized_matmul 2025-05-27 15:49:21 +03:00
Disty0 79bb348927 SDNQ sort quant schemes by recommended order 2025-05-27 13:06:17 +03:00
Disty0 ccf9deaf28 Move SDNQ to the top of the settings list 2025-05-26 18:30:50 +03:00
Disty0 4453efee76 Rename NNCF to SDNQ and rename quant schemes 2025-05-26 02:39:51 +03:00
Disty0 85f00f9edb Enable dyn atten by default for ROCm 2025-05-23 18:24:50 +03:00
Vladimir Mandic 4157336238 rename vae 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-05-15 08:59:49 -04:00
Disty0 18c10883b8 Move NNCF above in the settings list 2025-05-14 05:19:11 +03:00
Disty0 f4e3a81a84 NNCF experimental direct INT8 MatMul support 2025-05-12 21:41:49 +03:00
Vladimir Mandic 91080f349f latent-diffusion-upscale n-steps 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-05-12 11:12:36 -04:00
Disty0 4eedeab9f8 NNCF use group size instead of number of groups and set default group size for int4 to 64 2025-05-11 20:38:01 +03:00
Disty0 0673689d5b NNCF set the default group size to 128 for INT4 2025-05-11 08:45:27 +03:00
Disty0 03a6d7f9bf NNCF add number of quantization groups 2025-05-11 05:55:58 +03:00
Disty0 b0e5a6c4df Add devices.has_triton() and enable NNCF compile if triton is available 2025-05-09 22:24:36 +03:00
Disty0 a4d4462e2a NNCF add decompress using toch.compile option 2025-05-09 21:02:24 +03:00
Seunghoon Lee 45c0bd6ec6
basic windows native pytorch support 2025-05-09 22:23:07 +09:00
Vladimir Mandic 808462fdab update changelog 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-05-09 08:18:40 -04:00
Vladimir Mandic 55b1cb8c8b lower default teacache threshold 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-05-08 10:14:15 -04:00
Disty0 dfebc909eb Disable cuDNN benchmark on ROCm and add cudnn_benchmark_limit option 2025-05-08 13:27:06 +03:00
Disty0 a57c7087b8 Make NNCF INT4 quant run 75% faster and don't force fp32 decompress 2025-05-07 20:34:07 +03:00
Vladimir Mandic 5261c55890 fix lora legacy disabled 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-05-07 11:48:21 -04:00
Disty0 f4dfe20bc1 Add sigmoid beta scheduler 2025-05-04 17:42:22 +03:00
Vladimir Mandic 473f394f97 fix save style 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-04-30 09:18:41 -04:00
Vladimir Mandic ff649291b5 lint fixes 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-04-28 10:55:21 -04:00
Vladimir Mandic 1b341dd809 setting to enable/disable clip skip editing 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-04-28 09:44:51 -04:00
Vladimir Mandic 5b68979226 update option names 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-04-26 13:46:33 -04:00
Vladimir Mandic 5647d782f8 configurable restore metadata settings and params 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-04-26 10:45:49 -04:00
Disty0 74d4093e74 NNCF disable quant conv by default 2025-04-23 16:31:27 +03:00
Vladimir Mandic 641e1e52b3 fix config save 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-04-23 09:10:53 -04:00
Disty0 bb0329f54f Update and refactor NNCF and add more quant options 2025-04-23 02:03:30 +03:00
Disty0 2264d8087b Pre-load support for NNCF 2025-04-22 04:35:36 +03:00
Disty0 4c5cbde1f5 Make ROCm listen to the gc config and set the minimum gc threshold to 1 2025-04-21 01:53:07 +03:00
Seunghoon Lee 712530341a
fix onnx 2025-04-19 13:25:05 +09:00
Vladimir Mandic cbef571f90 svdquant and others stuff 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-04-17 22:14:11 -04:00
Vladimir Mandic 75ebf1e196 hidream add llm info to metadata 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-04-17 14:44:37 -04:00
Vladimir Mandic 15f8e70e89 add nunchaku prototype 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-04-15 14:39:24 -04:00
Vladimir Mandic 59efc95e00 flux-cfgzero map autopipeline 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-04-14 10:03:33 -04:00
Vladimir Mandic 4aa17ca745 networks regex pattern(s) for skip-scan 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-04-13 09:10:11 -04:00
Vladimir Mandic 90415a7469 add cfgzero to additional pipelines 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-04-13 07:56:32 -04:00
Vladimir Mandic 6f2891afbd add cfgzero for flux 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-04-12 19:20:27 -04:00
Vladimir Mandic 3533258980 hidream whitelist samplers 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-04-11 22:32:57 -04:00
Vladimir Mandic 78d8bfeba7 hidream allow custom llama 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-04-11 21:27:48 -04:00
Vladimir Mandic 0439e5652d add shared.opts.device_map 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-04-11 14:53:42 -04:00
Vladimir Mandic 92af0036c6 add hidream 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-04-10 16:28:15 -04:00
Vladimir Mandic dc9a64d00b memmon detect gpu swapping 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-04-07 08:59:54 -04:00
Vladimir Mandic 84a24fb681 lora restore weights to orig device on apply 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-04-07 07:49:18 -04:00
Vladimir Mandic f414ea1139 set offload default 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-04-06 13:10:32 -04:00
Vladimir Mandic 8f95477ad2 add teacache for flux 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-04-05 12:58:00 -04:00
Vladimir Mandic 7520be4874 styles resize and bring quick-ui forward on hover 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-04-04 09:05:32 -04:00
Vladimir Mandic cd8357f1f4 add detailer renoise feature 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-04-03 21:12:58 -04:00
Vladimir Mandic 5bdc87b68a fix server restart 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-04-03 08:22:43 -04:00
Vladimir Mandic 760b41e99f update requirements and changelog 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-04-02 09:33:09 -04:00
Vladimir Mandic 032bd46de2 improve mp4 download 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-04-01 13:39:47 -04:00
Vladimir Mandic 5906eb6792 lora apply on gpu vs cpu settings option 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-04-01 13:39:47 -04:00
Vladimir Mandic daec94a9e9 settings css improvements 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-03-30 15:39:44 -04:00
Vladimir Mandic a467e23d72 full ui-settings refactor 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-03-30 15:04:17 -04:00
Vladimir Mandic f4fdd496b9 more granular quantization modules options 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-03-28 14:46:52 -04:00
Vladimir Mandic d1c3b97c65 add prompt enhance 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-03-28 14:05:28 -04:00
Vladimir Mandic 0d6301ff25 samplers add manual sigma adjustment 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-03-27 16:26:11 -04:00
Vladimir Mandic 2c58d3b36c fastercache and pyramidattentionbroadcast 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-03-27 11:49:30 -04:00
Vladimir Mandic 46bc0834b1 video tab major update 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-03-21 14:53:52 -04:00
Vladimir Mandic 4f56f4aa33 add new optimum-quanto on-the-fly and simplify quantization loading 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-03-16 21:45:05 -04:00
Vladimir Mandic 942553a504 rename vae and unet none to default 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-03-16 18:46:26 -04:00
Vladimir Mandic a91c95870d remote vae encode 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-03-15 17:03:37 -04:00
Vladimir Mandic dbfd59434f add gemma3 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-03-15 15:30:57 -04:00
Vladimir Mandic f39ae70eed remote vae support raw/png/jpg 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-02-23 15:01:43 -05:00
Vladimir Mandic 80d9070f09 skip control ui for legacy extensions 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-02-22 14:25:58 -05:00
Seunghoon Lee 3253ec9c99
zluda flash attention 2 2025-02-22 21:40:09 +09:00
Vladimir Mandic bf61c189a1 logging improvements and configurable extensions folder 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-02-20 12:54:53 -05:00
Vladimir Mandic 6cf445d317 add ras-sd35 experimental 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-02-18 18:47:42 -05:00
Vladimir Mandic a4b3dc269e modernize clip interrogate 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-02-16 19:37:09 -05:00
Vladimir Mandic 5e12985c52 configurable request timeout 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-02-16 17:54:21 -05:00
Vladimir Mandic f3dd9b9646 vlm advanced settings and batch processing 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-02-15 14:34:28 -05:00
Vladimir Mandic e95bd93f67 caption ui redesign 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-02-15 12:57:19 -05:00
Vladimir Mandic 1f2fc929f7 add joytag 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-02-15 10:10:04 -05:00
Vladimir Mandic dbf20d1388 api refactor: force access control and handle subpaths 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-02-14 11:27:21 -05:00
Disty0 f94196bcd1 Rename ROCm Flash atten hijack to CK Flash atten and enable AOTriton memory and flash atten by default 2025-02-13 22:01:06 +03:00