1580158
/
automatic
mirror of https://github.com/vladmandic/automatic
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
9,799 Commits
3 Branches
29 Tags
109 MiB
Commit Graph

6363 Commits (cfcfa4e4d28dcce91eb029c8a70d01042161403f)

Author SHA1 Message Date
Disty0 a6ea26fb8d Use transformers QuantoConfig for TE and LLM 2025-04-16 19:16:35 +03:00
Disty0 68d1262836 Fix live previews with HiDream 2025-04-16 18:40:50 +03:00
Vladimir Mandic ebe62a30a6 lint fixes and update requirements 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-04-16 09:24:39 -04:00
Vladimir Mandic 38a3b62553 modularize hidream loader 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-04-16 09:11:43 -04:00
Vladimir Mandic 87defaac61 add lcm-flowmatch sampler and fix hunyuanvideo-i2v 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-04-16 07:29:41 -04:00
Vladimir Mandic 15f8e70e89 add nunchaku prototype 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-04-15 14:39:24 -04:00
Vladimir Mandic ee1a4c607d offload cleanup 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-04-15 10:06:34 -04:00
Disty0 1541a19d89 Offload the TE right away 2025-04-15 02:28:44 +03:00
Disty0 7a4848dada Fix NNCF not applying for TE only quant 2025-04-15 02:16:18 +03:00
Disty0 3564b34e0d Prompt cache support for HiDream 2025-04-15 00:59:46 +03:00
Vladimir Mandic b63afc80fa explicitly flag h1 as large model 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-04-14 10:25:31 -04:00
Vladimir Mandic 762be6e369 cleanup te hijack 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-04-14 10:16:16 -04:00
Vladimir Mandic 8f7a397a32 fix unipc-flowmatch 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-04-14 10:14:26 -04:00
Vladimir Mandic 59efc95e00 flux-cfgzero map autopipeline 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-04-14 10:03:33 -04:00
Vladimir Mandic a38f7cbca0 general te hijack 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-04-14 09:46:03 -04:00
Vladimir Mandic cf1606ea11 update diffusers 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-04-14 09:10:01 -04:00
Vladimir Mandic 76b5709f51 add unipc-flowmatch, cfgzero for hidream 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-04-14 08:50:01 -04:00
Vladimir Mandic 06f4879be9 fix logging 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-04-14 08:28:35 -04:00
Vladimir Mandic 94848cbc2b add native hf auth check 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-04-13 10:05:15 -04:00
Vladimir Mandic e9a31a92c9 hidream warn on gated model 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-04-13 09:53:25 -04:00
Vladimir Mandic 4aa17ca745 networks regex pattern(s) for skip-scan 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-04-13 09:10:11 -04:00
Vladimir Mandic a8abed125e xyz grid allow bool 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-04-13 08:39:31 -04:00
Vladimir Mandic 90415a7469 add cfgzero to additional pipelines 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-04-13 07:56:32 -04:00
Vladimir Mandic 9b82bf900e fix typo 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-04-13 07:25:47 -04:00
Vladimir Mandic 6f2891afbd add cfgzero for flux 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-04-12 19:20:27 -04:00
Vladimir Mandic 054a28d25a cleanup logging 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-04-12 18:07:17 -04:00
Vladimir Mandic d9a72be74c display reference models with subdued color 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-04-12 17:59:24 -04:00
Vladimir Mandic 7364bc364b cleanup cogview loader 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-04-12 17:36:51 -04:00
Vladimir Mandic fb48f5e60b hidream remote-vae 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-04-12 11:11:25 -04:00
Vladimir Mandic 6dd37753db hidream bump max-token-length from 128 to 256 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-04-12 09:24:38 -04:00
Vladimir Mandic 3533258980 hidream whitelist samplers 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-04-11 22:32:57 -04:00
Vladimir Mandic 0f595d4cc5 cleanup multiple model loaders 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-04-11 22:16:05 -04:00
Vladimir Mandic 78d8bfeba7 hidream allow custom llama 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-04-11 21:27:48 -04:00
Disty0 51c46339d6 IPEX fix Flux and HiDream 2025-04-11 22:17:18 +03:00
Vladimir Mandic 0439e5652d add shared.opts.device_map 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-04-11 14:53:42 -04:00
Disty0 72918eb94d Fix quanto needing to re-quant when moving to gpu 2025-04-11 21:50:06 +03:00
Disty0 8e567f3ab0 Fix and update TorchAO 2025-04-11 20:08:03 +03:00
Disty0 bd1d8d44dc Fix quanto with transformers 2025-04-11 19:15:23 +03:00
Vladimir Mandic 92af0036c6 add hidream 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-04-10 16:28:15 -04:00
Vladimir Mandic f2a4ef1eb0 loader basic gguf support 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-04-09 08:59:23 -04:00
Vladimir Mandic 984aa8ec55 lint fixes 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-04-08 16:31:51 -04:00
Vladimir Mandic 6ab59230ba update ui 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-04-08 15:22:08 -04:00
Vladimir Mandic 84fe068070 custom model loader 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-04-08 14:56:07 -04:00
Vladimir Mandic 26193b6c22 update changelog 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-04-08 07:52:10 -04:00
Vladimir Mandic b5e421018b fix prompt scheduling 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-04-08 07:46:25 -04:00
Disty0 748bdbf437 Update rocm flash attention repo with navi rotary fix 2025-04-08 00:15:57 +03:00
Vladimir Mandic 97df5869a4 update requirements 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-04-07 09:30:03 -04:00
Vladimir Mandic dc9a64d00b memmon detect gpu swapping 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-04-07 08:59:54 -04:00
Vladimir Mandic 84a24fb681 lora restore weights to orig device on apply 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-04-07 07:49:18 -04:00
Vladimir Mandic f414ea1139 set offload default 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-04-06 13:10:32 -04:00
Vladimir Mandic d30b1cb1c8 lora improvements 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-04-06 13:02:58 -04:00
Vladimir Mandic 000a689428 ui custom model loader 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-04-06 11:37:23 -04:00
Vladimir Mandic 85a961aa49 add cmdopt status 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-04-06 08:43:26 -04:00
Vladimir Mandic 95d055c191 live preview and progress polling now depend if page is visible 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-04-05 20:31:46 -04:00
Vladimir Mandic 228da75a2e add teacache 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-04-05 20:15:48 -04:00
Vladimir Mandic 8f95477ad2 add teacache for flux 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-04-05 12:58:00 -04:00
Vladimir Mandic d502e3510a add softfill pipeline 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-04-05 12:58:00 -04:00
Vladimir Mandic 538b81021c add generate context menu get server status 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-04-05 12:58:00 -04:00
Vladimir Mandic 263b841129 logging cleanup 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-04-05 12:58:00 -04:00
Seunghoon Lee 69ec66f58a
fix zluda-python.py 
closes #3857

Co-authored-by: ackhack <christoph.fuerbacher@gmail.com>
 2025-04-05 22:26:07 +09:00
Vladimir Mandic 68f3c203b1 remove non-blocking 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-04-04 15:49:50 -04:00
Vladimir Mandic ff4d57814e fix debug logging 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-04-04 09:14:48 -04:00
Vladimir Mandic 7520be4874 styles resize and bring quick-ui forward on hover 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-04-04 09:05:32 -04:00
Vladimir Mandic 1f446bc8ed progress use batch info 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-04-04 08:22:25 -04:00
Seunghoon Lee 64bc5cea6a
zluda triton add more gpus 2025-04-04 21:20:02 +09:00
Vladimir Mandic cd8357f1f4 add detailer renoise feature 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-04-03 21:12:58 -04:00
Vladimir Mandic ea0389162f check for init and call 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-04-03 19:23:33 -04:00
Vladimir Mandic 8725cfc488 lora obey device 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-04-03 14:31:39 -04:00
Vladimir Mandic a5f796a166 change field used for true cfg 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-04-03 10:24:55 -04:00
Vladimir Mandic 5c6c1465f4 fix style apply params 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-04-03 10:03:48 -04:00
Vladimir Mandic 5bdc87b68a fix server restart 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-04-03 08:22:43 -04:00
Vladimir Mandic 6c29c3fb4d edit built-in styles 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-04-03 07:04:59 -04:00
Seunghoon Lee 8e3ef40014
zluda llm/vlm temp fix 2025-04-02 23:19:41 +09:00
Vladimir Mandic 760b41e99f update requirements and changelog 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-04-02 09:33:09 -04:00
Vladimir Mandic 73cd4727e6 fix paste incorrect float to int cast 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-04-02 08:59:27 -04:00
Vladimir Mandic e5a256e74d prompt enhance add prefix and suffix 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-04-01 21:31:19 -04:00
Vladimir Mandic d3633be484 add job info to monitor stats 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-04-01 14:19:40 -04:00
Vladimir Mandic 17fbadb0e8 reset memory stats between runs 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-04-01 14:00:39 -04:00
Vladimir Mandic 6430f7006f add monitor cli option and finish lora refactor 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-04-01 13:39:47 -04:00
Vladimir Mandic c208175c0f fix flux partial quantization 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-04-01 13:39:47 -04:00
Vladimir Mandic b5031a5eba lora modularize code 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-04-01 13:39:47 -04:00
Vladimir Mandic 032bd46de2 improve mp4 download 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-04-01 13:39:47 -04:00
Vladimir Mandic 6b8299eac8 lora mpt4 preview support 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-04-01 13:39:47 -04:00
Vladimir Mandic 5906eb6792 lora apply on gpu vs cpu settings option 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-04-01 13:39:47 -04:00
Seunghoon Lee 0eaa2c0378
rocm wsl better arch detection 2025-04-01 21:14:02 +09:00
Vladimir Mandic e8ae79cc49 hdr detect packed latents 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-03-31 13:59:46 -04:00
Seunghoon Lee f46ee37f3a
zluda log & install improvements 2025-03-31 22:50:25 +09:00
Vladimir Mandic f965e72515 fix nncf check 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-03-31 09:40:02 -04:00
Vladimir Mandic daec94a9e9 settings css improvements 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-03-30 15:39:44 -04:00
Vladimir Mandic def571dae9 fix settings save 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-03-30 15:29:18 -04:00
Vladimir Mandic a467e23d72 full ui-settings refactor 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-03-30 15:04:17 -04:00
Vladimir Mandic 1137297e3a fix latte1-t2v 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-03-29 13:43:53 -04:00
Vladimir Mandic 2cd89378bd styles change settings on-the-fly 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-03-29 12:54:48 -04:00
Vladimir Mandic ac61fce526 prompt enhance add censor detection and debugging 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-03-29 11:43:22 -04:00
Vladimir Mandic 02f480bf32 add prompt enhance wiki 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-03-29 09:55:56 -04:00
Vladimir Mandic 8014c6381d interpolate dont skip duplicate frames 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-03-28 21:31:52 -04:00
Vladimir Mandic 8343469be0 improve prompt enhancer and update apply styles 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-03-28 21:03:27 -04:00
Vladimir Mandic 720d8a8df6 improve video interpolation logging 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-03-28 20:37:09 -04:00
Vladimir Mandic 5ce834c362 fix missing quant options 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-03-28 14:50:37 -04:00
Vladimir Mandic f4fdd496b9 more granular quantization modules options 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-03-28 14:46:52 -04:00