1580158
/
automatic
mirror of https://github.com/vladmandic/automatic
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
12,597 Commits
3 Branches
29 Tags
109 MiB
Commit Graph

955 Commits (0e0b607cfaabf59167e3ab2a44d491b4e4e1b08e)

Author SHA1 Message Date
Disty0 917d9e6c86 Live previews add flow_prediction 2024-12-25 18:43:10 +03:00
Disty0 5e35d6c3a3 Better live previews 2024-12-25 18:19:43 +03:00
Vladimir Mandic ea6d3107ab update all todo statements 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-12-22 08:39:31 -05:00
Vladimir Mandic 11b2a055c3 fix svd i2v 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-12-21 11:31:08 -05:00
Vladimir Mandic ed3e5f06d6 linting 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-12-20 18:48:06 -05:00
Vladimir Mandic 58ad18ee58 on-the-fly quant for sd35, flux and sana 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-12-20 17:28:33 -05:00
Vladimir Mandic 20f2554cec add sd35-ipadapter and more balanced offload optimizations 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-12-20 10:22:42 -05:00
Vladimir Mandic fd7fe8cea5 add torchao 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-12-17 13:29:36 -05:00
Vladimir Mandic ab07788ab5 add sana 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-12-16 11:30:15 -05:00
Vladimir Mandic 814161cb21 major controlnet work, xinsir promax and tiling support 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-12-14 17:29:51 -05:00
Disty0 7d7bcb9684 Fix balanced offload with Cascade 2024-12-13 23:01:53 +03:00
Vladimir Mandic e9f951b2c5 offload logging 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-12-11 14:20:01 -05:00
Vladimir Mandic 9a588d9c91 update balanced offload 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-12-11 12:06:03 -05:00
Vladimir Mandic f4847f1b8a optimize balanced offload 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-12-10 15:49:20 -05:00
Vladimir Mandic 28eeb00432 remove non-blocking 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-12-06 09:15:37 -05:00
Vladimir Mandic ca06002602 lora maintain device 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-12-04 09:25:57 -05:00
Vladimir Mandic e41d9f52cd add offload warning 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-12-04 08:47:22 -05:00
Vladimir Mandic 106f93f079 memory optimizations 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-12-01 17:13:55 -05:00
Vladimir Mandic 023b13b6cb balanced offload improvements 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-12-01 15:34:25 -05:00
Vladimir Mandic c5cd3cb623 reinit offoad instance on change 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-11-30 19:15:50 -05:00
Vladimir Mandic b7aff134a2 add low/high threshold to balanced offload 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-11-30 19:03:51 -05:00
Disty0 81a95d04cf Skip apply_balanced_offload if not needed 2024-11-30 21:12:26 +03:00
Disty0 b55e746fca Improve balanced offload pre forward performance 2024-11-30 20:49:57 +03:00
Vladimir Mandic eee85e5a4e lora refactor in progress 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-11-30 12:29:58 -05:00
Disty0 6ec93f2d46 Disable load lora gpu with medvram too 2024-11-30 17:04:35 +03:00
Disty0 881fa1183c Fix offload issues with lora 2024-11-30 00:16:38 +03:00
Disty0 e52019104d revert sd_models.py 2024-11-29 22:55:15 +03:00
Disty0 39b14a202e Fix sequential offload with lora 2024-11-29 22:35:00 +03:00
Vladimir Mandic 164ce252dc add sd35 controlnets 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-11-28 08:46:10 -05:00
Vladimir Mandic e4038feff1 minor updates 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-11-24 15:05:58 -05:00
Vladimir Mandic 67c6b93213 flux tools support 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-11-23 15:27:01 -05:00
Vladimir Mandic 6bd25a6f90 js pbar improvements 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-11-23 09:07:43 -05:00
Vladimir Mandic 62c53942e0 post release jumbo patch 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-11-22 12:55:18 -05:00
AI-Casanova 9f65f8b8c3
Fix LoRA with balanced offload 2024-11-20 13:00:41 -06:00
Vladimir Mandic 7344a8c3d8 fix pulid attention 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-11-14 17:08:11 -05:00
Vladimir Mandic 4033f2b63f pulid enable inpaint mask only 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-11-14 08:16:12 -05:00
Vladimir Mandic c199e3e668 pulid optimizations: dtype, vae, offload 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-11-12 11:18:33 -05:00
Vladimir Mandic 34bc7377d8 update pulid 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-11-12 11:18:33 -05:00
Vladimir Mandic 8249865f41 fix pag switch pipeline 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-11-12 11:18:06 -05:00
Vladimir Mandic 9492228175 improve auto-pipeline switch 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-11-12 11:18:06 -05:00
Vladimir Mandic 13cb5704b9 pulid img2img and inpaint placeholders 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-11-12 11:17:26 -05:00
Vladimir Mandic b42e9253e3 pullid offload compatibility and extra samplers 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-11-12 11:17:26 -05:00
Vladimir Mandic 29f5202811
Merge branch 'dev' into refactor-prompt 2024-11-06 10:58:03 -05:00
Vladimir Mandic 0a0c5cd85a add instantir 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-11-05 18:20:38 -05:00
Vladimir Mandic 3df0fb8008 apply balanced to recursive pipe 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-11-04 12:42:16 -05:00
Vladimir Mandic a2f9a4dbb0 refactor pulid 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-11-04 12:31:39 -05:00
Vladimir Mandic 51d6e1d559 update notes 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-11-03 11:14:51 -05:00
Vladimir Mandic abfb197504 sd35 all-in-one safetensors support 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-10-30 19:30:52 -04:00
Vladimir Mandic 8b5f510528 add sd3 controlnets 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-10-30 14:24:12 -04:00
Vladimir Mandic f9ca39c630 readd model_hash to sd_models 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-10-30 08:42:55 -04:00
AI-Casanova 38303f0c61
Cache unload 2024-10-29 21:24:10 -05:00
Vladimir Mandic d205b5cf3e update 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-10-29 15:31:50 -04:00
Vladimir Mandic 76a0a63243 offload exclude lsit 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-10-29 13:53:21 -04:00
Vladimir Mandic c5f5c5e0d0 fix diffusers load from folder 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-10-29 13:22:01 -04:00
Vladimir Mandic 07f3ff7659 cleanup 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-10-29 12:58:07 -04:00
Vladimir Mandic 0756e410c9 add k-diffusion samplers to diffusers 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-10-27 13:10:06 -04:00
Vladimir Mandic 706852e7c5 fix taesd live preview 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-10-27 09:23:53 -04:00
Vladimir Mandic 0fb6cf2dec add legacy typo 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-10-26 20:35:47 -04:00
Vladimir Mandic 6760632f38 major model load refactor 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-10-26 13:22:29 -04:00
Vladimir Mandic 1ad8ca1d58 change model selector 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-10-25 11:23:41 -04:00
Vladimir Mandic 8c12d0264e enable sd3 native lora and update requirements 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-10-25 09:21:09 -04:00
Vladimir Mandic ad3f40f736 improve sd3 loader 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-10-24 13:14:48 -04:00
Vladimir Mandic 321bfe8bc7 better handle partial models 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-10-24 11:36:21 -04:00
Vladimir Mandic f191134aa6 support bnb quantization during load 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-10-22 15:43:09 -04:00
Vladimir Mandic b37c6115ff fix sd3 loader 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-10-22 12:49:07 -04:00
Vladimir Mandic cf9fe20803 omnigen! 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-10-22 12:10:53 -04:00
Vladimir Mandic ae4591ac0b reimplement torchao quantization 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-10-18 09:34:04 -04:00
Disty0 6ae82cbd6e Cascade fix default scheduler 2024-10-18 01:26:23 +03:00
Vladimir Mandic 9c7eba1b61
Merge pull request #3490 from Fundaris/dev 
Fix UnboundLocalError on pipeline loading
 2024-10-16 17:40:40 -04:00
Disty0 899c896f23 cleanup 2024-10-17 00:25:03 +03:00
Vladimir Mandic 1427a4f06b add conditional 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-10-16 17:21:20 -04:00
Vladimir Mandic dba69ac65e refactor load-model 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-10-16 16:44:00 -04:00
Fundaris 7a5e623084 Fix UnboundLocalError on pipeline loading 2024-10-16 19:23:29 +02:00
Vladimir Mandic db3e03cb89 add meissonic (unstable) 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-10-16 12:10:43 -04:00
Vladimir Mandic be7449cf02 fix loading of some non-primary models 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-10-15 12:52:42 -04:00
Disty0 62d74318a0 Use _internal_dict.keys instead of _get_signature_keys 2024-10-14 22:44:14 +03:00
Disty0 bbedeaf18c Set has_accelerate with get_signature_keys 2024-10-14 21:19:10 +03:00
Vladimir Mandic 6bb688c371 add set_accelerate 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-10-14 13:57:05 -04:00
Vladimir Mandic cdcca50fb4 add model analyzer 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-10-14 13:03:46 -04:00
Disty0 b14e8f9a5f Don't assume Cuda on devices.same_device() 2024-10-14 17:23:51 +03:00
Vladimir Mandic ea0dfebe2d better handle any quant lib requirements 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-10-12 13:36:16 -04:00
Vladimir Mandic 723ce74986 add linfusion 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-10-09 11:01:16 -04:00
Vladimir Mandic f17fbe096d fix corner-case model load on startup 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-10-09 08:36:52 -04:00
Vladimir Mandic 176c5c5773 sampler options rewrite 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-10-03 09:38:38 -04:00
Vladimir Mandic e8e05b7dda change clip load order 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-10-02 12:48:37 -04:00
Vladimir Mandic bd6e689bd1 fix te meta 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-10-01 21:26:21 -04:00
Vladimir Mandic 9a46d381cc cleanups 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-10-01 20:02:21 -04:00
Vladimir Mandic 47755dce6b refactor devices 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-09-29 20:17:03 -04:00
Vladimir Mandic 2e3a3a3ec7 add ctrl+x 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-09-29 12:35:48 -04:00
Vladimir Mandic 92f2a2902f improve profiling 2024-09-23 11:07:24 -04:00
Vladimir Mandic b9e230c17f update logging 2024-09-22 11:17:06 -04:00
Vladimir Mandic f059313333 auto-set upcast if first decode fails, fix flux 2024-09-21 13:32:58 -04:00
Vladimir Mandic bdbd24ee66 expermental t5 gguf support 2024-09-20 12:52:52 -04:00
Vladimir Mandic 2698ede68f flux controlnet img2img and inpaint 2024-09-19 11:44:38 -04:00
Vladimir Mandic 2acb883dda jumbo update, see changelog 2024-09-18 13:48:30 -04:00
Vladimir Mandic 0c221a6b7d cleanup 2024-09-15 12:30:48 -04:00
Vladimir Mandic 5bbc8e4b03 interrogate update 2024-09-15 10:50:52 -04:00
Vladimir Mandic 3379232e9c fix path-to-repo-parsing 2024-09-15 09:01:13 -04:00
Disty0 012a7f3572 Update OpenVINO to 2024.3.0 2024-09-13 03:57:06 +03:00
Vladimir Mandic 6ab65318ee fix auraflow 2024-09-12 17:51:15 -04:00
Vladimir Mandic c788c8a3d5 update diffusers 2024-09-11 18:03:15 -04:00
Vladimir Mandic f2c5cbbb36 lint updates and diffusers installer 2024-09-06 14:10:53 -04:00
Vladimir Mandic 85b26e03ff minor updates 2024-09-06 10:13:32 -04:00
Vladimir Mandic 25a301105f add flux inpaint and img2img 2024-09-04 18:20:40 -04:00
Vladimir Mandic 00c9a2bb75 add cogvideox txt2video 2024-09-04 16:45:44 -04:00
Vladimir Mandic e2d13a4dfb flux controlnet support 2024-09-02 11:54:18 -04:00
Vladimir Mandic 045b24c060 fix vae decode for backend original 2024-09-02 08:23:40 -04:00
Vladimir Mandic 7f2e30576d fix handling of online model configs 2024-09-01 23:19:38 -04:00
Vladimir Mandic b4df9a4de1 jumbo update with flux.1 refactor, see changelog for details 2024-09-01 22:56:15 -04:00
Vladimir Mandic 0d9ce663e4 post release dev merge, see changelog for details 2024-09-01 12:20:10 -04:00
Vladimir Mandic 1114165cc1 update changelog and cleanup 2024-08-29 20:16:32 -04:00
Vladimir Mandic 81583efdf5 add flux offline config and fix vae config reference 2024-08-29 19:16:17 -04:00
Vladimir Mandic 2c8cb5cd67 vae exception handling 2024-08-29 17:46:32 -04:00
Vladimir Mandic ec85ab408f cleanup 2024-08-29 17:05:42 -04:00
Vladimir Mandic 68a8ffa3cf ipadapter optional face autocrop input image 2024-08-29 14:10:38 -04:00
Vladimir Mandic 4f606d38f8 update auraflow 2024-08-29 08:11:06 -04:00
Vladimir Mandic 5ed58ac7cc end-to-end update flux, see changelog and wiki 2024-08-28 08:04:24 -04:00
Disty0 3a97db1f8a Fix setting no-half-vae 2024-08-22 00:16:00 +03:00
Disty0 6a58d5210b Make eval use apply_compile_to_model 2024-08-19 20:06:51 +03:00
Disty0 cc89ed84f9 Rename cpu offload to model offload 2024-08-19 18:48:09 +03:00
Disty0 a3f26c9df0 Convert Dynamic Attention SDP to a global SDP option 2024-08-18 01:44:27 +03:00
Disty0 5c857e8aaf Add check for Flux attention processor 2024-08-18 00:35:10 +03:00
Disty0 bce3c7eabf Fix --Xvram flags not activating offload 2024-08-18 00:23:15 +03:00
Disty0 5a75b120ae Fix Lora with Balanced Offlaod 2024-08-16 21:22:41 +03:00
Disty0 7a6b45b410 Balanced offload move device map calcs 2024-08-16 02:49:42 +03:00
Disty0 8699e0cacb Add gc to balanced offload 2024-08-14 17:37:07 +03:00
Disty0 7edc864014 Add module name to disk offload path 2024-08-14 12:21:54 +03:00
Disty0 8619a7f35c Better balanced offload 2024-08-14 11:53:35 +03:00
Disty0 a73716bf89 Add meta to device check 2024-08-13 23:35:56 +03:00
Disty0 97a5faed4c Fix qint4 2024-08-13 23:24:42 +03:00
Disty0 6a1af56834 FLUX quant loading support 2024-08-11 23:54:05 +03:00
Disty0 fb89e26b54 Auto detect memory size ffor balaced offload 2024-08-11 19:01:49 +03:00
Disty0 4ba173280b Check device index for balanced offload 2024-08-11 17:35:07 +03:00
Disty0 e3b087b6c0 Add balanced offload mode and make offload modes a single choice list 2024-08-11 17:27:30 +03:00
Seunghoon Lee a9f27991a3
enable diffusers_move_unet for Flux 2024-08-09 16:12:01 +09:00
Disty0 1cf87ef409 Change cascade load order 2024-08-07 05:03:26 +03:00
Disty0 9818950991 Cascade fixes 2024-08-07 04:54:41 +03:00
Disty0 6c75bcca0a Optimum Quanto support 2024-07-30 17:35:56 +03:00
Vladimir Mandic 9e6fb5249c add auraflow 2024-07-12 08:43:30 -04:00
Vladimir Mandic dddf0f2aeb draft kwai kolors 2024-07-07 12:44:38 -04:00
Vladimir Mandic 32dc4b3ab4 draft lumina work 2024-07-05 20:06:06 -04:00
Disty0 e5bd949b93 Don't force vae config on huggingface models 2024-07-03 19:00:50 +03:00
Vladimir Mandic 576d9aae73 autodetect sd3-t5-fp16 2024-06-28 09:27:36 -04:00
Vladimir Mandic 16ab1a0af7 lint updates 2024-06-26 08:58:22 -04:00
Vladimir Mandic 2f9f2c5c52 fix inpaint pipeline missing requires_aesthetics_score 2024-06-22 18:00:01 -04:00
Vladimir Mandic 01ca2d40fb cleanup 2024-06-22 08:43:06 -04:00
Vladimir Mandic e4a8919ca1 one more fix for requires_aesthetics_score 2024-06-22 08:35:18 -04:00
Disty0 bbaec29720 Cleanup 2024-06-21 21:07:15 +03:00
Vladimir Mandic 0f459411e4 extra check 2024-06-21 12:59:35 -04:00
Disty0 77657611c0 Fix Diffusers requires_aesthetics_score 2024-06-21 19:30:20 +03:00
Disty0 8eb26b202c Update changelog 2024-06-21 18:21:48 +03:00
Disty0 43a54317ee Fix face hires with lowvram 2024-06-21 18:09:56 +03:00
Vladimir Mandic a1beb777fc update notes 2024-06-21 08:35:37 -04:00
Vladimir Mandic 6b6170bfaa
Merge branch 'dev' into SD3-parsing 2024-06-21 08:16:44 -04:00
Vladimir Mandic e51599cc6f disable model load fallback on unknown model 2024-06-20 18:21:42 -04:00
Vladimir Mandic 1a6d313340 cleanup 2024-06-20 13:46:31 -04:00
AI-Casanova 1fcd378bd1
Merge branch 'dev' into SD3-parsing 2024-06-19 23:47:17 -05:00
AI-Casanova e3009753e3
Finish SD3 Prompt Parsing, reconfigure Compel Hijack 2024-06-19 23:41:11 -05:00
Disty0 bf9565cb46 NNCF compression support on CPU and add INT8 option for T5 2024-06-19 21:23:47 +03:00
Vladimir Mandic 2a27cd916d pixart sigma improvements 2024-06-18 13:21:13 -04:00
Vladimir Mandic bbaa03a466 add 4bit t5 2024-06-17 09:39:30 -04:00
Vladimir Mandic 9644063cd6 add generic t5 loader 2024-06-16 11:38:29 -04:00
Vladimir Mandic a726acbcc6 fix HunyuanDiT 2024-06-15 17:08:33 -04:00
Vladimir Mandic 5feaed0c6a unify hf-login 2024-06-15 16:47:03 -04:00
Vladimir Mandic 3f1c236ce4 force apply vae config on model load 2024-06-13 20:13:18 -04:00
Vladimir Mandic d7983eece7 sd3 add transformer attention method 2024-06-13 13:28:24 -04:00
Vladimir Mandic 3a9f56a7ac sd3 allow loading safetensors without clip 2024-06-13 09:07:47 -04:00
Vladimir Mandic 9ec6816a91 sd use hf token froms settings and use cached config 2024-06-13 08:52:01 -04:00
Vladimir Mandic e0ab411686 update sd3 loader cache 2024-06-12 21:30:15 -04:00
Vladimir Mandic 6e01d510d4 add sd3 2024-06-12 21:02:48 -04:00
Vladimir Mandic 6d6f1de295 additional python 3.12 compatibility 2024-06-08 14:14:48 -04:00
Vladimir Mandic 5574833f0d refactor backend detection 2024-06-06 20:41:10 -04:00
Vladimir Mandic 1e4800e8f5 Jumbo update: HunyuanDiT, MuLan, PCM, T-Gate, KohyaHiResFix 2024-06-03 16:53:20 -04:00
Vladimir Mandic 3cd12c51f5 fix loading models 2024-06-02 11:51:42 -04:00
Vladimir Mandic 9a7a5ba81c lint cleanup 2024-05-28 10:48:27 -04:00
Vladimir Mandic d7c732bfe6 layer diffuse enhancements 2024-05-28 08:45:29 -04:00
Vladimir Mandic b5c1ec1941 multiple patches 2024-05-27 16:29:32 -04:00
Disty0 08497c1a90 Remove offload device workaround 2024-05-27 16:22:16 +03:00
Vladimir Mandic ac5b9a66b9 update requirements 2024-05-21 11:42:59 -04:00
Vladimir Mandic 554e5c8224 torch dynamic profiling 2024-05-16 18:40:18 -04:00
Vladimir Mandic d63f35e298 add cudaMallocAsync 2024-05-16 18:02:55 -04:00
Vladimir Mandic 199eca2133 mulan prototype 2024-05-16 12:40:28 -04:00
Vladimir Mandic 2dc08a0453
Merge pull request #3136 from Disty0/dev 
Stable Cascade UNet support
 2024-05-15 11:54:31 -04:00
Vladimir Mandic eb34241ca9 enhance metadata handling 2024-05-15 10:08:31 -04:00
Disty0 d171f58018 Move Cascade from sd_models 2024-05-15 09:18:18 +03:00
Disty0 aca870ac4f Stable Cascade UNet support 2024-05-15 09:06:53 +03:00
Vladimir Mandic 894a1986f3 fix pixart-sigma and make it muuch faster 2024-05-14 14:59:55 -04:00
Vladimir Mandic f7fa2794df fix stable cascade 2024-05-14 14:20:13 -04:00
Vladimir Mandic 76cbf11559 cache diffusers model config 2024-05-14 12:54:34 -04:00
Vladimir Mandic 328930966e change local_files_only 2024-05-12 18:37:30 -04:00
Vladimir Mandic d6e2271fc3 fix pag with facehires 2024-05-11 09:42:39 -04:00
Vladimir Mandic cb1838c05e update loading logic again 2024-05-11 09:33:04 -04:00
Vladimir Mandic bd3b3bd01c set localfilesonly default false 2024-05-10 18:02:01 -04:00
Disty0 8cddaa5723 Re-apply attention if attention method changes 2024-05-11 00:05:22 +03:00
Vladimir Mandic d1b0cd61b3 reorg model load 2024-05-10 16:53:49 -04:00
Vladimir Mandic 1c793e8357 fix embeddings load 2024-05-10 16:35:36 -04:00
Vladimir Mandic 2f3557f6ea patch diffusers loader 2024-05-10 10:08:01 -04:00
Vladimir Mandic 35665cd719 new from_single_file compatibiltiy 2024-05-09 16:27:21 -04:00
Vladimir Mandic faf3f3212e animatediffxl alpha 2024-05-09 10:13:56 -04:00
Vladimir Mandic 0b420eaf44 fix git mess 2024-05-07 17:43:27 -04:00
Vladimir Mandic be52fe003b backup default sampler 2024-05-07 17:26:01 -04:00
Disty0 6942c3e61e Fix sequential offload with embeddings 2024-05-07 20:25:20 +03:00
Disty0 3f4cd91640 Fix VAE reload with sequential offload 2024-05-07 19:38:00 +03:00
Vladimir Mandic 9ff507d93a add todo token downsampling and simplify tomes 2024-04-28 20:29:28 -04:00
Vladimir Mandic a26d222cc1 add load unet override 2024-04-28 11:51:08 -04:00
Vladimir Mandic e9dcceac0e fix pixart-sigma 2024-04-26 11:06:08 -04:00
Disty0 5b444c39d7 Wuerstchen V3 fixes and custom model support 2024-04-25 23:13:08 +03:00
Disty0 a8b2d0b8c9 Update defaults and add autodetect for VRAM optimizations 2024-04-21 00:53:31 +03:00
Vladimir Mandic e900adf5ee cleanup 2024-04-20 11:48:44 -04:00
Vladimir Mandic e4b179e027 check attention availability 2024-04-15 11:43:51 -04:00
Vladimir Mandic ad7d0bbf6a add pixart-sigma 2024-04-11 15:12:50 -04:00
Disty0 16b714ac48 Pass device to Model CPU Offload 2024-03-27 22:24:37 +03:00
Vladimir Mandic 0862b80377 gallery improve sort and separators 2024-03-24 11:11:23 -04:00
Vladimir Mandic b0cb57ee23 add error handler around fused call 2024-03-16 11:23:56 -04:00
Vladimir Mandic 16e3e4023f remove device reference from offload call 2024-03-15 18:31:19 -04:00
Vladimir Mandic 04dbc43186 update 2024-03-14 20:48:10 -04:00
Disty0 7d7d3aaff2 Pass device to model_cpu_offload 2024-03-14 23:47:46 +03:00
Vladimir Mandic 36368d1601 force disable watermark 2024-03-14 16:11:09 -04:00
Vladimir Mandic 20bc82a4ce pipeline load with variant fallback 2024-03-14 15:09:05 -04:00
Vladimir Mandic e971e4fbc0
Merge pull request #2976 from Disty0/dev 
VRAM efficient loading and compile
 2024-03-14 13:57:13 -04:00
Vladimir Mandic 940b6d02ba facehires support batch size&count, add override strength 2024-03-14 11:40:58 -04:00
Disty0 164ada5805 VRAM efficient loading and compile 2024-03-14 01:42:36 +03:00
Vladimir Mandic 80445a6b23 add ledits pipeline 2024-03-13 14:52:28 -04:00
Vladimir Mandic 50b09082a9 update svd 2024-03-13 09:18:07 -04:00
Vladimir Mandic a4c6257124 full refactor of reference models 2024-03-12 23:51:36 -04:00
Vladimir Mandic 6cb20edf7e fix upscaler compile, diffusers enum, svd 2024-03-09 08:35:18 -05:00
Vladimir Mandic 7e7ed3b7fe improve model offload compatibility 2024-03-08 08:29:03 -05:00
Vladimir Mandic ae7b03ac74 fix sc pipeline 2024-03-06 12:59:50 -05:00
Vladimir Mandic b75d84da37 update sc revisions 2024-03-06 12:08:19 -05:00
Vladimir Mandic 96601221f9 improve params parsing 2024-03-06 10:50:52 -05:00
Vladimir Mandic 76b0017675 fix move model 2024-03-05 21:44:20 -05:00
Vladimir Mandic f58f3e6779 fix control init image and offloading 2024-03-05 16:00:30 -05:00
Vladimir Mandic 558463aeaf validate and fix all refiner workflows 2024-03-02 10:01:22 -05:00
Vladimir Mandic 6d0a48db86 modify offloading algo 2024-03-01 16:01:53 -05:00
Vladimir Mandic 4b911ea822 add support for json configs per model component 2024-02-28 15:12:05 -05:00
Vladimir Mandic db22bd5440 cleanup 2024-02-28 11:45:57 -05:00
Vladimir Mandic 7e0f0ae24f update stable cascade pipeline 2024-02-28 11:45:30 -05:00
Disty0 c8ed8659be Update Stable Cascade pipeline 2024-02-28 19:41:42 +03:00
Vladimir Mandic e3c1432502 experimental playground 2.5 support 2024-02-27 17:11:37 -05:00
Vladimir Mandic 36dac2af9c extend use of move_model 2024-02-27 07:46:28 -05:00
Vladimir Mandic 3488dd2cf6 use model yaml if present 2024-02-26 17:38:09 -05:00
Vladimir Mandic 17f2f8d98f add include mask in output, improve model offload compatibility 2024-02-24 11:06:14 -05:00
Vladimir Mandic 6239d266f4 remove training 2024-02-24 09:58:46 -05:00
Vladimir Mandic 1b976f610c update requirements 2024-02-23 00:29:19 -05:00
Vladimir Mandic cf7118be4d refactor stable-cascade, fix taesd bf16, add skip-env cmd flag 2024-02-21 17:13:53 -05:00
Vladimir Mandic d76136fb81 cleanup 2024-02-15 19:03:17 -05:00
Disty0 e631fd85e2 Stable Cascade previewer and fixes 2024-02-15 18:50:54 +03:00
Vladimir Mandic 0e91c46a68 cleanup stable cascade 2024-02-14 09:43:20 -05:00
Disty0 52efa909c5 Experimental Stable Cascade support 2024-02-14 14:51:20 +03:00
Vladimir Mandic 3c9a4d55bb init values for ip 2024-02-11 17:23:50 -05:00