Commit Graph

693 Commits (321bfe8bc77d4b4e0e223089f437df1eba9d2d9d)

Author SHA1 Message Date
Vladimir Mandic 2c8cb5cd67 vae exception handling 2024-08-29 17:46:32 -04:00
Vladimir Mandic ec85ab408f cleanup 2024-08-29 17:05:42 -04:00
Vladimir Mandic 68a8ffa3cf ipadapter optional face autocrop input image 2024-08-29 14:10:38 -04:00
Vladimir Mandic 4f606d38f8 update auraflow 2024-08-29 08:11:06 -04:00
Vladimir Mandic 5ed58ac7cc end-to-end update flux, see changelog and wiki 2024-08-28 08:04:24 -04:00
Disty0 3a97db1f8a Fix setting no-half-vae 2024-08-22 00:16:00 +03:00
Disty0 6a58d5210b Make eval use apply_compile_to_model 2024-08-19 20:06:51 +03:00
Disty0 cc89ed84f9 Rename cpu offload to model offload 2024-08-19 18:48:09 +03:00
Disty0 a3f26c9df0 Convert Dynamic Attention SDP to a global SDP option 2024-08-18 01:44:27 +03:00
Disty0 5c857e8aaf Add check for Flux attention processor 2024-08-18 00:35:10 +03:00
Disty0 bce3c7eabf Fix --Xvram flags not activating offload 2024-08-18 00:23:15 +03:00
Disty0 5a75b120ae Fix Lora with Balanced Offlaod 2024-08-16 21:22:41 +03:00
Disty0 7a6b45b410 Balanced offload move device map calcs 2024-08-16 02:49:42 +03:00
Disty0 8699e0cacb Add gc to balanced offload 2024-08-14 17:37:07 +03:00
Disty0 7edc864014 Add module name to disk offload path 2024-08-14 12:21:54 +03:00
Disty0 8619a7f35c Better balanced offload 2024-08-14 11:53:35 +03:00
Disty0 a73716bf89 Add meta to device check 2024-08-13 23:35:56 +03:00
Disty0 97a5faed4c Fix qint4 2024-08-13 23:24:42 +03:00
Disty0 6a1af56834 FLUX quant loading support 2024-08-11 23:54:05 +03:00
Disty0 fb89e26b54 Auto detect memory size ffor balaced offload 2024-08-11 19:01:49 +03:00
Disty0 4ba173280b Check device index for balanced offload 2024-08-11 17:35:07 +03:00
Disty0 e3b087b6c0 Add balanced offload mode and make offload modes a single choice list 2024-08-11 17:27:30 +03:00
Seunghoon Lee a9f27991a3
enable diffusers_move_unet for Flux 2024-08-09 16:12:01 +09:00
Disty0 1cf87ef409 Change cascade load order 2024-08-07 05:03:26 +03:00
Disty0 9818950991 Cascade fixes 2024-08-07 04:54:41 +03:00
Disty0 6c75bcca0a Optimum Quanto support 2024-07-30 17:35:56 +03:00
Vladimir Mandic 9e6fb5249c add auraflow 2024-07-12 08:43:30 -04:00
Vladimir Mandic dddf0f2aeb draft kwai kolors 2024-07-07 12:44:38 -04:00
Vladimir Mandic 32dc4b3ab4 draft lumina work 2024-07-05 20:06:06 -04:00
Disty0 e5bd949b93 Don't force vae config on huggingface models 2024-07-03 19:00:50 +03:00
Vladimir Mandic 576d9aae73 autodetect sd3-t5-fp16 2024-06-28 09:27:36 -04:00
Vladimir Mandic 16ab1a0af7 lint updates 2024-06-26 08:58:22 -04:00
Vladimir Mandic 2f9f2c5c52 fix inpaint pipeline missing requires_aesthetics_score 2024-06-22 18:00:01 -04:00
Vladimir Mandic 01ca2d40fb cleanup 2024-06-22 08:43:06 -04:00
Vladimir Mandic e4a8919ca1 one more fix for requires_aesthetics_score 2024-06-22 08:35:18 -04:00
Disty0 bbaec29720 Cleanup 2024-06-21 21:07:15 +03:00
Vladimir Mandic 0f459411e4 extra check 2024-06-21 12:59:35 -04:00
Disty0 77657611c0 Fix Diffusers requires_aesthetics_score 2024-06-21 19:30:20 +03:00
Disty0 8eb26b202c Update changelog 2024-06-21 18:21:48 +03:00
Disty0 43a54317ee Fix face hires with lowvram 2024-06-21 18:09:56 +03:00
Vladimir Mandic a1beb777fc update notes 2024-06-21 08:35:37 -04:00
Vladimir Mandic 6b6170bfaa
Merge branch 'dev' into SD3-parsing 2024-06-21 08:16:44 -04:00
Vladimir Mandic e51599cc6f disable model load fallback on unknown model 2024-06-20 18:21:42 -04:00
Vladimir Mandic 1a6d313340 cleanup 2024-06-20 13:46:31 -04:00
AI-Casanova 1fcd378bd1
Merge branch 'dev' into SD3-parsing 2024-06-19 23:47:17 -05:00
AI-Casanova e3009753e3
Finish SD3 Prompt Parsing, reconfigure Compel Hijack 2024-06-19 23:41:11 -05:00
Disty0 bf9565cb46 NNCF compression support on CPU and add INT8 option for T5 2024-06-19 21:23:47 +03:00
Vladimir Mandic 2a27cd916d pixart sigma improvements 2024-06-18 13:21:13 -04:00
Vladimir Mandic bbaa03a466 add 4bit t5 2024-06-17 09:39:30 -04:00
Vladimir Mandic 9644063cd6 add generic t5 loader 2024-06-16 11:38:29 -04:00
Vladimir Mandic a726acbcc6 fix HunyuanDiT 2024-06-15 17:08:33 -04:00
Vladimir Mandic 5feaed0c6a unify hf-login 2024-06-15 16:47:03 -04:00
Vladimir Mandic 3f1c236ce4 force apply vae config on model load 2024-06-13 20:13:18 -04:00
Vladimir Mandic d7983eece7 sd3 add transformer attention method 2024-06-13 13:28:24 -04:00
Vladimir Mandic 3a9f56a7ac sd3 allow loading safetensors without clip 2024-06-13 09:07:47 -04:00
Vladimir Mandic 9ec6816a91 sd use hf token froms settings and use cached config 2024-06-13 08:52:01 -04:00
Vladimir Mandic e0ab411686 update sd3 loader cache 2024-06-12 21:30:15 -04:00
Vladimir Mandic 6e01d510d4 add sd3 2024-06-12 21:02:48 -04:00
Vladimir Mandic 6d6f1de295 additional python 3.12 compatibility 2024-06-08 14:14:48 -04:00
Vladimir Mandic 5574833f0d refactor backend detection 2024-06-06 20:41:10 -04:00
Vladimir Mandic 1e4800e8f5 Jumbo update: HunyuanDiT, MuLan, PCM, T-Gate, KohyaHiResFix 2024-06-03 16:53:20 -04:00
Vladimir Mandic 3cd12c51f5 fix loading models 2024-06-02 11:51:42 -04:00
Vladimir Mandic 9a7a5ba81c lint cleanup 2024-05-28 10:48:27 -04:00
Vladimir Mandic d7c732bfe6 layer diffuse enhancements 2024-05-28 08:45:29 -04:00
Vladimir Mandic b5c1ec1941 multiple patches 2024-05-27 16:29:32 -04:00
Disty0 08497c1a90 Remove offload device workaround 2024-05-27 16:22:16 +03:00
Vladimir Mandic ac5b9a66b9 update requirements 2024-05-21 11:42:59 -04:00
Vladimir Mandic 554e5c8224 torch dynamic profiling 2024-05-16 18:40:18 -04:00
Vladimir Mandic d63f35e298 add cudaMallocAsync 2024-05-16 18:02:55 -04:00
Vladimir Mandic 199eca2133 mulan prototype 2024-05-16 12:40:28 -04:00
Vladimir Mandic 2dc08a0453
Merge pull request #3136 from Disty0/dev
Stable Cascade UNet support
2024-05-15 11:54:31 -04:00
Vladimir Mandic eb34241ca9 enhance metadata handling 2024-05-15 10:08:31 -04:00
Disty0 d171f58018 Move Cascade from sd_models 2024-05-15 09:18:18 +03:00
Disty0 aca870ac4f Stable Cascade UNet support 2024-05-15 09:06:53 +03:00
Vladimir Mandic 894a1986f3 fix pixart-sigma and make it muuch faster 2024-05-14 14:59:55 -04:00
Vladimir Mandic f7fa2794df fix stable cascade 2024-05-14 14:20:13 -04:00
Vladimir Mandic 76cbf11559 cache diffusers model config 2024-05-14 12:54:34 -04:00
Vladimir Mandic 328930966e change local_files_only 2024-05-12 18:37:30 -04:00
Vladimir Mandic d6e2271fc3 fix pag with facehires 2024-05-11 09:42:39 -04:00
Vladimir Mandic cb1838c05e update loading logic again 2024-05-11 09:33:04 -04:00
Vladimir Mandic bd3b3bd01c set localfilesonly default false 2024-05-10 18:02:01 -04:00
Disty0 8cddaa5723 Re-apply attention if attention method changes 2024-05-11 00:05:22 +03:00
Vladimir Mandic d1b0cd61b3 reorg model load 2024-05-10 16:53:49 -04:00
Vladimir Mandic 1c793e8357 fix embeddings load 2024-05-10 16:35:36 -04:00
Vladimir Mandic 2f3557f6ea patch diffusers loader 2024-05-10 10:08:01 -04:00
Vladimir Mandic 35665cd719 new from_single_file compatibiltiy 2024-05-09 16:27:21 -04:00
Vladimir Mandic faf3f3212e animatediffxl alpha 2024-05-09 10:13:56 -04:00
Vladimir Mandic 0b420eaf44 fix git mess 2024-05-07 17:43:27 -04:00
Vladimir Mandic be52fe003b backup default sampler 2024-05-07 17:26:01 -04:00
Disty0 6942c3e61e Fix sequential offload with embeddings 2024-05-07 20:25:20 +03:00
Disty0 3f4cd91640 Fix VAE reload with sequential offload 2024-05-07 19:38:00 +03:00
Vladimir Mandic 9ff507d93a add todo token downsampling and simplify tomes 2024-04-28 20:29:28 -04:00
Vladimir Mandic a26d222cc1 add load unet override 2024-04-28 11:51:08 -04:00
Vladimir Mandic e9dcceac0e fix pixart-sigma 2024-04-26 11:06:08 -04:00
Disty0 5b444c39d7 Wuerstchen V3 fixes and custom model support 2024-04-25 23:13:08 +03:00
Disty0 a8b2d0b8c9 Update defaults and add autodetect for VRAM optimizations 2024-04-21 00:53:31 +03:00
Vladimir Mandic e900adf5ee cleanup 2024-04-20 11:48:44 -04:00
Vladimir Mandic e4b179e027 check attention availability 2024-04-15 11:43:51 -04:00
Vladimir Mandic ad7d0bbf6a add pixart-sigma 2024-04-11 15:12:50 -04:00
Disty0 16b714ac48 Pass device to Model CPU Offload 2024-03-27 22:24:37 +03:00