Commit Graph

126 Commits (7d35264c4e40ac8a864b66a96e2fa8b65e3cfcf4)

Author SHA1 Message Date
Vladimir Mandic f4ed53c159 handle a1111 prompt scheduling
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2024-10-24 09:53:25 -04:00
Vladimir Mandic 7d7b2fcf00 add sd3.5
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2024-10-22 13:29:03 -04:00
Vladimir Mandic b37c6115ff fix sd3 loader
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2024-10-22 12:49:07 -04:00
Vladimir Mandic c2ab0b11c3 check te device
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2024-10-14 09:29:33 -04:00
Vladimir Mandic bd6e689bd1 fix te meta
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2024-10-01 21:26:21 -04:00
Vladimir Mandic 9a46d381cc cleanups
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2024-10-01 20:02:21 -04:00
Vladimir Mandic f9b5a83b49 cleanup
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2024-10-01 12:20:32 -04:00
Vladimir Mandic 046d588de2 add fix-te
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2024-10-01 12:12:10 -04:00
Vladimir Mandic 92f2a2902f improve profiling 2024-09-23 11:07:24 -04:00
Vladimir Mandic b9e230c17f update logging 2024-09-22 11:17:06 -04:00
Vladimir Mandic 6919ca310a lint updates 2024-09-21 15:44:53 -04:00
Vladimir Mandic 2be087be38 embeds addiotional checks 2024-09-18 21:46:19 -04:00
Vladimir Mandic 8bd944d48b add move-te 2024-09-18 16:02:20 -04:00
Vladimir Mandic edd92c604e fix 2024-09-18 15:51:26 -04:00
Vladimir Mandic 2acb883dda jumbo update, see changelog 2024-09-18 13:48:30 -04:00
Vladimir Mandic 0d9ce663e4 post release dev merge, see changelog for details 2024-09-01 12:20:10 -04:00
Vladimir Mandic 2c8cb5cd67 vae exception handling 2024-08-29 17:46:32 -04:00
Vladimir Mandic 0b901e08ce xhinker move te as needed 2024-08-29 10:42:38 -04:00
Vladimir Mandic 707fc1de79 flux prompt attention 2024-08-28 08:34:42 -04:00
AI-Casanova 1de7716495
Remove print commands 2024-08-25 18:27:30 -05:00
AI-Casanova 517ee93e96
xhinker parser implementation 2024-08-25 18:23:45 -05:00
Disty0 c1285c6de6 Cascade re-add empty embed provider 2024-08-23 07:09:05 +03:00
Disty0 02d6b674c6 Cascade decide atten mask value from the model name 2024-08-23 02:53:39 +03:00
Disty0 8619a7f35c Better balanced offload 2024-08-14 11:53:35 +03:00
Disty0 70c2e84d26 Prompt cache support for Flux 2024-08-12 01:02:13 +03:00
Disty0 e3b087b6c0 Add balanced offload mode and make offload modes a single choice list 2024-08-11 17:27:30 +03:00
Disty0 6431296ec1 Fix Cascade empty prompt encode 2024-08-09 00:32:19 +03:00
Disty0 a17e452db2 Fix Cascade with long prompts 2024-08-07 01:32:09 +03:00
Vladimir Mandic 2cac5f365d update 2024-07-02 11:28:14 -04:00
Disty0 61d4acda68 SD3 send TE back to CPU when using cpu offload 2024-06-23 15:22:34 +03:00
Disty0 4d0ba8692a Add gc to prompt parser 2024-06-23 04:50:30 +03:00
Disty0 3856cb213a Fix SD3 prompt parser with offload 2024-06-22 15:43:58 +03:00
Vladimir Mandic 323b20813a fix prompt parsing 2024-06-21 08:58:33 -04:00
Vladimir Mandic 6b6170bfaa
Merge branch 'dev' into SD3-parsing 2024-06-21 08:16:44 -04:00
Vladimir Mandic 4e80e6c40c add option to disable text-encoder cache 2024-06-20 11:46:38 -04:00
Vladimir Mandic 9be91e2e2d update notes 2024-06-20 09:01:24 -04:00
AI-Casanova 1fcd378bd1
Merge branch 'dev' into SD3-parsing 2024-06-19 23:47:17 -05:00
AI-Casanova e3009753e3
Finish SD3 Prompt Parsing, reconfigure Compel Hijack 2024-06-19 23:41:11 -05:00
Vladimir Mandic ed8d2ee1d8 update changelog 2024-06-17 19:22:32 -04:00
AI-Casanova d3802f9fbc
SD3 Prompt Parsing, preliminary 2024-06-16 18:00:30 -05:00
Disty0 5f41181576 Cascade normalize padding and replace empty embed option with zeros 2024-06-13 03:13:45 +03:00
Vladimir Mandic a20103a86c add prompt attention normalization 2024-06-10 15:48:55 -04:00
Disty0 38c6dbdd4a Don't force empty padding on Cascade 2024-06-10 18:36:57 +03:00
Disty0 4f482986d1 Add empty prompt padding option 2024-06-10 17:59:07 +03:00
Vladimir Mandic 5574833f0d refactor backend detection 2024-06-06 20:41:10 -04:00
Vladimir Mandic 9bc217644d improve metadata parser 2024-06-06 11:24:31 -04:00
Vladimir Mandic 8a9c10e665 hidiffusion disable embeds cache 2024-06-05 17:36:43 -04:00
Disty0 887de74d22 Fix Cascade overcooking with more than 75 tokens 2024-05-31 18:40:39 +03:00
Disty0 3ebe2ab469 Fix prompt cache with clip skip 2024-05-26 18:15:38 +03:00
Disty0 be264d14d6 Stable Cascade prompt parser support 2024-05-26 16:01:27 +03:00