Commit Graph

143 Commits (a71bae4f42c84cf8a87cc1fe4f5bcd8b997afa8a)

Author SHA1 Message Date
Vladimir Mandic a7e0723dcf profiling
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2024-12-18 13:02:22 -05:00
Vladimir Mandic 1185950c4a yet another lora refactor
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2024-12-09 13:40:19 -05:00
Vladimir Mandic ca06002602 lora maintain device
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2024-12-04 09:25:57 -05:00
Vladimir Mandic 023b13b6cb balanced offload improvements
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2024-12-01 15:34:25 -05:00
Vladimir Mandic eee85e5a4e lora refactor in progress
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2024-11-30 12:29:58 -05:00
Vladimir Mandic e4038feff1 minor updates
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2024-11-24 15:05:58 -05:00
Vladimir Mandic fdb8cb509e force move te when using xhinker
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2024-11-24 13:49:27 -05:00
Vladimir Mandic a0d55a5956 pulid with refine pass
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2024-11-13 18:22:20 -05:00
Vladimir Mandic 17a5f34cce update dependencies and changelog
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2024-11-12 11:42:02 -05:00
Vladimir Mandic 66820edb63 update
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2024-11-12 11:02:34 -05:00
AI-Casanova 2635906742
fix scheduled prompt because diffusers callback is broken 2024-11-11 18:37:08 -06:00
AI-Casanova fb4638288b
fix IndexError, change callback type 2024-11-08 23:31:52 -06:00
Vladimir Mandic 34d6d5f92b update
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2024-11-08 08:53:42 -05:00
AI-Casanova 3932d5fd1b
Move embedder object, cleanup stepwise lora 2024-10-30 23:24:50 -05:00
AI-Casanova 39dfa9cbdb
Scheduling and cleanup 2024-10-28 22:32:26 -05:00
AI-Casanova f3442abc92
Prompt LRU Cache 2024-10-26 18:47:11 -05:00
AI-Casanova 90e12b7880
Initial Prompt Refactor 2024-10-26 12:17:58 -05:00
Vladimir Mandic f4ed53c159 handle a1111 prompt scheduling
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2024-10-24 09:53:25 -04:00
Vladimir Mandic 7d7b2fcf00 add sd3.5
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2024-10-22 13:29:03 -04:00
Vladimir Mandic b37c6115ff fix sd3 loader
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2024-10-22 12:49:07 -04:00
Vladimir Mandic c2ab0b11c3 check te device
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2024-10-14 09:29:33 -04:00
Vladimir Mandic bd6e689bd1 fix te meta
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2024-10-01 21:26:21 -04:00
Vladimir Mandic 9a46d381cc cleanups
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2024-10-01 20:02:21 -04:00
Vladimir Mandic f9b5a83b49 cleanup
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2024-10-01 12:20:32 -04:00
Vladimir Mandic 046d588de2 add fix-te
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2024-10-01 12:12:10 -04:00
Vladimir Mandic 92f2a2902f improve profiling 2024-09-23 11:07:24 -04:00
Vladimir Mandic b9e230c17f update logging 2024-09-22 11:17:06 -04:00
Vladimir Mandic 6919ca310a lint updates 2024-09-21 15:44:53 -04:00
Vladimir Mandic 2be087be38 embeds addiotional checks 2024-09-18 21:46:19 -04:00
Vladimir Mandic 8bd944d48b add move-te 2024-09-18 16:02:20 -04:00
Vladimir Mandic edd92c604e fix 2024-09-18 15:51:26 -04:00
Vladimir Mandic 2acb883dda jumbo update, see changelog 2024-09-18 13:48:30 -04:00
Vladimir Mandic 0d9ce663e4 post release dev merge, see changelog for details 2024-09-01 12:20:10 -04:00
Vladimir Mandic 2c8cb5cd67 vae exception handling 2024-08-29 17:46:32 -04:00
Vladimir Mandic 0b901e08ce xhinker move te as needed 2024-08-29 10:42:38 -04:00
Vladimir Mandic 707fc1de79 flux prompt attention 2024-08-28 08:34:42 -04:00
AI-Casanova 1de7716495
Remove print commands 2024-08-25 18:27:30 -05:00
AI-Casanova 517ee93e96
xhinker parser implementation 2024-08-25 18:23:45 -05:00
Disty0 c1285c6de6 Cascade re-add empty embed provider 2024-08-23 07:09:05 +03:00
Disty0 02d6b674c6 Cascade decide atten mask value from the model name 2024-08-23 02:53:39 +03:00
Disty0 8619a7f35c Better balanced offload 2024-08-14 11:53:35 +03:00
Disty0 70c2e84d26 Prompt cache support for Flux 2024-08-12 01:02:13 +03:00
Disty0 e3b087b6c0 Add balanced offload mode and make offload modes a single choice list 2024-08-11 17:27:30 +03:00
Disty0 6431296ec1 Fix Cascade empty prompt encode 2024-08-09 00:32:19 +03:00
Disty0 a17e452db2 Fix Cascade with long prompts 2024-08-07 01:32:09 +03:00
Vladimir Mandic 2cac5f365d update 2024-07-02 11:28:14 -04:00
Disty0 61d4acda68 SD3 send TE back to CPU when using cpu offload 2024-06-23 15:22:34 +03:00
Disty0 4d0ba8692a Add gc to prompt parser 2024-06-23 04:50:30 +03:00
Disty0 3856cb213a Fix SD3 prompt parser with offload 2024-06-22 15:43:58 +03:00
Vladimir Mandic 323b20813a fix prompt parsing 2024-06-21 08:58:33 -04:00