Commit Graph

170 Commits (3a65d561a70f60d2c67f607d2b00a944c7c427ed)

Author SHA1 Message Date
Disty0 33c74e7066 Use zeros for empty negs when diffusers_zeros_prompt_pad enabled 2025-11-24 19:27:25 +03:00
Vladimir Mandic b4d61a5a5c
Merge pull request #4262 from nolbert82/master
Fix prompt scheduling embed reuse and add per-batch caching
2025-10-14 09:27:40 -04:00
Nolan GILBERT db9297244c
Fixed prompt scheduling + uses TE once per batch 2025-10-14 01:07:48 +02:00
Vladimir Mandic 962cb7115d infra for full-model load/save with quant
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-10-07 14:30:45 -04:00
Vladimir Mandic 2c740697c4 guard against null prompt
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-08-18 10:29:01 -04:00
Vladimir Mandic 1b3f5405a3 fix batch processing
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-07-31 09:56:40 -04:00
Vladimir Mandic 76504e5264 add explicit BOS/EOS handling in prompt parser
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-07-30 12:46:01 -04:00
Disty0 c21c7e545a cleanup 2025-07-26 04:52:56 +03:00
Disty0 9afb122367 Fix prompt parser with Flux 2025-07-26 04:25:43 +03:00
Vladimir Mandic e8bec2823a css fonts update
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-07-25 14:55:24 -04:00
Vladimir Mandic a298173cf0 handle batch when saving images
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-07-25 13:13:32 -04:00
Vladimir Mandic b311bdf91e fix prompt encoding if prompts within batch have different segment counts
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-07-25 12:59:14 -04:00
Vladimir Mandic 0b8001c0fa prompt error handling
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-07-25 12:38:25 -04:00
Vladimir Mandic e8b5ea3847 major refactor: remove backend original
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-07-05 13:16:46 -04:00
Enes Sadık Özbek e91208bea9
Merge branch 'dev' into feature/chroma-support 2025-06-26 17:02:00 +03:00
Vladimir Mandic 4de160608e fix prompt parser with batch size
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-06-26 07:47:03 -04:00
Enes Sadık Özbek 954138bfc1
add attention masks 2025-06-23 01:27:40 +00:00
Enes Sadık Özbek 4b3ce06916
Initial support for Chroma 2025-06-18 00:38:17 +00:00
Disty0 677bdd8611 HiDream fix prompt parser 2025-04-23 03:14:58 +03:00
Vladimir Mandic 15f8e70e89 add nunchaku prototype
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-04-15 14:39:24 -04:00
Disty0 3564b34e0d Prompt cache support for HiDream 2025-04-15 00:59:46 +03:00
Vladimir Mandic 984aa8ec55 lint fixes
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-04-08 16:31:51 -04:00
Vladimir Mandic 26193b6c22 update changelog
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-04-08 07:52:10 -04:00
Vladimir Mandic b5e421018b fix prompt scheduling
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-04-08 07:46:25 -04:00
Vladimir Mandic ac61fce526 prompt enhance add censor detection and debugging
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-03-29 11:43:22 -04:00
Vladimir Mandic d9583df8de modernui fix sampler advanced options
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-02-12 16:28:17 -05:00
Vladimir Mandic 8e03755d4b add setting for prompt linebreaks
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-02-01 09:41:52 -05:00
Vladimir Mandic a7e0723dcf profiling
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2024-12-18 13:02:22 -05:00
Vladimir Mandic 1185950c4a yet another lora refactor
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2024-12-09 13:40:19 -05:00
Vladimir Mandic ca06002602 lora maintain device
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2024-12-04 09:25:57 -05:00
Vladimir Mandic 023b13b6cb balanced offload improvements
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2024-12-01 15:34:25 -05:00
Vladimir Mandic eee85e5a4e lora refactor in progress
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2024-11-30 12:29:58 -05:00
Vladimir Mandic e4038feff1 minor updates
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2024-11-24 15:05:58 -05:00
Vladimir Mandic fdb8cb509e force move te when using xhinker
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2024-11-24 13:49:27 -05:00
Vladimir Mandic a0d55a5956 pulid with refine pass
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2024-11-13 18:22:20 -05:00
Vladimir Mandic 17a5f34cce update dependencies and changelog
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2024-11-12 11:42:02 -05:00
Vladimir Mandic 66820edb63 update
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2024-11-12 11:02:34 -05:00
AI-Casanova 2635906742
fix scheduled prompt because diffusers callback is broken 2024-11-11 18:37:08 -06:00
AI-Casanova fb4638288b
fix IndexError, change callback type 2024-11-08 23:31:52 -06:00
Vladimir Mandic 34d6d5f92b update
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2024-11-08 08:53:42 -05:00
AI-Casanova 3932d5fd1b
Move embedder object, cleanup stepwise lora 2024-10-30 23:24:50 -05:00
AI-Casanova 39dfa9cbdb
Scheduling and cleanup 2024-10-28 22:32:26 -05:00
AI-Casanova f3442abc92
Prompt LRU Cache 2024-10-26 18:47:11 -05:00
AI-Casanova 90e12b7880
Initial Prompt Refactor 2024-10-26 12:17:58 -05:00
Vladimir Mandic f4ed53c159 handle a1111 prompt scheduling
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2024-10-24 09:53:25 -04:00
Vladimir Mandic 7d7b2fcf00 add sd3.5
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2024-10-22 13:29:03 -04:00
Vladimir Mandic b37c6115ff fix sd3 loader
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2024-10-22 12:49:07 -04:00
Vladimir Mandic c2ab0b11c3 check te device
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2024-10-14 09:29:33 -04:00
Vladimir Mandic bd6e689bd1 fix te meta
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2024-10-01 21:26:21 -04:00
Vladimir Mandic 9a46d381cc cleanups
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2024-10-01 20:02:21 -04:00