Commit Graph

97 Commits (8deb6a6e4397d22c524d4ec4430e92f8aeba2525)

Author SHA1 Message Date
Disty0 61d4acda68 SD3 send TE back to CPU when using cpu offload 2024-06-23 15:22:34 +03:00
Disty0 4d0ba8692a Add gc to prompt parser 2024-06-23 04:50:30 +03:00
Disty0 3856cb213a Fix SD3 prompt parser with offload 2024-06-22 15:43:58 +03:00
Vladimir Mandic 323b20813a fix prompt parsing 2024-06-21 08:58:33 -04:00
Vladimir Mandic 6b6170bfaa
Merge branch 'dev' into SD3-parsing 2024-06-21 08:16:44 -04:00
Vladimir Mandic 4e80e6c40c add option to disable text-encoder cache 2024-06-20 11:46:38 -04:00
Vladimir Mandic 9be91e2e2d update notes 2024-06-20 09:01:24 -04:00
AI-Casanova 1fcd378bd1
Merge branch 'dev' into SD3-parsing 2024-06-19 23:47:17 -05:00
AI-Casanova e3009753e3
Finish SD3 Prompt Parsing, reconfigure Compel Hijack 2024-06-19 23:41:11 -05:00
Vladimir Mandic ed8d2ee1d8 update changelog 2024-06-17 19:22:32 -04:00
AI-Casanova d3802f9fbc
SD3 Prompt Parsing, preliminary 2024-06-16 18:00:30 -05:00
Disty0 5f41181576 Cascade normalize padding and replace empty embed option with zeros 2024-06-13 03:13:45 +03:00
Vladimir Mandic a20103a86c add prompt attention normalization 2024-06-10 15:48:55 -04:00
Disty0 38c6dbdd4a Don't force empty padding on Cascade 2024-06-10 18:36:57 +03:00
Disty0 4f482986d1 Add empty prompt padding option 2024-06-10 17:59:07 +03:00
Vladimir Mandic 5574833f0d refactor backend detection 2024-06-06 20:41:10 -04:00
Vladimir Mandic 9bc217644d improve metadata parser 2024-06-06 11:24:31 -04:00
Vladimir Mandic 8a9c10e665 hidiffusion disable embeds cache 2024-06-05 17:36:43 -04:00
Disty0 887de74d22 Fix Cascade overcooking with more than 75 tokens 2024-05-31 18:40:39 +03:00
Disty0 3ebe2ab469 Fix prompt cache with clip skip 2024-05-26 18:15:38 +03:00
Disty0 be264d14d6 Stable Cascade prompt parser support 2024-05-26 16:01:27 +03:00
Vladimir Mandic 41efd6584d fix cached prompts 2024-05-24 09:46:18 -04:00
Vladimir Mandic 49c997e20f handle unknown tokens 2024-05-21 16:59:16 -04:00
Vladimir Mandic 4fa421ef90 add prompt caching and tokenizer info 2024-05-21 16:34:38 -04:00
Vladimir Mandic 7390815e07 minor prompt parse changes 2024-05-13 11:17:07 -04:00
Vladimir Mandic b137f67edc lint changes 2024-05-07 09:56:32 -04:00
Vladimir Mandic a4c6257124 full refactor of reference models 2024-03-12 23:51:36 -04:00
Vladimir Mandic 558463aeaf validate and fix all refiner workflows 2024-03-02 10:01:22 -05:00
Vladimir Mandic aec8f76c15 add differential-diffusion support for sd15 2024-02-20 13:14:32 -05:00
Vladimir Mandic ae4f7e6a5f regional prompting 2024-02-14 11:24:19 -05:00
AI-Casanova 33c8285e69 Experimental clip skip interpolation 2024-02-09 14:15:14 -05:00
Disty0 9a1ce4dd77 Adjust clip skip to expected range 2024-02-09 08:21:04 +03:00
Vladimir Mandic f56d210854 update clip-skip code 2024-02-08 19:40:26 -05:00
AI-Casanova e883348089 Fix offset 2024-02-08 18:41:28 -05:00
AI-Casanova 251373afca Hijacking Compel to enable clip skip 2024-02-08 18:41:28 -05:00
Vladimir Mandic 78722065e3 add batch embedding load 2024-01-17 10:28:05 -05:00
AI-Casanova ed9d3d93cc
Fix Long Prompts
`extend` to `repeat`

Extend only works on singleton dimensions, mia culpa.
2024-01-14 15:09:31 -06:00
AI-Casanova b10ea42506 Fix Early Out 2024-01-13 16:23:22 -06:00
AI-Casanova cc2e3e058b Fix Scheduling 2024-01-13 15:07:32 -06:00
AI-Casanova 1edecc2389 cleanup 2024-01-13 11:48:58 -06:00
Vladimir Mandic 204853afea global crlf to lf 2024-01-10 09:45:26 -05:00
Vladimir Mandic 5cfc044ec6 tracing and control improvements 2023-12-20 17:33:19 -05:00
Vladimir Mandic 8ceeee8b87 add trace logging 2023-12-20 10:17:39 -05:00
AI-Casanova ff94b197c1 Fix scheduling, lint 2023-12-18 23:42:31 -06:00
Vladimir Mandic f13f2d03f9 fix prompt scheduling 2023-12-18 13:27:36 -05:00
AI-Casanova 0b3e1f475d Fix batch & optimize 2023-12-17 19:37:05 -06:00
AI-Casanova 9e7757b7fe Fixes 2023-12-16 20:16:01 -06:00
AI-Casanova 2020d20bcb Prompt Scheduling 2023-12-16 18:07:20 -06:00
Vladimir Mandic 1b1ae6784c add demofusion 2023-12-09 14:15:48 -05:00
Vladimir Mandic f91735deac fix prompt parser with blank lines 2023-12-09 10:14:35 -05:00