Commit Graph

758 Commits (d49d470a89a8a456cb0389a492e47d520dce3a18)

Author SHA1 Message Date
Disty0 2693a46f67 Fix PuLID 2024-12-26 19:26:33 +03:00
Vladimir Mandic 9cb15a564c update vae tiling defaults and allow hypertile min size setting
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2024-12-25 18:59:56 -05:00
Vladimir Mandic e7f0047d52 add granular vae tiling options
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2024-12-25 12:38:21 -05:00
Disty0 917d9e6c86 Live previews add flow_prediction 2024-12-25 18:43:10 +03:00
Disty0 5e35d6c3a3 Better live previews 2024-12-25 18:19:43 +03:00
Vladimir Mandic ea6d3107ab update all todo statements
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2024-12-22 08:39:31 -05:00
Vladimir Mandic 11b2a055c3 fix svd i2v
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2024-12-21 11:31:08 -05:00
Vladimir Mandic ed3e5f06d6 linting
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2024-12-20 18:48:06 -05:00
Vladimir Mandic 58ad18ee58 on-the-fly quant for sd35, flux and sana
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2024-12-20 17:28:33 -05:00
Vladimir Mandic 20f2554cec add sd35-ipadapter and more balanced offload optimizations
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2024-12-20 10:22:42 -05:00
Vladimir Mandic fd7fe8cea5 add torchao
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2024-12-17 13:29:36 -05:00
Vladimir Mandic ab07788ab5 add sana
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2024-12-16 11:30:15 -05:00
Vladimir Mandic 814161cb21 major controlnet work, xinsir promax and tiling support
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2024-12-14 17:29:51 -05:00
Disty0 7d7bcb9684 Fix balanced offload with Cascade 2024-12-13 23:01:53 +03:00
Vladimir Mandic e9f951b2c5 offload logging
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2024-12-11 14:20:01 -05:00
Vladimir Mandic 9a588d9c91 update balanced offload
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2024-12-11 12:06:03 -05:00
Vladimir Mandic f4847f1b8a optimize balanced offload
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2024-12-10 15:49:20 -05:00
Vladimir Mandic 28eeb00432 remove non-blocking
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2024-12-06 09:15:37 -05:00
Vladimir Mandic ca06002602 lora maintain device
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2024-12-04 09:25:57 -05:00
Vladimir Mandic e41d9f52cd add offload warning
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2024-12-04 08:47:22 -05:00
Vladimir Mandic 106f93f079 memory optimizations
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2024-12-01 17:13:55 -05:00
Vladimir Mandic 023b13b6cb balanced offload improvements
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2024-12-01 15:34:25 -05:00
Vladimir Mandic c5cd3cb623 reinit offoad instance on change
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2024-11-30 19:15:50 -05:00
Vladimir Mandic b7aff134a2 add low/high threshold to balanced offload
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2024-11-30 19:03:51 -05:00
Disty0 81a95d04cf Skip apply_balanced_offload if not needed 2024-11-30 21:12:26 +03:00
Disty0 b55e746fca Improve balanced offload pre forward performance 2024-11-30 20:49:57 +03:00
Vladimir Mandic eee85e5a4e lora refactor in progress
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2024-11-30 12:29:58 -05:00
Disty0 6ec93f2d46 Disable load lora gpu with medvram too 2024-11-30 17:04:35 +03:00
Disty0 881fa1183c Fix offload issues with lora 2024-11-30 00:16:38 +03:00
Disty0 e52019104d revert sd_models.py 2024-11-29 22:55:15 +03:00
Disty0 39b14a202e Fix sequential offload with lora 2024-11-29 22:35:00 +03:00
Vladimir Mandic 164ce252dc add sd35 controlnets
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2024-11-28 08:46:10 -05:00
Vladimir Mandic e4038feff1 minor updates
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2024-11-24 15:05:58 -05:00
Vladimir Mandic 67c6b93213 flux tools support
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2024-11-23 15:27:01 -05:00
Vladimir Mandic 6bd25a6f90 js pbar improvements
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2024-11-23 09:07:43 -05:00
Vladimir Mandic 62c53942e0 post release jumbo patch
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2024-11-22 12:55:18 -05:00
AI-Casanova 9f65f8b8c3
Fix LoRA with balanced offload 2024-11-20 13:00:41 -06:00
Vladimir Mandic 7344a8c3d8 fix pulid attention
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2024-11-14 17:08:11 -05:00
Vladimir Mandic 4033f2b63f pulid enable inpaint mask only
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2024-11-14 08:16:12 -05:00
Vladimir Mandic c199e3e668 pulid optimizations: dtype, vae, offload
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2024-11-12 11:18:33 -05:00
Vladimir Mandic 34bc7377d8 update pulid
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2024-11-12 11:18:33 -05:00
Vladimir Mandic 8249865f41 fix pag switch pipeline
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2024-11-12 11:18:06 -05:00
Vladimir Mandic 9492228175 improve auto-pipeline switch
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2024-11-12 11:18:06 -05:00
Vladimir Mandic 13cb5704b9 pulid img2img and inpaint placeholders
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2024-11-12 11:17:26 -05:00
Vladimir Mandic b42e9253e3 pullid offload compatibility and extra samplers
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2024-11-12 11:17:26 -05:00
Vladimir Mandic 29f5202811
Merge branch 'dev' into refactor-prompt 2024-11-06 10:58:03 -05:00
Vladimir Mandic 0a0c5cd85a add instantir
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2024-11-05 18:20:38 -05:00
Vladimir Mandic 3df0fb8008 apply balanced to recursive pipe
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2024-11-04 12:42:16 -05:00
Vladimir Mandic a2f9a4dbb0 refactor pulid
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2024-11-04 12:31:39 -05:00
Vladimir Mandic 51d6e1d559 update notes
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2024-11-03 11:14:51 -05:00