1580158
/
automatic
mirror of https://github.com/vladmandic/automatic
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
11,243 Commits
3 Branches
29 Tags
109 MiB
Commit Graph

897 Commits (10bbbed218458b8a899aac2140ec738d8d716f05)

Author SHA1 Message Date
Vladimir Mandic 92af0036c6 add hidream 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-04-10 16:28:15 -04:00
Vladimir Mandic dc9a64d00b memmon detect gpu swapping 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-04-07 08:59:54 -04:00
Vladimir Mandic 85a961aa49 add cmdopt status 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-04-06 08:43:26 -04:00
Vladimir Mandic d502e3510a add softfill pipeline 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-04-05 12:58:00 -04:00
Vladimir Mandic ff4d57814e fix debug logging 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-04-04 09:14:48 -04:00
Vladimir Mandic 17fbadb0e8 reset memory stats between runs 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-04-01 14:00:39 -04:00
Vladimir Mandic 6430f7006f add monitor cli option and finish lora refactor 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-04-01 13:39:47 -04:00
Vladimir Mandic b5031a5eba lora modularize code 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-04-01 13:39:47 -04:00
Vladimir Mandic f965e72515 fix nncf check 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-03-31 09:40:02 -04:00
Vladimir Mandic f4fdd496b9 more granular quantization modules options 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-03-28 14:46:52 -04:00
Vladimir Mandic 06b0abc4f4 fix token counter error style with modernui 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-03-24 18:08:33 -04:00
Vladimir Mandic d7bab01df0 update video 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-03-23 13:19:12 -04:00
Vladimir Mandic 942553a504 rename vae and unet none to default 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-03-16 18:46:26 -04:00
Vladimir Mandic a5d3a68107 add cogview4 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-03-15 13:20:17 -04:00
Vladimir Mandic 30f76022b0 handle pipeline class switch error 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-02-24 09:05:40 -05:00
Vladimir Mandic a7ccea60ff add lumina2 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-02-12 08:54:00 -05:00
Vladimir Mandic 1c1657525c cleanup logging 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-02-04 09:02:45 -05:00
Vladimir Mandic d50d467a33 multiple fixes 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-01-30 09:41:11 -05:00
Vladimir Mandic f0a2120368 fix typo 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-01-27 16:13:32 -05:00
Vladimir Mandic 338e3a59da port streaming load to diffusers 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-01-27 09:01:24 -05:00
Vladimir Mandic 843011406f obj trace 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-01-25 11:41:34 -05:00
Disty0 9b579bfd96 Move quant functions to model_quant.py 2025-01-23 21:50:26 +03:00
Vladimir Mandic 5a7c1f50c1 add native torch fp8 storage dtype 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-01-23 12:07:08 -05:00
Vladimir Mandic 311d402b0c model component merge 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-01-19 14:36:09 -05:00
Vladimir Mandic 0c8044070a refactor: split legacy loaders 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-01-13 13:00:30 -05:00
Vladimir Mandic 1c10e69276 update controlnet logic and start sd_models refactor 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-01-13 10:09:15 -05:00
Vladimir Mandic 465d7caa3a fix pulid 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-01-10 08:00:19 -05:00
Vladimir Mandic c2e88021eb pipeline restore args after batch and restore pipeline after base 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-01-09 11:12:39 -05:00
Vladimir Mandic 25babb7075 flux bnb on-the-fly for unet-only 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-01-07 17:13:14 -05:00
Vladimir Mandic 19d56d3342 update diffusers and register mask_processor 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-01-06 09:49:07 -05:00
Vladimir Mandic bf5c47adb8 add pixelsmith 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-01-03 11:55:43 -05:00
Vladimir Mandic 94a659ee1f fix xyz with detailer, sd35 img2img 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-01-02 11:00:10 -05:00
Vladimir Mandic 5c5c7e0d51 fix vae tiling defaults 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-01-01 15:48:30 -05:00
Vladimir Mandic 9f95fcc46e first update in 2025 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2025-01-01 09:49:12 -05:00
Vladimir Mandic 73de099711 fix lora on model change 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-12-31 10:41:58 -05:00
Vladimir Mandic 8110f06c3b remove all ldm imports when running in native mode 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-12-30 11:42:04 -05:00
Vladimir Mandic f327b3aca6 fix kandinsky 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-12-30 10:03:34 -05:00
Vladimir Mandic 910f5d0a73 lora direct on-demand apply/unapply 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-12-29 12:38:19 -05:00
Vladimir Mandic 14f1cc2416 fix flux pipeline switches 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-12-27 17:04:54 -05:00
Disty0 2693a46f67 Fix PuLID 2024-12-26 19:26:33 +03:00
Vladimir Mandic 9cb15a564c update vae tiling defaults and allow hypertile min size setting 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-12-25 18:59:56 -05:00
Vladimir Mandic e7f0047d52 add granular vae tiling options 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-12-25 12:38:21 -05:00
Disty0 917d9e6c86 Live previews add flow_prediction 2024-12-25 18:43:10 +03:00
Disty0 5e35d6c3a3 Better live previews 2024-12-25 18:19:43 +03:00
Vladimir Mandic ea6d3107ab update all todo statements 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-12-22 08:39:31 -05:00
Vladimir Mandic 11b2a055c3 fix svd i2v 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-12-21 11:31:08 -05:00
Vladimir Mandic ed3e5f06d6 linting 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-12-20 18:48:06 -05:00
Vladimir Mandic 58ad18ee58 on-the-fly quant for sd35, flux and sana 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-12-20 17:28:33 -05:00
Vladimir Mandic 20f2554cec add sd35-ipadapter and more balanced offload optimizations 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-12-20 10:22:42 -05:00
Vladimir Mandic fd7fe8cea5 add torchao 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-12-17 13:29:36 -05:00
Vladimir Mandic ab07788ab5 add sana 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-12-16 11:30:15 -05:00
Vladimir Mandic 814161cb21 major controlnet work, xinsir promax and tiling support 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-12-14 17:29:51 -05:00
Disty0 7d7bcb9684 Fix balanced offload with Cascade 2024-12-13 23:01:53 +03:00
Vladimir Mandic e9f951b2c5 offload logging 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-12-11 14:20:01 -05:00
Vladimir Mandic 9a588d9c91 update balanced offload 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-12-11 12:06:03 -05:00
Vladimir Mandic f4847f1b8a optimize balanced offload 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-12-10 15:49:20 -05:00
Vladimir Mandic 28eeb00432 remove non-blocking 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-12-06 09:15:37 -05:00
Vladimir Mandic ca06002602 lora maintain device 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-12-04 09:25:57 -05:00
Vladimir Mandic e41d9f52cd add offload warning 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-12-04 08:47:22 -05:00
Vladimir Mandic 106f93f079 memory optimizations 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-12-01 17:13:55 -05:00
Vladimir Mandic 023b13b6cb balanced offload improvements 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-12-01 15:34:25 -05:00
Vladimir Mandic c5cd3cb623 reinit offoad instance on change 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-11-30 19:15:50 -05:00
Vladimir Mandic b7aff134a2 add low/high threshold to balanced offload 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-11-30 19:03:51 -05:00
Disty0 81a95d04cf Skip apply_balanced_offload if not needed 2024-11-30 21:12:26 +03:00
Disty0 b55e746fca Improve balanced offload pre forward performance 2024-11-30 20:49:57 +03:00
Vladimir Mandic eee85e5a4e lora refactor in progress 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-11-30 12:29:58 -05:00
Disty0 6ec93f2d46 Disable load lora gpu with medvram too 2024-11-30 17:04:35 +03:00
Disty0 881fa1183c Fix offload issues with lora 2024-11-30 00:16:38 +03:00
Disty0 e52019104d revert sd_models.py 2024-11-29 22:55:15 +03:00
Disty0 39b14a202e Fix sequential offload with lora 2024-11-29 22:35:00 +03:00
Vladimir Mandic 164ce252dc add sd35 controlnets 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-11-28 08:46:10 -05:00
Vladimir Mandic e4038feff1 minor updates 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-11-24 15:05:58 -05:00
Vladimir Mandic 67c6b93213 flux tools support 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-11-23 15:27:01 -05:00
Vladimir Mandic 6bd25a6f90 js pbar improvements 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-11-23 09:07:43 -05:00
Vladimir Mandic 62c53942e0 post release jumbo patch 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-11-22 12:55:18 -05:00
AI-Casanova 9f65f8b8c3
Fix LoRA with balanced offload 2024-11-20 13:00:41 -06:00
Vladimir Mandic 7344a8c3d8 fix pulid attention 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-11-14 17:08:11 -05:00
Vladimir Mandic 4033f2b63f pulid enable inpaint mask only 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-11-14 08:16:12 -05:00
Vladimir Mandic c199e3e668 pulid optimizations: dtype, vae, offload 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-11-12 11:18:33 -05:00
Vladimir Mandic 34bc7377d8 update pulid 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-11-12 11:18:33 -05:00
Vladimir Mandic 8249865f41 fix pag switch pipeline 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-11-12 11:18:06 -05:00
Vladimir Mandic 9492228175 improve auto-pipeline switch 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-11-12 11:18:06 -05:00
Vladimir Mandic 13cb5704b9 pulid img2img and inpaint placeholders 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-11-12 11:17:26 -05:00
Vladimir Mandic b42e9253e3 pullid offload compatibility and extra samplers 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-11-12 11:17:26 -05:00
Vladimir Mandic 29f5202811
Merge branch 'dev' into refactor-prompt 2024-11-06 10:58:03 -05:00
Vladimir Mandic 0a0c5cd85a add instantir 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-11-05 18:20:38 -05:00
Vladimir Mandic 3df0fb8008 apply balanced to recursive pipe 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-11-04 12:42:16 -05:00
Vladimir Mandic a2f9a4dbb0 refactor pulid 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-11-04 12:31:39 -05:00
Vladimir Mandic 51d6e1d559 update notes 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-11-03 11:14:51 -05:00
Vladimir Mandic abfb197504 sd35 all-in-one safetensors support 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-10-30 19:30:52 -04:00
Vladimir Mandic 8b5f510528 add sd3 controlnets 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-10-30 14:24:12 -04:00
Vladimir Mandic f9ca39c630 readd model_hash to sd_models 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-10-30 08:42:55 -04:00
AI-Casanova 38303f0c61
Cache unload 2024-10-29 21:24:10 -05:00
Vladimir Mandic d205b5cf3e update 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-10-29 15:31:50 -04:00
Vladimir Mandic 76a0a63243 offload exclude lsit 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-10-29 13:53:21 -04:00
Vladimir Mandic c5f5c5e0d0 fix diffusers load from folder 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-10-29 13:22:01 -04:00
Vladimir Mandic 07f3ff7659 cleanup 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-10-29 12:58:07 -04:00
Vladimir Mandic 0756e410c9 add k-diffusion samplers to diffusers 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-10-27 13:10:06 -04:00
Vladimir Mandic 706852e7c5 fix taesd live preview 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-10-27 09:23:53 -04:00
Vladimir Mandic 0fb6cf2dec add legacy typo 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-10-26 20:35:47 -04:00
Vladimir Mandic 6760632f38 major model load refactor 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-10-26 13:22:29 -04:00
Vladimir Mandic 1ad8ca1d58 change model selector 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-10-25 11:23:41 -04:00
Vladimir Mandic 8c12d0264e enable sd3 native lora and update requirements 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-10-25 09:21:09 -04:00
Vladimir Mandic ad3f40f736 improve sd3 loader 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-10-24 13:14:48 -04:00
Vladimir Mandic 321bfe8bc7 better handle partial models 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-10-24 11:36:21 -04:00
Vladimir Mandic f191134aa6 support bnb quantization during load 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-10-22 15:43:09 -04:00
Vladimir Mandic b37c6115ff fix sd3 loader 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-10-22 12:49:07 -04:00
Vladimir Mandic cf9fe20803 omnigen! 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-10-22 12:10:53 -04:00
Vladimir Mandic ae4591ac0b reimplement torchao quantization 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-10-18 09:34:04 -04:00
Disty0 6ae82cbd6e Cascade fix default scheduler 2024-10-18 01:26:23 +03:00
Vladimir Mandic 9c7eba1b61
Merge pull request #3490 from Fundaris/dev 
Fix UnboundLocalError on pipeline loading
 2024-10-16 17:40:40 -04:00
Disty0 899c896f23 cleanup 2024-10-17 00:25:03 +03:00
Vladimir Mandic 1427a4f06b add conditional 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-10-16 17:21:20 -04:00
Vladimir Mandic dba69ac65e refactor load-model 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-10-16 16:44:00 -04:00
Fundaris 7a5e623084 Fix UnboundLocalError on pipeline loading 2024-10-16 19:23:29 +02:00
Vladimir Mandic db3e03cb89 add meissonic (unstable) 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-10-16 12:10:43 -04:00
Vladimir Mandic be7449cf02 fix loading of some non-primary models 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-10-15 12:52:42 -04:00
Disty0 62d74318a0 Use _internal_dict.keys instead of _get_signature_keys 2024-10-14 22:44:14 +03:00
Disty0 bbedeaf18c Set has_accelerate with get_signature_keys 2024-10-14 21:19:10 +03:00
Vladimir Mandic 6bb688c371 add set_accelerate 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-10-14 13:57:05 -04:00
Vladimir Mandic cdcca50fb4 add model analyzer 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-10-14 13:03:46 -04:00
Disty0 b14e8f9a5f Don't assume Cuda on devices.same_device() 2024-10-14 17:23:51 +03:00
Vladimir Mandic ea0dfebe2d better handle any quant lib requirements 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-10-12 13:36:16 -04:00
Vladimir Mandic 723ce74986 add linfusion 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-10-09 11:01:16 -04:00
Vladimir Mandic f17fbe096d fix corner-case model load on startup 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-10-09 08:36:52 -04:00
Vladimir Mandic 176c5c5773 sampler options rewrite 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-10-03 09:38:38 -04:00
Vladimir Mandic e8e05b7dda change clip load order 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-10-02 12:48:37 -04:00
Vladimir Mandic bd6e689bd1 fix te meta 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-10-01 21:26:21 -04:00
Vladimir Mandic 9a46d381cc cleanups 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-10-01 20:02:21 -04:00
Vladimir Mandic 47755dce6b refactor devices 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-09-29 20:17:03 -04:00
Vladimir Mandic 2e3a3a3ec7 add ctrl+x 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-09-29 12:35:48 -04:00
Vladimir Mandic 92f2a2902f improve profiling 2024-09-23 11:07:24 -04:00
Vladimir Mandic b9e230c17f update logging 2024-09-22 11:17:06 -04:00
Vladimir Mandic f059313333 auto-set upcast if first decode fails, fix flux 2024-09-21 13:32:58 -04:00
Vladimir Mandic bdbd24ee66 expermental t5 gguf support 2024-09-20 12:52:52 -04:00
Vladimir Mandic 2698ede68f flux controlnet img2img and inpaint 2024-09-19 11:44:38 -04:00
Vladimir Mandic 2acb883dda jumbo update, see changelog 2024-09-18 13:48:30 -04:00
Vladimir Mandic 0c221a6b7d cleanup 2024-09-15 12:30:48 -04:00
Vladimir Mandic 5bbc8e4b03 interrogate update 2024-09-15 10:50:52 -04:00
Vladimir Mandic 3379232e9c fix path-to-repo-parsing 2024-09-15 09:01:13 -04:00
Disty0 012a7f3572 Update OpenVINO to 2024.3.0 2024-09-13 03:57:06 +03:00
Vladimir Mandic 6ab65318ee fix auraflow 2024-09-12 17:51:15 -04:00
Vladimir Mandic c788c8a3d5 update diffusers 2024-09-11 18:03:15 -04:00
Vladimir Mandic f2c5cbbb36 lint updates and diffusers installer 2024-09-06 14:10:53 -04:00
Vladimir Mandic 85b26e03ff minor updates 2024-09-06 10:13:32 -04:00
Vladimir Mandic 25a301105f add flux inpaint and img2img 2024-09-04 18:20:40 -04:00
Vladimir Mandic 00c9a2bb75 add cogvideox txt2video 2024-09-04 16:45:44 -04:00
Vladimir Mandic e2d13a4dfb flux controlnet support 2024-09-02 11:54:18 -04:00
Vladimir Mandic 045b24c060 fix vae decode for backend original 2024-09-02 08:23:40 -04:00
Vladimir Mandic 7f2e30576d fix handling of online model configs 2024-09-01 23:19:38 -04:00