1580158
/
automatic
mirror of https://github.com/vladmandic/automatic
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
12,597 Commits
3 Branches
29 Tags
109 MiB
Commit Graph

184 Commits (0e0b607cfaabf59167e3ab2a44d491b4e4e1b08e)

Author SHA1 Message Date
Vladimir Mandic 9d142581b9 flux nf4 offline load 2024-08-31 11:46:41 -04:00
osanseviero 04f4757b88
Update to new huggingface stuff 2024-08-13 10:48:11 +02:00
Vladimir Mandic 03a6e25d48 fix civitai search 2024-07-10 09:55:58 -04:00
Vladimir Mandic 2a27cd916d pixart sigma improvements 2024-06-18 13:21:13 -04:00
Vladimir Mandic 5feaed0c6a unify hf-login 2024-06-15 16:47:03 -04:00
Vladimir Mandic 6c1d59d367 civitai download validate name 2024-06-15 16:31:58 -04:00
Vladimir Mandic 6e01d510d4 add sd3 2024-06-12 21:02:48 -04:00
Vladimir Mandic 554e5c8224 torch dynamic profiling 2024-05-16 18:40:18 -04:00
Vladimir Mandic b137f67edc lint changes 2024-05-07 09:56:32 -04:00
Vladimir Mandic 685b0e3bf1 diffusers skip non-models on enum 2024-04-05 15:24:44 -04:00
Vladimir Mandic 0862b80377 gallery improve sort and separators 2024-03-24 11:11:23 -04:00
Vladimir Mandic 8c53dfdcd0 update civit downloader 2024-03-16 12:42:33 -04:00
Vladimir Mandic 8b9d85a386 fix ipadapter batch runs 2024-03-15 09:25:14 -04:00
Vladimir Mandic 50b09082a9 update svd 2024-03-13 09:18:07 -04:00
Vladimir Mandic a4c6257124 full refactor of reference models 2024-03-12 23:51:36 -04:00
Vladimir Mandic 9d065b83e4 fix modelloader from huggingface 2024-03-12 11:35:40 -04:00
Vladimir Mandic 2919ba9540 fix model downloader on invalid image 2024-03-11 16:43:39 -04:00
Vladimir Mandic 9873178897 add extra_network_reference setting, refactor geninfo parser 2024-03-11 11:15:51 -04:00
Vladimir Mandic 9557dbf9d4 facehires improvements and fixes 2024-03-10 19:11:32 -04:00
Vladimir Mandic 6cb20edf7e fix upscaler compile, diffusers enum, svd 2024-03-09 08:35:18 -05:00
Vladimir Mandic 30543221fa update changelog 2024-02-29 09:46:59 -05:00
Vladimir Mandic cf7118be4d refactor stable-cascade, fix taesd bf16, add skip-env cmd flag 2024-02-21 17:13:53 -05:00
Vladimir Mandic 5b76fc3140 update notes 2024-02-08 16:46:23 -05:00
Vladimir Mandic 9acc6259bb control auto-install process depenencies 2024-02-02 10:07:15 -05:00
Vladimir Mandic f45655f077 civitai enable embedding download 2024-01-29 09:55:16 -05:00
Vladimir Mandic 640b8279bf add hf token to settings 2024-01-27 09:28:53 -05:00
Vladimir Mandic f83f4edb0b add depth_anywhere processor 2024-01-23 13:21:12 -05:00
Vladimir Mandic 7c8d035edb better en preview matching and optimize caching 2024-01-19 13:50:23 -05:00
Vladimir Mandic 16eaeeb766 cleanup startup 2024-01-17 12:15:07 -05:00
Midcoastal 94270243b4
Merge branch 'dev' into Dev/DirectoryCacheing 2024-01-14 19:54:50 -05:00
Vladimir Mandic 2ec5e9d136 remove eol cmdflag no-download 2024-01-11 12:39:06 -05:00
Vladimir Mandic fcdc53addc lazy load imports 2024-01-08 12:51:12 -05:00
Midcoastal 157772c8b9
Merge branch 'dev' of https://github.com/vladmandic/automatic into Dev/DirectoryCacheing 2024-01-08 10:18:54 -05:00
Vladimir Mandic d2940a05d1 fix folder enum and refactor control ipadapter 2024-01-07 17:57:58 -05:00
Vladimir Mandic 52d19637d8 fix progress api 2024-01-07 17:55:00 -05:00
Midcoastal f90f23bcc2
Merge branch 'dev' into Dev/DirectoryCacheing 2024-01-06 22:12:24 -05:00
Vladimir Mandic de80b74c64 uniform listdir and use threadpool to index loras 2024-01-06 15:15:23 -05:00
Midcoastal cd18d29511
In-Memory Directory/File Cache 2024-01-05 16:55:01 -05:00
Vladimir Mandic 1a0e3c6bee cleanup logging 2023-12-27 19:49:13 -05:00
Vladimir Mandic 81952ce099 cleanups 2023-12-26 13:41:21 -05:00
Vladimir Mandic 54deae7746 change onboarding and remove download default model 2023-12-26 13:06:14 -05:00
Vladimir Mandic 068809719a update requirements and add control-lllite 2023-12-25 14:45:01 -05:00
Vladimir Mandic 0609e995bf add upscaler refresh 2023-12-16 18:38:27 -05:00
Vladimir Mandic aa4b9b4119 enable civit token 2023-12-08 12:21:25 -05:00
Vladimir Mandic 439542d3df redesign profiler 2023-12-03 11:27:24 -05:00
Vladimir Mandic 84d733f0a0 add stable-video-diffusion 2023-11-30 11:21:26 -05:00
Vladimir Mandic 15503a7e0c add experimental model update 2023-11-21 12:25:19 -05:00
Vladimir Mandic d6aefd046c reference match previews 2023-11-13 16:20:21 -05:00
Vladimir Mandic e53db4e259 use ThreadPoolExecutor for extra networks 2023-11-07 08:00:44 -05:00
Vladimir Mandic d878970873 add reference models 2023-11-05 11:07:39 -05:00
Vladimir Mandic eddcc360be support onnx branch and css tweaks 2023-11-01 11:48:17 -04:00
Vladimir Mandic 676ac120f1 log cleanup 2023-10-31 12:34:35 -04:00
Vladimir Mandic 267905e6bb Revert "Merge pull request #2411 from vladmandic/master" 
This reverts commit 64cce8a606, reversing
changes made to 597fc1863f.
 2023-10-26 07:30:01 -04:00
Vladimir Mandic 5219daa7fb Revert "Merge branch 'dev' into master" 
This reverts commit 4b91ee0044, reversing
changes made to fc7e3c5721.
 2023-10-26 07:17:40 -04:00
Vladimir Mandic 2522bdeedb redesign job state and progress bar 2023-10-24 22:02:46 -04:00
Disty0 dbd0bf4bac Add custom pipeline support for Diffusers backend 2023-10-24 20:12:40 +03:00
Vladimir Mandic 21595ee9e7 lint cleanup 2023-10-16 12:07:37 -04:00
Vladimir Mandic 1bc7ffed73 lint fixes 2023-10-12 11:40:50 -04:00
Vladimir Mandic 3727bf3d02 new lora handler and remove lyco 2023-10-05 14:30:58 -04:00
Vladimir Mandic 1e70a1ae57 civitai multithreaded downloads 2023-10-03 10:46:00 -04:00
Vladimir Mandic d01f01c981 update upscalers 2023-09-30 09:20:25 -04:00
Vladimir Mandic 7f9013533d better error handling 2023-09-26 12:30:45 -04:00
Vladimir Mandic 38402c8e6e fix new k-diffusers 2023-09-26 09:55:22 -04:00
Vladimir Mandic ff28ac35e0 add actual latent upscalers 2023-09-25 19:46:12 -04:00
Vladimir Mandic 7d5119a5d7 add model metadata 2023-09-24 17:52:21 -04:00
Vladimir Mandic b00c323c31 update changelog 2023-09-21 07:52:09 -04:00
Vladimir Mandic 8ca79ad9b5 refactor upscalers 2023-09-20 13:07:29 -04:00
Vladimir Mandic fc75b5ec41 add wuerstchen model 2023-09-14 11:51:09 -04:00
Vladimir Mandic a1120666d8 fix styles and console logging 2023-09-13 16:50:03 -04:00
Vladimir Mandic 56e041c3b6 improve civitai integration 2023-09-10 18:13:20 -04:00
Vladimir Mandic 5a649f951a skip invalid diffusers model 2023-09-10 15:19:39 -04:00
Vladimir Mandic 250d1bf2fb update hints 2023-09-10 13:05:31 -04:00
Vladimir Mandic 7bda411738 improve styles, better logging 2023-09-09 13:47:46 -04:00
Vladimir Mandic 2187735187 hf quick model scan 2023-09-07 16:54:03 -04:00
Vladimir Mandic 09b4c79f4a add job info to all jobs 2023-09-07 10:40:07 -04:00
Vladimir Mandic 241b47fa72 fix en description style 2023-09-07 09:22:43 -04:00
Vladimir Mandic e9055c7cd8 major refactor 2023-09-04 11:31:29 -04:00
Vladimir Mandic d6f7bb92da add model preview download 2023-08-30 12:51:12 -04:00
Vladimir Mandic 91406bc9a0 update civit downloader 2023-08-26 14:13:56 +00:00
Vladimir Mandic 6a4d4ea5b7 update logging and model hashinh 2023-08-22 18:28:09 +00:00
Vladimir Mandic 53dcf157fb switch abs to relative paths 2023-08-21 08:11:30 +00:00
Vladimir Mandic 5eac99d3f5 optimize diffusers memory handling 2023-08-18 20:41:34 +00:00
Vladimir Mandic 20ba9aa649 update lint 2023-08-15 08:29:04 +02:00
Midcoastal 67f369ed25
A walk() optimization and lint fixes 2023-08-17 16:49:42 -04:00
Midcoastal 89da66207a
I guess I didn't quite understand Lint error C416 
Seems like a rather pedantic check, if you ask me...  Oh well.
 2023-08-16 00:25:27 -04:00
Midcoastal 03363ce866
Resolve Lint Errors: C416 (x2), W291 and F541 2023-08-15 23:20:00 -04:00
Midcoastal 873e864640
Ooof, modelloader changes needed for TI upgrade 2023-08-15 23:09:24 -04:00
Midcoastal 7e4aed7948
Add a FS directory/path cacher 
- Added FS dir/path mechanism to 'modules.modelloader'
- Refactored 'modules.modelloader.load_models' to use the cache
- Refactored 'modules.ui_extra_networks.find_*' methods to use the cache
- Added progress indicator to 'modules.ui_extra_networks.create_html'

The cache, as implimented, will always ensure it is up-to-date (per 'directory_has_changed') and significantly improves loading speed (when used with 'model_loader' and the 'find_*' methods) with large model directories.

Overall load speed tested with ~10k models (mix of checkpoints, loras, lycoris, and embeddings) and ~40k secndary files (images, descriptions, CivitAI Info, etc).  Loading speeds went from ~1 hour and 45 minutes to ~5 minutes.

Confounding variable to loading speeds: this is over a fiber-attached storage device.  Connection is 10gbe full-duplex, remote source has an NVMe raid cache.  Saturation of the network is the norm, but laintency is a factor.  Regardless, small-scale local-storage testing also shows measurable improvements, so this should be a welcome addition.
 2023-08-15 16:07:41 -04:00
Vladimir Mandic 5d5f22e6e1 remove invalid downloaded files 2023-08-12 08:07:13 +00:00
Vladimir Mandic a77fa4c12e add job info 2023-08-09 08:42:26 +00:00
Vladimir Mandic a5f95f4b38 civitai model search and download 2023-08-09 08:01:37 +00:00
Patrick von Platen a9d239ab51 [Diffusers] Make all Kandinsky work 2023-07-25 21:47:49 +00:00
Vladimir Mandic 46709ee391 fix image metadata and diffuser search 2023-07-18 20:41:47 -04:00
Vladimir Mandic debec28be6 rework settings, image-watermark, safe config handling 2023-07-18 14:41:27 -04:00
Vladimir Mandic a7f5e75a35 fix secondary model location 2023-07-15 16:07:10 -04:00
Vladimir Mandic a16eee1504 bugfix release 2023-07-09 10:06:47 -04:00
Vladimir Mandic 89a7ea6a3f overal quality fixes 2023-07-08 09:49:41 -04:00
Vladimir Mandic 8241e33868 major diffusers update 2023-07-03 16:48:03 -04:00
Vladimir Mandic cc685a8729 wip diffusers 2023-07-02 21:07:26 -04:00
Vladimir Mandic a2caafe4df initial diffusers merge into dev 2023-07-02 14:04:54 -04:00