1580158
/
automatic
mirror of https://github.com/vladmandic/automatic
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
12,468 Commits
3 Branches
29 Tags
109 MiB
Commit Graph

298 Commits (9de84792b4c4ae644fe84df73e97ecffac01a163)

Author SHA1 Message Date
Vladimir Mandic 9bc217644d improve metadata parser 2024-06-06 11:24:31 -04:00
Vladimir Mandic 2165a30f2d fix control gallery selector 2024-05-17 13:25:14 -04:00
Vladimir Mandic 4b4783db11 fix en list view tags 2024-05-14 12:10:05 -04:00
Vladimir Mandic d449b23132 fix en switch view 2024-05-14 11:58:47 -04:00
Vladimir Mandic 51f9c3a99b en default sort and disable hypernet by default 2024-05-12 08:52:34 -04:00
Vladimir Mandic 24caf7c133 add modernui to readme 2024-05-10 13:55:00 -04:00
Vladimir Mandic 473c47506c add style apply/save 2024-04-27 13:49:09 -04:00
QuantumSoul 79b7e5c6e2
Update ui_extra_networks.py 2024-04-27 00:35:05 +02:00
Vladimir Mandic 6d27f25366 en sort fixes 2024-04-20 09:29:11 -04:00
Vladimir Mandic f2610c3936 ip adapter masking 2024-04-18 12:43:51 -04:00
Vladimir Mandic 6fa0315682 en vae scan civitai 2024-03-24 09:46:21 -04:00
Vladimir Mandic a4c6257124 full refactor of reference models 2024-03-12 23:51:36 -04:00
Vladimir Mandic 91ae4d7fb6 extra network details styling 2024-03-08 08:38:10 -05:00
Vladimir Mandic 4d3851ecfd styles editor 2024-03-07 11:57:09 -05:00
Vladimir Mandic 533951423e fix en refresh 2024-02-24 08:24:20 -05:00
Vladimir Mandic 92c3c26729 hide en with no entries 2024-02-23 09:22:57 -05:00
Vladimir Mandic 09d1f1e788 add sa solver and prototype instaflow 2024-01-31 09:51:34 -05:00
Vladimir Mandic 3f8fa36a0c fix en display 2024-01-21 08:49:04 -05:00
Vladimir Mandic f6ac307a4e expand use of no-metadata 2024-01-19 20:23:01 -05:00
Vladimir Mandic 7c8d035edb better en preview matching and optimize caching 2024-01-19 13:50:23 -05:00
Vladimir Mandic f10a478c82 fix find preview 2024-01-17 11:44:52 -05:00
Midcoastal 94270243b4
Merge branch 'dev' into Dev/DirectoryCacheing 2024-01-14 19:54:50 -05:00
Midcoastal 86212a52d6
Cleanup, Ruff, Pylint 2024-01-14 18:49:07 -05:00
Vladimir Mandic 011bac41df jumbo commit see changelog for details 2024-01-12 15:00:02 -05:00
Vladimir Mandic 204853afea global crlf to lf 2024-01-10 09:45:26 -05:00
Vladimir Mandic de80b74c64 uniform listdir and use threadpool to index loras 2024-01-06 15:15:23 -05:00
Midcoastal cd18d29511
In-Memory Directory/File Cache 2024-01-05 16:55:01 -05:00
Vladimir Mandic 9a96477111 optimize json parsing and extension register 2024-01-04 12:17:33 -05:00
Vladimir Mandic 0df94404c4 add reference to original, reimplement control-xs 2023-12-27 08:52:04 -05:00
Vladimir Mandic 5cfc044ec6 tracing and control improvements 2023-12-20 17:33:19 -05:00
Vladimir Mandic 8ceeee8b87 add trace logging 2023-12-20 10:17:39 -05:00
Vladimir Mandic 2b56e82f16 modularize en 2023-12-17 09:32:26 -05:00
Vladimir Mandic 9e9d31f1b7 fix save params.txt 2023-12-13 08:34:42 -05:00
Vladimir Mandic 2b49dae74f en load improvements, torchvision compatibility fix 2023-12-04 18:32:52 -05:00
Vladimir Mandic 439542d3df redesign profiler 2023-12-03 11:27:24 -05:00
Vladimir Mandic 15503a7e0c add experimental model update 2023-11-21 12:25:19 -05:00
Vladimir Mandic b647fb84e9 fix non-sd pipeline 2023-11-18 11:20:31 -05:00
Vladimir Mandic 606e4d5c08 configurable hf cache 2023-11-18 08:46:59 -05:00
Vladimir Mandic 1de913f984 auto refresh styles on change 2023-11-14 17:16:33 -05:00
Vladimir Mandic d6aefd046c reference match previews 2023-11-13 16:20:21 -05:00
Vladimir Mandic 7cbd2bc9b5 fix list view 2023-11-09 09:28:44 -05:00
Vladimir Mandic f6dd495eb3 multiple fixes 2023-11-09 09:04:50 -05:00
Vladimir Mandic af30c1e27c en error handler 2023-11-07 13:15:45 -05:00
Vladimir Mandic e53db4e259 use ThreadPoolExecutor for extra networks 2023-11-07 08:00:44 -05:00
Vladimir Mandic 28ee8b4d57 improve preview lookups 2023-11-06 12:19:52 -05:00
Vladimir Mandic cca69e526d update 2023-11-06 09:42:09 -05:00
Vladimir Mandic d878970873 add reference models 2023-11-05 11:07:39 -05:00
Vladimir Mandic 2919774c01 improve en display 2023-11-05 08:09:40 -05:00
Vladimir Mandic 6e05fa865a improve en performance 2023-11-04 12:58:45 -04:00
Vladimir Mandic 8432e68d30 add extra networks list view 2023-11-03 13:55:40 -04:00
Vladimir Mandic da3d5d0fc7 context menus 2023-11-03 11:41:46 -04:00
Vladimir Mandic 676ac120f1 log cleanup 2023-10-31 12:34:35 -04:00
Vladimir Mandic 19203aab6c en add sort and other updates 2023-10-29 10:29:50 -04:00
Vladimir Mandic 53d0cb35b8 cleanup 2023-10-19 13:43:41 -04:00
Vladimir Mandic e0c92b1085 fix samplers 2023-10-19 10:19:46 -04:00
Vladimir Mandic 8aa2d0347c premerge fixes 2023-10-17 08:01:35 -04:00
Vladimir Mandic 24a8699890 fixed 2023-10-12 12:47:33 -04:00
Vladimir Mandic 1bc7ffed73 lint fixes 2023-10-12 11:40:50 -04:00
Vladimir Mandic b225cedb50 css tweaks 2023-10-06 08:33:12 -04:00
Vladimir Mandic 3727bf3d02 new lora handler and remove lyco 2023-10-05 14:30:58 -04:00
Vladimir Mandic 1369c4d714 initial built-in styles 2023-10-04 16:06:02 -04:00
Vladimir Mandic 1e70a1ae57 civitai multithreaded downloads 2023-10-03 10:46:00 -04:00
Vladimir Mandic bf3bb91d56 avoid js double load 2023-10-02 11:39:12 -04:00
Vladimir Mandic 1e66ff4f99 cleanup gradio 2023-10-02 08:57:43 -04:00
Vladimir Mandic 9d335a34e8 update en paths 2023-10-01 16:20:27 -04:00
Vladimir Mandic 1c28757061 update train script 2023-10-01 13:59:13 -04:00
Vladimir Mandic 4c98b8d1c7 minor patches and nvml cli 2023-09-30 17:17:57 -04:00
Vladimir Mandic 9cbe496d68 en load refiner, track server job state 2023-09-29 11:01:26 -04:00
Vladimir Mandic a2b00f34ec add vae to en 2023-09-29 09:00:44 -04:00
Vladimir Mandic a785f3da2e update main ui 2023-09-28 14:33:20 -04:00
Vladimir Mandic 23593d5442 en styles phase two 2023-09-28 14:33:20 -04:00
Vladimir Mandic 75c41498dd styles editing phase one 2023-09-26 19:11:51 -04:00
Vladimir Mandic 7d5119a5d7 add model metadata 2023-09-24 17:52:21 -04:00
Vladimir Mandic aabad68872 en details 2023-09-24 12:21:36 -04:00
Vladimir Mandic 940b4122f9 add en details view - phase one 2023-09-23 17:49:31 -04:00
Vladimir Mandic 36324361bd refactor en folder handling 2023-09-21 11:58:24 -04:00
Vladimir Mandic 0f3dc232c1 add en show/hide/reorder 2023-09-18 10:27:31 -04:00
Vladimir Mandic eee6d3104e rename en 2023-09-18 09:25:25 -04:00
Vladimir Mandic f4492f4c86 optimize en search 2023-09-17 10:47:25 -04:00
Vladimir Mandic 7bda411738 improve styles, better logging 2023-09-09 13:47:46 -04:00
Vladimir Mandic f36c1eb476 jumbo patch 2023-09-08 13:01:20 -04:00
Vladimir Mandic a6dcb8c2f5 fix en refresh 2023-09-07 16:15:42 -04:00
Vladimir Mandic 09b4c79f4a add job info to all jobs 2023-09-07 10:40:07 -04:00
Vladimir Mandic 81ff379e2c fix refiner 2023-09-07 09:38:35 -04:00
Vladimir Mandic 241b47fa72 fix en description style 2023-09-07 09:22:43 -04:00
Vladimir Mandic ac267d7f3f add light theme, enhance profilng and logging 2023-09-06 13:23:14 -04:00
Vladimir Mandic 4753f363d4 en refresh page 2023-09-05 12:36:08 -04:00
Vladimir Mandic a3033dc65f sort out embeddings loading in dffusers 2023-09-05 12:36:08 -04:00
Vladimir Mandic e9055c7cd8 major refactor 2023-09-04 11:31:29 -04:00
Vladimir Mandic d41baddf50 add styles to extra networks 2023-09-03 15:00:48 -04:00
Vladimir Mandic f32fcb5d16 cleanup 2023-09-01 13:47:33 -04:00
Vladimir Mandic 1b2890d02c extra network tags 2023-09-01 11:51:22 -04:00
Vladimir Mandic 9d4194edc2 read model metadata 2023-08-31 09:05:38 -04:00
Vladimir Mandic 10f345f09b handle loading invalid model or pipeline 2023-08-29 15:59:57 -04:00
Vladimir Mandic 9e2e2b8b8f fix gallery, update js logging, add en caching 2023-08-29 14:16:37 -04:00
Vladimir Mandic 91406bc9a0 update civit downloader 2023-08-26 14:13:56 +00:00
Vladimir Mandic 6a4d4ea5b7 update logging and model hashinh 2023-08-22 18:28:09 +00:00
Vladimir Mandic 53dcf157fb switch abs to relative paths 2023-08-21 08:11:30 +00:00
Vladimir Mandic 5eac99d3f5 optimize diffusers memory handling 2023-08-18 20:41:34 +00:00
Midcoastal 67f369ed25
A walk() optimization and lint fixes 2023-08-17 16:49:42 -04:00
Midcoastal 03363ce866
Resolve Lint Errors: C416 (x2), W291 and F541 2023-08-15 23:20:00 -04:00
Midcoastal c9bdd0344d
Allow JPEG image files 
JPEG is allowed and searched for when looking for previews/thumbs, and therefore should be allowed to view.
 2023-08-15 23:10:30 -04:00
Midcoastal 6eae768fb0
Gather HTML parts as list to append in the end 
Somehow, significant increase in speed (size of text append was slowing large loads down.
 2023-08-15 23:08:26 -04:00
Midcoastal 7e4aed7948
Add a FS directory/path cacher 
- Added FS dir/path mechanism to 'modules.modelloader'
- Refactored 'modules.modelloader.load_models' to use the cache
- Refactored 'modules.ui_extra_networks.find_*' methods to use the cache
- Added progress indicator to 'modules.ui_extra_networks.create_html'

The cache, as implimented, will always ensure it is up-to-date (per 'directory_has_changed') and significantly improves loading speed (when used with 'model_loader' and the 'find_*' methods) with large model directories.

Overall load speed tested with ~10k models (mix of checkpoints, loras, lycoris, and embeddings) and ~40k secndary files (images, descriptions, CivitAI Info, etc).  Loading speeds went from ~1 hour and 45 minutes to ~5 minutes.

Confounding variable to loading speeds: this is over a fiber-attached storage device.  Connection is 10gbe full-duplex, remote source has an NVMe raid cache.  Saturation of the network is the norm, but laintency is a factor.  Regardless, small-scale local-storage testing also shows measurable improvements, so this should be a welcome addition.
 2023-08-15 16:07:41 -04:00
Aptronymist 196fa29ee0 Update ui_extra_networks.py 
Added fix to thumbnail images that exceed 70kb to address slowdowns and wasted memory.
 2023-08-08 11:43:38 -04:00
Vladimir Mandic 58bfb9246f update lora enum 2023-07-26 19:27:38 -04:00
Vladimir Mandic c5b089cbb6 major ui simplification 2023-07-26 11:39:58 -04:00
Vladimir Mandic 02fe616141 fix en tags 2023-07-25 17:40:09 -04:00
Vladimir Mandic b31fa98669 fixes... 2023-07-21 09:28:02 -04:00
Vladimir Mandic a3ab302f51 fix extensions reset 2023-07-20 09:52:21 -04:00
Vladimir Mandic 19d176ea3d en add tags 2023-07-19 10:33:23 -04:00
Vladimir Mandic 42cba64ac8 add basename to info search 2023-07-14 08:58:05 -04:00
Vladimir Mandic 6b26c55138 fix extra network tab detection and add heic to training options 2023-07-11 08:35:18 -04:00
Vladimir Mandic 72048f9e24 installer and extra networks tweaks 2023-07-10 08:19:33 -04:00
Vladimir Mandic a16eee1504 bugfix release 2023-07-09 10:06:47 -04:00
Vladimir Mandic 0f4f8c6015 extra networks fixes 2023-07-07 20:20:48 -04:00
Vladimir Mandic 3e1a6a96d0 add additional pipelines 2023-07-07 09:38:19 -04:00
Vladimir Mandic 145b990c73 thumbnail creation exception handling 2023-07-03 22:47:29 -04:00
Vladimir Mandic 8241e33868 major diffusers update 2023-07-03 16:48:03 -04:00
Vladimir Mandic d61b0cfd4c update extra networks 2023-07-02 07:43:01 -04:00
Vladimir Mandic 8000d1965d new extra networks 2023-06-30 15:29:31 -04:00
Vladimir Mandic 05a9f5a892 create extra network thumbnails from previews 2023-06-28 14:55:42 -04:00
Vladimir Mandic c80b1ebc36 stricter lint rules 2023-06-27 10:28:47 -04:00
Vladimir Mandic 91e65fd3c5 sort extra networks depth-first 2023-06-22 09:36:42 -04:00
Vladimir Mandic 8d80b5f6d9 add server class 2023-06-17 13:44:55 -04:00
Vladimir Mandic 9334b2f21c jumbo merge part three 2023-06-14 13:54:23 -04:00
Vladimir Mandic 0ddf613b49 jumbo merge part two 2023-06-14 11:23:02 -04:00
Vladimir Mandic cb307399dd jumbo merge 2023-06-13 11:59:56 -04:00
Vladimir Mandic fff3bda6cf fix extra network save preview/description 2023-06-06 07:52:59 -04:00
Vladimir Mandic c49b6c34e1 fix extra networks 2023-06-05 15:14:50 -04:00
Vladimir Mandic c0a824d8c6 add extra networks to xyz 2023-06-05 10:32:08 -04:00
Vladimir Mandic b127ca4874 catch extra networks error 2023-06-04 07:05:31 -04:00
Vladimir Mandic c7051cc1dd extra error handling during image save 2023-06-03 09:05:01 -04:00
Vladimir Mandic 02c9640fa5 enhance image saving 2023-06-01 15:44:38 -04:00
Vladimir Mandic c1e70df845 follow symlinks 2023-05-18 07:36:38 -04:00
Vladimir Mandic 0ccda9bc8b jumbo patch 2023-05-17 14:15:55 -04:00
Vladimir Mandic 05656a54fe update extra networks 2023-05-11 09:30:34 -04:00
wbh1129 0055336894
ui_extra_networks.py: make description default to "" instead of error 2023-05-06 06:06:17 -05:00
Vladimir Mandic 7a083d322b merge commits 2023-05-02 15:06:06 -04:00
Vladimir Mandic 69ee51f7f2 fix extra networks 2023-04-29 14:16:39 -04:00
Vladimir Mandic 408147d9c4 critical fix 2023-04-29 13:25:20 -04:00
Vladimir Mandic 5dcaaba614 reduce extra network exceptions 2023-04-27 09:42:41 -04:00
Miao Xiang f7c7f396bb fix for vlad fork 2023-04-23 21:36:59 -07:00
Miao Xiang b1050a3dcb fix typo 2023-04-23 21:00:22 -07:00
Samuel 1cf6b91862 Use smaller ToolButton for 🔃❌ in extra networks submenu 2023-04-20 14:43:46 -04:00
Samuel 1439100617 🔃❌ buttons in extra networks submenu 2023-04-20 14:35:08 -04:00
Miao Xiang 0587f6c5c6 fix bug when there are dots in the file name 2023-04-16 14:10:35 -07:00
Vladimir Mandic ed8819b8fc lycoris, strong linting, model keyword, circular imports 2023-04-15 10:28:31 -04:00
Miao Xiang 54e755528f add a button to read descript into decription input box 2023-04-01 19:47:45 -07:00
Miao Xiang 26d0c12444 Revert "load description to input box by clicking on card(except checkpoint)" 
This reverts commit bd8d3f1692.
 2023-04-01 18:54:36 -07:00