1580158
/
automatic
mirror of https://github.com/vladmandic/automatic
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
11,144 Commits
3 Branches
29 Tags
109 MiB
Commit Graph

273 Commits (2e4e741d47c61730d34e79ae8dae4f7995f7b4a7)

Author SHA1 Message Date
Vladimir Mandic de80b74c64 uniform listdir and use threadpool to index loras 2024-01-06 15:15:23 -05:00
Midcoastal cd18d29511
In-Memory Directory/File Cache 2024-01-05 16:55:01 -05:00
Vladimir Mandic 9a96477111 optimize json parsing and extension register 2024-01-04 12:17:33 -05:00
Vladimir Mandic 0df94404c4 add reference to original, reimplement control-xs 2023-12-27 08:52:04 -05:00
Vladimir Mandic 5cfc044ec6 tracing and control improvements 2023-12-20 17:33:19 -05:00
Vladimir Mandic 8ceeee8b87 add trace logging 2023-12-20 10:17:39 -05:00
Vladimir Mandic 2b56e82f16 modularize en 2023-12-17 09:32:26 -05:00
Vladimir Mandic 9e9d31f1b7 fix save params.txt 2023-12-13 08:34:42 -05:00
Vladimir Mandic 2b49dae74f en load improvements, torchvision compatibility fix 2023-12-04 18:32:52 -05:00
Vladimir Mandic 439542d3df redesign profiler 2023-12-03 11:27:24 -05:00
Vladimir Mandic 15503a7e0c add experimental model update 2023-11-21 12:25:19 -05:00
Vladimir Mandic b647fb84e9 fix non-sd pipeline 2023-11-18 11:20:31 -05:00
Vladimir Mandic 606e4d5c08 configurable hf cache 2023-11-18 08:46:59 -05:00
Vladimir Mandic 1de913f984 auto refresh styles on change 2023-11-14 17:16:33 -05:00
Vladimir Mandic d6aefd046c reference match previews 2023-11-13 16:20:21 -05:00
Vladimir Mandic 7cbd2bc9b5 fix list view 2023-11-09 09:28:44 -05:00
Vladimir Mandic f6dd495eb3 multiple fixes 2023-11-09 09:04:50 -05:00
Vladimir Mandic af30c1e27c en error handler 2023-11-07 13:15:45 -05:00
Vladimir Mandic e53db4e259 use ThreadPoolExecutor for extra networks 2023-11-07 08:00:44 -05:00
Vladimir Mandic 28ee8b4d57 improve preview lookups 2023-11-06 12:19:52 -05:00
Vladimir Mandic cca69e526d update 2023-11-06 09:42:09 -05:00
Vladimir Mandic d878970873 add reference models 2023-11-05 11:07:39 -05:00
Vladimir Mandic 2919774c01 improve en display 2023-11-05 08:09:40 -05:00
Vladimir Mandic 6e05fa865a improve en performance 2023-11-04 12:58:45 -04:00
Vladimir Mandic 8432e68d30 add extra networks list view 2023-11-03 13:55:40 -04:00
Vladimir Mandic da3d5d0fc7 context menus 2023-11-03 11:41:46 -04:00
Vladimir Mandic 676ac120f1 log cleanup 2023-10-31 12:34:35 -04:00
Vladimir Mandic 19203aab6c en add sort and other updates 2023-10-29 10:29:50 -04:00
Vladimir Mandic 53d0cb35b8 cleanup 2023-10-19 13:43:41 -04:00
Vladimir Mandic e0c92b1085 fix samplers 2023-10-19 10:19:46 -04:00
Vladimir Mandic 8aa2d0347c premerge fixes 2023-10-17 08:01:35 -04:00
Vladimir Mandic 24a8699890 fixed 2023-10-12 12:47:33 -04:00
Vladimir Mandic 1bc7ffed73 lint fixes 2023-10-12 11:40:50 -04:00
Vladimir Mandic b225cedb50 css tweaks 2023-10-06 08:33:12 -04:00
Vladimir Mandic 3727bf3d02 new lora handler and remove lyco 2023-10-05 14:30:58 -04:00
Vladimir Mandic 1369c4d714 initial built-in styles 2023-10-04 16:06:02 -04:00
Vladimir Mandic 1e70a1ae57 civitai multithreaded downloads 2023-10-03 10:46:00 -04:00
Vladimir Mandic bf3bb91d56 avoid js double load 2023-10-02 11:39:12 -04:00
Vladimir Mandic 1e66ff4f99 cleanup gradio 2023-10-02 08:57:43 -04:00
Vladimir Mandic 9d335a34e8 update en paths 2023-10-01 16:20:27 -04:00
Vladimir Mandic 1c28757061 update train script 2023-10-01 13:59:13 -04:00
Vladimir Mandic 4c98b8d1c7 minor patches and nvml cli 2023-09-30 17:17:57 -04:00
Vladimir Mandic 9cbe496d68 en load refiner, track server job state 2023-09-29 11:01:26 -04:00
Vladimir Mandic a2b00f34ec add vae to en 2023-09-29 09:00:44 -04:00
Vladimir Mandic a785f3da2e update main ui 2023-09-28 14:33:20 -04:00
Vladimir Mandic 23593d5442 en styles phase two 2023-09-28 14:33:20 -04:00
Vladimir Mandic 75c41498dd styles editing phase one 2023-09-26 19:11:51 -04:00
Vladimir Mandic 7d5119a5d7 add model metadata 2023-09-24 17:52:21 -04:00
Vladimir Mandic aabad68872 en details 2023-09-24 12:21:36 -04:00
Vladimir Mandic 940b4122f9 add en details view - phase one 2023-09-23 17:49:31 -04:00
Vladimir Mandic 36324361bd refactor en folder handling 2023-09-21 11:58:24 -04:00
Vladimir Mandic 0f3dc232c1 add en show/hide/reorder 2023-09-18 10:27:31 -04:00
Vladimir Mandic eee6d3104e rename en 2023-09-18 09:25:25 -04:00
Vladimir Mandic f4492f4c86 optimize en search 2023-09-17 10:47:25 -04:00
Vladimir Mandic 7bda411738 improve styles, better logging 2023-09-09 13:47:46 -04:00
Vladimir Mandic f36c1eb476 jumbo patch 2023-09-08 13:01:20 -04:00
Vladimir Mandic a6dcb8c2f5 fix en refresh 2023-09-07 16:15:42 -04:00
Vladimir Mandic 09b4c79f4a add job info to all jobs 2023-09-07 10:40:07 -04:00
Vladimir Mandic 81ff379e2c fix refiner 2023-09-07 09:38:35 -04:00
Vladimir Mandic 241b47fa72 fix en description style 2023-09-07 09:22:43 -04:00
Vladimir Mandic ac267d7f3f add light theme, enhance profilng and logging 2023-09-06 13:23:14 -04:00
Vladimir Mandic 4753f363d4 en refresh page 2023-09-05 12:36:08 -04:00
Vladimir Mandic a3033dc65f sort out embeddings loading in dffusers 2023-09-05 12:36:08 -04:00
Vladimir Mandic e9055c7cd8 major refactor 2023-09-04 11:31:29 -04:00
Vladimir Mandic d41baddf50 add styles to extra networks 2023-09-03 15:00:48 -04:00
Vladimir Mandic f32fcb5d16 cleanup 2023-09-01 13:47:33 -04:00
Vladimir Mandic 1b2890d02c extra network tags 2023-09-01 11:51:22 -04:00
Vladimir Mandic 9d4194edc2 read model metadata 2023-08-31 09:05:38 -04:00
Vladimir Mandic 10f345f09b handle loading invalid model or pipeline 2023-08-29 15:59:57 -04:00
Vladimir Mandic 9e2e2b8b8f fix gallery, update js logging, add en caching 2023-08-29 14:16:37 -04:00
Vladimir Mandic 91406bc9a0 update civit downloader 2023-08-26 14:13:56 +00:00
Vladimir Mandic 6a4d4ea5b7 update logging and model hashinh 2023-08-22 18:28:09 +00:00
Vladimir Mandic 53dcf157fb switch abs to relative paths 2023-08-21 08:11:30 +00:00
Vladimir Mandic 5eac99d3f5 optimize diffusers memory handling 2023-08-18 20:41:34 +00:00
Midcoastal 67f369ed25
A walk() optimization and lint fixes 2023-08-17 16:49:42 -04:00
Midcoastal 03363ce866
Resolve Lint Errors: C416 (x2), W291 and F541 2023-08-15 23:20:00 -04:00
Midcoastal c9bdd0344d
Allow JPEG image files 
JPEG is allowed and searched for when looking for previews/thumbs, and therefore should be allowed to view.
 2023-08-15 23:10:30 -04:00
Midcoastal 6eae768fb0
Gather HTML parts as list to append in the end 
Somehow, significant increase in speed (size of text append was slowing large loads down.
 2023-08-15 23:08:26 -04:00
Midcoastal 7e4aed7948
Add a FS directory/path cacher 
- Added FS dir/path mechanism to 'modules.modelloader'
- Refactored 'modules.modelloader.load_models' to use the cache
- Refactored 'modules.ui_extra_networks.find_*' methods to use the cache
- Added progress indicator to 'modules.ui_extra_networks.create_html'

The cache, as implimented, will always ensure it is up-to-date (per 'directory_has_changed') and significantly improves loading speed (when used with 'model_loader' and the 'find_*' methods) with large model directories.

Overall load speed tested with ~10k models (mix of checkpoints, loras, lycoris, and embeddings) and ~40k secndary files (images, descriptions, CivitAI Info, etc).  Loading speeds went from ~1 hour and 45 minutes to ~5 minutes.

Confounding variable to loading speeds: this is over a fiber-attached storage device.  Connection is 10gbe full-duplex, remote source has an NVMe raid cache.  Saturation of the network is the norm, but laintency is a factor.  Regardless, small-scale local-storage testing also shows measurable improvements, so this should be a welcome addition.
 2023-08-15 16:07:41 -04:00
Aptronymist 196fa29ee0 Update ui_extra_networks.py 
Added fix to thumbnail images that exceed 70kb to address slowdowns and wasted memory.
 2023-08-08 11:43:38 -04:00
Vladimir Mandic 58bfb9246f update lora enum 2023-07-26 19:27:38 -04:00
Vladimir Mandic c5b089cbb6 major ui simplification 2023-07-26 11:39:58 -04:00
Vladimir Mandic 02fe616141 fix en tags 2023-07-25 17:40:09 -04:00
Vladimir Mandic b31fa98669 fixes... 2023-07-21 09:28:02 -04:00
Vladimir Mandic a3ab302f51 fix extensions reset 2023-07-20 09:52:21 -04:00
Vladimir Mandic 19d176ea3d en add tags 2023-07-19 10:33:23 -04:00
Vladimir Mandic 42cba64ac8 add basename to info search 2023-07-14 08:58:05 -04:00
Vladimir Mandic 6b26c55138 fix extra network tab detection and add heic to training options 2023-07-11 08:35:18 -04:00
Vladimir Mandic 72048f9e24 installer and extra networks tweaks 2023-07-10 08:19:33 -04:00
Vladimir Mandic a16eee1504 bugfix release 2023-07-09 10:06:47 -04:00
Vladimir Mandic 0f4f8c6015 extra networks fixes 2023-07-07 20:20:48 -04:00
Vladimir Mandic 3e1a6a96d0 add additional pipelines 2023-07-07 09:38:19 -04:00
Vladimir Mandic 145b990c73 thumbnail creation exception handling 2023-07-03 22:47:29 -04:00
Vladimir Mandic 8241e33868 major diffusers update 2023-07-03 16:48:03 -04:00
Vladimir Mandic d61b0cfd4c update extra networks 2023-07-02 07:43:01 -04:00
Vladimir Mandic 8000d1965d new extra networks 2023-06-30 15:29:31 -04:00
Vladimir Mandic 05a9f5a892 create extra network thumbnails from previews 2023-06-28 14:55:42 -04:00
Vladimir Mandic c80b1ebc36 stricter lint rules 2023-06-27 10:28:47 -04:00
Vladimir Mandic 91e65fd3c5 sort extra networks depth-first 2023-06-22 09:36:42 -04:00
Vladimir Mandic 8d80b5f6d9 add server class 2023-06-17 13:44:55 -04:00
Vladimir Mandic 9334b2f21c jumbo merge part three 2023-06-14 13:54:23 -04:00
Vladimir Mandic 0ddf613b49 jumbo merge part two 2023-06-14 11:23:02 -04:00
Vladimir Mandic cb307399dd jumbo merge 2023-06-13 11:59:56 -04:00
Vladimir Mandic fff3bda6cf fix extra network save preview/description 2023-06-06 07:52:59 -04:00
Vladimir Mandic c49b6c34e1 fix extra networks 2023-06-05 15:14:50 -04:00
Vladimir Mandic c0a824d8c6 add extra networks to xyz 2023-06-05 10:32:08 -04:00
Vladimir Mandic b127ca4874 catch extra networks error 2023-06-04 07:05:31 -04:00
Vladimir Mandic c7051cc1dd extra error handling during image save 2023-06-03 09:05:01 -04:00
Vladimir Mandic 02c9640fa5 enhance image saving 2023-06-01 15:44:38 -04:00
Vladimir Mandic c1e70df845 follow symlinks 2023-05-18 07:36:38 -04:00
Vladimir Mandic 0ccda9bc8b jumbo patch 2023-05-17 14:15:55 -04:00
Vladimir Mandic 05656a54fe update extra networks 2023-05-11 09:30:34 -04:00
wbh1129 0055336894
ui_extra_networks.py: make description default to "" instead of error 2023-05-06 06:06:17 -05:00
Vladimir Mandic 7a083d322b merge commits 2023-05-02 15:06:06 -04:00
Vladimir Mandic 69ee51f7f2 fix extra networks 2023-04-29 14:16:39 -04:00
Vladimir Mandic 408147d9c4 critical fix 2023-04-29 13:25:20 -04:00
Vladimir Mandic 5dcaaba614 reduce extra network exceptions 2023-04-27 09:42:41 -04:00
Miao Xiang f7c7f396bb fix for vlad fork 2023-04-23 21:36:59 -07:00
Miao Xiang b1050a3dcb fix typo 2023-04-23 21:00:22 -07:00
Samuel 1cf6b91862 Use smaller ToolButton for 🔃❌ in extra networks submenu 2023-04-20 14:43:46 -04:00
Samuel 1439100617 🔃❌ buttons in extra networks submenu 2023-04-20 14:35:08 -04:00
Miao Xiang 0587f6c5c6 fix bug when there are dots in the file name 2023-04-16 14:10:35 -07:00
Vladimir Mandic ed8819b8fc lycoris, strong linting, model keyword, circular imports 2023-04-15 10:28:31 -04:00
Miao Xiang 54e755528f add a button to read descript into decription input box 2023-04-01 19:47:45 -07:00
Miao Xiang 26d0c12444 Revert "load description to input box by clicking on card(except checkpoint)" 
This reverts commit bd8d3f1692.
 2023-04-01 18:54:36 -07:00
Miao Xiang bd8d3f1692 load description to input box by clicking on card(except checkpoint) 2023-04-01 18:16:23 -07:00
Miao Xiang 62a9a9cbe9 don't overwrite if description is empty 2023-03-31 20:29:30 -07:00
Miao Xiang 5d0a673df3 ui changes 2023-03-31 20:04:17 -07:00
Miao Xiang f3eee04b83 Merge branch 'master' into dev-button 2023-03-31 17:37:58 -07:00
Miao Xiang 0263a694c6 make code cleaner 2023-03-31 17:36:32 -07:00
AUTOMATIC1111 769def1e41
Merge pull request #8944 from SirFrags/extra_save_geninfo 
Transfer generation parameters to previews
 2023-03-27 08:06:54 +03:00
AUTOMATIC a70ae917ea update button pressed down style for #8569 2023-03-27 08:05:55 +03:00
Miao Xiang a6b30069f0 semi real solution 2023-03-26 15:10:16 -07:00
missionfloyd 6f18c9b13f
Merge branch 'master' into extra-networks-toggle 2023-03-25 14:51:25 -06:00
SirFrags abc4d3a693
preview replace save params 2023-03-25 15:59:50 -04:00
AUTOMATIC1111 6b00d876f7
Merge pull request #7936 from EllangoK/master 
Custom height and width settings for Extra Networks cards
 2023-03-25 13:01:49 +03:00
Karun 63a2f8d822
Merge branch 'master' into master 2023-03-25 05:12:55 -04:00
AUTOMATIC1111 8dbe793af5
Merge branch 'master' into extra-network-info 2023-03-25 12:08:24 +03:00
AUTOMATIC 9ed04e759d use HTTP request to fetch metadata for Lora cards instead of including it into the main page 2023-03-25 10:11:04 +03:00
AUTOMATIC ff216820fd fix extra networks ui 2023-03-25 09:00:37 +03:00
missionfloyd 8e3ced73a8 Add event.stopPropagation() to extraNetworksShowMetadata() 
Prevent bubbling the same way "replace preview" does
 2023-03-20 18:04:22 -06:00
missionfloyd 64fc936738
Don't bubble when metadata_button is clicked 2023-03-19 19:30:28 -06:00
willtakasan 4281432594
Update ui_extra_networks.py 
I updated it so that no error message is displayed when setting a webp for the preview image.
 2023-03-14 15:36:08 +09:00
AUTOMATIC c19530f1a5 Add view metadata button for Lora cards. 2023-03-14 09:10:26 +03:00
missionfloyd 9e23bacfbc Make extra networks button togglable 2023-03-12 17:07:03 -06:00
AUTOMATIC1111 6106f6d0a0
Merge pull request #7965 from Kilvoctu/extranet-buttons 
Use emojis for extra network buttons
 2023-03-12 08:25:03 +03:00
Kilvoctu 247a34498b restore text, remove 'close' 
don't use emojis for extra network buttons; remove 'close'
 2023-03-11 13:11:26 -06:00
AUTOMATIC 6da2027213 save previews for extra networks in the selected format 2023-03-11 15:46:20 +03:00
AUTOMATIC 9320139bd8 support three extensions for preview instead of one: png, jpg, webp 2023-03-11 15:33:24 +03:00
AUTOMATIC ce68ab8d0d remove underscores from function names in #8366 
remove LRU from #8366 because I don't know why it's there
 2023-03-11 15:27:42 +03:00