Commit Graph

1527 Commits (3a8ef750687d8d0d4e2575bd16f796b8dfc15cdb)

Author SHA1 Message Date
awsr dcb7164d30
Update `readfile` type safety 2025-12-17 16:43:54 -08:00
awsr 41105c362a
Revert change incorrectly reported by Pyright as an error 2025-12-17 13:18:14 -08:00
awsr c34c42493e
Opt in to dict type safety 2025-12-17 13:18:14 -08:00
awsr 5206216487
Typing updates 2025-12-17 13:18:13 -08:00
vladmandic a7956d0c5c detailer support for segmentation models and use of segmentation masks
Signed-off-by: vladmandic <mandic00@live.com>
2025-12-16 22:51:52 +01:00
vladmandic 13b4dc8996 update google access methods
Signed-off-by: vladmandic <mandic00@live.com>
2025-12-12 09:56:39 +01:00
vladmandic a72b98848c cleanup
Signed-off-by: vladmandic <mandic00@live.com>
2025-12-10 10:17:37 +01:00
awsr 9d8119b6ab
Fix/update browser cache behavior
It was partially ignoring the setting and writing to cache anyway.
2025-12-09 19:23:16 -08:00
CalamitousFelicitousness 195161c436 fix(settings): hide VLM prefill/thinking settings from Settings UI
These settings are accessible from the Caption tab and can be saved
as defaults via "Set UI defaults", so they don't need to appear in
Settings > Interrogate.
2025-12-05 00:54:24 +00:00
CalamitousFelicitousness 2b6226b62b feat(vqa): persist thinking mode and improve reasoning output formatting
- Add interrogate_vlm_thinking_mode setting to save checkbox state
- Update ui_caption to restore Thinking Mode preference on load
- Add blank line before 'Answer:' label for visual separation
- Remove '\n\n' replacement in clean() that stripped blank lines
- Fix Qwen reasoning detection when <think> tag is in prompt, not response
- Add reasoning icon to Moondream 2 and 3 model names
2025-12-05 00:00:25 +00:00
CalamitousFelicitousness c024c0c9c6 feat(settings): add VLM prefill and thinking retention options
Add new VLM configuration options:
- interrogate_vlm_keep_prefill: Keep prefill text in output
- interrogate_vlm_keep_thinking: Keep reasoning trace in output

Also adjust defaults:
- Change interrogate_clip_flavor_count: 16 -> 1024 with updated range
- Change interrogate_vlm_prompt default to first item ("Use Prompt")
2025-12-05 00:00:24 +00:00
Disty0 b6e9332cfe SDNQ de-couple matmul dtype and add fp16 matmul 2025-11-22 02:16:20 +03:00
Vladimir Mandic c50c987a33 sdnq always-register
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-11-16 08:14:01 -05:00
Vladimir Mandic ba270db6ad separate settings for lora fuse
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-11-08 11:08:06 -05:00
Vladimir Mandic 56026c4e61 refactor attention handling
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-11-08 10:55:41 -05:00
Vladimir Mandic 65dfc9b4d0 fix ui_disabled
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-11-04 12:06:32 -05:00
Vladimir Mandic 9927b3e62c controlnet allow processor to keep aspect-ratio for override images based on i2i or t2i resolution
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-11-04 09:37:18 -05:00
Vladimir Mandic 05261e708a ability to disable parts of the app
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-11-03 19:36:55 -05:00
Vladimir Mandic fc4033a628 change num_beams and update changelog
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-11-02 10:56:50 -05:00
awsr dd029ce057
Fix settings conflict that caused UI desync
Because these were being counted as regular settings, the Apply Settings button would revert any changes made in the Detailer section and make the settings become out of sync with the UI (until they were re-saved by changing a value in the Detailers section).
2025-11-02 02:15:24 -08:00
Vladimir Mandic f4400adb74 detailer improvements
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-11-01 21:38:48 -04:00
Vladimir Mandic 58f218a560 add cudnn enable/disable override
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-11-01 11:33:39 -04:00
Vladimir Mandic 3ae10dd0e1 add nvidia-chronoedit
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-10-30 19:52:29 -04:00
Vladimir Mandic 9308a28c9d split diffusers/transformers safetensors patch
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-10-27 14:39:24 -04:00
Vladimir Mandic 5ab9a5a15d add sota model loader: runai streamer
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-10-27 14:20:10 -04:00
vladmandic 0271e0830c triton split check into early and full
Signed-off-by: vladmandic <mandic00@live.com>
2025-10-26 11:48:10 -04:00
Vladimir Mandic f4a8776108 fix full-screen image-viewer toolbar actions with control tab
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-10-22 14:35:41 -04:00
Vladimir Mandic f69b4c5589 disabling live preview should not disable progress updates
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-10-21 11:07:47 -04:00
Vladimir Mandic 0b346ec1ce add base and max shift parameters for flow-matching samplers
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-10-19 14:11:41 -04:00
Vladimir Mandic 281db94625 add offline mode
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-10-19 09:33:49 -04:00
Vladimir Mandic 45c5091aa9 fix wan and add hf mirror setting
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-10-16 11:26:23 -04:00
Disty0 6d64f4a2fd rename svd options 2025-10-14 17:48:01 +03:00
Disty0 b601f0d402 SDNQ expose svd_steps and update module skip keys 2025-10-14 00:15:09 +03:00
Vladimir Mandic 2e4e741d47 seedvt2
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-10-12 15:35:08 -04:00
Disty0 1f81a37e8e Set the default svd rank to 32 2025-10-06 01:27:29 +03:00
Disty0 9e52d0c1fb SDNQ add SVDQuant quantization method 2025-10-05 22:50:30 +03:00
Vladimir Mandic 2621aecacc interrrupt will now show last known preview image
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-09-29 19:25:50 -04:00
Vladimir Mandic 8cc9c23f98 add directml and rocm note to changelog
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-09-28 18:44:42 -04:00
Vladimir Mandic eb025eaf31 remove split-attention and add attention slicing option
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-09-28 18:01:34 -04:00
Vladimir Mandic 749878289f document vae changes
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-09-28 09:25:38 -04:00
Vladimir Mandic 9e6fdaa5cc vae slicing and tiling enabled on low and med vram, off otherwise
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-09-28 09:24:07 -04:00
Disty0 a47959b114 move ROCm Windows hijacks outside of torch install 2025-09-28 13:33:15 +03:00
Disty0 587db51e9e Cleanup env vars and set TORCH_ROCM_AOTRITON_ENABLE_EXPERIMENTAL to 1 2025-09-28 00:22:00 +03:00
Vladimir Mandic 0d2579302e cleanup modular init
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-09-24 13:03:18 -04:00
Vladimir Mandic a502cc2ae1 cache-dit support
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-09-23 10:13:32 -04:00
Vladimir Mandic 4130c6cc8b experimental cache-dit
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-09-22 15:55:26 -04:00
Vladimir Mandic cd79f92dff add opts models_not_to_offload
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-09-19 11:21:54 -04:00
Vladimir Mandic cc6101ecb2 jumbo update: add wan22-vace, improve offloading, add offloading-using-streams, change logging-levels, refactor some default packages
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-09-17 12:32:30 -04:00
Vladimir Mandic 8ed04fb9a6 cleanup
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-09-11 13:02:52 -04:00
Vladimir Mandic 7940217764 add models_not_to_quant option
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-09-11 12:31:07 -04:00
Vladimir Mandic 4093b6c040 allow custom detailer resolution
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-09-10 16:32:50 -04:00
Vladimir Mandic 78c2a629b6 add experimental tensorrt quantization
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-09-05 10:43:05 -04:00
Vladimir Mandic 2124ab6879 trt experiment
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-09-04 10:53:32 -04:00
Vladimir Mandic 05dd0096c9 set default vqa model
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-09-04 08:38:29 -04:00
Disty0 19c8711132 Basic ControlNet support for OpenVINO 2025-09-03 19:06:26 +03:00
Disty0 266c9c0d3d Move Zluda Triton flash atten hijack to Triton Flash attention option 2025-09-03 16:16:41 +03:00
Vladimir Mandic dd7b69bea8 modernui configurable grid images size
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-08-31 12:39:59 -04:00
Vladimir Mandic 928b8838b9 set modernui as default
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-08-29 10:23:05 -04:00
Vladimir Mandic c41afe6b08 offloading hooks
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-08-27 22:28:07 -04:00
Vladimir Mandic 9c0d9bd766 enable offload pre-forward by default
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-08-23 08:51:45 -04:00
Vladimir Mandic 105b917d72 modernui improved image sizing
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-08-22 14:06:51 -04:00
Vladimir Mandic 74da5095f0 fix and regenerate locales
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-08-20 14:40:39 -04:00
Disty0 e49814098e Add sdnq_modules_dtype_dict 2025-08-20 14:58:54 +03:00
Disty0 0946710662 Add sdnq_modules_to_not_convert to UI settings 2025-08-20 04:38:20 +03:00
Vladimir Mandic 13195dadb9 rename wan a14b stages
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-08-18 16:13:59 -04:00
Vladimir Mandic fbc50ce3e1 setting for hf transfer mode
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-08-16 16:45:56 -04:00
Disty0 6597a9111f Fix offload detection with CPU only envs 2025-08-16 16:12:43 +03:00
Vladimir Mandic 068f63badc add model parallel load option
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-08-13 21:18:57 -04:00
Vladimir Mandic ff2c03538d add mtime to reference models
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-08-13 20:53:39 -04:00
Vladimir Mandic 562799314d change default hfcache folder
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-08-13 13:04:14 -04:00
Vladimir Mandic 669f9874a0 increase ui default timeouts
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-08-12 08:19:22 -04:00
Vladimir Mandic d7daefb8ac update cogview links, fix auraflow and hidream loaders
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-08-11 16:05:39 -04:00
Vladimir Mandic 2a85c05689 refactor pipeline loaders to generic methods and introduce `te_shared_t5` option
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-08-11 16:05:39 -04:00
Vladimir Mandic 4b74fd26b5 redesign gpu monitor
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-08-07 13:56:13 -04:00
Vladimir Mandic a91ee36b5c fix settings components mismatch
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-08-06 18:35:43 -04:00
Vladimir Mandic ba4bff08d6 remove ldsr and refactor sdnq device map
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-08-06 09:27:54 -04:00
Vladimir Mandic 8aff68fe06 new models tab including civitai downloader
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-08-04 15:53:43 -04:00
Vladimir Mandic 265cb5e8ba redo ui model metadata
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-08-02 18:46:40 -04:00
Vladimir Mandic f9b585d983 refactor ui_models
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-08-02 14:18:58 -04:00
Vladimir Mandic 4be093b80f add diffusers_offload_nonblocking setting
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-08-01 16:38:31 -04:00
Vladimir Mandic b291c337a1 refactor internal post loop
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-08-01 10:45:39 -04:00
Vladimir Mandic b120778c4f lint
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-07-31 17:33:44 -04:00
Vladimir Mandic fa44521ea3 offload-never and offload-always per-module and new highvram profile
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-07-31 11:40:24 -04:00
Vladimir Mandic 1b3f5405a3 fix batch processing
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-07-31 09:56:40 -04:00
Disty0 6a981358e7 Fix OpenVINO 2025-07-31 12:42:40 +03:00
Vladimir Mandic d8e03bb855 improve handling of wan22 stages
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-07-30 11:22:08 -04:00
Vladimir Mandic 636d261159 fix networks tags display
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-07-29 06:47:22 -04:00
Vladimir Mandic 74bb2b9ea6 autodetect v-pred
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-07-28 19:41:39 -04:00
Disty0 f02cfeaef9 Rename SDNQ TE dtype default to Same as model 2025-07-27 23:06:41 +03:00
Vladimir Mandic 896c3ce9c2 fix detailer min/max thresholds
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-07-26 08:41:12 -04:00
Vladimir Mandic fc0e0635b5 detailer add option to merge multiple results into composite mask
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-07-24 15:32:07 -04:00
Vladimir Mandic a852d1cea9 add detailer expert mode
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-07-21 10:39:19 -04:00
Vladimir Mandic 287c3600d7 torch compile for llm
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-07-20 12:07:30 -04:00
Vladimir Mandic ea0b84ffc0 group offloading (experimental)
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-07-20 09:33:02 -04:00
Vladimir Mandic 27ce0dea9a torch.compile use repeated blocks
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-07-20 08:44:25 -04:00
Vladimir Mandic 4e449ca9b2 refactor monolithic shared.py and separate legacy options with logging
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-07-12 13:35:41 -04:00
Vladimir Mandic c7ef692563 replace boundry with boundary
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-07-10 14:26:16 -04:00
Vladimir Mandic d688514d0d set taesd as default preview type
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-07-05 17:30:54 -04:00
Vladimir Mandic 8c676d0a61 lint formatting
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-07-05 17:13:31 -04:00
Vladimir Mandic e8b5ea3847 major refactor: remove backend original
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-07-05 13:16:46 -04:00