awsr
dcb7164d30
Update `readfile` type safety
2025-12-17 16:43:54 -08:00
awsr
41105c362a
Revert change incorrectly reported by Pyright as an error
2025-12-17 13:18:14 -08:00
awsr
c34c42493e
Opt in to dict type safety
2025-12-17 13:18:14 -08:00
awsr
5206216487
Typing updates
2025-12-17 13:18:13 -08:00
vladmandic
a7956d0c5c
detailer support for segmentation models and use of segmentation masks
...
Signed-off-by: vladmandic <mandic00@live.com>
2025-12-16 22:51:52 +01:00
vladmandic
13b4dc8996
update google access methods
...
Signed-off-by: vladmandic <mandic00@live.com>
2025-12-12 09:56:39 +01:00
vladmandic
a72b98848c
cleanup
...
Signed-off-by: vladmandic <mandic00@live.com>
2025-12-10 10:17:37 +01:00
awsr
9d8119b6ab
Fix/update browser cache behavior
...
It was partially ignoring the setting and writing to cache anyway.
2025-12-09 19:23:16 -08:00
CalamitousFelicitousness
195161c436
fix(settings): hide VLM prefill/thinking settings from Settings UI
...
These settings are accessible from the Caption tab and can be saved
as defaults via "Set UI defaults", so they don't need to appear in
Settings > Interrogate.
2025-12-05 00:54:24 +00:00
CalamitousFelicitousness
2b6226b62b
feat(vqa): persist thinking mode and improve reasoning output formatting
...
- Add interrogate_vlm_thinking_mode setting to save checkbox state
- Update ui_caption to restore Thinking Mode preference on load
- Add blank line before 'Answer:' label for visual separation
- Remove '\n\n' replacement in clean() that stripped blank lines
- Fix Qwen reasoning detection when <think> tag is in prompt, not response
- Add reasoning icon to Moondream 2 and 3 model names
2025-12-05 00:00:25 +00:00
CalamitousFelicitousness
c024c0c9c6
feat(settings): add VLM prefill and thinking retention options
...
Add new VLM configuration options:
- interrogate_vlm_keep_prefill: Keep prefill text in output
- interrogate_vlm_keep_thinking: Keep reasoning trace in output
Also adjust defaults:
- Change interrogate_clip_flavor_count: 16 -> 1024 with updated range
- Change interrogate_vlm_prompt default to first item ("Use Prompt")
2025-12-05 00:00:24 +00:00
Disty0
b6e9332cfe
SDNQ de-couple matmul dtype and add fp16 matmul
2025-11-22 02:16:20 +03:00
Vladimir Mandic
c50c987a33
sdnq always-register
...
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-11-16 08:14:01 -05:00
Vladimir Mandic
ba270db6ad
separate settings for lora fuse
...
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-11-08 11:08:06 -05:00
Vladimir Mandic
56026c4e61
refactor attention handling
...
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-11-08 10:55:41 -05:00
Vladimir Mandic
65dfc9b4d0
fix ui_disabled
...
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-11-04 12:06:32 -05:00
Vladimir Mandic
9927b3e62c
controlnet allow processor to keep aspect-ratio for override images based on i2i or t2i resolution
...
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-11-04 09:37:18 -05:00
Vladimir Mandic
05261e708a
ability to disable parts of the app
...
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-11-03 19:36:55 -05:00
Vladimir Mandic
fc4033a628
change num_beams and update changelog
...
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-11-02 10:56:50 -05:00
awsr
dd029ce057
Fix settings conflict that caused UI desync
...
Because these were being counted as regular settings, the Apply Settings button would revert any changes made in the Detailer section and make the settings become out of sync with the UI (until they were re-saved by changing a value in the Detailers section).
2025-11-02 02:15:24 -08:00
Vladimir Mandic
f4400adb74
detailer improvements
...
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-11-01 21:38:48 -04:00
Vladimir Mandic
58f218a560
add cudnn enable/disable override
...
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-11-01 11:33:39 -04:00
Vladimir Mandic
3ae10dd0e1
add nvidia-chronoedit
...
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-10-30 19:52:29 -04:00
Vladimir Mandic
9308a28c9d
split diffusers/transformers safetensors patch
...
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-10-27 14:39:24 -04:00
Vladimir Mandic
5ab9a5a15d
add sota model loader: runai streamer
...
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-10-27 14:20:10 -04:00
vladmandic
0271e0830c
triton split check into early and full
...
Signed-off-by: vladmandic <mandic00@live.com>
2025-10-26 11:48:10 -04:00
Vladimir Mandic
f4a8776108
fix full-screen image-viewer toolbar actions with control tab
...
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-10-22 14:35:41 -04:00
Vladimir Mandic
f69b4c5589
disabling live preview should not disable progress updates
...
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-10-21 11:07:47 -04:00
Vladimir Mandic
0b346ec1ce
add base and max shift parameters for flow-matching samplers
...
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-10-19 14:11:41 -04:00
Vladimir Mandic
281db94625
add offline mode
...
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-10-19 09:33:49 -04:00
Vladimir Mandic
45c5091aa9
fix wan and add hf mirror setting
...
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-10-16 11:26:23 -04:00
Disty0
6d64f4a2fd
rename svd options
2025-10-14 17:48:01 +03:00
Disty0
b601f0d402
SDNQ expose svd_steps and update module skip keys
2025-10-14 00:15:09 +03:00
Vladimir Mandic
2e4e741d47
seedvt2
...
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-10-12 15:35:08 -04:00
Disty0
1f81a37e8e
Set the default svd rank to 32
2025-10-06 01:27:29 +03:00
Disty0
9e52d0c1fb
SDNQ add SVDQuant quantization method
2025-10-05 22:50:30 +03:00
Vladimir Mandic
2621aecacc
interrrupt will now show last known preview image
...
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-09-29 19:25:50 -04:00
Vladimir Mandic
8cc9c23f98
add directml and rocm note to changelog
...
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-09-28 18:44:42 -04:00
Vladimir Mandic
eb025eaf31
remove split-attention and add attention slicing option
...
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-09-28 18:01:34 -04:00
Vladimir Mandic
749878289f
document vae changes
...
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-09-28 09:25:38 -04:00
Vladimir Mandic
9e6fdaa5cc
vae slicing and tiling enabled on low and med vram, off otherwise
...
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-09-28 09:24:07 -04:00
Disty0
a47959b114
move ROCm Windows hijacks outside of torch install
2025-09-28 13:33:15 +03:00
Disty0
587db51e9e
Cleanup env vars and set TORCH_ROCM_AOTRITON_ENABLE_EXPERIMENTAL to 1
2025-09-28 00:22:00 +03:00
Vladimir Mandic
0d2579302e
cleanup modular init
...
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-09-24 13:03:18 -04:00
Vladimir Mandic
a502cc2ae1
cache-dit support
...
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-09-23 10:13:32 -04:00
Vladimir Mandic
4130c6cc8b
experimental cache-dit
...
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-09-22 15:55:26 -04:00
Vladimir Mandic
cd79f92dff
add opts models_not_to_offload
...
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-09-19 11:21:54 -04:00
Vladimir Mandic
cc6101ecb2
jumbo update: add wan22-vace, improve offloading, add offloading-using-streams, change logging-levels, refactor some default packages
...
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-09-17 12:32:30 -04:00
Vladimir Mandic
8ed04fb9a6
cleanup
...
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-09-11 13:02:52 -04:00
Vladimir Mandic
7940217764
add models_not_to_quant option
...
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-09-11 12:31:07 -04:00
Vladimir Mandic
4093b6c040
allow custom detailer resolution
...
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-09-10 16:32:50 -04:00
Vladimir Mandic
78c2a629b6
add experimental tensorrt quantization
...
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-09-05 10:43:05 -04:00
Vladimir Mandic
2124ab6879
trt experiment
...
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-09-04 10:53:32 -04:00
Vladimir Mandic
05dd0096c9
set default vqa model
...
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-09-04 08:38:29 -04:00
Disty0
19c8711132
Basic ControlNet support for OpenVINO
2025-09-03 19:06:26 +03:00
Disty0
266c9c0d3d
Move Zluda Triton flash atten hijack to Triton Flash attention option
2025-09-03 16:16:41 +03:00
Vladimir Mandic
dd7b69bea8
modernui configurable grid images size
...
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-08-31 12:39:59 -04:00
Vladimir Mandic
928b8838b9
set modernui as default
...
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-08-29 10:23:05 -04:00
Vladimir Mandic
c41afe6b08
offloading hooks
...
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-08-27 22:28:07 -04:00
Vladimir Mandic
9c0d9bd766
enable offload pre-forward by default
...
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-08-23 08:51:45 -04:00
Vladimir Mandic
105b917d72
modernui improved image sizing
...
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-08-22 14:06:51 -04:00
Vladimir Mandic
74da5095f0
fix and regenerate locales
...
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-08-20 14:40:39 -04:00
Disty0
e49814098e
Add sdnq_modules_dtype_dict
2025-08-20 14:58:54 +03:00
Disty0
0946710662
Add sdnq_modules_to_not_convert to UI settings
2025-08-20 04:38:20 +03:00
Vladimir Mandic
13195dadb9
rename wan a14b stages
...
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-08-18 16:13:59 -04:00
Vladimir Mandic
fbc50ce3e1
setting for hf transfer mode
...
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-08-16 16:45:56 -04:00
Disty0
6597a9111f
Fix offload detection with CPU only envs
2025-08-16 16:12:43 +03:00
Vladimir Mandic
068f63badc
add model parallel load option
...
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-08-13 21:18:57 -04:00
Vladimir Mandic
ff2c03538d
add mtime to reference models
...
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-08-13 20:53:39 -04:00
Vladimir Mandic
562799314d
change default hfcache folder
...
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-08-13 13:04:14 -04:00
Vladimir Mandic
669f9874a0
increase ui default timeouts
...
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-08-12 08:19:22 -04:00
Vladimir Mandic
d7daefb8ac
update cogview links, fix auraflow and hidream loaders
...
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-08-11 16:05:39 -04:00
Vladimir Mandic
2a85c05689
refactor pipeline loaders to generic methods and introduce `te_shared_t5` option
...
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-08-11 16:05:39 -04:00
Vladimir Mandic
4b74fd26b5
redesign gpu monitor
...
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-08-07 13:56:13 -04:00
Vladimir Mandic
a91ee36b5c
fix settings components mismatch
...
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-08-06 18:35:43 -04:00
Vladimir Mandic
ba4bff08d6
remove ldsr and refactor sdnq device map
...
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-08-06 09:27:54 -04:00
Vladimir Mandic
8aff68fe06
new models tab including civitai downloader
...
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-08-04 15:53:43 -04:00
Vladimir Mandic
265cb5e8ba
redo ui model metadata
...
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-08-02 18:46:40 -04:00
Vladimir Mandic
f9b585d983
refactor ui_models
...
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-08-02 14:18:58 -04:00
Vladimir Mandic
4be093b80f
add diffusers_offload_nonblocking setting
...
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-08-01 16:38:31 -04:00
Vladimir Mandic
b291c337a1
refactor internal post loop
...
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-08-01 10:45:39 -04:00
Vladimir Mandic
b120778c4f
lint
...
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-07-31 17:33:44 -04:00
Vladimir Mandic
fa44521ea3
offload-never and offload-always per-module and new highvram profile
...
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-07-31 11:40:24 -04:00
Vladimir Mandic
1b3f5405a3
fix batch processing
...
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-07-31 09:56:40 -04:00
Disty0
6a981358e7
Fix OpenVINO
2025-07-31 12:42:40 +03:00
Vladimir Mandic
d8e03bb855
improve handling of wan22 stages
...
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-07-30 11:22:08 -04:00
Vladimir Mandic
636d261159
fix networks tags display
...
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-07-29 06:47:22 -04:00
Vladimir Mandic
74bb2b9ea6
autodetect v-pred
...
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-07-28 19:41:39 -04:00
Disty0
f02cfeaef9
Rename SDNQ TE dtype default to Same as model
2025-07-27 23:06:41 +03:00
Vladimir Mandic
896c3ce9c2
fix detailer min/max thresholds
...
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-07-26 08:41:12 -04:00
Vladimir Mandic
fc0e0635b5
detailer add option to merge multiple results into composite mask
...
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-07-24 15:32:07 -04:00
Vladimir Mandic
a852d1cea9
add detailer expert mode
...
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-07-21 10:39:19 -04:00
Vladimir Mandic
287c3600d7
torch compile for llm
...
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-07-20 12:07:30 -04:00
Vladimir Mandic
ea0b84ffc0
group offloading (experimental)
...
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-07-20 09:33:02 -04:00
Vladimir Mandic
27ce0dea9a
torch.compile use repeated blocks
...
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-07-20 08:44:25 -04:00
Vladimir Mandic
4e449ca9b2
refactor monolithic shared.py and separate legacy options with logging
...
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-07-12 13:35:41 -04:00
Vladimir Mandic
c7ef692563
replace boundry with boundary
...
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-07-10 14:26:16 -04:00
Vladimir Mandic
d688514d0d
set taesd as default preview type
...
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-07-05 17:30:54 -04:00
Vladimir Mandic
8c676d0a61
lint formatting
...
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-07-05 17:13:31 -04:00
Vladimir Mandic
e8b5ea3847
major refactor: remove backend original
...
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-07-05 13:16:46 -04:00