Commit Graph

7886 Commits (4e1f8a2b711784636e27e3db2d9d5eb7ee7170a4)

Author SHA1 Message Date
Seunghoon Lee 364c3beb2e
Fix onnx model downloading & more fixes. 2024-02-01 01:13:21 +09:00
Seunghoon Lee 4e5f0d3dde
Add static dims option. 2024-02-01 01:13:21 +09:00
Seunghoon Lee 2fc7a94c7e
Add pass for QUInt8 Quantization. 2024-02-01 01:13:20 +09:00
Seunghoon Lee bdd6b2b8f7
vae override for onnx 2024-02-01 01:13:20 +09:00
Seunghoon Lee 208c877cd7
Add ui for olive 2024-02-01 01:13:20 +09:00
Seunghoon Lee 34ffba96e3
other devices 2024-02-01 01:13:20 +09:00
Seunghoon Lee 286ec8e753
Integrate Olive into compile backend. 2024-02-01 01:13:19 +09:00
Seunghoon Lee 3cad532d81
SDXL Turbo with Olive optimization.
[WIP] SDXL Refiner with Olive optimization.
2024-02-01 01:13:19 +09:00
Seunghoon Lee 7ac30fb731
minor 2024-02-01 01:13:19 +09:00
Seunghoon Lee 82523bd799
separate onnx & add pipeline for SDXL Img2Img 2024-02-01 01:13:19 +09:00
Seunghoon Lee f10b257dd9
Olive SDXL optimization. 2024-02-01 01:13:18 +09:00
Seunghoon Lee 86b56d2d2c
follow up 2024-02-01 01:13:18 +09:00
Seunghoon Lee 106a1ea68f
batch size 2024-02-01 01:13:18 +09:00
Seunghoon Lee 88faafe6de
wip: sdxl optimization 2024-02-01 01:13:18 +09:00
Seunghoon Lee 68b31782bf
update configs 2024-02-01 01:13:17 +09:00
Seunghoon Lee 9d602ea90c
load pipeline before removing temp dir 2024-02-01 01:13:17 +09:00
Seunghoon Lee 5b2f77811c
reduce memory usage (conversion/optimization) 2024-02-01 01:13:17 +09:00
Seunghoon Lee f832f62773
add onnx pipeline for inpaint 2024-02-01 01:13:17 +09:00
Seunghoon Lee d685426e5b
refactor onnx/olive 2024-02-01 01:13:16 +09:00
Seunghoon Lee cef798bf57
implement olive img2img 2024-02-01 01:13:16 +09:00
Seunghoon Lee c8814c4898
img2img wip 2024-02-01 01:13:16 +09:00
Seunghoon Lee 6507491d8f
refactor onnx and olive 2024-02-01 01:13:14 +09:00
Seunghoon Lee b70258c926
add sdxl configs 2024-02-01 01:13:01 +09:00
Seunghoon Lee ba66bf7900
add sdxl configs 2024-02-01 01:13:01 +09:00
Seunghoon Lee af4302ddfa
update olive by #2429 2024-02-01 01:13:01 +09:00
Disty0 8c819df207
ONNX OpenVINO fixes 2024-02-01 01:13:00 +09:00
Seunghoon Lee 5ce83bbfc4
specify provider 2024-02-01 01:13:00 +09:00
Seunghoon Lee ee818d9990
fixes 2024-02-01 01:13:00 +09:00
Seunghoon Lee 84f2a9df95
make olive optional 2024-02-01 01:12:58 +09:00
Seunghoon Lee e954695b5a
fix olive not found 2024-02-01 01:12:12 +09:00
Seunghoon Lee 204d9b7738
vae channels last 2024-02-01 01:12:12 +09:00
Seunghoon Lee f154c7824a
directly load submodels 2024-02-01 01:12:11 +09:00
Seunghoon Lee 583116e66e
fix cached model pipeline 2024-02-01 01:12:11 +09:00
Seunghoon Lee ae5e40785e
fix ep option save 2024-02-01 01:12:11 +09:00
Seunghoon Lee 507f8c24e7
add license of olive 2024-02-01 01:12:11 +09:00
Seunghoon Lee 18e2579842
update footprint filename of cpuep 2024-02-01 01:12:10 +09:00
Seunghoon Lee 98ee5848f2
customizable execution provider. 2024-02-01 01:12:10 +09:00
Seunghoon Lee b7cfd09d50
add optimization on gpu 2024-02-01 01:12:10 +09:00
Disty0 150c3ad078
Use get_raw_openvino_device with ONNX 2024-02-01 01:12:10 +09:00
Seunghoon Lee fd2c1e2546
add onnxruntime-openvino support. 2024-02-01 01:12:09 +09:00
Seunghoon Lee df021b3982
support more backends 2024-02-01 01:12:09 +09:00
Seunghoon Lee c327331312
update olive configs 2024-02-01 01:12:09 +09:00
Seunghoon Lee b22d5521b7
optimized model downloading 2024-02-01 01:12:08 +09:00
Seunghoon Lee f22bc3f53c
remove optimize error log 2024-02-01 01:12:08 +09:00
Seunghoon Lee ff6acb4e3f
olive_cache_optimized 2024-02-01 01:12:08 +09:00
Seunghoon Lee b7cce01222
cleanup 2024-02-01 01:12:08 +09:00
Seunghoon Lee def8a30017
Initial Olive implementation. 2024-02-01 01:12:07 +09:00
Vladimir Mandic 21516c3ba3 cleanup 2024-01-31 10:29:11 -05:00
Vladimir Mandic f7842d959e fix typo 2024-01-31 10:29:01 -05:00
Vladimir Mandic 778f54e7c7 remove dependency on diffusers dev 2024-01-31 10:27:15 -05:00