Commit Graph

28 Commits (d49d470a89a8a456cb0389a492e47d520dce3a18)

Author SHA1 Message Date
Disty0 e424b343ce Zluda don't override user set attention options 2024-10-24 20:40:02 +03:00
Disty0 801ebdd080 Treat Zluda as a different backend and auto disable BF16 for Zluda and ROCm on RDNA1-2 2024-10-24 15:06:39 +03:00
Vladimir Mandic 47755dce6b refactor devices
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2024-09-29 20:17:03 -04:00
Seunghoon Lee 82ce34cc74
zluda device id experiment 2024-09-26 11:38:30 +09:00
Seunghoon Lee bb44955fd0
zluda vqa florence 2024-06-24 14:22:22 +09:00
Vladimir Mandic 3341a34549 cuda exception handler 2024-06-09 11:15:31 -04:00
Seunghoon Lee 885f272cdd
zluda fix recursion 2024-05-31 13:26:31 +09:00
Seunghoon Lee 7a19dad24e
force cpu ep for zluda 2024-05-29 13:13:51 +09:00
Seunghoon Lee 3c3e195063
zluda init 2024-05-28 17:19:19 +09:00
Seunghoon Lee 815ad61df3
hotfix 2024-05-28 17:11:20 +09:00
Seunghoon Lee b408e0e584
zluda peft 0.11.x compatibility 2024-05-28 16:38:39 +09:00
Seunghoon Lee 9267b9b4e2
zluda minor fixes 2024-05-21 10:58:42 +09:00
Seunghoon Lee cdc694c7f9
zluda remove dnn 2024-05-18 12:50:32 +09:00
Seunghoon Lee 5e541b6ba7
remove unused 2024-05-17 10:07:56 +09:00
Seunghoon Lee 74687dbc44
improve zluda operation test 2024-05-13 17:44:44 +09:00
Seunghoon Lee 814778bc8d
zluda restore torch <2.3 compatibility 2024-05-09 11:32:10 +09:00
Seunghoon Lee 385f06883e
prevent re-setting sdp params (zluda) 2024-05-01 00:28:28 +09:00
Seunghoon Lee f05ef954a6
Improve ZLUDA instllation. 2024-04-28 15:52:15 +09:00
Seunghoon Lee ce2bb713d8
add partial support of zluda dnn 2024-04-04 02:51:10 +09:00
Seunghoon Lee e91935b69b
zluda update torch 2024-03-10 21:26:34 +09:00
Seunghoon Lee d36d072e05 improve zluda installation 2024-02-24 08:24:20 -05:00
Seunghoon Lee 0e1fb9c18a
zluda force sdp_options to math 2024-02-20 00:00:06 +09:00
Seunghoon Lee 2785af1bc4
zluda enable math sdp kernel 2024-02-18 01:23:25 +09:00
Seunghoon Lee 8ae3b5bb43
remove zluda force sync 2024-02-17 20:56:10 +09:00
Seunghoon Lee 6e412d406b
add zluda force sync 2024-02-17 16:16:11 +09:00
Disty0 cc9d0960c2 ZLUDA loosen attention settings 2024-02-15 20:42:34 +03:00
Seunghoon Lee 25c652782f
for Windows only 2024-02-15 07:40:16 +09:00
Seunghoon Lee cc4438651f
Initial ZLUDA support. 2024-02-15 07:38:49 +09:00