Commit Graph

2 Commits (7d35264c4e40ac8a864b66a96e2fa8b65e3cfcf4)

Author SHA1 Message Date
Vladimir Mandic f191134aa6 support bnb quantization during load
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2024-10-22 15:43:09 -04:00
Vladimir Mandic ea0dfebe2d better handle any quant lib requirements
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2024-10-12 13:36:16 -04:00