Commit Graph

2 Commits (321bfe8bc77d4b4e0e223089f437df1eba9d2d9d)

Author SHA1 Message Date
Vladimir Mandic f191134aa6 support bnb quantization during load
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2024-10-22 15:43:09 -04:00
Vladimir Mandic ea0dfebe2d better handle any quant lib requirements
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2024-10-12 13:36:16 -04:00