Commit Graph

10 Commits

Author SHA1 Message Date
8a2ef81d17 add copyright header 2024-07-20 22:57:16 +02:00
c38ac65d5b various optimizations 2024-07-20 21:47:18 +02:00
68f748e99e Fix mypy warnings 2024-05-07 14:53:28 +02:00
a74ef976e4 add support for huggingfacehub datasets and for specificying a prompt for eval 2024-05-07 00:23:12 +02:00
8abea9ef89 fix checkDistance 2024-04-08 00:33:02 +02:00
6b38cfabf8 imlement 8bit quantization 2024-04-07 20:52:15 +02:00
c33964371c Inactive parameter quanitzation support 2024-04-07 19:15:42 +02:00
3fa1fc254f add qunatized linear, refactor model for it soon to be addition 2024-03-23 21:38:27 +01:00
38a7f7cfc4 add gpu memory rebalanceing 2024-03-17 22:54:33 +01:00
5acb6809ed wip refactor 2024-03-13 19:45:52 +01:00