cpral

Nex-N2-Pro-EXL3-4BPW

README

License: apache-2.0

4BPW EXL3 quant of Nex-N2-Pro 397B.

markdown
-- A perplexity:  3.27116721
 -- B perplexity:  3.29296225
 -- A label in top-K:
      K = 1: 0.7135
      K = 2: 0.8113
      K = 3: 0.8530
      K = 4: 0.8765
      K = 5: 0.8927
 -- B label in top-K:
      K = 1: 0.7113
      K = 2: 0.8105
      K = 3: 0.8523
      K = 4: 0.8756
      K = 5: 0.8919
 -- Top-K agreement, A vs B:
      K = 1: 0.9593
      K = 2: 0.8339
      K = 3: 0.6691
      K = 4: 0.5051
      K = 5: 0.3653
 -- KL divergence (A, B):  0.01929369
 -- KL divergence (B, A):  0.01882344