~2.65BPW custom optimized EXL3 quant of Nex-N2-Pro 397B.

markdown
Copy code
-- A perplexity:  3.27133081
 -- B perplexity:  3.34182977
 -- A label in top-K:
      K = 1: 0.7132
      K = 2: 0.8113
      K = 3: 0.8532
      K = 4: 0.8768
      K = 5: 0.8924
 -- B label in top-K:
      K = 1: 0.7072
      K = 2: 0.8088
      K = 3: 0.8509
      K = 4: 0.8749
      K = 5: 0.8909
 -- Top-K agreement, A vs B:
      K = 1: 0.9229
      K = 2: 0.7174
      K = 3: 0.4974
      K = 4: 0.3202
      K = 5: 0.1970
 -- KL divergence (A, B):  0.07487052
 -- KL divergence (B, A):  0.06852871