~4.5BPW custom optimized EXL3 quant of Nex-N2-Pro 397B.

markdown
Copy code
-- A perplexity:  3.27112741
 -- B perplexity:  3.28136052
 -- A label in top-K:
      K = 1: 0.7131
      K = 2: 0.8111
      K = 3: 0.8531
      K = 4: 0.8767
      K = 5: 0.8923
 -- B label in top-K:
      K = 1: 0.7126
      K = 2: 0.8110
      K = 3: 0.8531
      K = 4: 0.8764
      K = 5: 0.8921
 -- Top-K agreement, A vs B:
      K = 1: 0.9670
      K = 2: 0.8597
      K = 3: 0.7125
      K = 4: 0.5587
      K = 5: 0.4200
 -- KL divergence (A, B):  0.01285279
 -- KL divergence (B, A):  0.01261996