~3.2BPW custom optimized EXL3 quant of Nex-N2-Pro 397B.

markdown
Copy code
-- A perplexity:  3.27223557
 -- B perplexity:  3.31265510
 -- A label in top-K:
      K = 1: 0.7130
      K = 2: 0.8113
      K = 3: 0.8532
      K = 4: 0.8769
      K = 5: 0.8923
 -- B label in top-K:
      K = 1: 0.7099
      K = 2: 0.8094
      K = 3: 0.8520
      K = 4: 0.8755
      K = 5: 0.8920
 -- Top-K agreement, A vs B:
      K = 1: 0.9426
      K = 2: 0.7747
      K = 3: 0.5770
      K = 4: 0.4003
      K = 5: 0.2656
 -- KL divergence (A, B):  0.04183738
 -- KL divergence (B, A):  0.03957721