~3.55BPW custom optimized EXL3 quant of Nex-N2-Pro 397B.

markdown
Copy code
-- A perplexity:  3.27204336
 -- B perplexity:  3.28824294
 -- A label in top-K:
      K = 1: 0.7131
      K = 2: 0.8113
      K = 3: 0.8530
      K = 4: 0.8768
      K = 5: 0.8925
 -- B label in top-K:
      K = 1: 0.7117
      K = 2: 0.8106
      K = 3: 0.8526
      K = 4: 0.8761
      K = 5: 0.8922
 -- Top-K agreement, A vs B:
      K = 1: 0.9551
      K = 2: 0.8190
      K = 3: 0.6442
      K = 4: 0.4761
      K = 5: 0.3361
 -- KL divergence (A, B):  0.02391939
 -- KL divergence (B, A):  0.02346712