OSCAR RotationZoo - Offline Spectral Covariance-Aware Rotation for 2-bit KV Cache Quantization
·
0 reactions
·
0 comments
·
16 views
Original article
r/LocalLLaMA
Anonymous · no account needed