Do Safety Probes Survive KV-Cache Compression?
I compressed the prompt KV cache of four Qwen3 models with JoLT, a low-rank compressor from my master's thesis, and with SnapKV, a token-eviction method, at several ratios. Each harmful or harmless request followed a long benign document. I measured refusals and unsafe responses with a safety classifier, and harmful-request detection with a frozen linear probe.
Result
Under KV-cache compression, the model's behaviour degraded before the safety probe did.
Qwen3KV-cache compressionLinear probesSnapKV