Derrick Liu

Publications

• A Self-Pruning Transformer: Extreme KV-Cache Compression with Universal Attention

  • • Davis Wertheimer
    • Haochen Shen
    • et al.
  • 2026
  • COLM 2026

  Conference paper

• DropKV: Decoupling Residual-Output Perturbation for Near-Optimal KV-Cache Eviction

  • • Aozhong Zhang
    • Selcuk Gurses
    • et al.
  • 2026
  • ICML 2026

  Workshop paper

• Frayed RoPE and Long Inputs: A Geometric Perspective

  • • Davis Wertheimer
    • Aozhong Zhang
    • et al.
  • 2026
  • ICLR 2026

  Conference paper

• Universal Position Interpolation: Unified Context Scaling for Hybrid Mamba-Transformer Models

  • • Haochen Shen
    • Davis Wertheimer
    • et al.
  • 2026
  • ICLR 2026

  Conference paper