DySCO: Dynamic Attention-Scaling Decoding for Long-Context LMs
Understanding and reasoning over long contexts is a crucial capability for language models (LMs).
Research
Academic or research source. Check the methodology, sample size, and whether it's been replicated.