PUBLICATION
- Huiyin Xue, Nafise Sadat Moosavi, Nikolaos Aletras. 2025. Deconstructing Attention: Investigating Design Principles for Effective Language Modeling. In Proceedings of the 14th International Joint Conference on Natural Language Processing and the 4th Conference of the Asia-Pacific Chapter of the Association for Computational Linguistics 2025, pages 708–727, Mumbai, India. The Asian Federation of Natural Language Processing and The Association for Computational Linguistics.
[poster] [pdf]
- Milan Gritta*, Huiyin Xue*, Gerasimos Lampouras. 2023. DReSD: Dense Retrieval for Speculative Decoding. In Findings of the Association for Computational Linguistics: ACL 2025, pages 19822–19832, Vienna, Austria. Association for Computational Linguistics.
[pdf]
- Huiyin Xue and Nikolaos Aletras. 2023. Pit One Against Many: Leveraging Attention-head Embeddings for Parameter-efficient Multi-head Attention. In Findings of the Association for Computational Linguistics: EMNLP 2023, pages 10355–10373, Sentosa Gateway, Singapore. Association for Computational Linguistics.
[poster] [pdf]
- Huiyin Xue and Nikolaos Aletras. 2022. HashFormers: Towards Vocabulary-independent Pre-trained Transformers. In Proceedings of the 2022 Conference on Empirical Methods in Natural Language Processing, pages 7862–7874, Abu Dhabi, United Arab Emirates. Association for Computational Linguistics.
[poster] [pdf] [code]
THESIS
- Huiyin Xue. 2026. PhD Thesis, University of Sheffield.
[pdf]