PUBLICATION
- Huiyin Xue and Nikolaos Aletras. 2023. Pit One Against Many: Leveraging Attention-head Embeddings for Parameter-efficient Multi-head Attention. In Findings of the Association for Computational Linguistics: EMNLP 2023, pages xxxx–xxxx, Sentosa Gateway, Singapore. Association for Computational Linguistics.
[camera-ready]
- Huiyin Xue and Nikolaos Aletras. 2022. HashFormers: Towards Vocabulary-independent Pre-trained Transformers. In Proceedings of the 2022 Conference on Empirical Methods in Natural Language Processing, pages 7862–7874, Abu Dhabi, United Arab Emirates. Association for Computational Linguistics.
[pdf] [code]