Publications

Conference Publications

Curt Tigges, Michael Hanna, Qinan Yu, Stella Biderman. 2024. LLM Circuit Analyses Are Consistent Across Training and Scale. To appear in the Thirty-eight Conference on Neural Information Processing Systems. (NeurIPS 2024)

Michael Hanna, Sandro Pezzelle, and Yonatan Belinkov. 2024. Have Faith in Faithfulness: Going Beyond Circuit Overlap When Finding Model Mechanisms. To appear at the First Conference on Language Modeling. (COLM 2024)

Frank Wildenburg, Michael Hanna, and Sandro Pezzelle. 2024. Do Pre-Trained Language Models Detect and Understand Semantic Underspecification? Ask the DUST!. In Findings of the Association for Computational Linguistics (ACL Findings 2024)

Michael Hanna, Yonatan Belinkov, and Sandro Pezzelle. 2023. When Language Models Fall in Love: Animacy Processing in Transformer Language Models. In Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing (EMNLP). (EMNLP 2023)

Michael Hanna, Ollie Liu, and Alexandre Variengien. 2023. How does GPT-2 compute greater-than?: Interpreting mathematical abilities in a pre-trained language model. In the Thirty-seventh Conference on Neural Information Processing Systems. (NeurIPS 2023)

Michael Hanna, Roberto Zamparelli, and David Mareček. 2023. The Functional Relevance of Probed Information: A Case Study. In Proceedings of the 17th Conference of the European Chapter of the Association for Computational Linguistics, Dubrovnik, Croatia. Association for Computational Linguistics. (EACL 2023)

Michael Hanna*, Federico Pedeni*, Alessandro Suglia, Alberto Testoni, and Raffaella Bernardi. 2022. ACT-Thor: A Controlled Benchmark for Embodied Action Understanding in Simulated Environments. In Proceedings of the 29th International Conference on Computational Linguistics, Gyeongju, Republic of Korea. International Committee on Computational Linguistics. (COLING 2022)

(Archival) Workshop Publications

Abhijith Chintam, Rahel Beloch, Willem Zuidema, Michael Hanna*, and Oskar van der Wal*. 2023. Identifying and Adapting Transformer-Components Responsible for Gender Bias in an English Language Model. In Proceedings of the Sixth BlackboxNLP Workshop on Analyzing and Interpreting Neural Networks for NLP. (BlackBoxNLP 2023)

Jaap Jumelet, Michael Hanna*, Marianne de Heer Kloots*, Anne Langedijk*, Charlotte Pouw*, and Oskar van der Wal*. 2023. ChapGTP, ILLC’s Attempt at Raising a BabyLM: Improving Data Efficiency by Automatic Task Formation. (BabyLM Challenge 2023)

Michael Hanna and Ondrej Bojar. 2021. A Fine-Grained Investigation of BERTScore. In Proceedings of the Sixth Conference on Machine Translation. Punta Cana, Dominican Republic (Online). Association for Computational Linguistics. (WMT 2021)

Michael Hanna and David Marecek. 2021. Investigating BERT’s Knowledge of Hypernymy through Prompting. In Proceedings of the Fourth BlackboxNLP Workshop on Analyzing and Interpreting Neural Networks for NLP. Punta Cana, Dominican Republic. Association for Computational Linguistics. (BlackBoxNLP 2021)

* Equal contribution