An Information-theoretic Analysis of Regressions in Naturalistic Reading
Ethan G. Wilcox, Tiago Pimentel, Clara Meister, and Ryan Cotterell. 2024. An Information-theoretic Analysis of Regressions in Naturalistic Reading. In Cognition.
Ethan G. Wilcox, Tiago Pimentel, Clara Meister, and Ryan Cotterell. 2024. An Information-theoretic Analysis of Regressions in Naturalistic Reading. In Cognition.
Cory Shain, Clara Meister, Tiago Pimentel, Ryan Cotterell, and Roger Levy. 2024. Large-scale evidence for logarithmic effects of word predictability on reading time. In Proceedings of the National Academy of Sciences.
Tiago Pimentel, Clara Meister, Ethan G. Wilcox, Kyle Mahowald, and Ryan Cotterell. 2023. Revisiting the Optimality of Word Lengths. In Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing, pages 2240–2255, Singapore. Association for Computational Linguistics.
Ethan G. Wilcox, Clara Meister, Ryan Cotterell, and Tiago Pimentel. 2023. Language Model Quality Correlates with Psychometric Predictive Power in Multiple Languages. In Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing, pages 7503–7511, Singapore. Association for Computational Linguistics.
Lukas Wolf, Tiago Pimentel, Evelina Fedorenko, Ryan Cotterell, Alex Warstadt, Ethan G. Wilcox, and Tamar Regev. 2023. Quantifying the redundancy between prosody and text. In Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing, pages 9765–9784, Singapore. Association for Computational Linguistics.
Andreas Opedal, Eleftheria Tsipidi, Tiago Pimentel, Ryan Cotterell, and Tim Vieira. 2023. An Exploration of Left-Corner Transformations. In Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing, pages 13393–13427, Singapore. Association for Computational Linguistics.
Dieuwke Hupkes, Mario Giulianelli, Verna Dankers, Mikel Artetxe, Yanai Elazar, Tiago Pimentel, Christos Christodoulopoulos, Karim Lasri, Naomi Saphra, Arabella Sinclair, Dennis Ulmer, Florian Schottmann, Khuyagbaatar Batsuren, Kaiser Sun, Koustuv Sinha, Leila Khalatbari, Maria Ryskina, Rita Frieske, Ryan Cotterell, and Zhijing Jin. 2024. A taxonomy and review of generalisation research in NLP. In Nature Machine Intelligence, pages 1161--1174.
Tiago Pimentel, Clara Meister, Ethan G. Wilcox, Roger Levy, and Ryan Cotterell. On the Effect of Anticipation on Reading Times. Transactions of the Association for Computational Linguistics (2023).
Ethan G. Wilcox, Tiago Pimentel, Clara Meister, Ryan Cotterell, and Roger P. Levy. Testing the Predictions of Surprisal Theory in 11 Languages. Transactions of the Association for Computational Linguistics (2023).
Thomas Hikaru Clark, Clara Meister, Tiago Pimentel, Michael Hahn, Ryan Cotterell, Richard Futrell, and Roger Levy. A Cross-Linguistic Pressure for Uniform Information Density in Word Order. Transactions of the Association for Computational Linguistics (2023).
Clara Meister, Tiago Pimentel, Luca Malagutti, Ethan Wilcox, and Ryan Cotterell. 2023. On the Efficacy of Sampling Adapters. In Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), pages 1437–1455, Toronto, Canada. Association for Computational Linguistics.
Marius Mosbach, Tiago Pimentel, Shauli Ravfogel, Dietrich Klakow, and Yanai Elazar. 2023. Few-shot Fine-tuning vs. In-context Learning: A Fair Comparison and Evaluation. In Findings of the Association for Computational Linguistics: ACL 2023, pages 12284–12314, Toronto, Canada. Association for Computational Linguistics.
Li Du, Lucas Torroba Hennigen, Tiago Pimentel, Clara Meister, Jason Eisner, and Ryan Cotterell. 2023. A Measure-Theoretic Characterization of Tight Language Models. In Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), pages 9744–9770, Toronto, Canada. Association for Computational Linguistics.
Clara Meister, Wojciech Stokowiec, Tiago Pimentel, Lei Yu, Laura Rimell, and Adhiguna Kuncoro. 2023. A Natural Bias for Language Generation Models. In Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (Volume 2: Short Papers), pages 243–255, Toronto, Canada. Association for Computational Linguistics.
Karolina Stańczak, Sagnik Ray Choudhury, Tiago Pimentel, Ryan Cotterell, and Isabelle Augenstein. Quantifying Gender Bias Towards Politicians in Cross-Lingual Language Models. PLOS One (2023).
Tiago Pimentel, Clara Isabel Meister, and Ryan Cotterell. "On the Usefulness of Embeddings, Clusters and Strings for Text Generation Evaluation." The Eleventh International Conference on Learning Representations. 2022.
Clemente Pasti, Andreas Opedal, Tiago Pimentel, Tim Vieira, Jason Eisner, and Ryan Cotterell. 2023. On the Intersection of Context-Free and Regular Languages. In Proceedings of the 17th Conference of the European Chapter of the Association for Computational Linguistics, pages 737–749, Dubrovnik, Croatia. Association for Computational Linguistics.
Afra Amini, Tiago Pimentel, Clara Meister, and Ryan Cotterell. 2023. Naturalistic Causal Probing for Morpho-Syntax. Transactions of the Association for Computational Linguistics, 11:384–403.
Clara Meister, Tiago Pimentel, Gian Wiher, and Ryan Cotterell. 2023. Locally Typical Sampling. Transactions of the Association for Computational Linguistics, 11:102–121.
Tiago Pimentel, Josef Valvoda, Niklas Stoehr, and Ryan Cotterell. 2022. The Architectural Bottleneck Principle. In Proceedings of the 2022 Conference on Empirical Methods in Natural Language Processing, pages 11459–11472, Abu Dhabi, United Arab Emirates. Association for Computational Linguistics.
Xin Xin, Tiago Pimentel, Alexandros Karatzoglou, Pengjie Ren, Konstantina Christakopoulou, and Zhaochun Ren. Rethinking Reinforcement Learning for Recommendation: A Prompt Perspective. In Proceedings of the 45th International ACM SIGIR Conference on Research and Development in Information Retrieval, pages 1347-1357. 2022.
Khuyagbaatar Batsuren, Omer Goldman, Salam Khalifa, Nizar Habash, Witold Kieraś, Gábor Bella, Brian Leonard, Garrett Nicolai, Kyle Gorman, Yustinus Ghanggo Ate, Maria Ryskina, Sabrina Mielke, Elena Budianskaya, Charbel El-Khaissi, Tiago Pimentel, Michael Gasser, William Abbott Lane, Mohit Raj, Matt Coler, et al.. 2022. UniMorph 4.0: Universal Morphology. In Proceedings of the Thirteenth Language Resources and Evaluation Conference, pages 840–855, Marseille, France. European Language Resources Association.
Karim Lasri, Tiago Pimentel, Alessandro Lenci, Thierry Poibeau, and Ryan Cotterell. 2022. Probing for the Usage of Grammatical Number. In Proceedings of the 60th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), pages 8818–8831, Dublin, Ireland. Association for Computational Linguistics.
Clara Meister, Tiago Pimentel, Thomas Clark, Ryan Cotterell, and Roger Levy. 2022. Analyzing Wrap-Up Effects through an Information-Theoretic Lens. In Proceedings of the 60th Annual Meeting of the Association for Computational Linguistics (Volume 2: Short Papers), pages 20–28, Dublin, Ireland. Association for Computational Linguistics.
Clara Meister, Gian Wiher, Tiago Pimentel, and Ryan Cotterell. 2022. On the probability–quality paradox in language generation. In Proceedings of the 60th Annual Meeting of the Association for Computational Linguistics (Volume 2: Short Papers), pages 36–45, Dublin, Ireland. Association for Computational Linguistics.
Pimentel T, Cotterell R. A Bayesian Framework for Information-Theoretic Probing. In: Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing (EMNLP), 2021 November.
Pimentel T, Meister C, Teufel S, Cotterell R. On Homophony and Rényi Entropy. In: Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing (EMNLP), 2021 November.
Pimentel T, Meister C, Salesky E, Teufel S, Blasi D, Cotterell R. A surprisal--duration trade-off across and within the world's languages. In: Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing (EMNLP), 2021 November.
Meister C, Pimentel T, Haller P, Jäger L, Cotterell R, Levy R. Revisiting the Uniform Information Density Hypothesis. In: Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing (EMNLP), 2021 November.
Nikkarinen I, Pimentel T, Blasi D, Cotterell R. Modeling the Unigram Distribution. In: Findings of the Association for Computational Linguistics: ACL-IJCNLP, 2021 June.
Pimentel T, Nikkarinen I, Mahowald K, Cotterell R, Blasi D. How (Non-)Optimal is the Lexicon?. In: Proceedings of the 2021 Conference of the North {A}merican Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers), 2021 June.
Pimentel T, Roark B, Wichmann S, Cotterell R, Blasi D. Finding Concept-specific Biases in Form--Meaning Associations. In: Proceedings of the 2021 Conference of the North {A}merican Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers), 2021 June.
White J, Pimentel T, Saphra N, Cotterell R. A Non-Linear Structural Probe. In: Proceedings of the 2021 Conference of the North {A}merican Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers), 2021 June.
Valvoda J, Pimentel T, Stoehr N, Cotterell R, Teufel S. What About the Precedent: An Information-Theoretic Analysis of Common Law. In: Proceedings of the 2021 Conference of the North {A}merican Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers), 2021 June.
Pimentel T, Cotterell R, Roark B. Disambiguatory Signals are Stronger in Word-initial Positions. In: Proceedings of the 16th Conference of the European Chapter of the Association for Computational Linguistics, 2021 Apr.
Pimentel T, Hall Maudslay R, Blasi D, Cotterell R. Speakers Fill Lexical Semantic Gaps with Context. In: Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP), 2020 Nov.
Pimentel T, Saphra N, Williams A, Cotterell R. Pareto Probing: Trading Off Accuracy for Complexity. In: Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP), 2020 Nov.
Pimentel T, Valvoda J, Hall Maudslay R, Zmigrod R, Williams A, Cotterell R. Information-theoretic probing for linguistic structure. In: Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics, 2020 Jul (pp. 4609-4622).
Hall Maudslay R, Valvoda J, Pimentel T, Williams A, Cotterell R. A Tale of a Probe and a Parser. In: Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics, 2020 Jul (pp. 7389-7395).
Williams A, Pimentel T, McCarthy AD, Blix H, Chodroff E, Cotterell R. Predicting Declension Class from Form and Meaning. In: Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics, 2020 Jul (pp. 6682-6695).
Salesky E, Chodroff E, Pimentel T, Wiesner M, Cotterell R, Black AW, Eisner J. A Corpus for Large-Scale Phonetic Typology. In: Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics, 2020 Jul (pp. 4526-4546).
Pimentel T, Monteiro M, Veloso A, Ziviani N. Deep Active Learning for Anomaly Detection. In: International Joint Conference on Neural Networks (IJCNN), 2020 Jul 19 (pp. 1-8). IEEE.
Valle D, Pimentel T, Veloso A. Assessing the Reliability of Visual Explanations of Deep Models with Adversarial Perturbations. In: International Joint Conference on Neural Networks (IJCNN), 2020 Jul 19 (pp. 1-8). IEEE.
Pimentel T, Roark B, Cotterell R. Phonotactic Complexity and its Trade-offs. Transactions of the Association for Computational Linguistics. 2020 Jan;8:1-8.
Pimentel T, McCarthy AD, Blasi D, Roark B, Cotterell R. Meaning to Form: Measuring Systematicity as Information. In: Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics, 2019 Jul (pp. 1751-1764).
Pimentel T, Castro R, Veloso A, Ziviani N. Efficient estimation of node representations in large graphs using linear contexts. In: International Joint Conference on Neural Networks (IJCNN), 2019 Jul 14 (pp. 1-8). IEEE.
Pimentel T, Viana J, Veloso A, Ziviani N. Fast and effective neural networks for translating natural language into denotations. In: International Symposium on String Processing and Information Retrieval, 2018 Oct 9 (pp. 334-347). Springer, Cham.
Shah D, Denicia E, Pimentel T, Bruno B, Mastrogiovanni F. Detection of bimanual gestures everywhere: Why it matters, what we need and what is missing. In: Robotics and Autonomous Systems. 2018 99:30-49.
Husain A, Jones H, Kannan B, Wong U, Pimentel T, Tang S, Daftry S, Huber S, Whittaker WL. Mapping planetary caves with an autonomous, heterogeneous robot team. In: IEEE Aerospace Conference, 2013 Mar 2 (pp. 1-13). IEEE.