Publications

Also indexed on Google Scholar.

* indicates equal contribution.

2026
International Conference on Machine Learning (ICML)
Operationalising the Superficial Alignment Hypothesis via Task Complexity
Tomás Vergara-Browne, Darshan Patil, Ivan Titov, Siva Reddy, Tiago Pimentel*, Marius Mosbach*
International Conference on Machine Learning (ICML)
What Language is This? Ask Your Tokenizer
Clara Meister, Ahmetcan Yavuz, Pietro Lesci, Tiago Pimentel
Annual Meeting of the Association for Computational Linguistics (ACL)
What Do Prosody and Text Convey? Characterizing How Meaningful Information is Distributed Across Multiple Channels
Aditya Yadavalli, Tiago Pimentel, Tamar I. Regev, Ethan Wilcox, Alex Warstadt
Findings of the Association for Computational Linguistics (ACL)
Do Generalisation Results Generalise?
Matteo Boglioni, Andrea Sgobbi, Gabriel Tavernini, Francesco Rita, Marius Mosbach, Tiago Pimentel
International Conference on Learning Representations (ICLR)
Tokenisation over Bounded Alphabets is Hard
Violeta Kastreva, Philip Whittington, Dennis Komm, Tiago Pimentel
2025
Conference on Empirical Methods in Natural Language Processing (EMNLP)
Convergence and Divergence of Language Models under Different Random Seeds
Finlay Fehlauer, Kyle Mahowald, Tiago Pimentel
Advances in Neural Information Processing Systems (NeurIPS)
The Non-Linear Representation Dilemma: Is Causal Abstraction Enough for Mechanistic Interpretability?
Denis Sutter, Julian Minder, Thomas Hofmann, Tiago Pimentel
Spotlight
Annual Meeting of the Association for Computational Linguistics (ACL)
Using Information Theory to Characterize Prosodic Typology: The Case of Tone, Pitch-Accent and Stress-Accent
Ethan Wilcox, Cui Ding, Giovanni Acampa, Tiago Pimentel, Alex Warstadt, Tamar I Regev
SAC highlights award
Annual Meeting of the Association for Computational Linguistics (ACL)
The time scale of redundancy between prosody and linguistic context
Tamar I Regev, Chiebuka Ohams, Shaylee Xie, Lukas Wolf, Evelina Fedorenko, Alex Warstadt, Ethan Wilcox, Tiago Pimentel
Annual Meeting of the Association for Computational Linguistics (ACL)
Causal Estimation of Tokenisation Bias
Pietro Lesci, Clara Meister, Thomas Hofmann, Andreas Vlachos, Tiago Pimentel
Annual Meeting of the Association for Computational Linguistics (ACL)
Tokenisation is NP-Complete
Philip Whittington, Gregor Bachmann, Tiago Pimentel
SAC highlights award
Transactions of the Association for Computational Linguistics (TACL)
Investigating Critical Period Effects in Language Acquisition through Neural Language Models
Ionut Constantinescu, Tiago Pimentel, Ryan Cotterell, Alex Warstadt
2024
Findings of the Association for Computational Linguistics (EMNLP)
Local and Global Decoding in Text Generation
Daniel Gareev, Thomas Hofmann, Ezhilmathi Krishnasamy, Tiago Pimentel
Conference on Empirical Methods in Natural Language Processing (EMNLP)
Towards a Similarity-adjusted Surprisal Theory
Clara Meister, Mario Giulianelli, Tiago Pimentel
Conference on Empirical Methods in Natural Language Processing (EMNLP)
How to Compute the Probability of a Word
Tiago Pimentel, Clara Meister
arXiv preprint
The Role of Language Imbalance in Cross-lingual Generalisation: Insights from Cloned Language Experiments
Anton Schäfer, Shauli Ravfogel, Thomas Hofmann, Tiago Pimentel*, Imanol Schlag*
Annual Meeting of the Association for Computational Linguistics (ACL)
Causal Estimation of Memorisation Profiles
Pietro Lesci, Clara Meister, Thomas Hofmann, Andreas Vlachos, Tiago Pimentel
Best paper award
Findings of the Association for Computational Linguistics (ACL)
On the Effect of (Near) Duplicate Subwords in Language Modelling
Anton Schäfer, Thomas Hofmann, Imanol Schlag*, Tiago Pimentel*
Human Sentence Processing Conference (HSP)
Are word predictability effects really linear? A critical reanalysis of key evidence
Cory Shain, Clara Meister, Tiago Pimentel, Ryan Cotterell, Roger Levy
Cognition
An Information-theoretic Analysis of Targeted Regressions during Reading
Ethan G. Wilcox, Tiago Pimentel, Clara Meister, Ryan Cotterell
Proceedings of the National Academy of Sciences (PNAS)
Large-scale evidence for logarithmic effects of word predictability on reading time
Cory Shain, Clara Meister, Tiago Pimentel, Ryan Cotterell, Roger Levy
2023
Conference on Empirical Methods in Natural Language Processing (EMNLP)
Revisiting the Optimality of Word Lengths
Tiago Pimentel, Ethan G. Wilcox, Clara Meister, Kyle Mahowald, Ryan Cotterell
Outstanding paper award
Conference on Empirical Methods in Natural Language Processing (EMNLP)
Language Model Quality Correlates with Psychometric Predictive Power in Multiple Languages
Ethan G. Wilcox, Clara Meister, Ryan Cotterell, Tiago Pimentel
Outstanding paper award
Conference on Empirical Methods in Natural Language Processing (EMNLP)
Quantifying the redundancy between prosody and text
Lukas Wolf, Tiago Pimentel, Evelina Fedorenko, Ryan Cotterell, Alex Warstadt, Ethan G. Wilcox, Tamar Regev
Conference on Empirical Methods in Natural Language Processing (EMNLP)
An Exploration of Left-Corner Transformations
Andreas Opedal, Eleftheria Tsipidi, Tiago Pimentel, Ryan Cotterell, Tim Vieira
Nature Machine Intelligence
A taxonomy and review of generalisation research in NLP
Dieuwke Hupkes, Mario Giulianelli, Verna Dankers, Mikel Artetxe, Yanai Elazar, Tiago Pimentel, Christos Christodoulopoulos, Karim Lasri, Naomi Saphra, Arabella Sinclair, Dennis Ulmer, Florian Schottmann, Khuyagbaatar Batsuren, Kaiser Sun, Koustuv Sinha, Leila Khalatbari, Maria Ryskina, Rita Frieske, Ryan Cotterell, Zhijing Jin
Transactions of the Association for Computational Linguistics (TACL)
On the Effect of Anticipation on Reading Times
Tiago Pimentel, Clara Meister, Ethan G. Wilcox, Roger Levy, Ryan Cotterell
Transactions of the Association for Computational Linguistics (TACL)
Testing the Predictions of Surprisal Theory in 11 Languages
Ethan G. Wilcox, Tiago Pimentel, Clara Meister, Ryan Cotterell, Roger P. Levy
Transactions of the Association for Computational Linguistics (TACL)
A Cross-Linguistic Pressure for Uniform Information Density in Word Order
Thomas Hikaru Clark, Clara Meister, Tiago Pimentel, Michael Hahn, Ryan Cotterell, Richard Futrell, Roger Levy
Annual Meeting of the Association for Computational Linguistics (ACL)
On the Efficacy of Sampling Adapters
Clara Meister, Tiago Pimentel, Luca Malagutti, Ethan G. Wilcox, Ryan Cotterell
Findings of the Association for Computational Linguistics (ACL)
Few-shot Fine-tuning vs. In-context Learning: A Fair Comparison and Evaluation
Marius Mosbach, Tiago Pimentel, Shauli Ravfogel, Dietrich Klakow, Yanai Elazar
Annual Meeting of the Association for Computational Linguistics (ACL)
A Measure-Theoretic Characterization of Tight Language Models
Li Du, Lucas Torroba Hennigen, Tiago Pimentel, Clara Meister, Jason Eisner, Ryan Cotterell
Annual Meeting of the Association for Computational Linguistics (ACL)
A Natural Bias for Language Generation Models
Clara Meister, Wojciech Stokowiec, Tiago Pimentel, Lei Yu, Laura Rimell, Adhiguna Kuncoro
PLOS ONE
Quantifying Gender Bias Towards Politicians in Cross-Lingual Language Models
Karolina Stańczak, Sagnik Ray Choudhury, Tiago Pimentel, Ryan Cotterell, Isabelle Augenstein
International Conference on Learning Representations (ICLR)
On the Usefulness of Embeddings, Clusters and Strings for Text Generation Evaluation
Tiago Pimentel*, Clara Meister*, Ryan Cotterell
Spotlight (top 25%)
Conference of the European Chapter of the Association for Computational Linguistics (EACL)
On the Intersection of Context-Free and Regular Languages
Clemente Pasti, Andreas Opedal, Tiago Pimentel, Tim Vieira, Jason Eisner, Ryan Cotterell
Transactions of the Association for Computational Linguistics (TACL)
Naturalistic Causal Probing for Morpho-Syntax
Afra Amini, Tiago Pimentel, Clara Meister, Ryan Cotterell
Transactions of the Association for Computational Linguistics (TACL)
Locally Typical Sampling
Clara Meister, Tiago Pimentel, Gian Wiher, Ryan Cotterell
Merged into HF Transformers
2022
Conference on Empirical Methods in Natural Language Processing (EMNLP)
The Architectural Bottleneck Principle
Tiago Pimentel*, Josef Valvoda*, Niklas Stoehr, Ryan Cotterell
International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR)
Rethinking Reinforcement Learning for Recommendation: A Prompt Perspective
Xin Xin, Tiago Pimentel, Alexandros Karatzoglou, Pengjie Ren, Konstantina Christakopoulou, Zhaochun Ren
Language Resources and Evaluation Conference (LREC)
UniMorph 4.0: Universal Morphology
Khuyagbaatar Batsuren, Omer Goldman, Salam Khalifa, Nizar Habash, Witold Kieraś, Gábor Bella, Brian Leonard, Garrett Nicolai, Kyle Gorman, Yustinus Ghanggo Ate, Maria Ryskina, Sabrina Mielke, Elena Budianskaya, Charbel El-Khaissi, Tiago Pimentel, Michael Gasser, William Abbott Lane, Mohit Raj, Matt Coler, Jaime Rafael Montoya Samame, Delio Siticonatzi Camaiteri, Esaú Zumaeta Rojas, Didier López Francis, Arturo Oncevay, Juan López Bautista, Gema Celeste Silva Villegas, Lucas Torroba Hennigen, Adam Ek, David Guriel, Peter Dirix, Jean-Philippe Bernardy, Andrey Scherbakov, Aziyana Bayyr-ool, Antonios Anastasopoulos, Roberto Zariquiey, Karina Sheifer, Sofya Ganieva, Hilaria Cruz, Ritván Karahóǧa, Stella Markantonatou, George Pavlidis, Matvey Plugaryov, Elena Klyachko, Ali Salehi, Candy Angulo, Jatayu Baxi, Andrew Krizhanovsky, Natalia Krizhanovskaya, Elizabeth Salesky, Clara Vania, Sardana Ivanova, Jennifer White, Rowan Hall Maudslay, Josef Valvoda, Ran Zmigrod, Paula Czarnowska, Irene Nikkarinen, Aelita Salchak, Brijesh Bhatt, Christopher Straughn, Zoey Liu, Jonathan North Washington, Yuval Pinter, Duygu Ataman, Marcin Wolinski, Totok Suhardijanto, Anna Yablonskaya, Niklas Stoehr, Hossep Dolatian, Zahroh Nuriah, Shyam Ratan, Francis M. Tyers, Edoardo M. Ponti, Grant Aiton, Aryaman Arora, Richard J. Hatcher, Ritesh Kumar, Jeremiah Young, Daria Rodionova, Anastasia Yemelina, Taras Andrushko, Igor Marchenko, Polina Mashkovtseva, Alexandra Serova, Emily Prud’hommeaux, Maria Nepomniashchaya, Fausto Giunchiglia, Eleanor Chodroff, Mans Hulden, Miikka Silfverberg, Arya D. McCarthy, David Yarowsky, Ryan Cotterell, Reut Tsarfaty, Ekaterina Vylomova
Annual Meeting of the Association for Computational Linguistics (ACL)
Probing for the Usage of Grammatical Number
Karim Lasri, Tiago Pimentel, Alessandro Lenci, Thierry Poibeau, Ryan Cotterell
Annual Meeting of the Association for Computational Linguistics (ACL)
Analyzing Wrap-Up Effects through an Information-Theoretic Lens
Clara Meister, Tiago Pimentel, Thomas Clark, Ryan Cotterell, Roger Levy
Annual Meeting of the Association for Computational Linguistics (ACL)
On the probability–quality paradox in language generation
Clara Meister, Gian Wiher, Tiago Pimentel, Ryan Cotterell
2021
Conference on Empirical Methods in Natural Language Processing (EMNLP)
A Bayesian Framework for Information-Theoretic Probing
Tiago Pimentel, Ryan Cotterell
Conference on Empirical Methods in Natural Language Processing (EMNLP)
On Homophony and Rényi Entropy
Tiago Pimentel, Clara Meister, Simone Teufel, Ryan Cotterell
Conference on Empirical Methods in Natural Language Processing (EMNLP)
A surprisal--duration trade-off across and within the world's languages
Tiago Pimentel, Clara Meister, Elizabeth Salesky, Simone Teufel, Damián Blasi, Ryan Cotterell
Conference on Empirical Methods in Natural Language Processing (EMNLP)
Revisiting the Uniform Information Density Hypothesis
Clara Meister, Tiago Pimentel, Patrick Haller, Lena Jäger, Ryan Cotterell, Roger Levy
Findings of the Association for Computational Linguistics (ACL)
Modeling the Unigram Distribution
Irene Nikkarinen*, Tiago Pimentel*, Damián Blasi, Ryan Cotterell
Conference of the North American Chapter of the Association for Computational Linguistics (NAACL)
How (Non-)Optimal is the Lexicon?
Tiago Pimentel*, Irene Nikkarinen*, Kyle Mahowald, Ryan Cotterell, Damián Blasi
Conference of the North American Chapter of the Association for Computational Linguistics (NAACL)
Finding Concept-specific Biases in Form--Meaning Associations
Tiago Pimentel, Brian Roark, Søren Wichmann, Ryan Cotterell, Damián Blasi
Conference of the North American Chapter of the Association for Computational Linguistics (NAACL)
A Non-Linear Structural Probe
Jennifer C. White, Tiago Pimentel, Naomi Saphra, Ryan Cotterell
Conference of the North American Chapter of the Association for Computational Linguistics (NAACL)
What About the Precedent: An Information-Theoretic Analysis of Common Law
Josef Valvoda, Tiago Pimentel, Niklas Stoehr, Ryan Cotterell, Simone Teufel
Conference of the European Chapter of the Association for Computational Linguistics (EACL)
Disambiguatory Signals are Stronger in Word-initial Positions
Tiago Pimentel, Ryan Cotterell, Brian Roark
2020
Conference on Empirical Methods in Natural Language Processing (EMNLP)
Speakers Fill Lexical Semantic Gaps with Context
Tiago Pimentel, Rowan Hall Maudslay, Damián Blasi, Ryan Cotterell
Conference on Empirical Methods in Natural Language Processing (EMNLP)
Pareto Probing: Trading-Off Accuracy and Complexity
Tiago Pimentel*, Naomi Saphra*, Adina Williams, Ryan Cotterell
International Joint Conference on Neural Networks (IJCNN)
Deep Active Learning for Anomaly Detection
Tiago Pimentel, Marianne Monteiro, Adriano Veloso, Nivio Ziviani
International Joint Conference on Neural Networks (IJCNN)
Assessing the Reliability of Visual Explanations of Deep Models with Adversarial Perturbations
Dan Valle, Tiago Pimentel, Adriano Veloso
Annual Meeting of the Association for Computational Linguistics (ACL)
A Tale of a Probe and a Parser
Rowan Hall Maudslay, Josef Valvoda, Tiago Pimentel, Adina Williams, Ryan Cotterell
Annual Meeting of the Association for Computational Linguistics (ACL)
Predicting Declension Class from Form and Meaning
Adina Williams, Tiago Pimentel, Hagen Blix, Arya D. McCarthy, Eleanor Chodroff, Ryan Cotterell
Annual Meeting of the Association for Computational Linguistics (ACL)
Information-Theoretic Probing for Linguistic Structure
Tiago Pimentel, Josef Valvoda, Rowan Hall Maudslay, Ran Zmigrod, Adina Williams, Ryan Cotterell
Annual Meeting of the Association for Computational Linguistics (ACL)
A Corpus for Large-Scale Phonetic Typology
Elizabeth Salesky, Eleanor Chodroff, Tiago Pimentel, Matthew Wiesner, Ryan Cotterell, Alan W. Black, Jason Eisner
Transactions of the Association for Computational Linguistics (TACL)
Phonotactic Complexity and Its Trade-offs
Tiago Pimentel, Brian Roark, Ryan Cotterell
2019
Annual Meeting of the Association for Computational Linguistics (ACL)
Meaning to Form: Measuring Systematicity as Information
Tiago Pimentel, Arya D. McCarthy, Damián Blasi, Brian Roark, Ryan Cotterell
Best paper nominee
International Joint Conference on Neural Networks (IJCNN)
Efficient estimation of node representations in large graphs using linear contexts
Tiago Pimentel, Rafael Castro, Adriano Veloso, Nivio Ziviani
2018
String Processing and Information Retrieval (SPIRE)
Fast and effective neural networks for translating natural language into denotations
Tiago Pimentel, Juliano Viana, Adriano Veloso, Nivio Ziviani
Robotics and Autonomous Systems
Detection of bimanual gestures everywhere: Why it matters, what we need and what is missing
Divya Shah*, Ernesto Denicia*, Tiago Pimentel*, Barbara Bruno, Fulvio Mastrogiovanni
2013
IEEE Aerospace Conference
Mapping planetary caves with an autonomous, heterogeneous robot team
Ammar Husain, Heather Jones, Balajee Kannan, Uland Wong, Tiago Pimentel, Sarah Tang, Shreyansh Daftry, Steven Huber, William L. Whittaker