PhD Student of Computer Science
Bar-Ilan University

Yanai Elazar

I am a third year PhD student in the Natural Language Processing Lab at Bar-Ilan University, under the supervision of Prof. Yoav Goldberg. In addition, I work as a research intern at AI2 Israel.
My interests lie between Natural Language Processing and Machine Learning. Specifically, I'm interested in interpretability and analysis of NLP models, biases of models and datasets, and commonsense reasoning.

Since August 2020, I am co-organizing an online NLP seminar: NLP with Friends, along with Abhilasha Ravichander, Liz Salesky and Zeerak Waseem. Join us!

I'm extremely greatful (and lucky!) to be a Google PhD Fellow.


Invited talk at ACMI lab, CMU
Apr 2021
Invited talk at Future of AI
Mar 2021
Invited talk at Google, Seattle
Feb 2021
Invited talk at reciTAL, Paris
Jan 2021
Invited talk at AI2, Seattle
Dec 2020
Invited talk at Miscrosoft, Tel-Aviv
Dec 2020
Invited talk at CMU, Pittsburgh
Nov 2020
I was featured in the Jerusalem Post
Oct, 2020
I shortly appeared on an Israeli radio show - Shlosha Sheyody’im (Three who knows) with Dudu Erez
Oct, 2020
Oct, 2020
Co-organizing a new online NLP seminar: NLP with Friends. Join us!
Jul, 2020



Back to Square One: Bias Detection, Training and Commonsense Disentanglement in the Winograd Schema
Yanai Elazar, Hongming Zhang, Yoav Goldberg, Dan Roth
preprint bibtex

Contrastive Explanations for Model Interpretability
Alon Jacovi, Swabha Swayamdipta, Shauli Ravfogel, Yanai Elazar, Yejin Choi, Yoav Goldberg
preprint bibtex code

Measuring and Improving Consistency in Pretrained Language Models
Yanai Elazar, Nora Kassner, Shauli Ravfogel, Abhilasha Ravichander, Eduard Hovy, Hinrich Schütze, Yoav Goldberg
preprint bibtex code resource

First Align, then Predict: Understanding the Cross-Lingual Ability of Multilingual BERT
Benjamin Muller, Yanai Elazar, Benoît Sagot and Djamé Seddah
EACL 2021
paper bibtex short code

*Amnesic Probing: Behavioral Explanation with Amnesic Counterfactuals
Yanai Elazar, Shauli Ravfogel, Alon Jacovi, Yoav Goldberg
TACL 2021
(*) previous version that appeared on arxiv was named: "When Bert Forgets How To POS: Amnesic Probing of Linguistic Properties and MLM Predictions", which we changed to the current title to better reflect our contributions.
paper bibtex journal code slides


It’s not Greek to mBERT: Inducing Word-Level Translations from Multilingual BERT
Hila Gonen, Shauli Ravfogel, Yanai Elazar, Yoav Goldberg
Third BlackboxNLP Workshop on Analyzing and Interpreting Neural Networks for NLP, at EMNLP 2020
paper bibtex long code poster

The Extraordinary Failure of Complement Coercion Crowdsourcing
Yanai Elazar, Victoria Basmov, Shauli Ravfogel, Yoav Goldberg, Reut Tsarfaty
Workshop on Insights from Negative Results in NLP, EMNLP 2020
paper bibtex short slides video

Do Language Embeddings Capture Scales?
Xikun Zhang, Deepak Ramachandran, Ian Tenney, Yanai Elazar, Dan Roth
Findings of EMNLP 2020
paper bibtex long code

Unsupervised Distillation of Syntactic Information from Contextualized Word Representations
*Shauli Ravfogel, *Yanai Elazar, Jacob Goldberger, Yoav Goldberg
Third BlackboxNLP Workshop on Analyzing and Interpreting Neural Networks for NLP, at EMNLP 2020
paper bibtex long code slides

Null It Out: Guarding Protected Attributes by Iterative Nullspace Projection
Shauli Ravfogel, Yanai Elazar, Hila Gonen, Michael Twiton, Yoav Goldberg
ACL 2020
paper bibtex long code video

Evaluating Models' Local Decision Boundaries via Contrast Sets
Matt Gardner, Yoav Artzi, Victoria Basmova, Jonathan Berant, Ben Bogin, Sihao Chen, Pradeep Dasigi, Dheeru Dua, Yanai Elazar, Ananth Gottumukkala, Nitish Gupta, Hanna Hajishirzi, Gabriel Ilharco, Daniel Khashabi, Kevin Lin, Jiangming Liu, Nelson F Liu, Phoebe Mulcaire, Qiang Ning, Sameer Singh, Noah A Smith, Sanjay Subramanian, Reut Tsarfaty, Eric Wallace, Ally Zhang, Ben Zhou
Findings of EMNLP 2020
paper bibtex long resource

oLMpics -- On what Language Model Pre-training Captures
Alon Talmor, Yanai Elazar, Yoav Goldberg, Jonathan Berant
TACL 2020 (presented at EMNLP 2020)
paper bibtex journal code video


Adversarial Removal of Demographic Attributes Revisited
Maria Barrett, Yova Kementchedjhieva, Yanai Elazar, Desmond Elliott, Anders Søgaard
EMNLP 2019
paper bibtex short

How Large Are Lions? Inducing Distributions over Quantitative Attributes
Yanai Elazar, Abhijit Mahabal, Deepak Ramachandran, Tania Bedrax-Weiss, Dan Roth
ACL 2019
paper bibtex long code resource demo slides

Where's My Head? Definition, Dataset and Models for Numeric Fused-Heads Identification and Resolution
Yanai Elazar, Yoav Goldberg
TACL 2019 (presented at EMNLP 2019)
paper bibtex journal code resource demo slides video

Privacy and Fairness in Recommender Systems via Adversarial Training of User Representations
Yehezkel S. Resheff, Yanai Elazar, Moni Shahar, Oren Sar Shalom
paper bibtex long


Adversarial Removal of Demographic Attributes from Text Data
Yanai Elazar, Yoav Goldberg
EMNLP 2018
paper bibtex long code slides video


Attending ACL 2020

My strategy for attending my first virtual conference.

Remote Servers

How to setup your environment to seemingly work with remote servers.