I am a Research Scientist at Google Research in Tel-Aviv where I work on natural language processing. Before that I was fortunate to complete my Phd at BIU's NLP lab under the supervision of Prof. Yoav Goldberg. My master's thesis was carried under the supervision of Prof. Moshe Koppel. My main interests are at the intersection of machine learning and natural language processing, with a soft spot for machine translation and sequence-to-sequence models. When not working on NLP you can usually find me on the mat practicing or teaching Ashtanga Vinyasa Yoga.
News & Activities
(Sep 2020) Short paper accepted in Findings of EMNLP
(Apr 2020) Long paper accepted in ACL 2020
(Mar 2020) Joined Google as a Research Scientist in Tel Aviv
(Mar 2020) Teaching a new course on machine translation in Bar Ilan University (slides and recordings)
(Aug 2019) Traveling to Florence to present our work on gender-aware NMT in the 1st ACL workshop on gender bias in NLP
(Jul 2019) Serving as a tutor in the Lisbon Machine Learning Summer School (LxMLS 2019)
(Jun 2019) Traveling to Minneapolis to present in NAACL
(Feb 2019) Long paper accepted in NAACL 2019 (internship project with Google Translate)
(Oct 2018) Invited talk in ISCOL
(Jul 2018) Traveling to Melbourne to present our work in ACL
(Jun 2018) Interning with Melvin Johnson and Orhan Firat, Google Translate, Mountain View, California
(Oct 2017) Invited talk in Google Research Tel-Aviv
(Sep 2017) Traveling to Zurich for Google NLP Summit
(Aug 2017) Traveling to Vancouver to present two papers in ACL
(Nov 2016) Invited talk in IBM Research Tel-Aviv
(Aug 2016) Traveling to Berlin to present our work on Morphological Reinflection in ACL
(Oct 2015) Attending the DL4MT winter school in Dublin
(Jul 2015) Attending LxMLS in Lisbon
(Apr 2015) Founded the Israeli Natural Language Processing Meetup. Join us!
Selected Publications
KoBE: Knowledge-Based Machine Translation Evaluation
pdf code
Zorik Gekhman, Roee Aharoni, Genady Beryozkin, Markus Freitag, Wolfgang Macherey
Findings of EMNLP 2020
Unsupervised Domain Clusters in Pretrained Language Models
pdf code video
Roee Aharoni, Yoav Goldberg
ACL 2020
Massively Multilingual Neural Machine Translation
pdf poster
Roee Aharoni, Melvin Johnson, Orhan Firat
NAACL 2019
Split and Rephrase: Better Evaluation and a Stronger Baseline
pdf code video
Roee Aharoni, Yoav Goldberg
ACL 2018
Towards String-to-Tree Neural Machine Translation
pdf slides video code
Roee Aharoni, Yoav Goldberg
ACL 2017 and the 1st Workshop on Neural Machine Translation
Morphological Inflection Generation with Hard Monotonic Attention
pdf poster code
Roee Aharoni, Yoav Goldberg
ACL 2017
Improving Sequence to Sequence Learning for Morphological Inflection Generation: The BIU-MIT Systems for the SIGMORPHON 2016 Shared Task
pdf code
Roee Aharoni, Yoav Goldberg, Yonatan Belinkov
SIGMORPHON Workshop, ACL 2016 (system paper, 2nd place out of 9 teams)
Automatic Detection of Machine Translated Text and Translation Quality Estimation
pdf slides video
Roee Aharoni, Moshe Koppel, Yoav Goldberg
ACL 2014
Topics in Sequence-to-Sequence Learning for Natural Language Processing (Ph.D. Thesis)
pdf
Roee Aharoni
Bar Ilan University, 2020
Automatic Detection of Machine Translated Text and Translation Quality Estimation (M.Sc. Thesis)
pdf
Roee Aharoni
Bar Ilan University, 2015
Unsupervised neural machine translation: Are we there yet?
slides
Machine & Deep Learning Israel Meetup
Attention Models for NLP
video (Hebrew)
ML Papers, Please Meetup
An interview on natural language processing
text (Hebrew)
Machine Learning Israel
Intro to Deep Learning for Natural Language Processing
slides
Intel research seminar & PyData Berlin
Neural Machine Translation
slides
BIU ML seminar
Towards Improving Machine Translation and Speech Recognition with Discriminative Fluency Classification
slides
Intel ICRI-CI retreat
Intro to Statistical Machine Translation
slides (Hebrew)