NLP Seminar Series
The NLP Seminar Series at AI Sweden is a bi-weekly forum for people who work with or are interested in Natural Language Processing (NLP). Join us online or on site at the AI Sweden Stockholm office on Fleminggatan 41. You can also take the opportunity to work from the AI Sweden Stockholm office for the entire day.
Schedule for the 2022 Autumn NLP Seminar Series
Wednesday September 14, 16.00-17.30:
Title: On the Dangers of Stochastic Parrots: Can Language Models Be Too Big?
Speaker: Prof. Dr Emily M. Bender, University of Washington
Wednesday September 28, 15.00-16.30:
Titel: "Natural" Natural Language Processing
Speaker: Slav Petrov, Distinguished Scientist / Senior Research Director, Google
Wednesday October 12, 15.00-16.30:
Titel: Reading between the lines: a better benchmark for text understanding
Speaker: Prof. Dr. Yoav Goldberg, Bar Ilan University and Research Director at AI2 Israel
Wednesday October 26, 15.00-16.30:
Titel: Detect - Verify - Communicate: Combating Misinformation with More Realistic NLP
Speaker: Prof. Dr. Iryna Gurevych, Technical University Darmstadt, Germany
Wednesday November 9, 15.00-16.30:
Titel: Revisiting Neural Scaling Laws in Language and Vision
Speaker: Ibrahim Alabdulmohsin, Research Scientist at Google Brain, and Xiaohua Zhai, Staff Researcher at Google Brain
Find more about the previous presentations here.
Wednesday November 23 - cancelled because of SLTC (Swedish Language Technology Conference)
Wednesday December 7, 15.00-16.30:
Titel: Text Summarization and Evaluation in the Era of GPT-3
Speaker: Tanya Goyal, PhD student at University of Texas at Austin
Abstract: The recent success of zero- and few-shot prompting with models like GPT-3 has led to a paradigm shift in NLP research. We study its impact on text summarization, focusing on the classic benchmark domain of news summarization. First, we investigate how zero-shot GPT-3 compares against fine-tuned models trained on large summarization datasets. We show that not only do humans overwhelmingly prefer GPT-3 summaries, but these also do not suffer from common dataset-specific issues such as poor factuality. Next, we study what this means for evaluation, particularly the role of gold standard test sets. Our experiments show that both reference-based and reference-free automatic metrics, e.g. recently proposed QA- or entailment-based factuality approaches, cannot reliably evaluate zero-shot summaries. Finally, we discuss future research challenges beyond generic summarization, specifically, keyword- and aspect-based summarization, showing how dominant fine-tuning approaches compare to zero-shot prompting.
Upcoming dates. Speakers and theme will be updated shortly!
Wednesday December 21, 15.00-16.30
By practitioners, for practitioners
Each seminar features an initial 45-minute presentation by practitioners or researchers followed by discussion. The NLP Seminar Series is organized by AI Sweden and RISE NLP group, and moderated by Magnus Sahlgren, Head of Research, Natural Language Understanding at AI Sweden and Joakim Nivre, Head of Natural Language Processing at RISE.
Proposals for presentations can be sent to: email@example.com and firstname.lastname@example.org
In association with