Tutorials


Dr. Sudipta Kar

Senior Applied Scientist at Amazon AGI


speaker_sudipta Sudipta Kar is a Senior Applied Scientist at Amazon AGI. He received his Ph.D. in Computer Science from the University of Houston in 2020 under the supervision of Thamar Solorio. His doctoral research focused on creative text analysis. Currently, he works on developing intelligent systems to enable seamless proactivity in smart voice assistants such as Alexa. His research interests include computational systems for low-resource languages, language models, and information extraction. He has co-organized multiple natural language processing workshops and shared tasks, including BLP, CALCS, MultiCoNER, and SentiMix. Additionally, in 2023 he led the first NLP hackathon held in Bangladesh.

Tutorial title: The Power of Rewards - Reinforcing Language Models with Reinforcement Learning

Language models ranging from BERT to GPT have shown impressive performance on many natural language tasks through first self-supervised pre-training on large text corpora and then fine-tuning on downstream tasks or even with zero-shot or few-shot approaches. These models are also very powerful in solving multiple tasks. However, their capabilities are still limited as they lack a built-in reward signal to directly optimize for the end task objective or align to certain human preferences.On the other hand, Reinforcement Learning (RL) is another area in machine learning which is commonly applied to develop systems that improve over real-time feedback loops (such as games). Because it provides a framework for optimizing goal-directed behavior through rewards. In this tutorial, we will explore how reinforcement learning came into the play of language modeling and suddenly changed the game by reinforcing the representational power of large language models with the ability to more efficiently solve tasks requiring reasoning, planning, and knowledge. We will first provide background on contemporary language models and reinforcement learning fundamentals. Next, we will discuss techniques for applying policy gradient methods to fine-tune language models to maximize rewards from an environment. Attendees will learn how to practically apply RL to language tasks, understand tradeoffs between different algorithms, and gain insight into state-of-the-art research in this emerging field.

Dr. Danae Sánchez

Researcher at the University of Copenhagen


speaker_danae Danae Sánchez Villegas is a postdoctoral researcher at the University of Copenhagen. She holds a Ph.D. and a Master's degree in Computer Science from the University of Sheffield and a Bachelor's degree in Computer Engineering from the Instituto Tecnológico Autónomo de México. Her research interests include multilingual natural language understanding, vision and language modeling, and computational social science. Danae has worked as a Research Associate in the Natural Language Processing Group at the University of Sheffield and as an Applied Scientist Intern at Amazon Alexa.

Tutorial title: Exploring Transformers and Limitations in Language Modeling.

This tutorial explores language modeling techniques in Natural Language Processing (NLP), covering key concepts from traditional approaches to Transformer architectures. Beginning with an introduction to NLP and language modeling, it delves into probabilistic language models and progresses to neural language models, emphasizing the significance of embeddings for semantic representation. Moving on to Transformer models, we will discuss key concepts such as multi-head attention mechanisms, masked language modeling, and encoder models. Additionally, the tutorial addresses the limitations of large language models, providing insights into challenges and considerations for leveraging these models effectively in practical applications.

Dr. Alham Fikri Aji

Assistant Professor at MBZUAI


speaker_aji Dr. Alham Fikri Aji is an Assistant Professor at MBZUAI, holding a Ph.D. from the University of Edinburgh's Institute for Language, Cognition, and Computation. His doctoral research, supervised by Dr. Kenneth Heafield and Dr. Rico Sennrich, focused on enhancing the training and inference speed of machine translation. Dr. Aji's current research centers around multilingual, low-resource, and low-compute Natural Language Processing (NLP). His recent work has been in developing diverse multilingual large language models. and multilingual NLP resources, particularly for underrepresented languages, with a specific emphasis on Indonesian. Dr. Aji has worked at Amazon, Google, and Apple in the past.

Tutorial title: TBD


Dr. Lena Voita

Research Scientist at Meta AI


speaker_lena Lena obtained her Ph.D. at the University of Edinburgh, supervised by Ivan Titov and Rico Sennrich, where she was awarded the Facebook PhD Fellowship. She also worked at Yandex as a Research Scientist. Currently, she is a Research Scientist at Meta AI, working on Analysis and Interpretability for NLP. She is the current president of SIGREP (ACL) and the creator of the NLP Course For You.

Tutorial title: TBD



Panelists


Dr. Veronica Perez Rosas

Researcher at the University of Michigan


Veronica Perez Rosas She obtained her Ph.D. in Computer Science and Engineering from the University of North Texas in 2014. She is a Level I Researcher recognized by the National System of Researchers. Currently, she is a researcher at the University of Michigan, where she is a part of the Artificial Intelligence laboratory and the Inform Language and Information Technologies research group in the Department of Computer Science. Her research interests include natural language processing (NLP), machine learning, computational linguistics, and multimodal representations. Her research focuses on NLP applications, including automatic detection of misinformation, NLP in mental health, as well as the detection of human behaviors such as sentiment, deception, sarcasm, and affective response. More information about her research can be found at https://vrncapr.engin.umich.edu/.

Dr. Jocelyn Dunstan

Assistant Professor at the Pontifical Catholic University of Chile.


speaker_jocelyn Jocelyn Dunstan is an Assistant Professor at the Pontifical Catholic University of Chile. She holds a Ph.D. in Applied Mathematics and Theoretical Physics from the University of Cambridge in the UK. She specializes in leveraging machine learning and natural language processing to address key challenges. Her research primarily revolves around clinical text mining and patient prioritization. In addition to her academic role at the Catholic University of Chile, she is actively engaged as a researcher at prominent institutions such as the Center for Mathematical Modeling (CMM), the Millenium Institute for Foundational Research on Data (IMFD), and the Institute for Intelligent Healthcare Engineering (iHealth). Further information about her group's work can be found on their webpage at pln.cmm.uchile.cl.

Dr. Luciana Benotti

Associate Professor at the Universidad Nacional de Córdoba and Researcher at CONICET.


speaker_benotti Luciana Benotti is an Associate Professor in Computer Science at the Universidad Nacional de Córdoba and a Researcher in Artificial Intelligence at CONICET, Argentina. Her research interests include different aspects of situated and interactive natural language processing, like interpreting noisy user-generated text, generating clarification requests and deciding when to talk in a dialogue system, among others. She is particularly interested in non-linguistic features that contribute to the meaning conveyed during a conversation. Such features include the conversational participants’ profile, conversational timing, visual context, etc. She has been an invited scientist at University of Trento (2019), Stanford University (2018), Roskilde University (2014), Universidad de Costa Rica (2012), and University of Southern California (2010). She received a PhD in Computer Science from Université Henri Poincaré (Loria/INRIA) in France in 2010.