NLP seminar at TU Wien
Every Tuesday, 14.15 - 15.45, Room HD0215
194.135 Research topics in natural language processing
TISS page: 2024SS, 2023WS, 2023SS
| Date | Topic | Required reading | Additional reading | Presenter | Slides |
|---|---|---|---|---|---|
| 3/5/2024 | Introduction, scheduling | ||||
| 3/12/2024 | Mixture Of Experts LLMs | Zoph et al. 2022, Du et al. 2022 | Jiang et al. 2024, Xue et al. 2024 | Ilya Lasy | |
| 3/19/2024 | Low-rank adaptation of LLMs | Hu et al. 2022 | Hennings 2023 | Roman Grebnev | |
| 3/26/2024 | No class (spring break) | ||||
| 4/2/2024 | No class (spring break) | ||||
| 4/9/2024 | Biographical Relation Extraction | own research | Varvara Arzt | ||
| 4/16/2024 | LLM Quantization | Lin et al. 2023, Ma et al. 2024 | Ilya Lasy | ||
| 4/23/2024 | Information Extraction at Kontron Transportation | own research | Mehdin Masinovic | ||
| 4/30/2024 | The Importance of Context in the Evaluation of Word Embeddings | Fodor et al. 2023 | Iva Pezo | ||
| 5/7/2024 | Relational Knowledge in Language Models | Hernandez et al. 2024 | Varvara Arzt | ||
| 5/14/2024 | Extracting Winners and Losers from Legislative Texts | Davoodi et al. 2022 | Kasra Zarinehbaf Asadi | ||
| 5/21/2024 | No class (Pentecost break) | ||||
| 5/28/2024 | Explainable AI in NLP | Danilevsky et al. 2020 | Mirta Medak | ||
| 6/4/2024 | Semantic shifts of words | Yao et al. 2018 | Kutuzov et al. 2018 | Kristian Ristic | |
| 6/11/2024 | Synthetic data for language models | Liu et al. 2024 | Aditi Chauhan | ||
| 6/18/2024 | SongComposer: A Large Language Model for Lyric and Melody Composition in Song Generation | Ding et al. 2024 | Fabian Ombui | ||
| 6/25/2024 | Sarcasm detection in NLP | Kumar & Garg 2019 | Farha et al. 2022 | Dario Bogenreiter |
| Date | Topic | Required reading | Additional reading | Presenter | Slides |
|---|---|---|---|---|---|
| 10/3/2023 | Introduction, scheduling | ||||
| 10/10/2023 | No class | ||||
| 10/17/2023 | Word embeddings, temporal embeddings | SLP3 Ch 6: Vector semantics and embeddings | Mikolov et al. 2013, Collobert et al. 2011 | Paul Schmitt | Slides |
| 10/24/2023 | Transformers and BERT | Vaswani et al. 2017, Devlin et al. 2019 | Rogers et al. 2020 | Valentin Peter, Carlos Vargas | Slides |
| 10/31/2023 | Problems with distributional models | Bender et al. 2021, Bender & Koller 2020 | Luiza Corpaci | Slides | |
| 11/7/2023 | No class | ||||
| 11/14/2023 | No class | ||||
| 11/21/2023 | Model evaluation with contrast sets | Gardner et al. 2020 | Varvara Arzt | ||
| 11/28/2023 | Large Language Models I | Touvron et al. 2023 | Varvara Arzt, Mahdi Azarbeik | ||
| 12/5/2023 | Large Language Models II | Borgeaud et al. 2022 | Ilya Lasy | Slides | |
| 12/12/2023 | Relation extraction | Wadhwa et al. 2023 | Varvara Arzt | ||
| 12/19/2023 | Cancelled due to illness | ||||
| 1/9/2024 | Ethical Issues in NLP | Bender & Friedman 2018 | Silvia Bonomi | Slides | |
| 1/16/2024 | Discourse Representation Parsing | van Noord et al. 2018 | van Noord et al. 2020 | Christian Obereder | Slides |
| 1/23/2024 | Information extraction | Fei et al. 2022 | Tilman Kerl |
| Date | Topic | Required reading | Additional reading | Presenter |
|---|---|---|---|---|
| 3/7/2023 | Introduction, scheduling | |||
| Overview of NLP tasks, task types, methods | ||||
| 3/21/2023 | Word embeddings | Mikolov et al. 2013 | Collobert et al. 2011, Pennington et al. 2014 | Lukas Arnhold |
| Transformer-based language models | Vaswani et al. 2017, Devlin et al. 2019 | Rogers et al. 2020 | Gerald Weber | |
| 4/4/2023 | Easter break | |||
| 4/18/2023 | Problems with distributional models | Bender et al. 2021 | Ana Terović | |
| Explainability | Ribeiro et al. 2016, Jain & Wallace 2019, DeYoung et al. 2020 | Jacovi & Goldberg 2020 | Thais Beham | |
| 5/2/2023 | Understanding and semantics | Bender & Koller 2020, Emerson 2020 | Lukas Hofstetter | |
| Semantic parsing and representation | Banarescu et al. 2013, Poelman et al. 2022 | Mina Jafari | ||
| 5/16/2023 | Semantics-based information extraction | Kovács et al. 2022b | Kovács et al. 2022a | |
| Graph-based Open Information Extraction | Léchelle et al. 2019 | Gashteovski et al. 2017 | Fabian Gabelberger | |
| 5/30/2023 | Pentecost break | |||
| 6/13/2023 | Semantic textual similarity of English legal text | Peter Walchhofer | ||
| Using AutoGPT to create a virtual assistant | Lukas Hofstetter | |||
| 6/27/2022 | Detecting bias in Transformer-based models | Tilman Kerl | ||
| End-of-semester update round |
For the schedule of earlier semesters see this page