JOKER

Home • Tasks • CLEF program • Publications • Partners • Contest • Contact Us • CLEF 2022 • CLEF 2023

CLEF 2024 JOKER Track:

Automatic Wordplay Analysis

JOKER Sessions takes place in Room 2 (IMAG Auditorium) except for the plenary CLEF conference sessions in Room 1 (MaCI Amphitheatre).

Zoom link for track sessions: Virtual CLEF Room 2.
If you registered for CLEF (online), the conference will provide the links for plenary sessions.

Tuesday 10th September

Lab Overviews 2 (Room 1)

09:00 - 10:40 Lab Overviews 2 [Room 1]: ImageCLEF, CheckThat!, JokerLab, Pan, qCLEF
Liana Ermakova, Tristan Miller, Anne-Gwenn Bosser, Victor Manuel Palma Preciado, Grigori Sidorov, and Adam Jatowt. 2024. Overview of CLEF 2024 JOKER track on Automatic Humor Analysis, in: Proceedings of CLEF’24, LNCS Volume 14958 + 14959, Springer, 2024 (Paper, Slides).

Joint session with SimpleText Session 4 (Room 2)

17:10 - 17:25

📶 Victor Manuel Palma-Preciado, Carolina Palma-Preciado, Grigori Sidorov. NLPalma Joker 2024: Yet, no Humor with Humorousness - Task 2 Humour Classification According to Genre and Technique. (Paper)

Wednesday 11th September

JOKER Session 1 (Room 2)

14:00 - 14:30 CLEF 2024 JOKER Task Overviews (Slides):
Liana Ermakova, Anne-Gwenn Bosser, Tristan Miller, Adam Jatowt. Overview of the CLEF 2024 JOKER Task 1: Humour-aware Information Retrieval. (Paper)
Victor Manuel Palma Preciado, Grigori Sidorov, Liana Ermakova, Anne-Gwenn Bosser, Tristan Miller, Adam Jatowt. Overview of the CLEF 2024 JOKER Task 2: Humour Classification According to Genre and Technique. (Paper)
Liana Ermakova, Anne-Gwenn Bosser, Tristan Miller, Adam Jatowt. Overview of the CLEF 2024 JOKER Task 3: Translate puns from English to French. (Paper)
14:30 - 15:30 Participants presentations (10+2 min)
Shih-Hung Wu, Yu-Feng Huang, Tsz-Yeung Lau. Humour Classification by Fine-tuning LLMs: CYUT at CLEF 2024 JOKER Lab Subtask Humour Classification According to Genre and Technique. (Paper)
Emma Schuurman, Mick Cazemier, Luc Buijs, Jaap Kamps. University of Amsterdam at the CLEF 2024 Joker Track. (Paper, Slides)
📶 Arina Gepalova, Adrian-Gabriel Chifu, Sébastien Fournier. CLEF 2024 Joker Task 1: Exploring Pun Detection Using The T5 Transformer Model. (Paper)
📶 Pierre Epron, Gaël Guibon, Miguel Couceiro. ORPAILLEUR & SyNaLP at CLEF 2024 Task 2: Good Old Cross Validation for Large Language Models Yields the Best Humorous Detection. (Paper, Slides)

JOKER Session 2 (Room 2)

16:30 - 18:00 CLEF 2024 Participant presentations (10+2 minutes).
📶 Regina Elagina, Petra Vučić. Working Notes of CLEF 2024: Effective Humor Analysis and Translation. (Paper, Slides)
📶 Jana Viktória Kováčiková, Marek Šuppa. Thinking, Fast and Slow: From the Speed of FastText to the Depth of Retrieval Augmented Large Language Models For Humour Classification. (Paper)
📶 Olga Popova. Comparative Evaluation of Humour Translation from English to Spanish: A Study with BLOOM and Googletrans. (Paper, Slides)
📶 Sarvesh Narayanan, Jayasimman J, Shiva Ganesh V. CLEF 2024 JOKER Task 2 : Using RoBERTa and Bert-uncased for Humour Classification According to Genre and Technique. (Paper)
📶 M Saipranav, Jaswanth Sridharan, Gautham Narayan G, Angel Deborah S, Rajalakshmi S, Mirnalinee T T, Samyuktaa Sivakumar. CLEF 2024 JOKER Task 2: Using BERT and Random Forest Classifier for Humor Classification According to Genre and Technique. (Paper)
📶 Rakshith Subramanian, Vaishnavi S, B Bharathi. Team Humour Insights at JOKER 2024 Task 2: Humour Classification According To Genre And Technique. (Paper, Slides)
📶 Ryan Rony Dsilva, Nidhi Bhardwaj. PunDerstand @ CLEF JOKER 2024: Who’s Laughing Now? Humor Classification by Genre & Technique. (Paper, Slides)

Thursday 12th September

CONFERENCE Session 4 In-Context Evaluation and Retrieval (Room 1)

9:00-9:20 Ryan Rony Dsilva, From Sentence Embeddings to Large Language Models to Detect and Understand Wordplay (JOKER Best of the Labs in CLEF 2023, Paper).

JOKER Session 3 (Room 2)

11:15-12:00 📶 Invited talk by Pavel Braslavski (Nazarbayeb University) “What you will be laughing about tomorrow? A brief overview of today’s computational humour research”

*12:00 - 12:12 Participant presentations (10+2 minutes)

📶 Rowan Mann, Tomislav Mikulandric. CLEF 2024 JOKER Tasks 1-3: Humour identification and classification. (Paper, Slides)
12:12 - 12:45 Round table and JOKER 2025 discussion:
- We want to hear from you!
- What was great about 2024, and what could we improve for you?
- Any ideas or volunteers are welcome!
- JOKER roadmap

Closing and Introduction of CLEF 2025 (Room 1)

17:00 - 18:00 Closing and plans for 2025 (including slides on the CLEF 2025 JOKER track)

All CLEF 2024 JOKER track papers

Liana Ermakova, Anne-Gwenn Bosser, Tristan Miller, Adam Jatowt. Overview of the CLEF 2024 JOKER Task 1: Humour-aware Information Retrieval. (Paper)
Victor Manuel Palma Preciado, Grigori Sidorov, Liana Ermakova, Anne-Gwenn Bosser, Tristan Miller, Adam Jatowt. Overview of the CLEF 2024 JOKER Task 2: Humour Classification According to Genre and Technique. (Paper)
Liana Ermakova, Anne-Gwenn Bosser, Tristan Miller, Adam Jatowt. Overview of the CLEF 2024 JOKER Task 3: Translate puns from English to French. (Paper)
Harouna Baguian, Huynh Nina Ashley. JOKER Track @ CLEF 2024: the Jokesters’ approaches for retrieving, classifying, and translating wordplay. (Paper)
Antonia Bartulović, Dóra Paula Váradi. University of Split and University of Malta (Team AB&DPV) at the CLEF 2024 JOKER Track: From ‘LOL’ to ‘MDR’ Using Artificial Intelligence Models to Retrieve and Translate Puns. (Paper)
Ryan Rony Dsilva, Nidhi Bhardwaj. PunDerstand @ CLEF JOKER 2024: Who’s Laughing Now? Humor Classification by Genre & Technique. (Paper)
Regina Elagina, Petra Vučić. Working Notes of CLEF 2024: Effective Humor Analysis and Translation. (Paper)
Pierre Epron, Gaël Guibon, Miguel Couceiro. ORPAILLEUR & SyNaLP at CLEF 2024 Task 2: Good Old Cross Validation for Large Language Models Yields the Best Humorous Detection. (Paper)
Arina Gepalova, Adrian-Gabriel Chifu, Sébastien Fournier. CLEF 2024 Joker Task 1: Exploring Pun Detection Using The T5 Transformer Model. (Paper)
Jana Viktória Kováčiková, Marek Šuppa. Thinking, Fast and Slow: From the Speed of FastText to the Depth of Retrieval Augmented Large Language Models For Humour Classification. (Paper)
Rowan Mann, Tomislav Mikulandric. CLEF 2024 JOKER Tasks 1-3: Humour identification and classification. (Paper)
Sarvesh Narayanan, Jayasimman J, Shiva Ganesh V. CLEF 2024 JOKER Task 2 : Using RoBERTa and Bert-uncased for Humour Classification According to Genre and Technique. (Paper)
Victor Manuel Palma-Preciado, Carolina Palma-Preciado, Grigori Sidorov. NLPalma Joker 2024: Yet, no Humor with Humorousness - Task 2 Humour Classification According to Genre and Technique. (Paper)
Olga Popova. Comparative Evaluation of Humour Translation from English to Spanish: A Study with BLOOM and Googletrans. (Paper)
Dhannya S M, Lakshmi Priya S, Shreedevi Seluka Balaji, Sai Nikitha N.S.R, Shwetha S, Surabhi Kamath, Srinidhi Lakshmi Narayanan. Vayam Solve Kurmaha @ CLEF 2024: Task 2: Humor Classification according to Genre and Technique using BERT Embeddings and Transformers. (Paper)
M Saipranav, Jaswanth Sridharan, Gautham Narayan G, Angel Deborah S, Rajalakshmi S, Mirnalinee T T, Samyuktaa Sivakumar. CLEF 2024 JOKER Task 2: Using BERT and Random Forest Classifier for Humor Classification According to Genre and Technique. (Paper)
Emma Schuurman, Mick Cazemier, Luc Buijs, Jaap Kamps. University of Amsterdam at the CLEF 2024 Joker Track. (Paper)
Rakshith Subramanian, Vaishnavi S, B Bharathi. Team Humour Insights at JOKER 2024 Task 2: Humour Classification According To Genre And Technique. (Paper)
Shih-Hung Wu, Yu-Feng Huang, Tsz-Yeung Lau. Humour Classification by Fine-tuning LLMs: CYUT at CLEF 2024 JOKER Lab Subtask Humour Classification According to Genre and Technique. (Paper)