DAY 1: August 15 2024

09:00–09:15 Welcome remarks

09:15–10:30 Findings of the IWSLT 2024 Evaluation Campaign

10:30–11:00 Coffee break

11:00–12:00 Findings of the IWSLT 2024 Evaluation Campaign

12:00-12:30 Oral Session A: Test suite papers

12:30–14:00 Lunch break

14:00–14:30 Oral Session B: Scientific papers

14:30–16:00 Poster Session I: System papers for low resource & indic tracks

15:30–16:00 Coffee break

16:30–17:30 Panel discussion

17:30 End of day 1

DAY 2: August 16 2024

09:00–10:30 Oral Session C: Scientific papers

10:20–11:00 Coffee break

11:00–12:30 Poster Session II: Findings papers and system papers for speech-to-speech, simultaneous, subtitling, offline & dubbing tracks

12:30–14:00 Lunch break

14:00–14:15 Oral Session D: Findings papers

14:15–15:30 Planning Session for 2025

15:30–16:00 Coffee break

16:00-16:15 Closing remarks

16:15 End of conference

Important Notes

Poster sessions: System papers will be presented in two poster sessions arranged by shared tasks. Papers covering multiple tasks can be presented as distinct posters. Poster format is A0. Printing service is available on site. Authors with a virtual registration who are unable to present their poster in person can provide a link to a video of max 15min with their presentation via this google doc. The page will be editable until August 10 and videos will be linked on the IWSLT program through the end of the IWSLT conference.

Oral sessions: Scientific papers, test suited and highlight will be presented in threee oral sessions. Each paper is allotted a slot of 15 minutes, including 2-3 minutes for questions. Speakers attending virtually will be able to present through the Underline platform.

Oral session A:

  • [1] FBK@IWSLT Test Suites Task: Gender Bias evaluation with MuST-SHE
    • Authors: Beatrice Savoldi, Marco Gaido, Matteo Negri and Luisa Bentivogli
  • [2] Charles Locock, Lowcock or Lockhart? Offline Speech Translation: Test Suite for Named Entities
    • Authors: Maximilian Awiszus, Jan Niehues, Marco Turchi, Sebastian Stüker and Alex Waibel

Oral session B:

  • [1] Recent Highlights in Multilingual and Multimodal Speech Translation
    • Authors: Danni Liu and Jan Niehues
  • [2] Enhancing Translation Accuracy of Large Language Models through Continual Pre-Training on Parallel Data
    • Authors: Minato Kondo, Takehito Utsuro and Masaaki Nagata

Oral session C:

  • [1] Transforming LLMs into Cross-modal and Cross-lingual Retrieval Systems
    • Authors: Frank Palma Gomez, Ramon Sanabria, Yun-hsuan Sung, Daniel Cer, Siddharth Dalmia and Gustavo Hernandez Abrego
  • [2] Conditioning LLMs with Emotion in Neural Machine Translation
    • Authors: Charles Brazier and Jean-Luc Rouas
  • [3] Compact Speech Translation Models via Discrete Speech Units Pretraining
    • Authors: Tsz Kin Lam, Alexandra Birch and Barry Haddow
  • [4] Speech Data from Radio Broadcasts for Low Resource Languages
    • Authors: Bismarck Bamfo Odoom, Leibny Paola Garcia Perera, Prangthip Hansanti, Loic Barrault, Christophe Ropers, Matthew Wiesner, Kenton Murray, Alexandre Mourachko and Philipp Koehn
  • [5] Word Order in English-Japanese Simultaneous Interpretation: Analyses and Evaluation using Chunk-wise Monotonic Translation
    • Authors: Kosuke Doi, Yuka Ko, Mana Makinae, Katsuhito Sudoh and Satoshi Nakamura
  • [6] Fixed and Adaptive Simultaneous Machine Translation Strategies Using Adapters
    • Authors: Abderrahmane Issam, Yusuf Can Semerci, Jan Scholtes and Gerasimos Spanakis

ACL Findings papers presented at IWSLT:

System papers presented in Poster Sessions I and II

Papers covering multiple shared tasks can be presented with multiple posters

  • [1] Pause-Aware Automatic Dubbing using LLM and Voice Cloning
    • Authors: Yuang Li, Jiaxin Guo, Min Zhang, Ma Miaomiao, Zhiqiang Rao, Weidong Zhang, Xianghui He, Daimeng Wei, Hao Yang
  • [2] NICT’s Cascaded and End-To-End Speech Translation Systems using Whisper and IndicTrans2 for the Indic Task
    • Authors: Raj Dabre, Haiyue Song
  • [3] The NYA’s Offline Speech Translation System for IWSLT 2024
    • Authors: Yingxin Zhang, Guodong Ma, Binbin Du
  • [4] Improving the Quality of IWLST 2024 Cascade Offline Speech Translation and Speech-to-Speech Translation via Translation Hypothesis Ensembling with NMT models and Large Language Models
    • Authors: Zhanglin Wu, Jiaxin Guo, Daimeng Wei, Zhiqiang Rao, Zongyao Li, Hengchao Shang, Yuanchang Luo, Shaojun Li, Hao Yang
  • [5] HW-TSC’s Speech to Text Translation System for IWSLT 2024 in Indic track
    • Authors: Bin Wei, Zongyao Li, Jiaxin Guo, Daimeng Wei, Zhanglin Wu, Xiaoyu Chen, Zhiqiang Rao, Shaojun Li, Yuanchang Luo, Hengchao Shang, Hao Yang, Yanfei Jiang
  • [6] Multi-Model System for Effective Subtitling Compression
    • Authors: Carol-Luca Gasan, Vasile Păiș
  • [7] SimulSeamless: FBK at IWSLT 2024 Simultaneous Speech Translation
    • Authors: Sara Papi, Marco Gaido, Matteo Negri, Luisa Bentivogli
  • [8] The SETU-DCU Submissions to IWSLT 2024 Low-Resource Speech-to-Text Translation Tasks
    • Authors: Maria Zafar, Antonio Castaldo, Prashanth Nayak, Rejwanul Haque, Neha Gajakos, Andy Way
  • [9] Automatic Subtitling and Subtitle Compression: FBK at the IWSLT 2024 Subtitling track
    • Authors: Marco Gaido, Sara Papi, Mauro Cettolo, Roldano Cattoni, Andrea Piergentili, Matteo Negri, Luisa Bentivogli
  • [10] UM IWSLT 2024 Low-Resource Speech Translation: Combining Maltese and North Levantine Arabic
    • Authors: Sara Nabhani, Aiden Williams, Miftahul Jannat, Kate Rebecca Belcher, Melanie Galea, Anna Taylor, Kurt Micallef, Claudia Borg
  • [11] UOM-Constrained IWSLT 2024 Shared Task Submission - Maltese Speech Translation
    • Authors: Kurt Abela, Md Abdur Razzaq Riyadh, Melanie Galea, Alana Busuttil, Roman Kovalev, Aiden Williams, Claudia Borg
  • [12] QUESPA Submission for the IWSLT 2024 Dialectal and Low-resource Speech Translation Task
    • Authors: John E. Ortega, Rodolfo Joel Zevallos, Ibrahim Said Ahmad, William Chen
  • [13] JHU IWSLT 2024 Dialectal and Low-resource System Description
    • Authors: Nathaniel Romney Robinson, Kaiser Sun, Cihan Xiao, Niyati Bafna, Weiting Tan, Haoran Xu, Henry Li Xinyuan, Ankur Kejriwal, Sanjeev Khudanpur, Kenton Murray, Paul McNamee
  • [14] CMU’s IWSLT 2024 Simultaneous Speech Translation System
    • Authors: Xi Xu, Siqi Ouyang, Lei Li
  • [15] HW-TSC’s Submissions To the IWSLT2024 Low-resource Speech Translation Tasks
    • Authors: Zheng Jiawei, Hengchao Shang, Zongyao Li, Zhanglin Wu, Daimeng Wei, Zhiqiang Rao, Shaojun Li, Jiaxin Guo, Bin Wei, Yuanchang Luo, Hao Yang
  • [16] CMU’s IWSLT 2024 Offline Speech Translation System: A Cascaded Approach For Long-Form Robustness
    • Authors: Brian Yan, Patrick Fernandes, Jinchuan Tian, Siqi Ouyang, William Chen, Karen Livescu, Lei Li, Graham Neubig, Shinji Watanabe
  • [17] NAIST Simultaneous Speech Translation System for IWSLT 2024
    • Authors: Yuka Ko, Ryo Fukuda, Yuta Nishikawa, Yasumasa Kano, Tomoya Yanagita, Kosuke Doi, Mana Makinae, Haotian Tan, Makoto Sakai, Sakriani Sakti, Katsuhito Sudoh, Satoshi Nakamura
  • [18] Blending LLMs into Cascaded Speech Translation: KIT’s Offline Speech Translation System for IWSLT 2024
    • Authors: Sai Koneru, Thai Binh Nguyen, Ngoc-Quan Pham, Danni Liu, Zhaolin Li, Alexander Waibel, Jan Niehues
  • [19] ALADAN at IWSLT24 Low-resource Arabic Dialectal Speech Translation Task
    • Authors: Waad Ben Kheder, Josef Jon, André Beyer, Abdel Messaoudi, Rabea Affan, Claude Barras, Maxim Tychonov, Jean-Luc Gauvain
  • [20] The KIT Speech Translation Systems for IWSLT 2024 Dialectal and Low-resource Track
    • Authors: Zhaolin Li, Enes Yavuz Ugan, Danni Liu, Carlos Mullov, Tu Anh Dinh, Sai Koneru, Alexander Waibel, Jan Niehues
  • [21] Empowering Low-Resource Language Translation: Methodologies for Bhojpuri-Hindi and Marathi-Hindi ASR and MT
    • Authors: Harpreet Singh Anand, Amulya Ratna Dash, Yashvardhan Sharma
  • [22] Leveraging Synthetic Audio Data for End-to-End Low-Resource Speech Translation
    • Authors: Yasmin Moslem
  • [23] HW-TSC’s Simultaneous Speech Translation System for IWSLT 2024
    • Authors: Shaojun Li, Zhiqiang Rao, Bin Wei, Yuanchang Luo, Zhanglin Wu, Zongyao Li, Hengchao Shang, Jiaxin Guo, Daimeng Wei, Hao Yang
  • [24] UoM-DFKI submission to the low resource shared task
    • Authors: Kumar Rishu, Aiden Williams, Claudia Borg, Simon Ostermann
  • [25] HW-TSC’s submission to the IWSLT 2024 Subtitling track
    • Authors: Yuhao Xie, Yuanchang Luo, Zongyao Li, Zhanglin Wu, Xiaoyu Chen, Zhiqiang Rao, Shaojun Li, Hengchao Shang, Jiaxin Guo, Daimeng Wei, Hao Yang
  • [26] IWSLT 2024 Indic Track system description paper: Speech-to-Text Translation from English to multiple Low-Resource Indian Languages
    • Authors: Deepanjali Singh, Ayush Anand, Abhyuday Chaturvedi, Niyati Baliyan