Thesis (Selection of subject)Thesis (Selection of subject)(version: 381)
Thesis details
   Login via CAS
Presentation of simultaneous speech translation
Thesis title in Czech: Prezentování výstupu simultánního strojového překladu mluvené řeči
Thesis title in English: Presentation of simultaneous speech translation
Key words: simultánní překlad mluvené řeči|automatické titulkování|uživatelské vyhodnocování
English key words: simultaneous speech translation|automatic subtitling|user evaluation
Academic year of topic announcement: 2021/2022
Thesis type: diploma thesis
Thesis language: angličtina
Department: Institute of Formal and Applied Linguistics (32-UFAL)
Supervisor: doc. RNDr. Ondřej Bojar, Ph.D.
Author: hidden - assigned and confirmed by the Study Dept.
Date of registration: 26.05.2021
Date of assignment: 03.06.2021
Confirmed by Study dept. on: 22.06.2021
Date and time of defence: 08.09.2021 09:00
Date of electronic submission:22.07.2021
Date of submission of printed version:22.07.2021
Date of proceeded defence: 08.09.2021
Opponents: doc. Ing. Zdeněk Žabokrtský, Ph.D.
 
 
 
Guidelines
The goal of the thesis is to examine methods for presenting the outputs of simultaneous speech translation systems to users.

Different from movie subtitles which are manually edited and heavily influenced by limitations of reading speed and space constraints, current speech recognition systems and speech translation systems at their best produce verbatim transcription and translation of what has been said. They lack the capabilities of reasonably simplifying and compressing the text to meet any presentation constraints.

The thesis will work with the current speech translation system and examine methods of presenting their output to the user in real time, even if the systems cannot compress the content. A user interface will be proposed and tested in realistic conditions with a small group of subjects watching videos in a language they do not speak, relying on the provided automatic speech recognition, translation and presentation. The goal is to come up with an evaluation methodology and then to find the best layout from a number of presentation options.

The thesis should rely on existing speech recognition and translation components, focusing purely on the presentation. Time permitting, a nice extension of the thesis would be to train machine translation systems so that they would be also compressing the text. Such a shortening system should be again empirically evaluated, including the presentation interface.
References
Dominik Macháček, Ondřej Bojar (2020): Presenting Simultaneous Translation in Limited Space. In: Proceedings of the 20th Conference Information Technologies - Applications and Theory (ITAT 2020), pp. 32-37, Tomáš Horváth, Košice, Slovakia.

Alina Karakanta, Matteo Negri, and Marco Turchi. Is 42 the answer to everything in subtitling-oriented speech translation? 2020.

Eunah Cho, C. Fugen, T. Hermann, K. Kilgour, Mohammed Mediani, C. Mohr, J. Niehues, Kay Rottmann, C. Saam, Sebastian Sẗuker, and A. Waibel. 2013. A real-world system for simultaneous translation of german lectures. pages 3473–3477.

Ashish Vaswani, Noam Shazeer, Niki Parmar, Jakob Uszkoreit, Llion Jones, Aidan N Gomez, Łukasz Kaiser, and Illia Polosukhin. 2017. Attention is all you need. In I. Guyon, U. V. Luxburg, S. Bengio, H. Wallach, R. Fergus, S. Vishwanathan, and R. Garnett, editors, Advances in Neural Information Processing Systems 30, pages 6000–6010. Curran Associates, Inc.
 
Charles University | Information system of Charles University | http://www.cuni.cz/UKEN-329.html