Silence in dialogue
Thesis title in Czech: | Ticho v dialogu |
---|---|
Thesis title in English: | Silence in dialogue |
Key words: | dialog|ticho|GPT-3|ladění|jazykové modely |
English key words: | dialogue|silence|GPT-3|fine-tuning|language models |
Academic year of topic announcement: | 2021/2022 |
Thesis type: | diploma thesis |
Thesis language: | angličtina |
Department: | Department of Logic (21-KLOG) |
Supervisor: | Raquel Fernandez Rovira, Ph.D. |
Author: | hidden - assigned and confirmed by the Study Dept. |
Date of registration: | 21.02.2022 |
Date of assignment: | 21.02.2022 |
Administrator's approval: | not processed yet |
Confirmed by Study dept. on: | 18.03.2022 |
Date and time of defence: | 16.06.2023 09:00 |
Date of electronic submission: | 11.05.2023 |
Date of proceeded defence: | 16.06.2023 |
Submitted/finalized: | committed by student and finalized |
Opponents: | Mgr. et Mgr. Ondřej Dušek, Ph.D. |
Guidelines |
Silence is an indispensable aspect of dialogue. This thesis examines silence in dialogue from a variety of perspectives. First, I provide a background on the historical development of theories of dialogue and the place of silence within them (1, 2). Second, I conduct a study of the capacity of one of the most prominent contemporary language models, called the GPT-3, to model silence in dialogue (3). I fine-tune the model on a dataset based on movie subtitle data. I evaluate its performance on its capacity to infer the length of silence between subtitle pairs. The experiment proposes a method of fine-tuning the language model via silence encoded as character strings. The results show that GPT-3 fine-tuning can indeed improve the model's performance by inferring silence gaps between subtitle turns. |
References |
(1) Clark, Herbert H. Using language. Cambridge university press, 1996. (2) McTear, Michael. "Conversational AI: dialogue systems, conversational agents, and chatbots." Synthesis Lectures on Human Language Technologies 13.3 (2020): 1-251. (3) Brown, Tom, et al. "Language models are few-shot learners." Advances in neural information processing systems 33 (2020): 1877-1901. |