A comparative acoustic analysis of non-verbal vocalisations in film dubbing

Artur  Gudmanian; Iryna Struk; Halyna Yencheva; Alla Sitko

doi:10.29038/gud

Authors

Artur Gudmanian State University of Information and Communication Technologies, Ukraine https://orcid.org/0000-0002-4196-2279
Iryna Struk * State University of Information and Communication Technologies, Ukraine https://orcid.org/0000-0002-8128-0205
Halyna Yencheva State University of Information and Communication Technologies, Ukraine https://orcid.org/0000-0003-2002-6761
Alla Sitko State University “Kyiv Aviation Institute”, Ukraine https://orcid.org/0000-0003-0071-038X

DOI:

https://doi.org/10.29038/gud

Keywords:

acoustic phonetic, voice acting, vegetative sounds, aural sounds, Praat software

Abstract

This study explores the translation of non-verbal vocalisations in dubbing and examines their role in maintaining the authenticity and emotional depth of audiovisual performance. It addresses a notable gap in translation and psycholinguistic research by focusing on vocal behaviours such as swallowing, sneezing, stuttering, wheezing, laboured breathing, and groaning, which have often been neglected within studies of paralanguage and kinesics. The corpus was compiled from four seasons of Friends (1994–2004) and their Ukrainian-dubbed versions, obtained from the Kyivstar TV platform. It included 1,050 instances of non-verbal vocalisations along with their corresponding dubbing solutions. A mixed-methods approach was adopted. Qualitative analysis focused on contextual use and acoustic characteristics, while quantitative analysis employed a corpus-based design. Acoustic parameters, including pitch, duration, stress, and amplitude, were measured using Praat, and Audacity was used to isolate background audio from dubbed tracks. The analysis also drew on sound analysis, functional equivalence, error analysis, and contrastive analysis frameworks. The findings demonstrate that vegetative vocalisations, such as coughing, sneezing, and swallowing, were frequently modified or omitted in the Ukrainian dub, resulting in the loss of emotional and comedic nuance. Aural vocalisations, including wheezing and laboured breathing, were similarly underrepresented, reducing synchronisation with visual cues and weakening emotional resonance. The study concludes that preserving the acoustic and emotional integrity of non-verbal vocalisations is essential for achieving greater authenticity and expressiveness in audiovisual translation.

Acknowledgements

The study is carried out within the framework of the project "Methods and Tools for Optimising the Parameters and Resources of Electronic Communication Networks and Information and Communication Systems Using Artificial Intelligence (AI)" at the Educational and Scientific Institute of Information Technologies, State University of Information and Communication Technologies, Ukraine.

Disclosure Statement

The authors reported no potential conflicts of interest.

Downloads

Download data is not yet available.

Author Biography

Iryna Struk *, State University of Information and Communication Technologies, Ukraine

Corresponding author. Email: [email protected]

References

Alós, J. (2023). Paralanguage in the translation of children’s graphic novels into Arabic: Jeff Kinney’s Diary of a wimpy kid. Children’s Literature in Education, 56(2), 256–272. https://doi.org/10.1007/s10583-023-09558-4

Bellini, C., Del Maschio, N., Gentile, M., Del Mauro, G., Franceschini, R. & Abutalebi, J. (2024). Original language versus dubbed movies: Effects on our brain and emotions. Brain and Language, 253, 105-424. https://doi.org/10.1016/j.bandl.2024.105424

Brannon, W., Virkar, Y., & Thompson, B. (2023). Dubbing in practice: A large scale study of human localization with insights for automatic dubbing. Transactions of the Association for Computational Linguistics, 11, 419–435. https://doi.org/10.1162/ tacl_a_00551

Chaume, F. (1997). Translating non-verbal information in dubbing. Benjamins Translation Library, 315–326. https://doi.org/10.1075/btl.17.25cha

Chaume, F. (2020). The language of dubbing: A matter of compromise. Audiovisual Translation: Dubbing, 81–99. https://doi.org/10.4324/9781003161660-5

Consonants and vowel sounds. (n.d.). Scribd. Retrieved December 5, 2025, from https://www.scribd.com/document/646908639/Consonants-and-Vowel-Sounds

Costabile, L. (2024). English-language cyberdubbing in the age of artificial intelligence [Unpublished master’s thesis]. Università degli Studi di Pavia. https://unitesi.unipv.it/ retrieve/2e56bf1d-b07c-4307-b664-e6ec45e49dd5/tesi%20definitiva%20formato%20pdfA.pdf

Đurić, D. M. (2020). Free software tools for computational linguistics: An overview. Zenodo. https://doi.org/10.5281/zenodo.4073971

Fresco, P. R. (2009). Naturalness in the Spanish dubbing language: A case of not-so-close Friends. Meta, 54(1), 49–72. https://doi.org/10.7202/029793ar

Gudmanian, A., Struk, I., & Myshko, A. (2023). Lip-synch-translation of onomatopoeic words in the American sitcom “F.R.I.E.N.D.S.” In K. Lisetskyi (Ed.), Third International Online Conference “Corpora and Discourse.” National Technical University of Ukraine “Igor Sikorsky Kyiv Polytechnic Institute.” https://corpora.kamts1.kpi.ua/cad-2023/paper/view/29305/17153

Hassan, A. Y., Abdullah, S. S., Al-Rawe, M. F. A., & Hasan, M. A. (2024). The use of relevance and euphemisms in translating taboo expressions in the subtitles of the TV show “Friends.” Kurdish Studies, 12(2), 337–345. https://doi.org/10.58262/ks.v12i2.028

Matamala, A. (2011). Dealing with Paratextual Elements in Dubbing: A Pioneering Perspective from Catalonia. Meta,56(4), 915-927. https://doi.org/10.7202/1011260ar

Miggiani, G. S. (2019). Dialogue writing for dubbing: An insider’s perspective. Palgrave Macmillan.

Miggiani, G. S. (2021). English-language dubbing: Challenges and quality standards of an emerging localisation trend. Journal of Specialised Translation, 36, 2–25. https://doi.org/10.26034/cm.jostrans.2021.054

Öktem, A., Farrús, M., & Wanner, L. (2017). Automatic extraction of parallel speech corpora from dubbed movies. In S. Sharoff (Ed.), Tenth Workshop on Building and Using Comparable Corpora (pp. 31–35). Association for Computational Linguistics. https://doi.org/10.18653/v1/w17-2506

Orozco-Jutoran, M. (2001). Translation and dubbing: Words, voices and images. Studies in Translatology, 9(1), 45–46.

Padilla Cruz, M. (2022). Paralanguage and ad hoc concepts. Pragmatics: Quarterly Publication of the International Pragmatics Association, 33(3), 343–367. https://doi.org/10.1075/prag.21059.pad

Poliakova, O. V., & Struk, I. V. (2017). Rozmovna pryroda animatsiinykh filmiv [The spoken nature of animated films]. In A. Malek (Ed.), International Research and Practical Conference Modern Philology: Relevant Issues and Prospects of Research. Maria Curie-Skłodowska University. https://er.nau.edu.ua/items/b2403c5d-d843-42af-a8c3-a67ffd480265

Sánchez-Mompeán, S. (2020). The Prosody of Dubbed Speech. Beyond the Character’s Words. Palgrave Macmillan.

Sisto, A. (2014). Film Sound in Italy: Listening to the Screen. Palgrave Macmillan.

Supardi, M., Putri, D. A. (2018). Audio-Visual Translation Techniques: Subtitling and Dubbing of Movie Soundtrack in Frozen: Let it Go. Buletin Al-Turas, 24(2), 399–414. https://doi.org/10.15408/bat.v24i2.8621

Trouvain, J., & Truong, K. P. (2012). Comparing non-verbal vocalisations in conversational speech corpora. In L. Devillers, B. Schuller, A. Batliner, P. Rosso, E. Douglas-Cowie, R. Cowie, & C. Pelachaud (Eds.), Fourth International Workshop on Corpora for Research on Emotion Sentiment and Social Signals (ES3 2012) (pp. 36–39). European Language Resources Association. http://www.lrec-conf.org/proceedings/lrec2012/ workshops/18.Proceedings%20ES3%202012.pdf

Zabalbeascoa, P. (1997). Dubbing and the nonverbal dimension of translation. In F. Poyatos (Ed.), Nonverbal communication and translation (pp. 327–342). John Benjamins Publishing Company. https://doi.org/10.1075/btl.17.26zab

Zárate, S. (2021). Captioning and subtitling for d/Deaf and hard of hearing audiences. UCL Press. https://doi.org/10.14324/111.9781787357105

Sources

Audacity Team. (n.d.). Audacity [Computer software]. Retrieved December 5, 2025, from https://www.audacityteam.org/

Corbari, E. (n.d.). Friends’ scripts. Retrieved December 5, 2025, from https://ederson-corbari.github.io/friends/

Friends [Television series]. (n.d.). Kyivstar TV. Retrieved December 5, 2025, from https://tv.kyivstar.ua/ua

Transkriptor. (n.d.). Video to text converter. Retrieved December 5, 2025, from https://transkriptor.com/video-to-text/

Watson, S. (2018, September 18). What it means to have a nasally voice. Healthline. https://www.healthline.com/health/nasal-voice