Comparative Prosody Modelling across Languages
- Project Scheme:
- General Research Fund
- Project Year:
- Project Leader:
- Dr LEE, Kwing Lok Albert
- (Department of Linguistics and Modern Language Studies)
Two problems have remained unresolved in speech prosody research. The first one is that there are numerous rival theories that have coexisted for decades -- supporters for one do not necessarily understand the others well.
The second one is that in the absence of a universally accepted framework, field linguists working with a new language could propose prosodic analyses not otherwise satisfactory to fellow researchers, in part also due to field-related practical challenges compared with lab settings. Computational modelling can be a useful tool for addressing these problems.
This project seeks to promote computational modeling of fundamental frequency as a tool for (i) theory comparison and (ii) hypothesis testing and analysis *for field linguists*. Here we specifically target linguists without background in computer science or statistics.
In the first part of this project, we will compare two currently prevailing rival theories of speech prosody, namely the Autosegmental-Metrical Theory and the Parallel Encoding and Target Approximation Model, in terms of their respective synthesis accuracy. The two theories will be implemented using the PRAAT-based synthesisers AMtrainer, qTAtrainer and PENTAtrainer, and compared through identical sets of speech data of varying lengths, communicative functions (sentence types and focus), and languages (Cantonese and Fijian). Their relative performance in these conditions will illuminate the differences in theoretical assumptions and workings between the two models. The resultant synthetic stimuli will be verified by native listeners in perception experiments. The findings will lead to a better understanding of both AM and PENTA, enabling less experienced researchers to choose their preferred model based on their needs. As the first systematic study of Fijian prosody, this project will also provide precious first-hand data of this lesser-studied language.
The second part involves refining PENTAtrainer for enhanced synthesis accuracy. Although it has already achieved excellent accuracy (Pearson’s r > .9) in numerous previous studies, several known sources of remaining errors (i.e. pre-low raising and time-delay) await to be addressed. By incorporating these factors into PENTAtrainer, we can take its accuracy to an even higher level, opening up new research and practical possibilities.
The final part is a knowledge transfer project in which we seek to promote the use of PENTAtrainer among field linguists. We will create training materials (tutorial manual, website, and videos) targeting linguists in the field using materials yielded from the above. We hope this will pave the way for analysis-by-synthesis to become the next standard tool in language documentation.
More Major Research Projects
Preparation for Post Pandemic Society: Providing Technology-Supported Adaptive Scaffoldings for Students with Mathematics Learning Difficulties in Hong Kong Primary Schools
Department of Mathematics and Information Technology
Diagnostic Assessment of Academic Writing from Sources in English: Investigating the Mediation Effects of Self-regulatory Control Strategy and Discourse Synthesis via Structural Equation Modeling
Department of Linguistics and Modern Language Studies
Evaluating the Panentheistic Properties of Our Natural World
Department of Science and Environmental Studies
Self-dehumanization and Other-dehumanization toward Students with Special Educational Needs: Examining their Prevalence, Consequences and Identifying Solutions
Department of Special Education and Counselling