Abstract
A significant challenge in Text-to-Speech (TtS) synthesis is the formulation of the prosodic structures (phrase breaks, pitch accents, phrase accents and boundary tones) of utterances. The prediction of these elements robustly relies on the accuracy and the quality of error-prone linguistic procedures, such as the identification of the part-of-speech and the syntactic tree. Additional linguistic factors, such as rhetorical relations, improve the naturalness of the prosody, but are hard to extract from plain texts. In this work, we are proposing a method to generate enhanced prosodic events for TtS by utilizing accurate, error-free and high-level linguistic information. We are also presenting an appropriate XML annotation scheme to encode syntax, grammar, new or given information, phrase subject/object information, as well as rhetorical elements. These linguistically enriched has have been utilized to build realistic machine learning models for the prediction of the prosodic structures in terms of segmental information and ToBI marks. The methodology has been applied by exploiting a Natural Language Generator (NLG) system. The trained models have been built using classification via regression trees and the results strongly indicate the realistic effect on the generated prosody. The evaluation of this approach has been made by comparing the models produced by the enriched documents to those produced by plain text of the same domain. The results show an improved accuracy of up to 23%.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
Similar content being viewed by others
References
Taylor, P., Black, A.W.: Assigning Phrase Breaks from Part-of-Speech Sequences. Computer Speech and Language 12(2), 99–117 (1998)
Petasis, G., Karkaletsis, V., Farmakiotou, D., Samaritakis, G., Androutsopoulos, I., Spyropoulos, C.: A Greek Morphological Lexicon and its Exploitation by a Greek Controlled Language Checker. In: Proceedings of the 8th Panhellenic Conference on Informatics, pp. 80–89 (2001)
Black, A., Taylor, P.: Assigning intonation elements and prosodic phrasing for English speech synthesis from high level linguistic input. In: ICSLP 1994, pp. 715–718 (1994)
Grosz, B., Hirschberg, J.: Some intonational characteristics of discourse structure. In: Proceedings of 2nd of International Conference on Spoken Language Processing, vol. 1, pp. 429–432 (1992)
Hirschberg, J.: Pitch accent in context: predicting intonational prominence from text. Artificial Intelligence 63, 305–340 (1993)
Prevost, S.: A semantics of contrast and information structure for specifying intonation in spoken language generation. Ph.D. Thesis, University of Pennsylvania (1995)
Theune, M., Klabbers, E., Odijk, J., De Pijper, J.R., Krahmer, E.: From Data to Speech: A General Approach. Natural Language Engineering 7(1), 47–86 (2001)
McKeown, K., Pan, S.: Prosody modelling in concept-to-speech generation: methodological issues. Philosophical Transactions of the Royal Society 358(1769), 1419–1431 (2000)
Reiter, E., Dale, R.: Building Applied Natural Generation Systems. Natural Language Engineering 3, 57–87 (1997)
Hitzeman, J., Black, A., Mellish, C., Oberlander, J., Poesio, M., Taylor, P.: An annotation scheme for Concept-to-Speech synthesis. In: Proceedings of the European Workshop on Natural Language Generation, Toulouse, France, pp. 59–66 (1999)
Breiman, L., Friedman, J.H., Olshen, R.A., Stone, C.J.: Classification and Regression Trees. Chapman & Hall, New York (1984)
Cruttenden, A.: Intonation. Cambridge University Press, Cambridge (1986)
Bolinger, D.: Intonation and its Uses: Melody in grammar and discourse. Edward Arnold, London (1989)
O’Donnel, M., Mellish, C., Oberlander, J., Knott, A.: ILEX: An architecture for a dynamic hypertext generation system. Natural Language Engineering 7(3), 225–250 (2001)
Xydas, G., Kouroupetroglou, G.: Augmented Auditory Representation of e-Texts for Text-to-Speech Systems. In: Matoušek, V., Mautner, P., Mouček, R., Tauser, K. (eds.) TSD 2001. LNCS (LNAI), vol. 2166, pp. 134–141. Springer, Heidelberg (2001)
Xydas, G., Kouroupetroglou, G.: The DEMOSTHeNES Speech Composer. In: Proceedings of the 4th ISCA Tutorial and Research Workshop on Speech Synthesis, pp. 167–172 (2001)
Taylor, P., Black, A., Caley, R.: Heterogeneous Relation Graphs as a Mechanism for Representing Linguistic Information. Speech Communications 33, 153–174 (2001)
Arvaniti, A., Baltazani, M.: Greek ToBI: A System For The Annotation Of Greek Speech Corpora. In: Proceedings of Second International Conference on Language Resources and Evaluation, vol. 2, pp. 555–562 (2000)
Taylor, P., Caley, R., Black, A.: The Edinburgh Speech Tools Library. The Centre for Speech Technology Research, University of Edinburgh, 1.0.1 edition (1998), http://www.cstr.ed.ac.uk/projects/speechtools.html
Androutsopoulos, I., Kokkinaki, V., Dimitromanolaki, A., Calder, J., Oberlander, J., Not, E.: Generating Multilingual Personalized Descriptions of Museum Exhibits – The M-PIRO Project. In: Proceedings of the 29th Conference on Computer Applications and Quantitative Methods in Archaeology (2001)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2004 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Xydas, G., Spiliotopoulos, D., Kouroupetroglou, G. (2004). Modeling Prosodic Structures in Linguistically Enriched Environments. In: Sojka, P., Kopeček, I., Pala, K. (eds) Text, Speech and Dialogue. TSD 2004. Lecture Notes in Computer Science(), vol 3206. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-30120-2_66
Download citation
DOI: https://doi.org/10.1007/978-3-540-30120-2_66
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-23049-6
Online ISBN: 978-3-540-30120-2
eBook Packages: Springer Book Archive