SPEECH SYNTHESIS-BASED RHYTHM ANALYSIS & SYNONYM/HYPERNYM RESTRUCTURING
A spoken text (i.e. words/phrases/sentences/paragraphs) is transcribed using a natural language processing API
Using the Wordnik API
on each word from the acquired text groups
of synonyms/hypernyms are found to replace their originals.
The resulting text & found word groups are synthesized word by word using text-to-speech (TTS).
The sonics of all
words are analyzed using the Echo Nest API
Variations of the synthesized text w/ inserted word substitutions are analyzed based on various properties (rhythm, pitch etc).
The resulting data is used to create a text w/ the same syntax as the initial input but with words substituted by synonyms/hypernyms based on desired rhythm, sound (harsh, mellow, screechy etc.), length, complexity (choice of words, amount of syllables etc.) or else.
The goal is to create a real time application that learns (collects metadata) while being used & can be applied in an installation environment to emphasize on rhythmical speech & miscommunication in language & technology.
Google Speech API
Chrome TTS API
Echo Nest API
Contact Dennis at firstname.lastname@example.org for more information