David Li created the Blob Opera, a beautiful creative experiment at the intersection of machine learning, music and digital art. From the project description at Google Arts & Culture, hosts of the project:
This experiment pays tribute to and explores the original musical instrument: the voice. We developed a machine learning model trained on the voices of four opera singers to create an engaging experiment for everyone regardless of musical ability. Tenor, Christian Joel, bass Frederick Tong, mezzo-soprano Joanna Gamble and soprano Olivia Doutney recorded vocals for many hours. In the experiment, you don’t hear their voices, but rather how the machine learning model understands what opera singing sounds like, based on what it learned from the opera singers.
With the resulting experiment you can play Blob Opera and change pitch and vowel sounds to create your own composition. The blobs respond and harmonize to your input in real time.