AI Completed Beethoven’s Unfinished Tenth Symphony

Artificial Intelligence
BeauHD
30 September 2021
0

AI Completed Beethoven’s Unfinished Tenth Symphony (thenextweb.com)

Posted
by

on Wednesday September 29, 2021 @09:25PM

from the mark-your-calendar dept.

Ahmed Elgammal, Professor and Director of the Art & AI Lab at Rutgers University, writes via The Conversation: When Ludwig von Beethoven died in 1827, he was three years removed from the completion of his Ninth Symphony, a work heralded by many as his magnum opus. He had started work on his Tenth Symphony but, due to deteriorating health, wasn’t able to make much headway: All he left behind were some musical sketches. Ever since then, Beethoven fans and musicologists have puzzled and lamented over what could have been. His notes teased at some magnificent reward, albeit one that seemed forever out of reach. Now, thanks to the work of a team of music historians, musicologists, composers and computer scientists, Beethoven’s vision will come to life. I presided over the artificial intelligence side of the project, leading a group of scientists at the creative AI startup Playform AI that taught a machine both Beethoven’s entire body of work and his creative process. A full recording of Beethoven’s 10th Symphony is set to be released on Oct. 9, 2021, the same day as the world premiere performance scheduled to take place in Bonn, Germany — the culmination of a two-year-plus effort.

[…]

The AI side of the project — my side — found itself grappling with a range of challenging tasks. First, and most fundamentally, we needed to figure out how to take a short phrase, or even just a motif, and use it to develop a longer, more complicated musical structure, just as Beethoven would have done. For example, the machine had to learn how Beethoven constructed the Fifth Symphony out of a basic four-note motif. Four notes famously serve as the basis for Beethoven’s Fifth Symphony. Next, because the continuation of a phrase also needs to follow a certain musical form, whether it’s a scherzo, trio or fugue, the AI needed to learn Beethoven’s process for developing these forms. The to-do list grew: We had to teach the AI how to take a melodic line and harmonize it. The AI needed to learn how to bridge two sections of music together. And we realized the AI had to be able to compose a coda, which is a segment that brings a section of a piece of music to its conclusion. Finally, once we had a full composition, the AI was going to have to figure out how to orchestrate it, which involves assigning different instruments for different parts. And it had to pull off these tasks in the way Beethoven might do so.

In November 2019, the team met in person again — this time, in Bonn, at the Beethoven House Museum, where the composer was born and raised. This meeting was the litmus test for determining whether AI could complete this project. We printed musical scores that had been developed by AI and built off the sketches from Beethoven’s 10th. A pianist performed in a small concert hall in the museum before a group of journalists, music scholars and Beethoven experts. We challenged the audience to determine where Beethoven’s phrases ended and where the AI extrapolation began. They couldn’t. The success of these tests told us we were on the right track. But these were just a couple of minutes of music. There was still much more work to do. At every point, Beethoven’s genius loomed, challenging us to do better. As the project evolved, the AI did as well. Over the ensuing 18 months, we constructed and orchestrated two entire movements of more than 20 minutes apiece.