Google has developed an Artificial Intelligence (AI) system known as ‘MusicLM’ that can generate music by following a text description.
In an academic paper published on January 26, Google researchers described MusicLM as “a model generating high-fidelity music from text descriptions such as ‘a calming violin melody backed by a distorted guitar riff’,” according to a report by Neowin.
“We demonstrate that MusicLM can be conditioned on both text and a melody in that it can transform whistled and hummed melodies according to the style described in a text caption,” the paper reads.
According to the research paper, MusicLM can take cues from user-generated descriptions like “enchanting jazz song with a memorable saxophone solo and a solo singer” or “Berlin 90s techno with a low bass and strong kick,” and receive corresponding results.
Google’s development of MusicLM comes after the rapid rise of OpenAI’s ChatGPT, a natural language processing tool powered by AI.
ChatGPT was so popular that Google’s management reportedly declared a “code red,” according to a report by The New York Times.
As a result, the company is purportedly set to introduce over 20 AI-related projects this year, including an AI-powered version of Google Search.
MusicLM isn’t the first AI music generator. As TechCrunch points out, Riffusion, Dance Diffusion, Google’s own AudioLM, and OpenAI’s Jukebox have experimented on the subject.
MusicLM may not be available to the public in the near future, however, according to Google’s researchers, there are concerns about programming biases that may result in technological glitches, lack of representation, and the “potential misappropriation of creative content.”
In fact, during an experiment, Google’s researchers found that about 1% of the music that MusicLM generated was directly copied from the songs it was trained on.