Summary
OpenAI is reportedly developing an exciting new tool that can generate music from text and audio prompts. This innovation could transform how creators add music to videos or enhance vocal tracks with instrumental accompaniment. While details about its release are still under wraps, the project highlights OpenAI’s ongoing exploration into generative audio technologies.
What Is OpenAI Working On?
According to a report from The Information, OpenAI is building a generative music tool that can create music based on both text and audio inputs. This means users might be able to describe the kind of music they want or provide an audio snippet, and the tool would generate fitting musical accompaniment.
Potential Uses of the Tool
Sources suggest that this tool could be used to add music to existing videos or to provide guitar accompaniment for vocal tracks. This could be a game-changer for content creators, musicians, and video editors looking for quick and customizable music solutions.
Collaboration with Juilliard Students
Interestingly, OpenAI is reportedly collaborating with students from the Juilliard School to annotate musical scores. This collaboration aims to create high-quality training data that will help the AI understand and generate music more effectively.
OpenAI’s History with Generative Music
OpenAI has experimented with generative music models before, but those efforts predate the launch of ChatGPT. More recently, the company has focused on audio models related to text-to-speech and speech-to-text technologies.
Other Players in Generative Music
OpenAI is not alone in this space. Other companies, including Google and Suno, are also developing generative music models, indicating a growing interest in AI-driven music creation.
Looking Ahead
It’s still unclear when OpenAI plans to launch this new music tool or whether it will be available as a standalone product or integrated into existing platforms like ChatGPT or the video app Sora. TechCrunch has reached out to OpenAI for comment and will provide updates as more information becomes available.