OpenAI is reportedly developing an innovative generative music tool capable of creating music from both text and audio prompts, as revealed by a recent report from The Information. This upcoming tool is expected to enhance multimedia projects, allowing users to seamlessly incorporate soundtracks into videos or add musical accompaniment, such as guitar, to vocal performances.
While the launch timeline remains uncertain, it’s unclear whether this tool will be available as a distinct product or integrated into existing offerings like ChatGPT and the video application Sora.
Collaboration with students from the Juilliard School is underway to annotate musical scores, providing essential training data for the tool’s development. Although OpenAI has previously introduced generative music models prior to the advent of ChatGPT, their current focus has been on advancing audio technologies for text-to-speech and speech-to-text applications. Competing generative music models from companies like Google and Suno also illustrate the growing interest in this innovative field.
Key Takeaways:
- Project Overview: OpenAI working on a generative music tool that translates text and audio into music.
- Application: Designed for multimedia enhancement, potentially integrating with existing platforms.
- Collaboration: Partnering with Juilliard students for score annotation.
- Context: Previous models by OpenAI predate ChatGPT; now focusing on audio capabilities.
