ElevenLabs New Model: AI Lyrics Creation Draws Attention

2024-05-10

AI startup ElevenLabs has launched a new model that can transform prompts into lyrics, aiming to open up new possibilities in music creation. To increase its visibility, ElevenLabs has followed the approach of OpenAI when launching the video-generating AI Sora, by collecting various ideas through social media and transforming them into unique lyrics.

Founded by former Google and Palantir employees, ElevenLabs focuses on using machine learning (ML) technology for multilingual voice cloning and synthesis. They offer a variety of tools, including one that can dub an entire film. Now, the company has set its sights on the music industry, attempting to bring new possibilities to music creation through AI technology.


Imagine the surprises this model can bring: creating a heartwarming lullaby for a child, composing a captivating melody for a marketing campaign, or crafting an energetic opening music for your podcast. So, can anyone utilize ElevenLabs' AI technology to create the next hit song? In fact, with the advancement of technology, several AI music startups have already emerged, such as Harmonai, Lyrical Labs, Suno AI, and Loudly.

In January of this year, ElevenLabs also launched a marketplace where users can sell these AI-generated songs. Additionally, their voice library allows users to earn money by selling their own AI-cloned voices while maintaining control and autonomy over their usage and compensation.


However, not everyone welcomes AI music generation. Like all generative AI applications, the source of ElevenLabs' model training and whether it involves copyrighted materials have become points of concern. If these materials contain copyrighted content, has ElevenLabs obtained permission from the copyright holders? Or do they believe that this unauthorized training falls under fair use principles? Some worry that this technology may lead to unemployment among artists, as AI can easily replicate the style of specific artists and replace them in music creation. Furthermore, this technology could also be used for creating deepfakes, which is equally concerning.