Taking a step into the world of AI, Meta recently launched an AI engine called AudioCraft, which generates music and sounds based on written prompts.
Meta status: “Imagine a professional musician being able to discover new compositions without having to play a single note on the instrument. Or a small business owner who easily adds background music to their latest video ad on Instagram.”
“That’s the promise of AudioCraft — our latest AI engine that creates high-quality, realistic sounds and music from text,” the company added.
The social media giant believes that creative AI has made significant progress on images, text, and video, but falls short on audio. That’s why Meta takes this new step with a vision to bridge this gap and provide a user-friendly platform that makes creating sounds easy.
This is what Meta mentioned in his blog: “However, while we see a lot of excitement around creating AI for images, videos and text, audio always seems to lag behind a bit. There’s some work there but it’s very complex and not open so people can’t easily get used to it.”
This new AI platform carries three AI models, AudioGen, MusicGen and EnCodec. All three models serve different purposes.
AudioGen is trained in public sound effects that can generate sounds from text-based inputs such as whistles, barking dogs, and footsteps.
MusicGen is trained in specifically licensed and owned Meta-owned music, and it can create music from written prompts.
Source: Meta
EnCodec allows to create higher quality music with less errors.
Source: Meta
The company is making these models open source so that everyone from music enthusiasts to developers can test the platform and train their own models using our dataset. their own.
Meta mentions: “We are making these models open source, giving researchers and practitioners access so they can train their own models with their own datasets for the first time, and help advance AI-generated music and sound.”
The company has made some additional audio samples available on its website so people can test the new AI’s capabilities.
In short, AudioCraft can be a powerful tool for the music industry. The ability to use written prompts can help users create music tailored to their specific needs. However, this tool can also detract from the originality of the music. Therefore, it is important to use AudioCraft carefully.
Categories: Optical Illusion
Source: pagasa.edu.vn