Introducing References: sound control for Music v2

Peter Bubenik ยท Elevenlabs Product ยท ยท Source
Introducing References: sound control for Music v2

Concept 1: What is "References"?

References is a feature that lets you upload an existing audio track to guide AI music generation.

Think of it like this:

๐ŸŽต Instead of describing the music you want, you show the AI an example of it.

Key idea: The AI listens to your uploaded track and generates new music that matches its:

  • Style
  • Instrumentation
  • Overall feel

Concept 2: How You Can Use It (Two Modes)

You have two ways to use References:

ModeHow it works
Reference aloneUpload a track โ†’ AI generates music guided purely by that sound
Reference + Text promptUpload a track AND write a description โ†’ combines a real sound with a specific direction

๐Ÿ’ก Example: Upload a lo-fi jazz clip AND type "make it feel melancholic and rainy" for more precise control.


Concept 3: Upload Requirements

Simple and flexible:

  • โฑ๏ธ Minimum: 10 seconds
  • โฑ๏ธ Maximum: 5 minutes

Concept 4: Copyright Protection

This is an important safeguard:

โš ๏ธ Every uploaded track is automatically checked for copyright matches before generation.

  • If your track matches someone else's copyrighted recording โ†’ โŒ it cannot be used
  • If your track is your own original music โ†’ โœ… it can be used

Bottom line: References is designed for music you created yourself, not other artists' work.


Concept 5: Where References is Available

References works across three platforms:

  1. ๐ŸŽต ElevenMusic โ€” for individual musicians and creators
  2. ๐ŸŽจ ElevenCreative โ€” for teams building creative workflows
  3. ๐Ÿ”ง ElevenAPI โ€” for developers integrating music generation into their own products

Concept 6: Who is This For?

Three main groups benefit from References:

UserUse Case
MusiciansYou hear a sound in your head but can't fully describe it in words
Brand/Marketing TeamsMatching a consistent sonic identity across ads and campaigns
DevelopersBuilding precise music tools that go beyond simple text prompts

Quick Summary

Upload your track (10sโ€“5min)
        โ†“
Copyright check runs automatically
        โ†“
AI analyzes style, feel, instrumentation
        โ†“
New original music is generated to match
        โ†“
Optionally combine with a text prompt for extra control

๐Ÿ”‘ Core idea: References bridges the gap between what you can describe and what you can actually hear in your mind.

More to study