Assistant-composed music
Assistant-composed music is music an AI assistant writes by operating a music app: it chooses the instruments, writes the notes, arranges and mixes them, and the app plays and renders the result. It differs from AI-generated audio, where a model outputs a finished recording.
Updated 16 November 2026
How it differs from AI-generated audio
A music-generation model takes a description and returns a recording. The recording is finished audio: to change one bar, you ask again and get a different take.
In assistant-composed music the assistant works the way a person would in a music app. It picks the drum kit, writes the bass line, sets the tempo, arranges the sections and balances the mix, and the app's own instruments play it. The result is a project, not a recording:
- Every note and every track can be changed afterwards, by you or by the assistant.
- One part can be fixed without touching the rest, such as the drums in a single chorus.
- It exports the way any music project does: a mixed file, each track on its own, or the notes as MIDI.
How an assistant operates a music app
Through the Model Context Protocol (MCP), an open standard for connecting AI assistants to apps and tools. A music app that offers MCP gives an assistant such as Claude Code or Codex a set of actions it can take, like creating a track or exporting a song, and ways to check the result.
Why it suits music for video
Video needs music that fits its timing: a hit on a cut, a swell before a reveal. In a project, timing is exact. At 120 beats a minute, a bar of four beats lasts exactly 2 seconds, so a cut at 0:16 falls on the downbeat of bar 9. An assistant can place a sound effect or a change of section on that bar and keep it there through every revision.
When the instruments and drum kits are the app's own, there is no stock-music licence to buy for them. Samples you add yourself keep their own terms, and copying a known melody can still infringe. This is a description of how the music is made, not legal advice.
Where it's used
Instant DJ, our music app for the Mac, has a Studio from version 1.6 where your own AI assistant (Claude Code, Codex or any MCP client) can write whole songs, background music and sound effects while you listen and steer. The app has no AI of its own and sends nothing anywhere. More on it:
- AI background music and sound effects for videos, on a Mac
- Building an MCP server for an app AI can't hear
Instant DJ on the Mac App Store · macOS 14 or later, Apple silicon.