Record a hum
Tap Record, make a short sound, then play it back. The digest preview is just a receipt for what the model would read; you do not need to use it.
Optional voice control: tap Voice start once, then say "start recording" or "stop recording."
# Your starter .lilt code will appear after recording.Music as access
Some people have songs inside but no easy way to get them out. Babbled Notes is for autistic users, non-speaking users, people with speech or motor differences, and anyone who needs a gentler path into composing.
Hum one note or a short phrase.
Tap notes with large buttons.
Build music from one intentional choice.
Share readable text for another person to edit.
Tap a melody
No voice required. Use touch, keyboard focus, or a switch control to place notes one at a time, then hear the phrase.
tempo 80
feel straight
key C major
mood gentle
voice voice:
rest 4
Try a demo
Make your music win
Write one tiny idea, choose a classical style, then let it replay while you change notes. The goal is to hear your idea become worth keeping.
Local AI voice render is available from the CLI for server-side use:
python -m lilt.cli voice examples\three_note_hum.json --style chopin
Why it is different
Babbled Notes is not a chatbot that talks about music. It turns a sound, a tap pattern, or a simple gesture into a small music program that can be edited, replayed, exported, and shared.
- .lilt keeps the idea readable as text.
- MIDI moves the idea into GarageBand, Ableton, Logic, or MuseScore.
- Tone.js lets the idea play in a browser.
- Digest JSON shows the timing and pitch facts the model used.
The goal is musical agency for people who may hum, tap, use a switch, use assisted speech, or communicate without speech at all. The first playback should feel like proof: your sound can become music.
Build a song
A full Babbled Notes build starts with one small musical thought, then grows through plain text. This is the submission workflow.
- Capture. Hum the hook, tap notes, or make a rhythm.
- Translate. Babbled Notes turns the gesture into readable code.
- Arrange. Pick instruments and add voices for melody, bass, or drums.
- Share. Send the `.lilt` text or MIDI to another musician.
# Brooke's first idea
tempo 86
feel straight
key C major
mood gentle, warm
voice melody:
C4 ! soft E4 ! mf G4 hold ! mf
voice pulse:
x . . . x . . .
voice bass:
C2 hold ! softWork with others
Babbled Notes is collaboration-friendly because the song is text. A partner can review the idea, change one line, and send it back without opening a DAW.
Brooke records or taps the hook.
Babbled Notes creates `.lilt` text and MIDI.
A collaborator changes the bass, drums, key, or instrument.
GitHub shows exactly what changed, line by line.
- voice bass:
- C2 hold ! soft
+ voice bass:
+ C2 ! soft G1 ! soft C2 hold ! mfSound alphabet
Babbled Notes treats small sounds and gestures as musical letters. Speech is not required; a hum, breath, tap, click, or switch press can be enough.
C4 ! mfG4 holdrest 1xoC4 ~ E4! loud/ staccatoAudio digest
This is the builder view: Babbled Notes turns a short WAV into timing and pitch facts, then Gemma uses those facts to write the music program.
python -m lilt.cli digest clip.wav
python -m lilt.cli audio clip.wav --digest clip.digest.json --backend geminiTell Brooke how it sounded
Optional. Pick one button and add one sentence if something felt odd. The technical preview is only there for transparency.
Technical preview of what gets shared
What is this?
Hum, beatbox, whistle, or play a phrase. Babbled Notes turns it into a short, human-readable program. Edit the program. Hear the result. Share the text.
Built for the Gemma 4 challenge by Brooke Chauntel. The model and the audio pipeline live offline; this page is the in-browser preview.