Neural Sequence Generation
Melody
Generator
Seven models. One evolving system. From basic LSTMs to LLaMA-style Transformers with BPE tokenisation, generating symbolic MIDI you can actually edit, arrange, and play.
Model Evolution
V2
LSTM
59 tokens
11MB
R&B
V3
LSTM
635 tokens
11MB
Dance
V4
LSTM
1.3k tokens
12MB
Jazz
V5
LSTM
629 tokens
22MB
Mixed
V6
LSTM
362 tokens
23MB
REMI
V7
Transformer
512 tokens
130MB
BPE
V8
Transformer
1024 tokens
131MB
MAESTRO
Create
Generate a Melody
No melodies generated yet. Click the button to create one!
It may take 1 - 2 minutes to generate.
Architecture
Frontend
Next.js 15 with an in-browser MIDI player and Web Audio synthesiser. Real-time visualisation of generated sequences.
Inference API
FastAPI serving PyTorch models with streaming generation. Configurable temperature, top-k, top-p sampling.
Training Pipeline
PyTorch training with MidiTok tokenisation. LSTM and LLaMA-style Transformer architectures on NVIDIA H100.
Gallery
Recent Melodies
Built On
📄
Music Transformer
ICLR 2019
Self-attention for long-range musical structure
📄
Pop Music Transformer
ACM MM 2020
REMI tokenisation for beat-relative encoding
📄
BPE for Symbolic Music
EMNLP 2023
Byte Pair Encoding compression for MIDI tokens
📄
MAESTRO Dataset
ICLR 2019
1,276 piano competition performances with aligned MIDI