Sirin is a creative web-based tool that turns your sketches into music. Just draw freely on the canvas, and our AI translates those visual strokes into unique melodies and rhythms — right in your browser.
Try it live: https://sirin-alpha.vercel.app
The main goal behind Sirin is to make music creation feel playful, intuitive, and accessible — especially for people who may not have any background in music. Whether you're a developer, an artist, a musician, or just someone curious about generative art, Sirin gives you a fun new way to explore the intersection of drawing and sound.
- Sketch-Based Music Creation – Draw on a canvas using a brush, eraser, and undo/redo functionality. Choose from a palette of vibrant neon colors.
- Real-Time AI Music Generator – Your sketch is turned into a live musical composition using MIDI logic.
- In-Browser Audio Playback – Music is played instantly using Tone.js without any downloads or plugins.
- Visual Playback – Watch your music come alive as animated tiles dance across the screen during playback.
- Instant Feedback – The app gives you visual cues and status updates like when your music is successfully generated.
- No Uploads Required – Sketches are processed via base64 image transfer; nothing is stored or uploaded.
- You draw freely on the canvas using brush tools and vibrant colors.
- When you hit "Generate Music", the drawing is converted into a base64 image.
- This image is sent to a Node.js backend, where:
- I analyze the brightness and position of strokes using Jimp.
- That visual data is mapped to musical parameters like pitch, volume, and timing.
- A MIDI file is created using @tonejs/midi and sent back.
- The frontend then uses Tone.js to:
- Decode the MIDI data.
- Play it as music while showing animated note tiles in sync.
| Frontend | Backend | Other Tools |
|---|---|---|
| React + CSS | Node.js + Express | Jimp, @tonejs/midi |
| Tone.js | RESTful APIs | Hosted on Render |
We're excited to keep improving Sirin. Here's what's coming next:
- Downloadable Tunes – Let users export their generated music as MIDI or audio files.
- Mobile Support – Enable touch gesture drawing for a fully mobile-friendly experience.
- Better Guidance – Provide tips, examples, and prompts to help users create more interesting musical outputs.
- User Accounts – Allow users to sign up and log in.
- Tone History & Savingving – Give users the ability to save and revisit their previous creations.