Piano Genie

About Piano Genie

Piano Genie: Ignite Your Passion for Piano with AI Power!

Embrace the magic of improvising on the piano, even as a beginner, with Piano Genie. Harnessing the power of artificial intelligence, Piano Genie lets you experience the joy of playing beautiful melodies with ease.

A Revolutionary Way to Play Piano

Unleashing the Pianist in Everyone

Piano Genie takes inspiration from popular video games like Rock Band and Guitar Hero, which make music accessible for novice musicians. But, unlike these games, Piano Genie offers users the freedom to create their own unique melodies instead of repeating a fixed repertoire. Users can control the piano using 1-8 numbered keys on their keyboard or by touching coloured blocks. Even the sustain pedal is within your control, activated by the space bar. The more you immerse yourself in the role of a pianist, the better your improvised melody will sound!

How Piano Genie Works

AI Learning for Dynamic Piano Performance

Piano Genie works by learning a time-varying mapping from a set of existing piano performances using a discrete autoencoder architecture. It employs a bidirectional LSTM encoder to map a sequence of piano notes to a sequence of controller buttons. A unidirectional LSTM decoder then decodes these controller sequences back into piano performances. After training, the encoder is discarded, and the controller sequences are provided by user input.

Instead of offering a fixed mapping, like the 8 buttons mapping to a fixed scale over a single octave, Piano Genie learns to adapt. This means that although the user has precise control over timing and degree of polyphony, the actual notes played are determined by the AI.

Enhanced Musicality through Pitch Contour

AI-Mapped Note Sequences for Rich Melodies

One unique feature of Piano Genie is how it preserves the pitch contours in the piano performance, mimicking the contours of the button sequence. This is encouraged by a training loss term that penalizes the encoder for violating relative pitch ordering. For instance, if an ascending piano interval maps to a descending button interval, the AI would consider it a fault. This results in a closely matching pitch contour between the actual piano performance and the 8-button sequence, leading to an enriched musical experience.

Experience the Magic of Piano Genie

Piano Genie offers a novel, engaging, and accessible way to enjoy piano music, regardless of your skill level. By leveraging advanced machine learning technology, it provides an opportunity to experiment with piano improvisation in an interactive setting. Whether you are an aspiring pianist, a curious enthusiast, or someone looking for a fun and creative pastime, Piano Genie is your gateway to musical expression. Give it a try and let your inner virtuoso shine!