We play musical instruments with our fingers, hands, mouths and feet. These human extremities are used for playing music because they are capable of fine muscle control. Our faces have more than 50 muscles and we can make dozens of facial expressions. Unfortunately, till now we have not been able to use them for making music. Well, things have changed! The latest face tracking technologies finally allows us to do exactly that.
MusiFace a.k.a MusEmoji is a unique Augmented Reality Face Tracking app. It enables you to play MIDI musical instruments by changing your facial expressions. The app is a MIDI controller & synthesizer. It features 12 standard MIDI instruments, which you can play in their full octave ranges. It has built-in Voice Control and can be used by disabled people who want to play music completely hands-free. It is also suitable for children ages 9 and above and has built-in parental controls.
The MusiFace app is localized in 20 of the world s most popular languages and features 30 practice melodies from those language regions. Each melody can be viewed in several notations including the standard sheet music notation, solfege, American, Asian and the unique MusEmoji notation. Detailed instructions and performance videos are also available in the info section.
MusiFace also includes a game and a demo. They are exciting to play and allow you to easily improve your music making skills while exercising your facial muscles.
MusiFace uses ARKit and the built-in TrueDepth camera in iPad Pro and iPhone X and higher to do face and head tracking.