©2018 by Gabriel Reis

Ukulele Hero

A PC game designed to teach Ukulele chords using sound recognition from an actual instrument.

RULES & RESPONSABILITIES

  • Lead Programmer

  • Develop a sound recognition algorithm tailored for the Ukulele 

  • Implement user interface and flow

  • Ideation with teammates, user testing and bug fixes

 

CHALLENGES

  • Being able to retrieve the data from the devices microphone

  • Being able to identify Ukulele strings sound, including multiple strings at the same time (chord)

  • Dealing with hardware specific features (microphone on different devices) 

  • Creating a fun learning experience for non-gamers

 

LEARNINGS

  • Limitation of sound recognition in Unity

  • Using Fourier Analysis in Unity to recognize Ukulele strings frequency

  • How sound is translated to data in different devices

  • Standard rhythm game core loop