Kaho Yeung
This project investigates the design and development of a gamified drum-learning system for beginner drummers using instructional design principles, motor learning theory, and real-time interaction. Traditional drum instruction often relies on notation-based teaching and passive video content, which can limit engagement, delay skill acquisition, and provide limited immediate feedback. The aim of this project was to develop an interactive system that supports coordination, rhythmic accuracy, and learner motivation through a more engaging and practice-oriented approach.
Connect electronic drum kit to computer and split the midi port so it can be used by two different software BFD Player and Unity, this can be done using LoopMidi (creates a port for BFD and Unity) and MidiOX (routes the new ports into each software)
Detect Midi input in Unity using MidiJack, a Unity Plugin that allows Midi detection in Unity. This allows inputs from the physical kit to light up the kit in Unity, giving visual feedback.
Use third-party software (Drum2Notes) to extract and export drum patterns from mp3 files as midi/xml.
The MIDI and MP3 files will be imported and parsed using Music21 python toolkit to generate level patterns. These patterns are visualised using falling notes which will light up the pad on contact.
Sync the song with a generated level pattern, combining these creates a Beatmap. This supports deliberate practice by allowing the user to play-along.
Provide the user with the opportunity to adjust the song tempo. This allows the user to study the song and play along slowly, altering the tempo incrementally to their desired speed.
Implement immediate feedback using audio from the kit and gamified UI elements (combo, score, accuracy, and hit feedback).
Create a scaffolding course and assessment strategy. The course will contain drum learning content such as demonstration videos, grooves, and rudiments.
The visualized drum kit made it more intuitive to learn new songs. Tempo control and segmenting the songs into manageable parts allowed learning to be more effective. Course content built-in to the app helped fundamental skill development.
This project focuses on creating a gamified drum-learning system for beginners that improves engagement, coordination, and rhythmic accuracy. Traditional methods often rely on notation and passive videos, which can slow learning and limit feedback.
The system was built in Unity and connects to an electronic drum kit via MIDI. It includes beatmap generation, audio processing, and tools for importing songs, adjusting tempo, and practicing specific sections. Users receive real-time visual and audio feedback while playing. Gamification features like scoring, combo tracking, and accuracy feedback help motivate consistent practice.
The design is based on motor learning theory, instructional design, and music pedagogy. Key principles include scaffolding, mastery learning, multimodal interaction, and reducing cognitive load. User testing improved synchronization, interface clarity, and feedback systems.
Overall, the project shows that combining gamification, real-time feedback, and interactive technology can make drum learning more engaging and effective than traditional approaches.
