The drum kit is a popular instrument in many music genres. However, for new drummers, owning a drum set is expensive both financially and space-wise. Playing drums is typically noisy and bothersome to those around.
In our project, we created a software-based drum set that uses only two sticks and a smartphone or a webcam to provide an air-drumming experience. Our solution is implemented by a trained deep network which detects drumsticks, and dynamic tracking algorithm includes Kalman filter. It successfully tracks drumsticks and can detect them in images with noisy backgrounds while allowing the playing of drums at various tempos and volumes.