MusicalHeart: A Hearty Way of Listening to Music

TitleMusicalHeart: A Hearty Way of Listening to Music
Publication TypeConference Paper
Year of Publication2012
AuthorsNirjon S, Dickerson R, Li Q, Asare P, Stankovic J, Hong D, Zhang B, Shen G, Jiang X, Zhao F
Conference NameThe 10th ACM Conference on Embedded Networked Sensor Systems (SenSys 2012)
Date Published11/2012
Conference LocationToronto, Canada
Keywordsactivity level, heart rate, music

MusicalHeart is a bio-feedback based, context aware, automated music recommendation system for smartphones. We introduce a new wearable sensing platform, Septimu, which consists of a pair of sensor equipped earphones that communicate to the smartphone via the audio jack. The Septimu platform enables the MusicalHeart application to continuously monitor the heart rate and activity level of the user, while the user is listening to music. The physiological information along with contextual information are then sent to a remote server, which provides dynamic music suggestions to assist the user maintain a target heart rate. We provide empirical evidence that the measured heart rate is 75%-85% correlated to the ground truth with an average error of 7.5 BPM, and the accuracy of activity level and context inference are on average 96.8% and 84.1%, respectively. We demonstrate the practicality of MusicalHeart by deploying it to two real world scenarios and show that MusicalHeart helps the user achieve a desired heart rate intensity with an average error of less than 12.2%, and it's quality of recommendation improves over time.