Project : LivePulse Games

Designing Engaging Camera Based Mobile Games for Implicit Heart Rate Monitoring

Research

Heart rate monitoring is widely used in clinical care, fitness training, and stress management. However, tracking individuals’ heart rate faces two major challenges, namely equipment availability and user motivation. In this paper, we present a novel technique, LivePulse Games (LPG), to measure users’ heart rates in real time by having them play games on unmodified mobile phones. With LPG, heart rate is calculated by detecting changes in transparency of users’ fingertips via a mobile device’s built-in camera. More importantly, LPG integrate users’ camera lens covering actions as an essential control mechanism for game play, and detect heart rate implicitly from intermittent lens covering actions. We explore the design space and trade-offs of LPG through three rounds of iterative design. In a 12-subject user study, we found that LivePulse games are fun to play and can measure heart rates accurately. We also report the insights for balancing measurement speed, accuracy, and entertainment value in LPG.

Publications

  • Han, T., Xiao, X., Shi, L., Canny, J., and Wang, J., Balancing Accuracy and Fun – Designing Camera Based Mobile Games for Implicit Heart Rate Monitoring. In Proceedings of ACM Conference on Human Factors in Computing Systems (CHI 2015), Seoul, Korea, April 18 – 23, 2015. ( pdf )
  • Han, T., Shi, L., Xiao, X., Canny, J., and Wang, J., Designing Camera Based Mobile Games for Implicit Heart Rate Monitoring. In Works-In-Process of ACM Conference on Human Factors in Computing Systems (CHI 2014), Toronto, Canada, April 26 – May 1, 2014. ( pdf )

Downloads

Source Code (BSD License) Video