Yonezawa, T., Clarkson, B., Yasumura, M., and Mase, K. 2001. Context-aware sensor-doll as a music expression device. In CHI '01 Extended Abstracts on Human Factors in Computing Systems (Seattle, Washington, March 31 - April 05, 2001). CHI '01. ACM Press, New York, NY, 307-308.
Abstract We present a sensor-doll capable of music expression as a sympathetic communication device. The doll is equipped with a computer and various sensors such as a camera, microphone, accelerometer, and touch-sensitive sensors to recognize its own situation and the activities of the user. The doll has its own internal “mind” states reflecting different situated contexts. The user’s multi-modal interaction with the passive doll is translated into musical expressions that depend on the state of mind of the doll.