Abstract
The research on Humanoid Robots designed for playing musical instruments has a long tradition in the research field of robotics. During the past decades, several researches are develo** anthropomorphic and automated machines able to create live musical performances for both understanding the human itself and for creating novel ways of musical expression. In particular, Humanoid Robots are being designed to roughly simulate the dexterity of human players and to display higher-level of perceptual capabilities to enhance the interaction with musical partners. In this chapter, the concept and implementation of an interactive musical system for multimodal musician-humanoid interaction is detailed.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
Similar content being viewed by others
References
Akai: MPC, Reference Manual (2009), http://www.akaipro.com
Arulampalam, M.S., Maskell, S., Gordon, N., Clapp, T.: A tutorial on particle filters for online nonlinear / non-GaussianBayesian tracking. IEEE Transactions on Signal Processing, 174–188 (2002)
Hayashi, E.: Development of an automatic piano that produce appropriate: touch for the accurate expression of a soft tone. In: The Proc. of the IEEE/RSJ International Conference on Intelligent Robots and Systems - Workshop: Musical Performance Robots and Its Applications, pp. 7–12 (2006)
Kapur, A., Lazier, A., Davidson, P., Wilson, R.S., Cook, P.R.: The Electronic Sitar Controller. In: International Conference on New Interfaces for Musical Expression (2004)
Kato, I., Ohteru, S., Shirai, K., Matsushima, T., Narita, S., Sugano, S., Kobayashi, T., Fuji-sawa, E.: The robot musician WABOT-2 (Waseda Robot-2). Robotics 3(2), 143–155 (1987)
Nummiaro, K., Koller-Meier, E., Gool, L.V.: An adaptive color based particle filter. Journal of Image and Vision Computing 21, 99–110 (2003)
Orio, N.: Musical Retrieval: A tutorial and review. Foundations and Trends® in In-formation Retrieval 1(1), 1–90 (2003)
Petersen, K., Solis, J., Takanishi, A.: Development of a Aural Real-Time Rhythmical and Harmonic Tracking to Enable the Musical Interaction with the Waseda Flutist Robot. In: Proceedings of the IEEE/RSJ International Conference on Intelligent Robots and Systems, pp. 2303–2308 (2009)
Petersen, K., Solis, J., Takanishi, A.: Development of a Real-Time Instrument Track-ing System for Enabling the Musical Interaction with the WF-4RIV. In: Proceedings of the IEEE/RSJ International Conference on Intelligent Robots and Systems, pp. 3654–3659 (2008)
Richardson, I.: H. 264 and mpeg-4 video compression: Video coding for next-generation multimedia, p. 320. Wiley, Chichester (2003)
Solis, J., Takanishi, A., et al.: MbIS’s visual interaction video: http://www.takanishi.mech.waseda.ac.jp/top/research/music/flute/wf_4riv/index.htm
Solis, J., Takanishi, A., et al.: MbIS’s aural interaction video: http://www.takanishi.mech.waseda.ac.jp/top/research/music/flute/wf_4rv/interaction_index.htm
Dannenberg, R.B., Brown, B., Zeglin, G., Lupish, R.: McBlare: A Robotic Bagpipe Player. In: Proc. of the International Conference on New Interfaces for Musical Expression, pp. 80–84 (2005)
Rowe, R.: Machine Musicianship. MIT Press, Cambridge (2004)
Saxe, D., Foulds, R.: Toward Robust Skin Identification in Video Images. In: 2nd International Conference on Automatic Face and Gesture Recognition, p. 379 (1996)
Breazeal, C., Takanishi, A., Kobayashi, T.: Social robots that interact with people. In: Siciliano, B., Khatib, O. (eds.) Springer Handbook of Robotics, pp. 1349–1422 (2008)
Singer, E.: LEMUR GuitarBot: MIDI robotic string instrument. In: Proc. of the International Conference on New Interfaces for Musical Expression, vol. 2003, pp. 188–191 (2003, 2007)
Shibuya, K.: Toward develo** a violin playing robot: bowing by anthropomorphic robot arm and sound analysis. In: Proc. of the 16th Int. Conference on Robot & Human Interactive Communication, pp. 763–768 (2007)
Solis, J.: Robotic Control Systems for Learning and Teaching Human Skills, Ph.D. Dissertation, Perceptual Robotics Laboratory, Scuola Superiore Sant’Anna, Pisa, Italy, p. 226 (2004)
Solis, J., Marcheschi, S., Frisoli, A., Avizzano, C.A., Bergamasco, M.: Reactive Ro-bots System: an active human/robot interaction for transferring skill from robot to unskilled persons. International Advanced Robotics Journal 21(3), 267–291 (2007)
Solis, J., Taniguchi, K., Ninomiya, T., Takanishi, A.: Understanding the Mechanisms of the Human Motor Control by Imitating Flute Playing with the Waseda Flutist Robot WF-4RIV. Mechanism and Machine Theory 44(3), 527–540 (2008)
Solis, J., Petersen, K., Yamamoto, T., Takeuchi, M., Ishikawa, S., Takanishi, A., Hashimoto, K.: Design of New Mouth and Hand Mechanisms of the Anthropomorphic Saxophon-ist Robot and Implementation of an Air Pressure Feed-Forward Control with Dead-Time Compensation. In: Proc. of the International Conference on Robotics and Automation, pp. 42–47 (2010)
Sony Computer Entertainment, Playstation eyeto (2008), http://www.eyetoy.com
Toyota Motor Corporation, Development of Partner Robots that Can Support an Aging Society: Creating an Era when Robots Provide Nursing Care and Perform Domestic Duties, http://www.toyota.co.jp/en/csr/report/08/stakeholder/02.html
Toyota Motor Corporation, Overview of the partner robots, http://www.toyota.co.jp/en/special/robot/
Weinberg, G., Driscoll, S.: Toward Robotic Musicianship. Computer Music Journal 30, 28–45 (2006)
Wren, C., Azarbayejani, A., Darrell, T., Pentland, A.: Pfinder: Real-Time Tracking of the Human Body. IEEE Transactions on Pattern Analysis and Machine Intelligence, 780–785 (1997)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2011 Springer-Verlag Berlin Heidelberg
About this chapter
Cite this chapter
Solis, J., Petersen, K., Takanishi, A. (2011). Interactive Musical System for Multimodal Musician-Humanoid Interaction. In: Solis, J., Ng, K. (eds) Musical Robots and Interactive Multimodal Systems. Springer Tracts in Advanced Robotics, vol 74. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-22291-7_15
Download citation
DOI: https://doi.org/10.1007/978-3-642-22291-7_15
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-22290-0
Online ISBN: 978-3-642-22291-7
eBook Packages: EngineeringEngineering (R0)