Assistive Social Robots for People with Special needs

Nadia Magnenat-Thalmann, Zhijun Zhang

Abstract


An increasing number of elderly people leads todemand for social robots to support health care and independentlife. An overview of various potential applications of social robotsis provided in this paper. In addition, the latest research progressin our institute is presented, i.e., multi-party interaction, gesturerecognition, affective computing, and attention capture. All theresearch and applications demonstrate that social robots are goodassistive robots for people with special needs.

References


“Profiles of ageing 2013,” in United Nations Department of Economic and Social Affairs, Population Division, 2013.

M. J. Mataric, “Socially assistive robotics,” Science, vol. 3, no. 6, pp. 233–242, 1999.

J. Fasola and M. Mataric, “A socially assistive robot exercise coach

for the elderly,” Journal of Human-Robot Interaction, vol. 2, no. 2, pp. 3–32, 2013.

C. Schaeffer and T. May, “Care-o-bot: A system for assisting elderly or disabled persons in home environments,” in Assistive technology on the threshold of the new millenium. IOS Press, Amsterdam, 1999.

B. Graf and H. Staab, “Service robots and automation for the disabled/ limited,” in Springer Handbook of Automation, pp. 1485–1502, Springer, 2009.

K. M. Tsui, A. Norton, D. J. Brooks, E. McCann, M. S. Medvedev, and H. A. Yanco, “Design and development of two generations of semiautonomous social telepresence robots,” in 2013 IEEE International Conference on Technologies for Practical Robot Applications (TePRA), pp. 1–6, IEEE, 2013.

J. Yeung and D. I. Fels, “A remote telepresence system for high school classrooms,” in Canadian Conference on Electrical and Computer Engineering, pp. 1465–1468, IEEE, 2005.

S. O. Adalgeirsson and C. Breazeal, “Mebot: a robotic platform for socially embodied presence,” in Proceedings of the 5th ACM/IEEE international conference on Human-robot interaction, pp. 15–22, IEEE Press, 2010.

R. Schraft, C. Schaeffer, and T. May, “Care-o-bottm: the concept of a system for assisting elderly or disabled persons in home environments,” in Proceedings of the 24th Annual Conference of the IEEE Industrial Electronics Society, 1998. IECON ’98, vol. 4, pp. 2476–2481 vol.4, Aug 1998.

U. Reiser, C. P. Connette, J. Fischer, J. Kubacki, A. Bubeck, F. Weisshardt, T. Jacobs, C. Parlitz, M. H¨agele, and A. Verl, “Care-o-bot R 3-creating a product vision for service robot applications by integrating design and technology.,” in IROS, vol. 9, pp. 1992–1998, 2009.

P. Milhorat, D. Istrate, J. Boudy, and G. Chollet, “Hands-free speechsound interactions at home,” in 2012 Proceedings of the 20th European Signal Processing Conference (EUSIPCO), pp. 1678–1682, IEEE, 2012.

H. Gross, C. Schroeter, S. Mueller, M. Volkhardt, E. Einhorn, A. Bley, T. Langner, M. Merten, C. Huijnen, H. van den Heuvel, et al., “Further progress towards a home robot companion for people with mild cognitive impairment,” in 2012 IEEE International Conference on Systems, Man, and Cybernetics (SMC), pp. 637–644, IEEE, 2012.

C. Schroeter, S. Mueller, M. Volkhardt, E. Einhorn, C. Huijnen, H. van den Heuvel, A. van Berlo, A. Bley, and H.-M. Gross, “Realization and user evaluation of a companion robot for people with mild cognitive impairments,” in 2013 IEEE International Conference on Robotics and Automation (ICRA), pp. 1153–1159, IEEE, 2013.

J. Fasola and M. J. Mataric, “Using socially assistive human–robot interaction to motivate physical exercise for older adults,” Proceedings of the IEEE, vol. 100, no. 8, pp. 2512–2526, 2012.

E. Wade and M. J. Mataric, “Design and testing of lightweight inexpensive motion-capture devices with application to clinical gait analysis,” in 3rd International Conference on Pervasive Computing Technologies for Healthcare, pp. 1–7, IEEE, 2009.

E. Wade, J. Dye, R. Mead, and M. J. Mataric, “Assessing the quality and quantity of social interaction in a socially assistive robot-guided therapeutic setting,” in 2011 IEEE International Conference on Rehabilitation Robotics (ICORR), pp. 1–6, IEEE, 2011.

T. Mukai, S. Hirano, H. Nakashima, Y. Kato, Y. Sakaida, S. Guo, and S. Hosoe, “Development of a nursing-care assistant robot riba that can lift a human in its arms,” in 2010 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), pp. 5996–6001, Oct 2010.

Y. Sakaida, R. Ikeura, and D. Chugo, “The analysis of upper arm movement when a human lift up a dummy doll,” in SICE Annual Conference 2010, Proceedings of, pp. 1711–1716, Aug 2010.

T. Mukai, S. Hirano, M. Yoshida, H. Nakashima, S. Guo, and Y. Hayakawa, “Whole-body contact manipulation using tactile information for the nursing-care assistant robot riba,” in 2011 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), pp. 2445–2451, Sept 2011.

T. Mukai, S. Hirano, M. Yoshida, H. Nakashima, S. Guo, and Y. Hayakawa, “Tactile-based motion adjustment for the nursing-care assistant robot riba,” in 2011 IEEE International Conference on Robotics and Automation (ICRA), pp. 5435–5441, May 2011.

M. Ding, R. Ikeura, T. Mukai, H. Nagashima, S. Hirano, K. Matsuo, M. Sun, C. Jiang, and S. Hosoe, “Comfort estimation during lift-up using nursing-care robot-riba,” in 2012 First International Conference on Innovative Engineering Systems (ICIES), pp. 225-230, Dec 2012.

M. Ding, R. Ikeura, Y. Mori, T. Mukai, and S. Hosoe, “Measurementof human body stiffness for lifting-up motion generation using nursingcareassistant robot-riba,” in SENSORS, 2013 IEEE, pp. 1–4, Nov 2013.

A. Morris, R. Donamukkala, A. Kapuria, A. Steinfeld, J. Matthews, J. Dunbar-Jacobs, and S. Thrun, “A robotic walker that provides guidance.” Submitted for publication, 2002.

M. Montemerlo, J. Pineau, N. Roy, S. Thrun, and V. Verma, “Experiences with a mobile robotic guide for the elderly,” in Proceedings of the AAAI National Conference on Artificial Intelligence, (Edmonton, Canada), AAAI, 2002.

M. E. Pollack, “Planning technology for intelligent cognitive orthotics.,” in AIPS, pp. 322–332, 2002.

M. E. Pollack, L. Brown, D. Colbry, C. Orosz, B. Peintner, S. Ramakrishnan, S. Engberg, J. T. Matthews, J. Dunbar-Jacob, C. E. McCarthy, et al., “Pearl: A mobile robotic assistant for the elderly,” in AAAI 2002 Workshop on Automation as Caregiver: The Role of Intelligent Technology in Elder Care, pp. 85–92, 2002.

M. Villano, C. R. Crowell, K. Wier, K. Tang, B. Thomas, N. Shea, L. M. Schmitt, and J. J. Diehl, “Domer: a wizard of oz interface for using interactive robots to scaffold social skills for children with autism spectrum disorders,” in Proceedings of the 6th international conference on Human-robot interaction, pp. 279–280, ACM, 2011.

S. Shamsuddin, H. Yussof, L. I. Ismail, S. Mohamed, F. A. Hanapiah, and N. I. Zahari, “Initial response in hri- a case study on evaluation of child with autism spectrum disorders interacting with a humanoid robot {NAO},” Procedia Engineering, vol. 41, no. 0, pp. 1448 – 1455, 2012. International Symposium on Robotics and Intelligent Sensors 2012 (IRIS 2012).

S. Shamsuddin, H. Yussof, L. Ismail, F. Hanapiah, S. Mohamed, H. Piah, and N. Ismarrubie Zahari, “Initial response of autistic children in human-robot interaction therapy with humanoid robot nao,” in 2012 IEEE 8th International Colloquium on Signal Processing and its Applications (CSPA), pp. 188–193, March 2012.

S. M. Anzalone, E. Tilmont, S. Boucenna, J. Xavier, A.-L. Jouen, N. Bodeau, K. Maharatna, M. Chetouani, and D. Cohen, “How children with autism spectrum disorder behave and explore the 4-dimensional (spatial 3d+time) environment during a joint attention induction task with a robot,” Research in Autism Spectrum Disorders, vol. 8, no. 7, pp. 814 – 826, 2014.

T. Shibata, Y. Kawaguchi, and K. Wada, “Investigation on people living with paro at home,” in The 18th IEEE International Symposium on Robot and Human Interactive Communication, pp. 1131–1136, Sept 2009.

K. Wada, Y. Ikeda, K. Inoue, and R. Uehara, “Development and preliminary evaluation of a caregiver’s manual for robot therapy using the therapeutic seal robot paro,” in RO-MAN, 2010 IEEE, pp. 533–538, Sept 2010.

T. Shibata, “Therapeutic seal robot as biofeedback medical device: Qualitative and quantitative evaluations of robot therapy in dementia care,” Proceedings of the IEEE, vol. 100, pp. 2527–2538, Aug 2012.

S. Sabanovic, C. Bennett, W.-L. Chang, and L. Huber, “Paro robot affects diverse interaction modalities in group sensory therapy for older adults with dementia,” in 2013 IEEE International Conference on Rehabilitation Robotics (ICORR), pp. 1–6, June 2013.

W.-L. Chang, S. Sabanovic, and L. Huber, “Use of seal-like robot paro in sensory group therapy for older adults with dementia,” in 2013 8th ACM/IEEE International Conference on Human-Robot Interaction (HRI), pp. 101–102, March 2013.

F. Tanaka and H. Suzuki, “Dance interaction with qrio: a case study for non-boring interaction by using an entrainment ensemble model,” in 13th IEEE International Workshop on Robot and Human Interactive Communication, pp. 419–424, Sept 2004.

L. Geppert, “Qrio, the robot that could,” Spectrum, IEEE, vol. 41, pp. 34–37, May 2004.

T. Ishida, “Development of a small biped entertainment robot qrio,” in Proceedings of the 2004 International Symposium on Micro-Nanomechatronics and Human Science, pp. 23–28, Oct 2004.

F. Tanaka, B. Fortenberry, K. Aisaka, and J. R. Movellan, “Developing dance interaction between qrio and toddlers in a classroom environment: plans for the first steps,” in IEEE International Workshop on Robot and Human Interactive Communication, pp. 223–228, Aug 2005.

F. Tanaka, B. Fortenberry, K. Aisaka, and J. R. Movellan, “Plans for developing real-time dance interaction between qrio and toddlers in a classroom environment,” in The 4th International Conference on Development and Learning, pp. 142–147, July 2005.

M. Fujita, “On activating human communications with pet-type robot aibo,” Proceedings of the IEEE, vol. 92, pp. 1804–1813, Nov 2004.

N. Suzuki and Y. Yamamoto, “Pursuing entertainment aspects of sony aibo quadruped robots,” in 4th International Conference on Modeling, Simulation and Applied Optimization (ICMSAO), pp. 1–5, April 2011.

C. Stanton, P. Kahn, R. Severson, J. Ruckert, and B. Gill, “Robotic

animals might aid in the social development of children with autism,” in 3rd ACM/IEEE International Conference on Human-Robot Interaction (HRI), pp. 271–278, March 2008.

D. DeSteno, C. Breazeal, R. H. Frank, D. Pizarro, J. Baumann, L. Dickens, and J. J. Lee, “Detecting the trustworthiness of novel partners in economic exchange,” Psychological science, p. 0956797612448793, 2012.

C. Breazeal, N. DePalma, J. Orkin, S. Chernova, and M. Jung, “Crowdsourcing human-robot interaction: New methods and system evaluation in a public environment,” Journal of Human-Robot Interaction, vol. 2, no. 1, pp. 82–111, 2013.

C. Chao, M. Cakmak, and A. Thomaz, “Transparent active learning for robots,” in 5th ACM/IEEE International Conference on Human-Robot Interaction (HRI), pp. 317–324, March 2010.

M. Cakmak, C. Chao, and A. Thomaz, “Designing interactions for robot active learners,” IEEE Transactions on Autonomous Mental Development, vol. 2, pp. 108–118, June 2010.

C. Chao, J. Lee, M. Begum, and A. L. Thomaz, “Simon plays simon says: The timing of turn-taking in an imitation game,” in RO-MAN, 2011 IEEE, pp. 235–240, IEEE, 2011.

G. Castellano, I. Leite, A. Pereira, C. Martinho, A. Paiva, and P. W. McOwan, “It’s all in the game: Towards an affect sensitive and context aware game companion,” in 3rd International Conference on Affective Computing and Intelligent Interaction and Workshops, pp. 1–8, Sept 2009.

F. Eyssel, F. Hegel, G. Horstmann, and C. Wagner, “Anthropomorphic inferences from emotional nonverbal cues: A case study,” in RO-MAN, 2010 IEEE, pp. 646–651, Sept 2010.

J. Sanghvi, G. Castellano, I. Leite, A. Pereira, P. W. McOwan, and A. Paiva, “Automatic analysis of affective postures and body motion to detect engagement with a game companion,” in 6th ACM/IEEE International Conference on Human Robot Interaction (HRI), pp. 305– 311, March 2011.

I. Leite, R. Henriques, C. Martinho, and A. Paiva, “Sensors in the wild: Exploring electrodermal activity in child-robot interaction,” in 8th ACM/IEEE International Conference on Human-Robot Interaction (HRI), pp. 41–48, March 2013.

C. Breazeal, “Proto-conversations with an anthropomorphic robot,” in 9th IEEE International Workshop on Robot and Human Interactive Communication, pp. 328–333, 2000.

C. Breazeal, “Socially intelligent robots: research, development, and applications,” in IEEE International Conference on Systems, Man, and Cybernetics, vol. 4, pp. 2121–2126 vol.4, 2001.

L. Aryananda, “Recognizing and remembering individuals: online and unsupervised face recognition for humanoid robot,” in IEEE/RSJ International Conference on Intelligent Robots and Systems, vol. 2, pp. 1202–1207 vol.2, 2002.

W. Stiehl, L. Lalla, and C. Breazeal, “A ”somatic alphabet” approach to ”sensitive skin”,” in IEEE International Conference on Robotics and Automation, vol. 3, pp. 2865–2870 Vol.3, April 2004.

Y. Xiao, Z. Zhang, A. Beck, J. Yuan, and D. Thalmann, “Human-robot interaction by understanding upper body gestures,” in MIT Presence, 2014.

“World population ageing 2013,” in Economic & Social Affairs, United Nations, 2013.

T. B. Sheridan, “Further musings on the psychophysics of presence,” in IEEE International Conference on Systems, Man, and Cybernetics, vol. 2, pp. 1073–1077, IEEE, 1994.

A. Kristoffersson, S. Coradeschi, and A. Loutfi, “A review of mobile robotic telepresence,” Advances in Human-Computer Interaction, vol. 2013, p. 3, 2013.

H. Gross, C. Schr ¨oter, S. Mueller, M. Volkhardt, E. Einhorn, A. Bley, T. Langner, C. Martin, and M. Merten, “I’ll keep an eye on you: Home robot companion for elderly people with cognitive impairment,” in 2011 IEEE International Conference on Systems, Man, and Cybernetics (SMC), pp. 2481–2488, IEEE, 2011.

E. Wade, A. R. Parnandi, and M. J. Mataric, “Using socially assistive robotics to augment motor task performance in individuals post-stroke,” in IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), pp. 2403–2408, IEEE, 2011.

M. J. Mataric, “Human-centered socially assistive robotics for rehabilitation: Is it time for a robot coach?,” in Virtual Rehabilitation, 2008, pp. 1–1, IEEE, 2008.

A. P. Association et al., The Diagnostic and Statistical Manual of Mental Disorders: DSM 5. bookpointUS, 2013.

A. Billard, B. Robins, J. Nadel, and K. Dautenhahn, “Building robota, a mini-humanoid robot for the rehabilitation of children with autism,” Assistive Technology, vol. 19, no. 1, pp. 37–49, 2007.

P. Ravindra, S. De Silva, K. Tadano, A. Saito, S. G. Lambacher, and M. Higashi, “Therapeutic-assisted robot for children with autism,” in IEEE/RSJ International Conference on Intelligent Robots and Systems, pp. 3561–3567, IEEE, 2009.

X. Ma and F. Quek, “Development of a child-oriented social robot for safe and interactive physical interaction,” in 2010 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), pp. 2163–2168, Oct 2010.

B. Scassellati, “How social robots will help us to diagnose, treat, and understand autism,” in Robotics research, pp. 552–563, Springer, 2007.

Z. Yumak, J. Ren, N. Thalmann, and J. Yuan, “Modelling multiparty interactions among virtual characters, robots and humans,” MIT Presence Journal, 2014.

Y. Xiao, Z. Zhang, A. Beck, J. Yuan, and D. Thalmann, “Human-robot interaction by understanding upper body gestures,”

J. Zhang, N. Magnenat-Thalmann, and J. Zhang, “Modeling emotions and moods in an affective system for virtual human and social robots,” in the 25th International Conference on Computer Animation and Social Agents, 2012.

P. Gebhard, “Alma: a layered model of affect,” in Proceedings of the fourth international joint conference on Autonomous agents and multiagent systems, pp. 29–36, ACM, 2005.


Full Text: PDF

Refbacks

  • There are currently no refbacks.