Norwegian version of this page

Multimodal Elderly Care Systems (MECS)

About the project

The number of elderly people living at home is increasing and this trend is expected to continue. The challenge then would be how to provide technology that can handle the complex and different environments found in homes. Further, technology can easily be seen as a threat to privacy and lack of interpersonal contact. This project addresses these issues by user centered design of robotic systems and the development of adaptive technology. A part of this will be to demonstrate the benefits regarding both performance and privacy being improved by applying sensors like cameras on a robot companion rather than having them permanently mounted in a home. These would be used for detecting falls and other non-normal situations. Using new sensor technology, we would also like to explore if it is possible to remotely monitor medical states like pulse, breathing etc. Rather than having elderly themselves activating their personal security alarm in the case of an emergency situation, a target of this project is to demonstrate automatic activation. Many systems for elderly have been designed but few have been adopted on a large scale. We think a key reason for this is limited user involvement and few iterations of user testing. Therefore, we will focus specifically on developing our systems with a large degree of user participation.

In this project, a robot companion moves in a residential environment in the presence of unknown static and dynamic obstacles. Thus, having an effective and efficient control architecture, plays an important role in the achievement of the project objectives.

Objectives

Create and evaluate multimodal mobile human supportive systems that are able to sense, learn and predict future events.

Financing

Research Council of Norway 2015–2019, IKTPLUSS, One PhDs and two post-doc (10% of proposals in the call were funded)

Cooperation

Tools

Publications

  • Woll, Anita & Tørresen, Jim (2023). What is a Smart Hospital? A Review of the Literature. In Duffy, V.G.; Lehto, M.; Yih, Y. & Proctor, R.W. (Ed.), Human-Automation Interaction. Springer. ISSN 978-3-031-10780-1. p. 145–165.
  • Saplacan, Diana; Schulz, Trenton; Tørresen, Jim & Pajalic, Zada (2023). Health Professionals’ Views on the Use of Social Robots with Vulnerable Users: A Scenario-Based Qualitative Study Using Story Dialogue Method , Proceedings of the 32nd IEEE International Conference on Robot & Human Interactive Communication (RO-MAN) 2023. IEEE conference proceedings. ISSN 979-8-3503-3671-9. p. 421–428. doi: 10.1109/RO-MAN57019.2023.10309644. Full text in Research Archive
  • Baselizadeh, Adel; Khaksar, Weria; Uddin, Md Zia; Saplacan, Diana & Tørresen, Jim (2023). Privacy-Preserving User Pose Prediction for Safe and Efficient Human-Robot Interaction, Proceedings of the 2023 19th IEEE International Conference on Automation Science and Engineering (CASE) . IEEE conference proceedings. ISSN 979-8-3503-2070-1. doi: 10.1109/CASE56687.2023.10260298. Full text in Research Archive
  • van Otterdijk, Marieke; Saplacan, Diana; Baselizadeh, Adel; Laeng, Bruno & Tørresen, Jim (2023). To Shake or Not to Shake: Intuitive Reactions of Senior Adults to a Robot Handshake in a Western Culture, Proceedings of the 32nd IEEE International Conference on Robot & Human Interactive Communication (RO-MAN) 2023. IEEE conference proceedings. ISSN 979-8-3503-3671-9. p. 890–896. doi: 10.1109/RO-MAN57019.2023.10309608. Full text in Research Archive
  • Tørresen, Jim; Saplacan, Diana; Baselizadeh, Adel & Mahler, Tobias (2023). Machine Excellence Tradeoffs to Ethical and Legal Perspectives, Proceedings of the 2023 IEEE Conference on Artificial Intelligence (IEEE CAI). IEEE conference proceedings. ISSN 979-8-3503-3984-0. p. 237–240. doi: 10.1109/CAI54212.2023.00109. Full text in Research Archive
  • Saplacan, Diana & Tørresen, Jim (2022). Robots as Welfare Technologies to Reduce Falls Amongst Older Adults: An Explorative Study from Norway, Human Aspects of IT for the Aged Population. Technology in Everyday Living. Lecture Notes in Computer Science. LNCS 13331. Springer Nature Switzerland AG. ISSN 978-3-031-05654-3. p. 88–106. doi: doi.org/10.1007/978-3-031-05654-3_6.
  • Bordvik, David Andreas; Hou, Jie; Noori, Farzan Majeed; Uddin, Md Zia & Tørresen, Jim (2022). Monitoring In-Home Emergency Situation and Preserve Privacy using Multi-modal Sensing and Deep Learning, 2022 International Conference on Electronics, Information, and Communication (ICEIC 2022) . IEEE (Institute of Electrical and Electronics Engineers). ISSN 9781665409353. doi: 10.1109/ICEIC54506.2022.9748829. Full text in Research Archive
  • Soma, Rebekka; Bratteteig, Tone; Saplacan, Diana; Schimmer, Robyn; Camparo, Erik & Verne, Guri Birgitte (2022). Strengthening Human Autonomy. In the Era of Autonomous Technology. Scandinavian Journal of Information Systems (SJIS). ISSN 0905-0167. 34(2).
  • Herstad, Jo; Schulz, Trenton Wade & Saplacan, Diana (2021). T-able: An Investigation of Habituating Moving Tables at Home . In Verma, Ira (Eds.), Universal Design 2021: From Special to Mainstream Solutions. IOS Press. ISSN 978-1-64368-190-0. p. 238–251. doi: 10.3233/SHTI210400.
  • Khaksar, Weria; Neggers, Margot; Barakova, Emilia Ivanova & Tørresen, Jim (2021). Generation Differences in Perception of the Elderly Care Robot. In Caleb-Solly, Praminda; Ghafurian, Moojan; Johnson, Michelle & Wada, Kazuyoshi (Ed.), Proceedings of the 30th IEEE International Conference on Robot & Human Interactive Communication (ROMAN). IEEE (Institute of Electrical and Electronics Engineers). ISSN 978-1-6654-0492-1. p. 551–558. doi: 10.1109/RO-MAN50785.2021.9515534.
  • van Otterdijk, Marieke; Neggers, Margot; Tørresen, Jim & Barakova, Emilia Ivanova (2021). Preferences of Seniors for Robots Delivering a Message With Congruent Approaching Behavior, Proceedings of the 2021 IEEE International Conference on Advanced Robotics and Its Social Impacts (ARSO) Virtual Conference, July 8-10, 2021. IEEE Robotics and Automation Society. ISSN 978-1-6654-4952-6. doi: 10.1109/ARSO51874.2021.9542833.
  • Tørresen, Jim (2021). Undertaking Research with Humans within Artificial Intelligence and Robotics: Multimodal Elderly Care Systems. Technology Architecture + Design (TAD). ISSN 2475-1448. 5(2), p. 141–145. doi: 10.1080/24751448.2021.1967052.
  • Schulz, Trenton Wade; Soma, Rebekka & Holthaus, Patrick (2021). Movement acts in breakdown situations: How a robot's recovery procedure affects participants' opinions. Paladyn - Journal of Behavioral Robotics. ISSN 2080-9778. 12(1), p. 336–355. doi: 10.1515/pjbr-2021-0027. Full text in Research Archive
  • Saplacan, Diana; Khaksar, Weria & Tørresen, Jim (2021). On Ethical Challenges Raised by Care Robots: A Review of the Existing Regulatory-, Theoretical-, and Research Gaps, Proceedings of the 2021 IEEE International Conference on Advanced Robotics and Its Social Impacts (ARSO) Virtual Conference, July 8-10, 2021. IEEE Robotics and Automation Society. ISSN 978-1-6654-4952-6. p. 219–226. doi: 10.1109/ARSO51874.2021.9542844.
  • Noori, Farzan Majeed; Uddin, Md Zia & Tørresen, Jim (2021). Ultra-Wideband Radar-Based Activity Recognition Using Deep Learning. IEEE Access. ISSN 2169-3536. 9, p. 138132–138143. doi: 10.1109/ACCESS.2021.3117667. Full text in Research Archive
  • Mantelli, Mathias; Pittol, Diego; Maffei, Renan; Tørresen, Jim; Prestes, Edson & Kolberg, Mariana (2021). Semantic Active Visual Search System Based on Text Information for Large and Unknown Environments. Journal of Intelligent and Robotic Systems. ISSN 0921-0296. 101(2). doi: 10.1007/s10846-020-01298-7.
  • Uddin, Md Zia; Noori, Farzan Majeed & Tørresen, Jim (2020). In-Home Emergency Detection Using an Ambient Ultra-Wideband Radar Sensor and Deep Learning. In Noori, Farzan Majeed (Eds.), IEEE 10th International Conference on Ultrawideband and Ultrashort Impulse Signals (UWBUSIS). IEEE (Institute of Electrical and Electronics Engineers). ISSN 978-1-7281-7314-6. p. 1089–1093. doi: 10.1109/UkrMW49653.2020.9252708.
  • Saplacan, Diana; Herstad, Jo & Pajalic, Zada (2020). An Analysis of Independent Living Elderly’s Views on Robots: A Descriptive Study from the Norwegian Context. In Mauri, Lloret, James; Saplacan, Diana; Carcani, Klaudia; Ardiansyah, Prima Oky Dicky & Vasilache, Simona (Ed.), ACHI 2020, The Thirteenth International Conference on Advances in Computer-Human Interactions. International Academy, Research and Industry Association (IARIA). ISSN 978-1-61208-761-0. p. 199–208. Full text in Research Archive
  • Saplacan, Diana; Herstad, Jo; Tørresen, Jim & Pajalic, Zada (2020). A Framework on Division of Work Tasks between Humans and Robots in the Home. Multimodal Technologies and Interaction. ISSN 2414-4088. 4(3). doi: 10.3390/mti4030044. Full text in Research Archive
  • Noori, Farzan; Riegler, Michael; Uddin, Md Zia & Tørresen, Jim (2020). Human Activity Recognition from Multiple Sensors Data Using Multi-Fusion Representations and CNNs. ACM Transactions on Multimedia Computing, Communications, and Applications (TOMCCAP). ISSN 1551-6857. 16(2). doi: 10.1145/3377882.
  • Saplacan, Diana; Herstad, Jo & Schulz, Trenton Wade (2020). Situated Abilities within Universal Design – A Theoretical Exploration. International Journal on Advances in Intelligent Systems. ISSN 1942-2679. 13(34), p. 278–291. Full text in Research Archive
  • Woll, Anita & Tørresen, Jim (2020). Bridging the User Barriers of Home Telecare. Advances in Intelligent Systems and Computing. ISSN 2194-5357. 1069, p. 816–835. doi: 10.1007/978-3-030-32520-6_59.

View all works in Cristin

  • Saplacan, Diana (2023). Presentation of the paper "Health Professionals’ Views on the Use of Social Robots with Vulnerable Users: A Scenario-Based Qualitative Study Using Story Dialogue Method".
  • Saplacan, Diana; Pajalic, Zada & Tørresen, Jim (2023). Should Social and Assistive Robots Integrated within Home- and Healthcare Services Be Universally Designed? Cambridge Handbook on Law, Policy, and Regulations for Human-Robot Interaction. Cambridge University Press. ISSN 000-0-000-00000-0. doi: ISBN%209781009386661.
  • Saplacan, Diana (2022). Robots as Welfare Technologies to Reduce Falls Amongst Older Adults: An Explorative Study from Norway.
  • Saplacan, Diana (2022). Tutorial presentation. Title: "Robots and Society: Challenges and Opportunities within social Human-Robot Interaction" at 31st IEEE International Conference on Robot & Human Interactive Communication.
  • Saplacan, Diana (2022). What do we talk about when we talk about social robots vs. robot sociomorphism ? Empirical examples from previous and ongoing research.
  • Saplacan, Diana (2022). Guest Lecture: Ongoing research with Social and Assistive Robots: Research projects, empirical examples, and theory.
  • Saplacan, Diana (2022). TIAGo wishes you welcome to a debate on the theme: Should a robot be involved in care tasks? (Norwegian title: TIAGo ønsker velkommen til en debatt med tema: Bør en robot involveres i omsorgsoppgaver?).
  • Saplacan, Diana; Baselizadeh, Adel & Tørresen, Jim (2022). Robot Demonstration: Meet TIAGo the robot! The robot showcases several tasks: brushing hair, putting the lipstick on, using a (plastic) knife, moving an object, carrying a bag.
  • Saplacan, Diana (2022). Ethics: Autonomous Technologies for All (ATA)?
  • Tørresen, Jim & Nakasawa, Atsushi (2022). Tutorial: Ethical Considerations in User Modeling and Personalization (ECUMAP).
  • Tørresen, Jim (2022). Research on health-related treatment and care technology – A technical and ethical view.
  • Tørresen, Jim; Atsushi, Nazawa; Saplacan, Diana; Prestes, Edson; Mahler, Tobias & Weng, Yueh-Hsuan (2022). Tutorial at IROS 2022 - Ethical, Legal and User Perspectives on Robots and Systems (ELAUPORAS) – Assessments and Potential Measures.
  • Tørresen, Jim (2022). Sensing, acting and adapting in the real world.
  • Tørresen, Jim (2022). Ethical Perspectives of Robotics and AI – How to develop preferable system? .
  • Tørresen, Jim (2022). Research Ethics in AI and Robotics.
  • Tørresen, Jim (2022). Tutorial: Ethical challenges for Autonomous and Multiagent Systems.
  • Tørresen, Jim (2022). Keynote: Multi-Modal Sensing for Care Robots for Older People.
  • Tørresen, Jim (2022). Tutorial: Ethical Challenges in Computational Intelligence Research.
  • Saplacan, Diana (2022). Ongoing research with Social and Assistive Robots - Presentation for the National Commitee in Research Ethics in Science and Technology (NENT).
  • Saplacan, Diana; Tørresen, Jim; Weng, Yueh-Hsuan & Li, Phoebe (2022). Tutorial: Robots and Society (RO-SO 2022) / Ethical perspectives and technical challenges and opportunities with care robots.
  • Saplacan, Diana (2022). Ethical Issues in Mobile Robots - Guest Lecture for Norwegian University of Life Sciences (NMBU), at the Faculty of Science and Technology, part of Human-Robot Interaction Course, Advanced Topics in Mobile robots.
  • Cheung, Anne; Saplacan, Diana; Pietropaoli, Stefano & Weng, Yueh-Hsuan (2022). SORO – INTERDISCIPLINARY WORKSHOP ON THE GOVERNANCE FOR SOCIAL ROBOTS (HALF DAY).
  • Saplacan, Diana (2022). Participatory Design and Human-Robot Interaction - An ethical and inclusive perspective on contemporary technologies.
  • Saplacan, Diana (2022). Healthcare Professionals’ Attitudes towards the Organization of Care Services and the Adoption of Welfare Robots in Norway.
  • Dahl, Heidi Elisabeth Iuell; Mehmandarov, Rustam Karim; Harkestad, Inge & Saplacan, Diana (2022). AI and Ethics workshop.
  • van Otterdijk, Marieke (2021). De Kennis van Nu” (The knowledge of now). [TV]. Dutch national TV (NPO).
  • Tørresen, Jim (2021). How to achieve ethical artificial intelligence (AI) research and development?
  • Saplacan, Diana (2021). Ethics and Technology.
  • Saplacan, Diana; Tørresen, Jim; Mahler, Tobias & Fosch-Villaronga, Eduard (2021). Robots and Society: Ethical, Legal, and Technical Perspectives on Integrating Robots in the Home- and Healthcare Systems and Services (RO-SO).
  • Saplacan, Diana; Khaksar, Weria & Tørresen, Jim (2021). On Ethical Challenges Raised by Care Robots: A Review of the Existing Regulatory-, Theoretical-, and Research Gaps.
  • Noori, Farzan Majeed (2021). Recognition of Human Activities using UWB Radar and Deep Learning.
  • Tørresen, Jim (2021). Tutorial: Ethical Considerations in User Modeling and Personalization.
  • Tørresen, Jim (2021). Kunstig intelligens – allsidig i metoder og anvendelser.
  • Tørresen, Jim (2021). Tutorial: Explainability, Trust and Ethics for Robots and Autonomous Systems.
  • Tørresen, Jim (2021). Tutorial: Intelligent System Research – AI Ethical Challenges and Opportunities.
  • Tørresen, Jim (2021). INTROMAT: INtroducing personalized TReatment Of Mental health problems using Adaptive Technology.
  • Tørresen, Jim (2021). Tutorial: Ethical Considerations in Robotics and Automation.
  • Tørresen, Jim; Saplacan, Diana; Lintvedt, Mona Naomi; Mahler, Tobias & Fosch-Villaronga, Eduard (2021). Tutorial: Ethical and Legal Assessments Related to Robots and Systems .
  • Saplacan, Diana (2021). Challenges and Opportunities with AI-based Care Robots: An Ethical and Inclusive Approach.
  • Tørresen, Jim (2021). Introducing a Multimodal Elderly Care Safety Alarm Robot.
  • Tørresen, Jim (2021). Tutorial: Ethical Considerations in the Development and Use of Neural Information Processing Systems.
  • Tørresen, Jim (2020). Addressing ethical challenges within evolutionary computation applications: GECCO 2020 tutorial. In Coello Coello, Carlos A. (Eds.), GECCO '20: Proceedings of the 2020 Genetic and Evolutionary Computation Conference Companion. Association for Computing Machinery (ACM). ISSN 978-1-4503-7127-8. p. 1206–1223. doi: https:/doi-org.ezproxy.uio.no/10.1145/3377929.3389894.
  • Tørresen, Jim (2020). Ethical Considerations in User Modeling and Personalization: ACM UMAP 2020 Tutorial. In Kuflik, Tsvi; Torre, Ilaria & Burke, Robin (Ed.), Proceedings of the 28th ACM Conference on User Modeling, Adaptation and Personalization. Association for Computing Machinery (ACM). ISSN 978-1-4503-6861-2. p. 390–391.
  • Tørresen, Jim (2020). Intelligent Robots and Systems for Foundational and Applied Healthcare Research.
  • Tørresen, Jim (2020). Interdisciplinary Research Collaboration in Rhythm, Time and Motion.
  • Tørresen, Jim (2020). Tutorial: Ethical Considerations in User Modeling and Personalization.
  • Tørresen, Jim (2020). Sensing Human State with Application in Older People Care and Mental Health Treatment.
  • Noori, Farzan Majeed; Uddin, Md Zia & Tørresen, Jim (2020). Presentation on In-Home Emergency Detection Using an Ambient Ultra-Wideband Radar Sensor and Deep Learning.
  • Tørresen, Jim (2020). Tutorial: Addressing Ethical Challenges within Evolutionary Computation Applications.
  • Tørresen, Jim; Kurazume, Ryo & Prestes, Edson (2020). Guest Editorial: Special Issue on Elderly Care Robotics – Technology and Ethics . Journal of Intelligent and Robotic Systems. ISSN 0921-0296. 98, p. 3–4. doi: 10.1007/s10846-020-01148-6.
  • Tørresen, Jim (2020). Tutorial: Ethical Challenges and Opportunities within Computational Intelligence System Development.
  • Tørresen, Jim (2020). Addressing Ethical Challenges for Care Giving Robots.
  • Tørresen, Jim (2020). Ethical Consideration in Robotics and Intelligent Systems Research.
  • Uddin, Md Zia (2019). Activity Recognition Using Smartphone Sensors, Robust Features, and Recurrent Neural Network.
  • Saplacan, Diana (2019). User involvement in design.
  • Noori, Farzan Majeed; Tørresen, Jim; Uddin, Md Zia & Riegler, Michael A. (2023). Multimodal Deep Learning Approaches for Human Activity recognition. Universitetet i Oslo. ISSN 1501-7710. Full text in Research Archive
  • Soma, Rebekka; Saplacan, Diana & Sikora, Magdalena Claudia (2022). Exploring personality and behavior with a robot table - a qualitative case study. Universitetet i Oslo.
  • Wang, Lina; Tørresen, Jim & Noori, Farzan Majeed (2021). Emergency Monitoring of Older People Using Multiple Sensors with Privacy in Consideration. Universitetet i Oslo.
  • Orten, Mathias Kramer & Tørresen, Jim (2021). Machine Ethics for Autonomous systems – Learning verifiable rules from the environment. Universitetet i Oslo.
  • Schulz, Trenton Wade (2020). Exploration of Moving Things in the Home. Universitetet i Oslo. ISSN 1501-7710.

View all works in Cristin

Published May 24, 2016 3:39 PM - Last modified Mar. 25, 2021 8:29 AM

Contact

Participants

Detailed list of participants