Norwegian version of this page

Multimodal Elderly Care Systems (MECS)

About the project

The number of elderly people living at home is increasing and this trend is expected to continue. The challenge then would be how to provide technology that can handle the complex and different environments found in homes. Further, technology can easily be seen as a threat to privacy and lack of interpersonal contact. This project addresses these issues by user centered design of robotic systems and the development of adaptive technology. A part of this will be to demonstrate the benefits regarding both performance and privacy being improved by applying sensors like cameras on a robot companion rather than having them permanently mounted in a home. These would be used for detecting falls and other non-normal situations. Using new sensor technology, we would also like to explore if it is possible to remotely monitor medical states like pulse, breathing etc. Rather than having elderly themselves activating their personal security alarm in the case of an emergency situation, a target of this project is to demonstrate automatic activation. Many systems for elderly have been designed but few have been adopted on a large scale. We think a key reason for this is limited user involvement and few iterations of user testing. Therefore, we will focus specifically on developing our systems with a large degree of user participation.

In this project, a robot companion moves in a residential environment in the presence of unknown static and dynamic obstacles. Thus, having an effective and efficient control architecture, plays an important role in the achievement of the project objectives.

Objectives

Create and evaluate multimodal mobile human supportive systems that are able to sense, learn and predict future events.

Financing

Research Council of Norway 2015–2019, IKTPLUSS, One PhDs and two post-doc (10% of proposals in the call were funded)

Cooperation

Tools

Publications

  • Saplacan, Diana & Tørresen, Jim (2022). Robots as Welfare Technologies to Reduce Falls Amongst Older Adults: An Explorative Study from Norway, Human Aspects of IT for the Aged Population. Technology in Everyday Living. Lecture Notes in Computer Science. LNCS 13331. Springer Nature Switzerland AG. ISSN 978-3-031-05654-3. p. 88–106.
  • Mantelli, Mathias; Pittol, Diego; Maffei, Renan; Tørresen, Jim; Prestes, Edson & Kolberg, Mariana (2021). Semantic Active Visual Search System Based on Text Information for Large and Unknown Environments. Journal of Intelligent and Robotic Systems. ISSN 0921-0296. 101(2). doi: 10.1007/s10846-020-01298-7.
  • Schulz, Trenton Wade; Soma, Rebekka & Holthaus, Patrick (2021). Movement acts in breakdown situations: How a robot's recovery procedure affects participants' opinions. Paladyn - Journal of Behavioral Robotics. ISSN 2080-9778. 12(1), p. 336–355. doi: 10.1515/pjbr-2021-0027. Full text in Research Archive
  • Khaksar, Weria; Neggers, Margot; Barakova, Emilia Ivanova & Tørresen, Jim (2021). Generation Differences in Perception of the Elderly Care Robot. In Caleb-Solly, Praminda; Ghafurian, Moojan; Johnson, Michelle & Wada, Kazuyoshi (Ed.), Proceedings of the 30th IEEE International Conference on Robot & Human Interactive Communication (ROMAN). IEEE (Institute of Electrical and Electronics Engineers). ISSN 978-1-6654-0492-1. p. 551–558. doi: 10.1109/RO-MAN50785.2021.9515534.
  • van Otterdijk, Marieke; Neggers, Margot; Tørresen, Jim & Barakova, Emilia Ivanova (2021). Preferences of Seniors for Robots Delivering a Message With Congruent Approaching Behavior, Proceedings of the 2021 IEEE International Conference on Advanced Robotics and Its Social Impacts (ARSO) Virtual Conference, July 8-10, 2021. IEEE Robotics and Automation Society. ISSN 978-1-6654-4952-6. doi: 10.1109/ARSO51874.2021.9542833.
  • Saplacan, Diana; Khaksar, Weria & Tørresen, Jim (2021). On Ethical Challenges Raised by Care Robots: A Review of the Existing Regulatory-, Theoretical-, and Research Gaps, Proceedings of the 2021 IEEE International Conference on Advanced Robotics and Its Social Impacts (ARSO) Virtual Conference, July 8-10, 2021. IEEE Robotics and Automation Society. ISSN 978-1-6654-4952-6. p. 219–226. doi: 10.1109/ARSO51874.2021.9542844.
  • Noori, Farzan Majeed; Uddin, Md Zia & Tørresen, Jim (2021). Ultra-Wideband Radar-Based Activity Recognition Using Deep Learning. IEEE Access. ISSN 2169-3536. 9, p. 138132–138143. doi: 10.1109/ACCESS.2021.3117667. Full text in Research Archive
  • Tørresen, Jim (2021). Undertaking Research with Humans within Artificial Intelligence and Robotics: Multimodal Elderly Care Systems. Technology Architecture + Design (TAD). ISSN 2475-1448. 5(2), p. 141–145. doi: 10.1080/24751448.2021.1967052.
  • Herstad, Jo; Schulz, Trenton Wade & Saplacan, Diana (2021). T-able: An Investigation of Habituating Moving Tables at Home . In Verma, Ira (Eds.), Universal Design 2021: From Special to Mainstream Solutions. IOS Press. ISSN 978-1-64368-190-0. p. 238–251. doi: 10.3233/SHTI210400.
  • Woll, Anita & Tørresen, Jim (2020). Bridging the User Barriers of Home Telecare. Advances in Intelligent Systems and Computing. ISSN 2194-5357. 1069, p. 816–835. doi: 10.1007/978-3-030-32520-6_59.
  • Noori, Farzan; Riegler, Michael; Uddin, Md Zia & Tørresen, Jim (2020). Human Activity Recognition from Multiple Sensors Data Using Multi-Fusion Representations and CNNs. ACM Transactions on Multimedia Computing, Communications, and Applications (TOMCCAP). ISSN 1551-6857. 16(2). doi: 10.1145/3377882.
  • Saplacan, Diana; Herstad, Jo & Schulz, Trenton Wade (2020). Situated Abilities within Universal Design – A Theoretical Exploration. International Journal on Advances in Intelligent Systems. ISSN 1942-2679. 13(34), p. 278–291. Full text in Research Archive
  • Uddin, Md Zia; Noori, Farzan Majeed & Tørresen, Jim (2020). In-Home Emergency Detection Using an Ambient Ultra-Wideband Radar Sensor and Deep Learning. In Noori, Farzan Majeed (Eds.), IEEE 10th International Conference on Ultrawideband and Ultrashort Impulse Signals (UWBUSIS). IEEE (Institute of Electrical and Electronics Engineers). ISSN 978-1-7281-7314-6. p. 1089–1093. doi: 10.1109/UkrMW49653.2020.9252708.
  • Saplacan, Diana; Herstad, Jo & Pajalic, Zada (2020). An Analysis of Independent Living Elderly’s Views on Robots: A Descriptive Study from the Norwegian Context. In Mauri, Lloret, James; Saplacan, Diana; Carcani, Klaudia; Ardiansyah, Prima Oky Dicky & Vasilache, Simona (Ed.), ACHI 2020, The Thirteenth International Conference on Advances in Computer-Human Interactions. International Academy, Research and Industry Association (IARIA). ISSN 978-1-61208-761-0. p. 199–208. Full text in Research Archive
  • Saplacan, Diana; Herstad, Jo; Tørresen, Jim & Pajalic, Zada (2020). A Framework on Division of Work Tasks between Humans and Robots in the Home. Multimodal Technologies and Interaction. ISSN 2414-4088. 4(3). doi: 10.3390/mti4030044. Full text in Research Archive
  • Khaksar, Weria; Uddin, Md Zia & Tørresen, Jim (2019). Neuro-Fuzzy Sampling: Safe and fast multi-query randomized path planning for mobile robots. Communications in Computer and Information Science. ISSN 1865-0929. 1015, p. 13–27. doi: 10.1007/978-981-13-7780-8_2.
  • Khaksar, Weria; Uddin, Md Zia & Tørresen, Jim (2019). Multi-Query Motion Planning in Uncertain Spaces: Incremental Adaptive Randomized Roadmaps. International Journal of Applied Mathematics and Computer Science. ISSN 1641-876X. 29(4), p. 641–654. doi: 10.2478/amcs-2019-0047. Full text in Research Archive
  • Schulz, Trenton Wade; Tørresen, Jim & Herstad, Jo (2019). Animation Techniques in Human-Robot Interaction User Studies: A Systematic Literature Review. ACM Transactions on Human-Robot Interaction. ISSN 2573-9522. 8(2). doi: 10.1145/3317325.
  • Noori, Farzan Majeed; Wallace, Benedikte; Uddin, Md Zia & Tørresen, Jim (2019). A Robust Human Activity Recognition Approach Using OpenPose, Motion Features, and Deep Recurrent Neural Network. Lecture Notes in Computer Science (LNCS). ISSN 0302-9743. 11482 LNCS, p. 299–310. doi: 10.1007/978-3-030-20205-7_25.
  • Uddin, Md Zia; Khaksar, Weria & Tørresen, Jim (2019). A Thermal Camera-based Activity Recognition Using Discriminant Skeleton Features and RNN, The 17th IEEE International Conference on Industrial Informatics (IEEE-INDIN 2019): Proceedings. IEEE (Institute of Electrical and Electronics Engineers). ISSN 9781-7281-2927-3. doi: 10.1109/INDIN41052.2019.8972082.
  • Saplacan, Diana & Herstad, Jo (2019). An Explorative Study on Motion as Feedback: Using Semi-Autonomous Robots in Domestic Settings. International Journal On Advances in Software. ISSN 1942-2628. 12(1&2), p. 68–90.
  • Khaksar, Weria; Uddin, Md Zia & Tørresen, Jim (2019). Fuzzy Motion Planning for Nonholonomic Mobile Robot Navigation in Unknown Indoor Environments. International Journal of Mechanical Engineering and Robotics Research (IJMERR). ISSN 2278-0149. 8(1), p. 6–11. doi: 10.18178/ijmerr.8.1.6-11.
  • Noori, Farzan Majeed; Uddin, Md Zia & Tørresen, Jim (2019). Robot-Care for the Older People: Ethically Justified or Not? Proceedings of the 9th Joint IEEE International Conference on Development and Learning and on Epigenetic Robotics. IEEE (Institute of Electrical and Electronics Engineers). ISSN 978-1-5386-8129-9. p. 43–47. doi: 10.1109/DEVLRN.2019.8850706.
  • Noori, Farzan Majeed; Garcia-Ceja, Enrique; Uddin, Md Zia; Riegler, Michael & Tørresen, Jim (2019). Fusion of Multiple Representations Extracted from a Single Sensor’s Data for Activity Recognition Using CNNs. In Jayne, Chrisina & Somogyvári, Zoltán (Ed.), 2019 International Joint Conference on Neural Networks (IJCNN) . IEEE (Institute of Electrical and Electronics Engineers). ISSN 978-1-7281-1985-4. doi: 10.1109/IJCNN.2019.8851898.
  • Rokkones, Anders Skibeli; Uddin, Md Zia & Tørresen, Jim (2019). Facial Expression Recognition Using Robust Local Directional Strength Pattern Features and Recurrent Neural Network, 9TH IEEE INTERNATIONAL CONFERENCE ON CONSUMER ELECTRONICS. IEEE (Institute of Electrical and Electronics Engineers). ISSN 978-1-7281-2745-3. p. 283–288. doi: 10.1109/ICCE-Berlin47944.2019.8966234.
  • Saplacan, Diana & Herstad, Jo (2019). Understanding Robot Motion in Domestic Settings, Proceedings of the 9th Joint IEEE International Conference on Development and Learning and on Epigenetic Robotics. IEEE (Institute of Electrical and Electronics Engineers). ISSN 978-1-5386-8129-9. p. 67–74. doi: 10.1109/DEVLRN.2019.8850695.

View all works in Cristin

  • Saplacan, Diana (2022). Participatory Design and Human-Robot Interaction - An ethical and inclusive perspective on contemporary technologies.
  • Saplacan, Diana (2022). Healthcare Professionals’ Attitudes towards the Organization of Care Services and the Adoption of Welfare Robots in Norway.
  • Dahl, Heidi Elisabeth Iuell; Mehmandarov, Rustam Karim; Harkestad, Inge & Saplacan, Diana (2022). AI and Ethics workshop.
  • Saplacan, Diana (2022). Ethics: Autonomous Technologies echnologies for All (ATA)?
  • Saplacan, Diana (2022). Tutorial presentation. Title: "Robots and Society: Challenges and Opportunities within social Human-Robot Interaction" at 31st IEEE International Conference on Robot & Human Interactive Communication.
  • Saplacan, Diana (2022). Robots as Welfare Technologies to Reduce Falls Amongst Older Adults: An Explorative Study from Norway.
  • Saplacan, Diana; Tørresen, Jim; Mahler, Tobias & Fosch-Villaronga, Eduard (2021). Robots and Society: Ethical, Legal, and Technical Perspectives on Integrating Robots in the Home- and Healthcare Systems and Services (RO-SO).
  • Tørresen, Jim (2021). Tutorial: Ethical Considerations in Robotics and Automation.
  • Tørresen, Jim (2021). Kunstig intelligens – allsidig i metoder og anvendelser.
  • Tørresen, Jim (2021). Tutorial: Explainability, Trust and Ethics for Robots and Autonomous Systems.
  • Tørresen, Jim (2021). Tutorial: Intelligent System Research – AI Ethical Challenges and Opportunities.
  • Tørresen, Jim (2021). INTROMAT: INtroducing personalized TReatment Of Mental health problems using Adaptive Technology.
  • Tørresen, Jim; Saplacan, Diana; Lintvedt, Mona Naomi; Mahler, Tobias & Fosch-Villaronga, Eduard (2021). Tutorial: Ethical and Legal Assessments Related to Robots and Systems .
  • Tørresen, Jim (2021). Tutorial: Ethical Considerations in User Modeling and Personalization.
  • Saplacan, Diana; Khaksar, Weria & Tørresen, Jim (2021). On Ethical Challenges Raised by Care Robots: A Review of the Existing Regulatory-, Theoretical-, and Research Gaps.
  • Saplacan, Diana (2021). Ethics and Technology.
  • van Otterdijk, Marieke (2021). De Kennis van Nu” (The knowledge of now). [TV]. Dutch national TV (NPO).
  • Tørresen, Jim (2021). How to achieve ethical artificial intelligence (AI) research and development?
  • Noori, Farzan Majeed (2021). Recognition of Human Activities using UWB Radar and Deep Learning.
  • Saplacan, Diana (2021). Challenges and Opportunities with AI-based Care Robots: An Ethical and Inclusive Approach.
  • Tørresen, Jim (2021). Introducing a Multimodal Elderly Care Safety Alarm Robot.
  • Tørresen, Jim (2021). Tutorial: Ethical Considerations in the Development and Use of Neural Information Processing Systems.
  • Tørresen, Jim (2020). Addressing Ethical Challenges for Care Giving Robots.
  • Tørresen, Jim (2020). Ethical Consideration in Robotics and Intelligent Systems Research.
  • Tørresen, Jim (2020). Tutorial: Ethical Challenges and Opportunities within Computational Intelligence System Development.
  • Tørresen, Jim (2020). Tutorial: Addressing Ethical Challenges within Evolutionary Computation Applications.
  • Tørresen, Jim (2020). Interdisciplinary Research Collaboration in Rhythm, Time and Motion.
  • Tørresen, Jim (2020). Tutorial: Ethical Considerations in User Modeling and Personalization.
  • Tørresen, Jim (2020). Sensing Human State with Application in Older People Care and Mental Health Treatment.
  • Noori, Farzan Majeed; Uddin, Md Zia & Tørresen, Jim (2020). Presentation on In-Home Emergency Detection Using an Ambient Ultra-Wideband Radar Sensor and Deep Learning.
  • Tørresen, Jim (2020). Intelligent Robots and Systems for Foundational and Applied Healthcare Research.
  • Tørresen, Jim; Kurazume, Ryo & Prestes, Edson (2020). Guest Editorial: Special Issue on Elderly Care Robotics – Technology and Ethics . Journal of Intelligent and Robotic Systems. ISSN 0921-0296. 98, p. 3–4. doi: 10.1007/s10846-020-01148-6.
  • Tørresen, Jim (2020). Ethical Considerations in User Modeling and Personalization: ACM UMAP 2020 Tutorial. In Kuflik, Tsvi; Torre, Ilaria & Burke, Robin (Ed.), Proceedings of the 28th ACM Conference on User Modeling, Adaptation and Personalization. Association for Computing Machinery (ACM). ISSN 978-1-4503-6861-2. p. 390–391.
  • Tørresen, Jim (2020). Addressing ethical challenges within evolutionary computation applications: GECCO 2020 tutorial. In Coello Coello, Carlos A. (Eds.), GECCO '20: Proceedings of the 2020 Genetic and Evolutionary Computation Conference Companion. Association for Computing Machinery (ACM). ISSN 978-1-4503-7127-8. p. 1206–1223. doi: https%3A/doi-org.ezproxy.uio.no/10.1145/3377929.3389894.
  • Saplacan, Diana (2019). Understanding Robot Motion in Domestic Settings.
  • Tørresen, Jim (2019). Intelligent and Adaptive Robots in Real-World Environment.
  • Miura, Jun & Tørresen, Jim (2019). Intelligent Robot Technologies for Care and Lifestyle Support .
  • Tørresen, Jim (2019). Intelligent Robots and Systems in Real-World Environment.
  • Tørresen, Jim (2019). Making Robots Adaptive and Preferable to Humans.
  • Soma, Rebekka (2019). Movement as interaction mechanism.
  • Uddin, Md Zia (2019). Activity Recognition Using Smartphone Sensors, Robust Features, and Recurrent Neural Network.
  • Uddin, Md Zia (2019). A Thermal Camera-based Activity Recognition Using Discriminant Skeleton Features and RNN.
  • Tørresen, Jim; Glette, Kyrre & Ellefsen, Kai Olav (2019). Intelligent, Adaptive Robots in Real-World Scenarios.
  • Tørresen, Jim; Glette, Kyrre & Ellefsen, Kai Olav (2019). Adaptive Robot Body and Control for Real-World Environments.
  • Saplacan, Diana (2019). From fieldwork to concepts: a walk through some of my experiences in doing qualitative research.
  • Saplacan, Diana (2019). A introduction to robots and qualitative research: Learnings from Multimodal Elderly Care System (MECS) project.
  • Rokkones, Anders Skibeli; Uddin, Md Zia & Torresen, Jim (2019). Facial Expression Recognition Using Robust Local Directional Strength Pattern Features and Recurrent Neural Network.
  • Saplacan, Diana (2019). From fieldwork to concepts: a walk through my experiences in doing qualitative research.
  • Saplacan, Diana (2019). User involvement in design.
  • Tørresen, Jim (2019). Design and Control of Robots for Real-World Environment.
  • Tørresen, Jim (2019). Introduction to Different Challenges in Ethical AI and Possible Ways of Addressing Them.
  • Tørresen, Jim (2019). Future and Ethical Perspectives of Robotics and AI.
  • Tørresen, Jim (2019). Artificial Intelligence and Applications in Health and Care .
  • Tørresen, Jim (2019). Ethical Considerations for Healthcare Robots.
  • Tørresen, Jim (2019). Sensing Human State with Application in Older People Care and Mental Health Treatment.
  • Soma, Rebekka; Saplacan, Diana & Sikora, Magdalena Claudia (2022). Exploring personality and behavior with a robot table - a qualitative case study. Reprosentralen, University of Oslo.
  • Orten, Mathias Kramer & Tørresen, Jim (2021). Machine Ethics for Autonomous systems – Learning verifiable rules from the environment. Universitetet i Oslo.
  • Wang, Lina; Tørresen, Jim & Noori, Farzan Majeed (2021). Emergency Monitoring of Older People Using Multiple Sensors with Privacy in Consideration. Universitetet i Oslo.
  • Schulz, Trenton Wade (2020). Exploration of Moving Things in the Home. Universitetet i Oslo. ISSN 1501-7710.
  • Refsum, Vetle Kind; Khaksar, Weria & Tørresen, Jim (2019). Human aware navigation and reaction for a mobile service robot with a LIDAR unit. Universitetet i Oslo.
  • Maartmann-Moe, Harald & Herstad, Jo (2019). These Things Take Time: Unhurried explorations and independent prototypes In participatory design with older adults. Universitetet i Oslo.
  • Lappyová, Veronika; Khaksar, Weria & Tørresen, Jim (2019). Development and implementation of human detection and following method on a mobile robot. Universitetet i Oslo.

View all works in Cristin

Published May 24, 2016 3:39 PM - Last modified Mar. 25, 2021 8:29 AM