Norwegian version of this page

Multimodal Elderly Care Systems (MECS)

About the project

The number of elderly people living at home is increasing and this trend is expected to continue. The challenge then would be how to provide technology that can handle the complex and different environments found in homes. Further, technology can easily be seen as a threat to privacy and lack of interpersonal contact. This project addresses these issues by user centered design of robotic systems and the development of adaptive technology. A part of this will be to demonstrate the benefits regarding both performance and privacy being improved by applying sensors like cameras on a robot companion rather than having them permanently mounted in a home. These would be used for detecting falls and other non-normal situations. Using new sensor technology, we would also like to explore if it is possible to remotely monitor medical states like pulse, breathing etc. Rather than having elderly themselves activating their personal security alarm in the case of an emergency situation, a target of this project is to demonstrate automatic activation. Many systems for elderly have been designed but few have been adopted on a large scale. We think a key reason for this is limited user involvement and few iterations of user testing. Therefore, we will focus specifically on developing our systems with a large degree of user participation.

In this project, a robot companion moves in a residential environment in the presence of unknown static and dynamic obstacles. Thus, having an effective and efficient control architecture, plays an important role in the achievement of the project objectives.

Objectives

Create and evaluate multimodal mobile human supportive systems that are able to sense, learn and predict future events.

Financing

Research Council of Norway 2015–2019, IKTPLUSS, One PhDs and two post-doc (10% of proposals in the call were funded)

Cooperation

Tools

Publications

  • van Otterdijk, Marieke; Neggers, Margot; Tørresen, Jim & Barakova, Emilia Ivanova (2021). Preferences of Seniors for Robots Delivering a Message With Congruent Approaching Behavior, Proceedings of the 2021 IEEE International Conference on Advanced Robotics and Its Social Impacts (ARSO) Virtual Conference, July 8-10, 2021. IEEE Robotics and Automation Society. ISSN 978-1-6654-4952-6.
  • Saplacan, Diana; Khaksar, Weria & Tørresen, Jim (2021). On Ethical Challenges Raised by Care Robots: A Review of the Existing Regulatory-, Theoretical-, and Research Gaps, Proceedings of the 2021 IEEE International Conference on Advanced Robotics and Its Social Impacts (ARSO) Virtual Conference, July 8-10, 2021. IEEE Robotics and Automation Society. ISSN 978-1-6654-4952-6. p. 219–226.
  • Mantelli, Mathias; Pittol, Diego; Maffei, Renan; Tørresen, Jim; Prestes, Edson & Kolberg, Mariana (2021). Semantic Active Visual Search System Based on Text Information for Large and Unknown Environments. Journal of Intelligent and Robotic Systems. ISSN 0921-0296. 101(2). doi: 10.1007/s10846-020-01298-7
  • Herstad, Jo; Schulz, Trenton Wade & Saplacan, Diana (2021). T-able: An Investigation of Habituating Moving Tables at Home . In Verma, Ira (Eds.), Universal Design 2021: From Special to Mainstream Solutions. IOS Press. ISSN 978-1-64368-190-0. p. 238–251. doi: 10.3233/SHTI210400
  • Khaksar, Weria; Neggers, Margot; Barakova, Emilia Ivanova & Tørresen, Jim (2021). Generation Differences in Perception of the Elderly Care Robot. In Caleb-Solly, Praminda; Ghafurian, Moojan; Johnson, Michelle & Wada, Kazuyoshi (Ed.), Proceedings of the 30th IEEE International Conference on Robot & Human Interactive Communication (ROMAN). IEEE. ISSN 978-1-6654-0492-1. p. 551–558. doi: 10.1109/RO-MAN50785.2021.9515534
  • Schulz, Trenton Wade; Soma, Rebekka & Holthaus, Patrick (2021). Movement acts in breakdown situations: How a robot's recovery procedure affects participants' opinions. Paladyn - Journal of Behavioral Robotics. ISSN 2080-9778. 12(1), p. 336–355. doi: 10.1515/pjbr-2021-0027 Full text in Research Archive
  • Saplacan, Diana; Herstad, Jo & Pajalic, Zada (2020). An Analysis of Independent Living Elderly’s Views on Robots: A Descriptive Study from the Norwegian Context. In Mauri, Lloret, James; Saplacan, Diana; Carcani, Klaudia; Ardiansyah, Prima Oky Dicky & Vasilache, Simona (Ed.), ACHI 2020, The Thirteenth International Conference on Advances in Computer-Human Interactions. International Academy, Research and Industry Association (IARIA). ISSN 978-1-61208-761-0. p. 199–208. Full text in Research Archive
  • Noori, Farzan; Riegler, Michael; Uddin, Md Zia & Tørresen, Jim (2020). Human Activity Recognition from Multiple Sensors Data Using Multi-Fusion Representations and CNNs. ACM Transactions on Multimedia Computing, Communications, and Applications (TOMCCAP). ISSN 1551-6857. 16(2). doi: 10.1145/3377882
  • Saplacan, Diana; Herstad, Jo; Tørresen, Jim & Pajalic, Zada (2020). A Framework on Division of Work Tasks between Humans and Robots in the Home. Multimodal Technologies and Interaction. ISSN 2414-4088. 4(3). doi: 10.3390/mti4030044 Full text in Research Archive
  • Saplacan, Diana; Herstad, Jo & Schulz, Trenton Wade (2020). Situated Abilities within Universal Design – A Theoretical Exploration. International Journal on Advances in Intelligent Systems. ISSN 1942-2679. 13(34), p. 278–291. Full text in Research Archive
  • Uddin, Md Zia; Noori, Farzan Majeed & Tørresen, Jim (2020). In-Home Emergency Detection Using an Ambient Ultra-Wideband Radar Sensor and Deep Learning. In Noori, Farzan Majeed (Eds.), IEEE 10th International Conference on Ultrawideband and Ultrashort Impulse Signals (UWBUSIS). IEEE. ISSN 978-1-7281-7314-6. p. 1089–1093. doi: 10.1109/UkrMW49653.2020.9252708
  • Woll, Anita & Tørresen, Jim (2020). Bridging the User Barriers of Home Telecare. Advances in Intelligent Systems and Computing. ISSN 2194-5357. 1069, p. 816–835. doi: 10.1007/978-3-030-32520-6_59
  • Khaksar, Weria; Uddin, Md Zia & Tørresen, Jim (2019). Fuzzy Motion Planning for Nonholonomic Mobile Robot Navigation in Unknown Indoor Environments. International Journal of Mechanical Engineering and Robotics Research (IJMERR). ISSN 2278-0149. 8(1), p. 6–11. doi: 10.18178/ijmerr.8.1.6-11
  • Schulz, Trenton Wade; Holthaus, Patrick; Amirabdollahian, Farshid; Koay, Kheng Lee; Tørresen, Jim & Herstad, Jo (2019). Differences of Human Perceptions of a Robot Moving using Linear or Slow in, Slow out Velocity Profiles When Performing a Cleaning Task. In Cabibihan, John-John; Mary Anne, Williams; Asokan, T & Behera, Laxmidhar (Ed.), 2019 28th IEEE International Conference on Robot and Human Interactive Communication (RO-MAN). IEEE. ISSN 978-1-7281-2622-7. doi: 10.1109/RO-MAN46459.2019.8956355
  • Schulz, Trenton Wade; Tørresen, Jim & Herstad, Jo (2019). Animation Techniques in Human-Robot Interaction User Studies: A Systematic Literature Review. ACM Transactions on Human-Robot Interaction. ISSN 2573-9522. 8(2). doi: 10.1145/3317325
  • Bråthen, Heidi; Maartmann-Moe, Harald & Schulz, Trenton Wade (2019). The Role of Physical Prototyping in Participatory Design with Older Adults. In Kokil, Uttam & Ota, Tomoko (Ed.), ACHI 2019, The Twelfth International Conference on Advances in Computer-Human Interactions. International Academy, Research and Industry Association (IARIA). ISSN 978-1-61208-686-6. p. 141–146. Full text in Research Archive
  • Uddin, Md Zia; Khaksar, Weria & Tørresen, Jim (2019). A Thermal Camera-based Activity Recognition Using Discriminant Skeleton Features and RNN, The 17th IEEE International Conference on Industrial Informatics (IEEE-INDIN 2019): Proceedings. IEEE. ISSN 9781-7281-2927-3. doi: 10.1109/INDIN41052.2019.8972082
  • Saplacan, Diana & Herstad, Jo (2019). Understanding Robot Motion in Domestic Settings, Proceedings of the 9th Joint IEEE International Conference on Development and Learning and on Epigenetic Robotics. IEEE. ISSN 978-1-5386-8129-9. p. 67–74. doi: 10.1109/DEVLRN.2019.8850695
  • Rokkones, Anders Skibeli; Uddin, Md Zia & Tørresen, Jim (2019). Facial Expression Recognition Using Robust Local Directional Strength Pattern Features and Recurrent Neural Network, 9TH IEEE INTERNATIONAL CONFERENCE ON CONSUMER ELECTRONICS. IEEE. ISSN 978-1-7281-2745-3. p. 283–288. doi: 10.1109/ICCE-Berlin47944.2019.8966234
  • Saplacan, Diana & Herstad, Jo (2019). An Explorative Study on Motion as Feedback: Using Semi-Autonomous Robots in Domestic Settings. International Journal On Advances in Software. ISSN 1942-2628. 12(1&2), p. 68–90.
  • Noori, Farzan Majeed; Garcia-Ceja, Enrique; Uddin, Md Zia; Riegler, Michael & Tørresen, Jim (2019). Fusion of Multiple Representations Extracted from a Single Sensor’s Data for Activity Recognition Using CNNs. In Jayne, Chrisina & Somogyvári, Zoltán (Ed.), 2019 International Joint Conference on Neural Networks (IJCNN) . IEEE. ISSN 978-1-7281-1985-4. doi: 10.1109/IJCNN.2019.8851898
  • Noori, Farzan Majeed; Uddin, Md Zia & Tørresen, Jim (2019). Robot-Care for the Older People: Ethically Justified or Not? Proceedings of the 9th Joint IEEE International Conference on Development and Learning and on Epigenetic Robotics. IEEE. ISSN 978-1-5386-8129-9. p. 43–47. doi: 10.1109/DEVLRN.2019.8850706
  • Noori, Farzan Majeed; Wallace, Benedikte; Uddin, Md Zia & Tørresen, Jim (2019). A Robust Human Activity Recognition Approach Using OpenPose, Motion Features, and Deep Recurrent Neural Network. Lecture Notes in Computer Science (LNCS). ISSN 0302-9743. 11482 LNCS, p. 299–310. doi: 10.1007/978-3-030-20205-7_25
  • Khaksar, Weria; Uddin, Md Zia & Tørresen, Jim (2019). Neuro-Fuzzy Sampling: Safe and fast multi-query randomized path planning for mobile robots. Communications in Computer and Information Science. ISSN 1865-0929. 1015, p. 13–27. doi: 10.1007/978-981-13-7780-8_2
  • Uddin, Md Zia; Khaksar, Weria & Tørresen, Jim (2018). Ambient Sensors for Elderly Care and Independent Living: A Survey . Sensors. ISSN 1424-8220. 18(7). doi: 10.3390/s18072027 Full text in Research Archive
  • Uddin, Md Zia (2018). A wearable sensor-based activity prediction system to facilitate edge computing in smart healthcare system. Journal of Parallel and Distributed Computing. ISSN 0743-7315. 123, p. 46–53. doi: 10.1016/j.jpdc.2018.08.010
  • Garcia Ceja, Enrique Alejandro; Uddin, Md Zia & Tørresen, Jim (2018). Classification of Recurrence Plots' Distance Matrices with a Convolutional Neural Network for Activity Recognition. Procedia Computer Science. ISSN 1877-0509. 130, p. 157–163. doi: 10.1016/j.procs.2018.04.025

View all works in Cristin

  • Saplacan, Diana (2021). Challenges and Opportunities with AI-based Care Robots: An Ethical and Inclusive Approach.
  • Tørresen, Jim (2021). Tutorial: Intelligent System Research – AI Ethical Challenges and Opportunities.
  • Tørresen, Jim (2021). Tutorial: Ethical Considerations in User Modeling and Personalization.
  • Tørresen, Jim (2021). Tutorial: Ethical Considerations in Robotics and Automation.
  • Tørresen, Jim (2021). Kunstig intelligens – allsidig i metoder og anvendelser.
  • Tørresen, Jim (2021). INTROMAT: INtroducing personalized TReatment Of Mental health problems using Adaptive Technology.
  • Tørresen, Jim (2021). Tutorial: Explainability, Trust and Ethics for Robots and Autonomous Systems.
  • Saplacan, Diana; Tørresen, Jim; Mahler, Tobias & Fosch-Villaronga, Eduard (2021). Robots and Society: Ethical, Legal, and Technical Perspectives on Integrating Robots in the Home- and Healthcare Systems and Services (RO-SO).
  • Tørresen, Jim; Saplacan, Diana; Lintvedt, Mona Naomi; Mahler, Tobias & Fosch-Villaronga, Eduard (2021). Tutorial: Ethical and Legal Assessments Related to Robots and Systems .
  • Noori, Farzan Majeed; Uddin, Md Zia & Tørresen, Jim (2021). Ultra-Wideband Radar-Based Activity Recognition Using Deep Learning. IEEE Access. ISSN 2169-3536. doi: 10.1109/ACCESS.2021.3117667
  • Noori, Farzan Majeed (2021). Recognition of Human Activities using UWB Radar and Deep Learning.
  • Tørresen, Jim (2020). Tutorial: Ethical Challenges and Opportunities within Computational Intelligence System Development.
  • Tørresen, Jim (2020). Ethical Consideration in Robotics and Intelligent Systems Research.
  • Noori, Farzan Majeed; Uddin, Md Zia & Tørresen, Jim (2020). Presentation on In-Home Emergency Detection Using an Ambient Ultra-Wideband Radar Sensor and Deep Learning.
  • Tørresen, Jim; Kurazume, Ryo & Prestes, Edson (2020). Guest Editorial: Special Issue on Elderly Care Robotics – Technology and Ethics . Journal of Intelligent and Robotic Systems. ISSN 0921-0296. 98, p. 3–4. doi: 10.1007/s10846-020-01148-6
  • Tørresen, Jim (2020). Addressing ethical challenges within evolutionary computation applications: GECCO 2020 tutorial. In Coello Coello, Carlos A. (Eds.), GECCO '20: Proceedings of the 2020 Genetic and Evolutionary Computation Conference Companion. Association for Computing Machinery (ACM). ISSN 978-1-4503-7127-8. p. 1206–1223. doi: https%3A/doi-org.ezproxy.uio.no/10.1145/3377929.3389894
  • Tørresen, Jim (2020). Ethical Considerations in User Modeling and Personalization: ACM UMAP 2020 Tutorial. In Kuflik, Tsvi; Torre, Ilaria & Burke, Robin (Ed.), Proceedings of the 28th ACM Conference on User Modeling, Adaptation and Personalization. Association for Computing Machinery (ACM). ISSN 978-1-4503-6861-2. p. 390–391.
  • Tørresen, Jim (2020). Sensing Human State with Application in Older People Care and Mental Health Treatment.
  • Tørresen, Jim (2020). Intelligent Robots and Systems for Foundational and Applied Healthcare Research.
  • Tørresen, Jim (2020). Tutorial: Addressing Ethical Challenges within Evolutionary Computation Applications.
  • Tørresen, Jim (2020). Interdisciplinary Research Collaboration in Rhythm, Time and Motion.
  • Tørresen, Jim (2020). Tutorial: Ethical Considerations in User Modeling and Personalization.
  • Tørresen, Jim (2020). Addressing Ethical Challenges for Care Giving Robots.
  • Tørresen, Jim (2019). Making Robots Adaptive and Preferable to Humans.
  • Tørresen, Jim (2019). Kunstig intelligens – hvem, hva og hvor. (Eng. Artificial Intelligence – who, what and where).
  • Schulz, Trenton Wade; Holthaus, Patrick; Amirabdollahian, Farshid & Koay, Kheng Lee (2019). Humans’ Perception of a Robot Moving Using a Slow in and Slow Out Velocity Profile. In Kim, Jung H.; Tapus, Adriana; Sirkin, David; Jung, Malte & Kwak, Sonya S. (Ed.), 14th Annual ACM/IEEE International Conference on Human Robot Interaction – HRI’19. IEEE. ISSN 978-1-5386-8555-6. p. 594–595.
  • Tørresen, Jim (2019). Intelligent Robots and Systems in Real-World Environment.
  • Saplacan, Diana (2019). From fieldwork to concepts: a walk through some of my experiences in doing qualitative research.
  • Saplacan, Diana (2019). A introduction to robots and qualitative research: Learnings from Multimodal Elderly Care System (MECS) project.
  • Tørresen, Jim; Glette, Kyrre & Ellefsen, Kai Olav (2019). Intelligent, Adaptive Robots in Real-World Scenarios.
  • Tørresen, Jim; Glette, Kyrre & Ellefsen, Kai Olav (2019). Adaptive Robot Body and Control for Real-World Environments.
  • Miura, Jun & Tørresen, Jim (2019). Intelligent Robot Technologies for Care and Lifestyle Support .
  • Soma, Rebekka (2019). Movement as interaction mechanism.
  • Uddin, Md Zia (2019). Activity Recognition Using Smartphone Sensors, Robust Features, and Recurrent Neural Network.
  • Uddin, Md Zia (2019). A Thermal Camera-based Activity Recognition Using Discriminant Skeleton Features and RNN.
  • Rokkones, Anders Skibeli; Uddin, Md Zia & Torresen, Jim (2019). Facial Expression Recognition Using Robust Local Directional Strength Pattern Features and Recurrent Neural Network.
  • Schulz, Trenton Wade (2019). Differences of Human Perceptions of a Robot Moving using Linear or Slow in, Slow out Velocity Profiles When Performing a Cleaning Task.
  • Tørresen, Jim (2019). Roboter kan slå salto – men bryr de seg om applausen? [Internet]. LO Ingeniør.
  • Saplacan, Diana (2019). Understanding Robot Motion in Domestic Settings.
  • Noori, Farzan Majeed (2019). A Robust Human Activity Recognition Approach Using OpenPose, Motion Features, and Deep Recurrent Neural Network.
  • Noori, Farzan Majeed (2019). Robot-Care for the Older People: Ethically Justified or Not?
  • Saplacan, Diana (2019). User involvement in design.
  • Saplacan, Diana (2019). From fieldwork to concepts: a walk through my experiences in doing qualitative research.
  • Tørresen, Jim (2019). Introduction to Different Challenges in Ethical AI and Possible Ways of Addressing Them.
  • Tørresen, Jim (2019). Design and Control of Robots for Real-World Environment.
  • Tørresen, Jim (2019). Supporting Older People with Robots for Independent Living.
  • Tørresen, Jim (2019). Intelligent and Adaptive Robots in Real-World Environment.
  • Tørresen, Jim (2019). Ethics and artificial intelligence in healthcare.
  • Tørresen, Jim (2019). Robots and Mobile Apps Solving Problems Better with Artificial Intelligence.
  • Tørresen, Jim (2019). Artificial Intelligence and Applications in Health and Care .
  • Tørresen, Jim (2019). Hva er kunstig intelligens?
  • Tørresen, Jim (2019). Ethical Considerations for Healthcare Robots.
  • Tørresen, Jim (2019). Sensing Human State with Application in Older People Care and Mental Health Treatment.
  • Tørresen, Jim (2019). Supporting Older People at Home with a Mobile Robot for Independent Living.
  • Tørresen, Jim (2019). Future and Ethical Perspectives of Robotics and AI.
  • Tørresen, Jim (2018). Roboter kommer nærmere – skal vi glede eller grue oss?
  • Tørresen, Jim (2018). Remote Lab and Applications for High Performance and Embedded Architectures.
  • Orten, Mathias Kramer & Tørresen, Jim (2021). Machine Ethics for Autonomous systems – Learning verifiable rules from the environment. Universitetet i Oslo.
  • Wang, Lina; Tørresen, Jim & Noori, Farzan Majeed (2021). Emergency Monitoring of Older People Using Multiple Sensors with Privacy in Consideration. Universitetet i Oslo.
  • Schulz, Trenton Wade (2020). Exploration of Moving Things in the Home. Universitetet i Oslo. ISSN 1501-7710.
  • Refsum, Vetle Kind; Khaksar, Weria & Tørresen, Jim (2019). Human aware navigation and reaction for a mobile service robot with a LIDAR unit. Universitetet i Oslo.
  • Lappyová, Veronika; Khaksar, Weria & Tørresen, Jim (2019). Development and implementation of human detection and following method on a mobile robot. Universitetet i Oslo.
  • Maartmann-Moe, Harald & Herstad, Jo (2019). These Things Take Time: Unhurried explorations and independent prototypes In participatory design with older adults. Universitetet i Oslo.

View all works in Cristin

Published May 24, 2016 3:39 PM - Last modified Mar. 25, 2021 8:29 AM