Norwegian version of this page

Multimodal Elderly Care Systems (MECS)

About the project

The number of elderly people living at home is increasing and this trend is expected to continue. The challenge then would be how to provide technology that can handle the complex and different environments found in homes. Further, technology can easily be seen as a threat to privacy and lack of interpersonal contact. This project addresses these issues by user centered design of robotic systems and the development of adaptive technology. A part of this will be to demonstrate the benefits regarding both performance and privacy being improved by applying sensors like cameras on a robot companion rather than having them permanently mounted in a home. These would be used for detecting falls and other non-normal situations. Using new sensor technology, we would also like to explore if it is possible to remotely monitor medical states like pulse, breathing etc. Rather than having elderly themselves activating their personal security alarm in the case of an emergency situation, a target of this project is to demonstrate automatic activation. Many systems for elderly have been designed but few have been adopted on a large scale. We think a key reason for this is limited user involvement and few iterations of user testing. Therefore, we will focus specifically on developing our systems with a large degree of user participation.

In this project, a robot companion moves in a residential environment in the presence of unknown static and dynamic obstacles. Thus, having an effective and efficient control architecture, plays an important role in the achievement of the project objectives.

Objectives

Create and evaluate multimodal mobile human supportive systems that are able to sense, learn and predict future events.

Financing

Research Council of Norway 2015–2019, IKTPLUSS, One PhDs and two post-doc (10% of proposals in the call were funded)

Cooperation

Tools

Publications

  • van Otterdijk, Marieke; Neggers, Margot; Tørresen, Jim & Barakova, Emilia Ivanova (2021). Preferences of Seniors for Robots Delivering a Message With Congruent Approaching Behavior, Proceedings of the 2021 IEEE International Conference on Advanced Robotics and Its Social Impacts (ARSO) Virtual Conference, July 8-10, 2021. IEEE Robotics and Automation Society. ISSN 978-1-6654-4952-6. doi: 10.1109/ARSO51874.2021.9542833.
  • Khaksar, Weria; Neggers, Margot; Barakova, Emilia Ivanova & Tørresen, Jim (2021). Generation Differences in Perception of the Elderly Care Robot. In Caleb-Solly, Praminda; Ghafurian, Moojan; Johnson, Michelle & Wada, Kazuyoshi (Ed.), Proceedings of the 30th IEEE International Conference on Robot & Human Interactive Communication (ROMAN). IEEE. ISSN 978-1-6654-0492-1. p. 551–558. doi: 10.1109/RO-MAN50785.2021.9515534.
  • Schulz, Trenton Wade; Soma, Rebekka & Holthaus, Patrick (2021). Movement acts in breakdown situations: How a robot's recovery procedure affects participants' opinions. Paladyn - Journal of Behavioral Robotics. ISSN 2080-9778. 12(1), p. 336–355. doi: 10.1515/pjbr-2021-0027. Full text in Research Archive
  • Tørresen, Jim (2021). Undertaking Research with Humans within Artificial Intelligence and Robotics: Multimodal Elderly Care Systems. Technology Architecture + Design (TAD). ISSN 2475-1448. 5(2), p. 141–145. doi: 10.1080/24751448.2021.1967052.
  • Mantelli, Mathias; Pittol, Diego; Maffei, Renan; Tørresen, Jim; Prestes, Edson & Kolberg, Mariana (2021). Semantic Active Visual Search System Based on Text Information for Large and Unknown Environments. Journal of Intelligent and Robotic Systems. ISSN 0921-0296. 101(2). doi: 10.1007/s10846-020-01298-7.
  • Saplacan, Diana; Khaksar, Weria & Tørresen, Jim (2021). On Ethical Challenges Raised by Care Robots: A Review of the Existing Regulatory-, Theoretical-, and Research Gaps, Proceedings of the 2021 IEEE International Conference on Advanced Robotics and Its Social Impacts (ARSO) Virtual Conference, July 8-10, 2021. IEEE Robotics and Automation Society. ISSN 978-1-6654-4952-6. p. 219–226. doi: 10.1109/ARSO51874.2021.9542844.
  • Noori, Farzan Majeed; Uddin, Md Zia & Tørresen, Jim (2021). Ultra-Wideband Radar-Based Activity Recognition Using Deep Learning. IEEE Access. ISSN 2169-3536. 9, p. 138132–138143. doi: 10.1109/ACCESS.2021.3117667. Full text in Research Archive
  • Saplacan, Diana; Herstad, Jo; Tørresen, Jim & Pajalic, Zada (2020). A Framework on Division of Work Tasks between Humans and Robots in the Home. Multimodal Technologies and Interaction. ISSN 2414-4088. 4(3). doi: 10.3390/mti4030044. Full text in Research Archive
  • Saplacan, Diana; Herstad, Jo & Schulz, Trenton Wade (2020). Situated Abilities within Universal Design – A Theoretical Exploration. International Journal on Advances in Intelligent Systems. ISSN 1942-2679. 13(34), p. 278–291. Full text in Research Archive
  • Uddin, Md Zia; Noori, Farzan Majeed & Tørresen, Jim (2020). In-Home Emergency Detection Using an Ambient Ultra-Wideband Radar Sensor and Deep Learning. In Noori, Farzan Majeed (Eds.), IEEE 10th International Conference on Ultrawideband and Ultrashort Impulse Signals (UWBUSIS). IEEE. ISSN 978-1-7281-7314-6. p. 1089–1093. doi: 10.1109/UkrMW49653.2020.9252708.
  • Saplacan, Diana; Herstad, Jo & Pajalic, Zada (2020). An Analysis of Independent Living Elderly’s Views on Robots: A Descriptive Study from the Norwegian Context. In Mauri, Lloret, James; Saplacan, Diana; Carcani, Klaudia; Ardiansyah, Prima Oky Dicky & Vasilache, Simona (Ed.), ACHI 2020, The Thirteenth International Conference on Advances in Computer-Human Interactions. International Academy, Research and Industry Association (IARIA). ISSN 978-1-61208-761-0. p. 199–208. Full text in Research Archive
  • Noori, Farzan; Riegler, Michael; Uddin, Md Zia & Tørresen, Jim (2020). Human Activity Recognition from Multiple Sensors Data Using Multi-Fusion Representations and CNNs. ACM Transactions on Multimedia Computing, Communications, and Applications (TOMCCAP). ISSN 1551-6857. 16(2). doi: 10.1145/3377882.
  • Woll, Anita & Tørresen, Jim (2020). Bridging the User Barriers of Home Telecare. Advances in Intelligent Systems and Computing. ISSN 2194-5357. 1069, p. 816–835. doi: 10.1007/978-3-030-32520-6_59.
  • Schulz, Trenton Wade; Tørresen, Jim & Herstad, Jo (2019). Animation Techniques in Human-Robot Interaction User Studies: A Systematic Literature Review. ACM Transactions on Human-Robot Interaction. ISSN 2573-9522. 8(2). doi: 10.1145/3317325.
  • Noori, Farzan Majeed; Wallace, Benedikte; Uddin, Md Zia & Tørresen, Jim (2019). A Robust Human Activity Recognition Approach Using OpenPose, Motion Features, and Deep Recurrent Neural Network. Lecture Notes in Computer Science (LNCS). ISSN 0302-9743. 11482 LNCS, p. 299–310. doi: 10.1007/978-3-030-20205-7_25.
  • Saplacan, Diana & Herstad, Jo (2019). Understanding Robot Motion in Domestic Settings, Proceedings of the 9th Joint IEEE International Conference on Development and Learning and on Epigenetic Robotics. IEEE. ISSN 978-1-5386-8129-9. p. 67–74. doi: 10.1109/DEVLRN.2019.8850695.
  • Uddin, Md Zia; Khaksar, Weria & Tørresen, Jim (2019). A Thermal Camera-based Activity Recognition Using Discriminant Skeleton Features and RNN, The 17th IEEE International Conference on Industrial Informatics (IEEE-INDIN 2019): Proceedings. IEEE. ISSN 9781-7281-2927-3. doi: 10.1109/INDIN41052.2019.8972082.
  • Rokkones, Anders Skibeli; Uddin, Md Zia & Tørresen, Jim (2019). Facial Expression Recognition Using Robust Local Directional Strength Pattern Features and Recurrent Neural Network, 9TH IEEE INTERNATIONAL CONFERENCE ON CONSUMER ELECTRONICS. IEEE. ISSN 978-1-7281-2745-3. p. 283–288. doi: 10.1109/ICCE-Berlin47944.2019.8966234.
  • Saplacan, Diana & Herstad, Jo (2019). An Explorative Study on Motion as Feedback: Using Semi-Autonomous Robots in Domestic Settings. International Journal On Advances in Software. ISSN 1942-2628. 12(1&2), p. 68–90.
  • Khaksar, Weria; Uddin, Md Zia & Tørresen, Jim (2019). Neuro-Fuzzy Sampling: Safe and fast multi-query randomized path planning for mobile robots. Communications in Computer and Information Science. ISSN 1865-0929. 1015, p. 13–27. doi: 10.1007/978-981-13-7780-8_2.
  • Bråthen, Heidi; Maartmann-Moe, Harald & Schulz, Trenton Wade (2019). The Role of Physical Prototyping in Participatory Design with Older Adults. In Kokil, Uttam & Ota, Tomoko (Ed.), ACHI 2019, The Twelfth International Conference on Advances in Computer-Human Interactions. International Academy, Research and Industry Association (IARIA). ISSN 978-1-61208-686-6. p. 141–146. Full text in Research Archive
  • Khaksar, Weria; Uddin, Md Zia & Tørresen, Jim (2019). Multi-Query Motion Planning in Uncertain Spaces: Incremental Adaptive Randomized Roadmaps. International Journal of Applied Mathematics and Computer Science. ISSN 1641-876X. 29(4), p. 641–654. doi: 10.2478/amcs-2019-0047. Full text in Research Archive
  • Khaksar, Weria; Uddin, Md Zia & Tørresen, Jim (2019). Fuzzy Motion Planning for Nonholonomic Mobile Robot Navigation in Unknown Indoor Environments. International Journal of Mechanical Engineering and Robotics Research (IJMERR). ISSN 2278-0149. 8(1), p. 6–11. doi: 10.18178/ijmerr.8.1.6-11.

View all works in Cristin

  • Saplacan, Diana (2022). Participatory Design and Human-Robot Interaction - An ethical and inclusive perspective on contemporary technologies.
  • Dahl, Heidi Elisabeth Iuell; Mehmandarov, Rustam Karim; Harkestad, Inge & Saplacan, Diana (2022). AI and Ethics workshop.
  • Saplacan, Diana; Khaksar, Weria & Tørresen, Jim (2021). On Ethical Challenges Raised by Care Robots: A Review of the Existing Regulatory-, Theoretical-, and Research Gaps.
  • Saplacan, Diana; Tørresen, Jim; Mahler, Tobias & Fosch-Villaronga, Eduard (2021). Robots and Society: Ethical, Legal, and Technical Perspectives on Integrating Robots in the Home- and Healthcare Systems and Services (RO-SO).
  • Tørresen, Jim (2021). INTROMAT: INtroducing personalized TReatment Of Mental health problems using Adaptive Technology.
  • Tørresen, Jim (2021). Tutorial: Ethical Considerations in User Modeling and Personalization.
  • Tørresen, Jim (2021). Tutorial: Intelligent System Research – AI Ethical Challenges and Opportunities.
  • Tørresen, Jim (2021). Tutorial: Ethical Considerations in Robotics and Automation.
  • Tørresen, Jim (2021). Kunstig intelligens – allsidig i metoder og anvendelser.
  • Tørresen, Jim; Saplacan, Diana; Lintvedt, Mona Naomi; Mahler, Tobias & Fosch-Villaronga, Eduard (2021). Tutorial: Ethical and Legal Assessments Related to Robots and Systems .
  • Tørresen, Jim (2021). Tutorial: Explainability, Trust and Ethics for Robots and Autonomous Systems.
  • Saplacan, Diana (2021). Ethics and Technology.
  • Saplacan, Diana (2021). Challenges and Opportunities with AI-based Care Robots: An Ethical and Inclusive Approach.
  • Noori, Farzan Majeed (2021). Recognition of Human Activities using UWB Radar and Deep Learning.
  • van Otterdijk, Marieke (2021). De Kennis van Nu” (The knowledge of now). [TV]. Dutch national TV (NPO).
  • Tørresen, Jim (2021). How to achieve ethical artificial intelligence (AI) research and development?
  • Tørresen, Jim (2021). Introducing a Multimodal Elderly Care Safety Alarm Robot.
  • Tørresen, Jim (2021). Tutorial: Ethical Considerations in the Development and Use of Neural Information Processing Systems.
  • Tørresen, Jim (2020). Tutorial: Addressing Ethical Challenges within Evolutionary Computation Applications.
  • Tørresen, Jim (2020). Interdisciplinary Research Collaboration in Rhythm, Time and Motion.
  • Tørresen, Jim (2020). Sensing Human State with Application in Older People Care and Mental Health Treatment.
  • Tørresen, Jim (2020). Intelligent Robots and Systems for Foundational and Applied Healthcare Research.
  • Tørresen, Jim (2020). Tutorial: Ethical Considerations in User Modeling and Personalization.
  • Tørresen, Jim; Kurazume, Ryo & Prestes, Edson (2020). Guest Editorial: Special Issue on Elderly Care Robotics – Technology and Ethics . Journal of Intelligent and Robotic Systems. ISSN 0921-0296. 98, p. 3–4. doi: 10.1007/s10846-020-01148-6.
  • Noori, Farzan Majeed; Uddin, Md Zia & Tørresen, Jim (2020). Presentation on In-Home Emergency Detection Using an Ambient Ultra-Wideband Radar Sensor and Deep Learning.
  • Tørresen, Jim (2020). Ethical Considerations in User Modeling and Personalization: ACM UMAP 2020 Tutorial. In Kuflik, Tsvi; Torre, Ilaria & Burke, Robin (Ed.), Proceedings of the 28th ACM Conference on User Modeling, Adaptation and Personalization. Association for Computing Machinery (ACM). ISSN 978-1-4503-6861-2. p. 390–391.
  • Tørresen, Jim (2020). Addressing ethical challenges within evolutionary computation applications: GECCO 2020 tutorial. In Coello Coello, Carlos A. (Eds.), GECCO '20: Proceedings of the 2020 Genetic and Evolutionary Computation Conference Companion. Association for Computing Machinery (ACM). ISSN 978-1-4503-7127-8. p. 1206–1223. doi: https%3A/doi-org.ezproxy.uio.no/10.1145/3377929.3389894.
  • Tørresen, Jim (2020). Addressing Ethical Challenges for Care Giving Robots.
  • Tørresen, Jim (2020). Ethical Consideration in Robotics and Intelligent Systems Research.
  • Tørresen, Jim (2020). Tutorial: Ethical Challenges and Opportunities within Computational Intelligence System Development.
  • Tørresen, Jim (2019). Ethics and artificial intelligence in healthcare.
  • Tørresen, Jim (2019). Intelligent and Adaptive Robots in Real-World Environment.
  • Saplacan, Diana (2019). From fieldwork to concepts: a walk through my experiences in doing qualitative research.
  • Tørresen, Jim (2019). Design and Control of Robots for Real-World Environment.
  • Tørresen, Jim (2019). Introduction to Different Challenges in Ethical AI and Possible Ways of Addressing Them.
  • Tørresen, Jim (2019). Sensing Human State with Application in Older People Care and Mental Health Treatment.
  • Tørresen, Jim (2019). Artificial Intelligence and Applications in Health and Care .
  • Tørresen, Jim (2019). Hva er kunstig intelligens?
  • Tørresen, Jim (2019). Future and Ethical Perspectives of Robotics and AI.
  • Tørresen, Jim (2019). Robots and Mobile Apps Solving Problems Better with Artificial Intelligence.
  • Saplacan, Diana (2019). Understanding Robot Motion in Domestic Settings.
  • Tørresen, Jim; Glette, Kyrre & Ellefsen, Kai Olav (2019). Intelligent, Adaptive Robots in Real-World Scenarios.
  • Uddin, Md Zia (2019). Activity Recognition Using Smartphone Sensors, Robust Features, and Recurrent Neural Network.
  • Soma, Rebekka (2019). Movement as interaction mechanism.
  • Uddin, Md Zia (2019). A Thermal Camera-based Activity Recognition Using Discriminant Skeleton Features and RNN.
  • Rokkones, Anders Skibeli; Uddin, Md Zia & Torresen, Jim (2019). Facial Expression Recognition Using Robust Local Directional Strength Pattern Features and Recurrent Neural Network.
  • Tørresen, Jim (2019). Intelligent Robots and Systems in Real-World Environment.
  • Tørresen, Jim (2019). Roboter kan slå salto – men bryr de seg om applausen? [Internet]. LO Ingeniør.
  • Tørresen, Jim; Glette, Kyrre & Ellefsen, Kai Olav (2019). Adaptive Robot Body and Control for Real-World Environments.
  • Saplacan, Diana (2019). From fieldwork to concepts: a walk through some of my experiences in doing qualitative research.
  • Saplacan, Diana (2019). A introduction to robots and qualitative research: Learnings from Multimodal Elderly Care System (MECS) project.
  • Tørresen, Jim (2019). Making Robots Adaptive and Preferable to Humans.
  • Tørresen, Jim (2019). Kunstig intelligens – hvem, hva og hvor. (Eng. Artificial Intelligence – who, what and where).
  • Schulz, Trenton Wade; Holthaus, Patrick; Amirabdollahian, Farshid & Koay, Kheng Lee (2019). Humans’ Perception of a Robot Moving Using a Slow in and Slow Out Velocity Profile. In Kim, Jung H.; Tapus, Adriana; Sirkin, David; Jung, Malte & Kwak, Sonya S. (Ed.), 14th Annual ACM/IEEE International Conference on Human Robot Interaction – HRI’19. IEEE. ISSN 978-1-5386-8555-6. p. 594–595.
  • Schulz, Trenton Wade (2019). Differences of Human Perceptions of a Robot Moving using Linear or Slow in, Slow out Velocity Profiles When Performing a Cleaning Task.
  • Miura, Jun & Tørresen, Jim (2019). Intelligent Robot Technologies for Care and Lifestyle Support .
  • Saplacan, Diana (2019). User involvement in design.
  • Noori, Farzan Majeed (2019). Robot-Care for the Older People: Ethically Justified or Not?
  • Noori, Farzan Majeed (2019). A Robust Human Activity Recognition Approach Using OpenPose, Motion Features, and Deep Recurrent Neural Network.
  • Tørresen, Jim (2019). Ethical Considerations for Healthcare Robots.
  • Tørresen, Jim (2019). Supporting Older People with Robots for Independent Living.
  • Wang, Lina; Tørresen, Jim & Noori, Farzan Majeed (2021). Emergency Monitoring of Older People Using Multiple Sensors with Privacy in Consideration. Universitetet i Oslo.
  • Orten, Mathias Kramer & Tørresen, Jim (2021). Machine Ethics for Autonomous systems – Learning verifiable rules from the environment. Universitetet i Oslo.
  • Schulz, Trenton Wade (2020). Exploration of Moving Things in the Home. Universitetet i Oslo. ISSN 1501-7710.
  • Refsum, Vetle Kind; Khaksar, Weria & Tørresen, Jim (2019). Human aware navigation and reaction for a mobile service robot with a LIDAR unit. Universitetet i Oslo.
  • Lappyová, Veronika; Khaksar, Weria & Tørresen, Jim (2019). Development and implementation of human detection and following method on a mobile robot. Universitetet i Oslo.
  • Maartmann-Moe, Harald & Herstad, Jo (2019). These Things Take Time: Unhurried explorations and independent prototypes In participatory design with older adults. Universitetet i Oslo.

View all works in Cristin

Published May 24, 2016 3:39 PM - Last modified Mar. 25, 2021 8:29 AM