Norwegian version of this page

Engineering Predictability with Embodied Cognition (EPEC)

How can multimodal systems sense, learn, and predict future events?

EPEC: engineering predictability with embodied cognition

Humans are superior to computers and robots when it comes to perceiving with eyes, ears and other senses as well as combining perception with learned knowledge to choose the best actions. This project aims to develop human-inspired models of behaviour and perception and to show that these models can predict future actions accurately.

Our inspiration comes from embodied cognition, a concept from psychology proposing that our bodies, perceptions, abilities, and form, influences how we think. Our goal is to exploit the form of various systems to develop predictive reasoning models as alternatives to traditional reactive systems. These models will be applied in interdisciplinary fields of music technology and robotics. In music, we aim to provide everyday people new ways to move within musical spaces. Our models learn about their interactions with smartphones to proactively assist with their future actions. In robotics, we are developing robots with dynamic forms that can change their thinking in response to new body shapes.

EPEC explores applications in musical interaction on smartphones and robotics
Musical interaction on smartphones and robotic systems, are EPEC's application areas for new predictive models.

EPEC is directed by Professor Jim Tørresen, who also leads the ROBIN research group in the Department of Informatics. The project employs two post doctoral fellows, Kai Olav Ellefsen and Charles Martin, and PhD researcher Tønnes Nygaard. The project also includes Associate Professor Kyrre Glette, PhD researcher Jørgen Nordmoen, and a number of masters students in machine learning, robotics and music technology.


Design, implement and evaluate multimodal systems that are able to sense, learn and predict future events.


Master Projects

Researchers from the EPEC group supervise master projects in robotics, music technology, and machine learning. Come work with us on predictive models, embodied interactive systems and new robotic interactions! More information available here.


Supported by The Research Council of Norway under FRINATEK grant agreement 240862 from 2015 to 2019. The grant funds 1 PhD and 2 post-doc positions (10% of prop. funded).


  • Charles Patrick Martin & Jim Tørresen (2017). MicroJam: An App for Sharing Tiny Touch-Screen Performances, In Cumhur Erkut (ed.),  Proceedings of the International Conference on New Interfaces for Musical Expression.  Aalborg University Copenhagen.  Chapter.  s 495 - 496
  • Charles Patrick Martin & Jim Tørresen (2017). Exploring Social Mobile Music with Tiny Touch-Screen Performances, In Jukka Pätynen; Tapio Lokki & Vesa Välimäki (ed.),  Proceedings of the 14th Sound and Music Computing Conference 2017.  Aalto University.  ISBN 978-952-60-3729-5.  Conference Paper.  s 175 - 180
  • Kai Olav Ellefsen & Jim Tørresen (2017). Evolving neural networks with multiple internal models, In Nicolas Bredèche; Jonathan Rouzaud-Cornabas; Dusan Misevic; Guillaume Beslon; Carole Knibbe; David Parsons; Hedi Soula; Olivier Simonin & Salima Hassas (ed.),  Proceedings of the European Conference on Artificial Life 2017.  MIT Press.  ISBN 978-0-262-34633-7.  Artikkel.  s 138 - 145
  • Torkil Aamodt & Jim Tørresen (2017). Comparing Neural Networks for Predicting Stock Markets, In Chrisina Jayne; Giacomo Boracchi; Aristidis Likas & Lazaros Iliadis (ed.),  Proceedings of 18th International Conference, EANN 2017, Athens, Greece, August 25–27, 2017.  Springer.  ISBN 978-3-319-651712.  Artikkel.  s 363 - 375
  • Charles Patrick Martin; Kai Olav Ellefsen & Jim Tørresen (2017). Deep Models for Ensemble Touch-Screen Improvisation, In Mathieu Barthet; Tony Stockman & George Fazekas (ed.),  Proceedings of the 12th International Audio Mostly Conference: Augmented and Participatory Sound and Music Experiences.  Association for Computing Machinery (ACM).  ISBN 978-1-4503-5373-1.  Conference paper.
  • Kai Olav Ellefsen; Herman Lepikson & Jan Albiez (2017). Multiobjective Coverage Path Planning: Enabling Automated Inspection of Complex, Real-World Structures. Applied Soft Computing.  ISSN 1568-4946.  s 264- 282
  • Charles Patrick Martin (2017). Percussionist-Centred Design for Touchscreen Digital Musical Instruments. Contemporary Music Review.  ISSN 0749-4467.  36, s 64- 85
  • Kristian Nymoen; Arjun Chandra & Jim Tørresen (2016). Self-awareness in Active Music Systems, In Xin Yao; Bernhard Rinner; Marco Platzner; Peter R. Lewis & Jim Tørresen (ed.),  Self-aware Computing Systems.  Springer.  ISBN 978-3-319-39674-3.  Kapittel 14.  s 279 - 296
  • Justinas Miseikis; Kyrre Glette; Ole Jakob Elle & Jim Tørresen (2016). Automatic Calibration of a Robot Manipulator and Multi 3D Camera System, In Yasuhisa Hirata (ed.),  Proc. of 2016 IEEE/SICE International Symposium on System Integration.  IEEE conference proceedings.  ISBN 978-1-5090-3329-4.  Artikkel.  s 735 - 741
  • Tønnes Frostad Nygaard; Jim Tørresen & Kyrre Glette (2016). Multi-objective Evolution of Fast and Stable Gaits on a Physical Quadruped Robotic Platform, In Stefanos Kollias & Yaochu Jin (ed.),  Proc. of 2016 IEEE Symposium Series on Computational Intelligence (SSCI).  IEEE conference proceedings.  ISBN 978-1-5090-4240-1.  Artikkel.
  • Jim Tørresen; Andreas Høyer Iversen & Ralf Greisiger (2016). Data from Past Patients used to Streamline Adjustment of Levels for Cochlear Implant for New Patients, In Yaochu Jin & Stefanos Kollias (ed.),  Proc. of 2016 IEEE Symposium Series on Computational Intelligence (SSCI).  IEEE conference proceedings.  ISBN 978-1-5090-4240-1.  Artikkel.
  • Andreas Færøvig Olsen & Jim Tørresen (2016). Smartphone Accelerometer Data used for Detecting Human Emotions, In Lipo Wang & Xiang Fei (ed.),  Proceedings of 2016 3rd International Conference on Systems and Informatics.  IEEE conference proceedings.  ISBN 978-1-5090-5520-3.  Artikkel.  s 410 - 415
  • Justinas Miseikis; Kyrre Glette; Ole Jakob Elle & Jim Tørresen (2016). Multi 3D Camera Mapping for Predictive and Reflexive Robot Manipulator Trajectory Estimation, In Stefanos Kollias & Yaochu Jin (ed.),  Proc. of 2016 IEEE Symposium Series on Computational Intelligence (SSCI).  IEEE conference proceedings.  ISBN 978-1-5090-4240-1.  1.

View all works in Cristin

  • Kai Olav Ellefsen (2017). Evolutionary Robotics: Automatic design of robot bodies and control.
  • Kai Olav Ellefsen (2017). Automating Robot Design with Evolutionary Algorithms.
  • Jim Tørresen (2017). Artificial Intelligence by Nature Inspired Computing.
  • Jim Tørresen (2017). Unleashing Artificial Intelligence in the Real World.
  • Jim Tørresen (2017). Sensing and Reasoning Technology Applied within Mental Health Treatment and Elderly Care Robot Companions.
  • Jim Tørresen (2017). Robotics activity at Robotics and Intelligent Systems Group University of Oslo.
  • Jim Tørresen (2017). Making Systems Intelligent by Biologically Inspired Computing.
  • Jim Tørresen (2017). Opportunities and Challenges with Artificial Intelligence.
  • Jim Tørresen (2017). Making Technology Adaptive by Biologically Inspired Computing.
  • Tønnes Frostad Nygaard (2017). Presentation on Robotics: Today and the future.
  • Charles Patrick Martin (2017). MicroJam: A Social App for Making Music.
  • Jim Tørresen (2017). Artificial Intelligence – What is it and what can it be applied to?.
  • Charles Patrick Martin (2017). Making Social Music with MicroJam.
  • Charles Patrick Martin (2017). Virtuosic Interactions / Performing with a Neural iPad Band.
  • Kyrre Glette (2017). Self-teaching robots.
  • Charles Patrick Martin (2017). Musical Networks: Using Recurrent Neural Networks to Model and Complement Musical Creativity.
  •  (2017). Ensemble Metatone - Improvised Touchscreen Performance.
  • Tannaz Navaie Roshandel (2017). System Control for Safe Autonomous Navigation of Robot Systems for Elderly Care.
  • Lexu Qi (2017). Using Skeleton Information for Human Identification for Elderly Care and Alarm System with the XBox One Kinect Sensor.
  • Mathias Ciarlo Thorstensen (2017). Visualization of Robotic Sensor Data with Augmented Reality.
  • Hans Fredrik Fahle (2017). Predicting Gaits Based on Prior Experience.
  • Jiader Chou (2017). Terrain classification using 3D optical tactile sensor.
  • Jim Tørresen (2016). Artificial intelligence in autonomous systems.
  • Jim Tørresen (2016). Teknologi som kan tilpasse seg gjennom læring.
  • Kyrre Glette (2016). Self-teaching robots.
  • Jim Tørresen (2016). Smartphone Analysis of Human Behaviour for Interactive Music Systems.
  • Jim Tørresen (2016). Maskiner som tenker. Psykologisk tidsskrift.  ISSN 1501-7508.  20, s 36- 40
  •  (2015). Alan Turing opp til prøve.

View all works in Cristin

Tags: machine learning, robotics, interactive music
Published May 24, 2016 3:38 PM - Last modified Oct. 27, 2017 1:07 PM