Norwegian version of this page

EPEC - Engineering Predictability with Embodied Cognition (completed)

How can multimodal systems sense, learn, and predict future events?

EPEC.  Engineering predictability with embodied cognition. It says with letters.. Logo.

Humans are superior to computers and robots when it comes to perceiving with eyes, ears and other senses as well as combining perception with learned knowledge to choose the best actions. This project aims to develop human-inspired models of behaviour and perception and to show that these models can predict future actions accurately.

Our inspiration comes from embodied cognition, a concept from psychology proposing that our bodies, perceptions, abilities, and form, influences how we think. Our goal is to exploit the form of various systems to develop predictive reasoning models as alternatives to traditional reactive systems. These models will be applied in interdisciplinary fields of music technology and robotics. In music, we aim to provide everyday people new ways to move within musical spaces. Our models learn about their interactions with smartphones to proactively assist with their future actions. In robotics, we are developing robots with dynamic forms that can change their thinking in response to new body shapes.

A hand holding a smartphone and feet on some robotics. Photo.
Musical interaction on smartphones and robotic systems, are EPEC's application areas for new predictive models.

EPEC is directed by Professor Jim Tørresen, who also leads the ROBIN research group in the Department of Informatics. The project employs two post doctoral fellows, Kai Olav Ellefsen and Charles Martin, and PhD researcher Tønnes Nygaard. The project also includes Associate Professor Kyrre Glette, PhD researcher Jørgen Nordmoen, and a number of masters students in machine learning, robotics and music technology.

Objectives

Design, implement and evaluate multimodal systems that are able to sense, learn and predict future events.

Sub-projects

  • Internal Models: Predicting real-world effects through internal simulations
  • DyRET: Dynamic Robot for Embodied Testing
  • Interactive music systems: Computer systems for extending and enhancing musical listening, performance and collaboration.

Master Projects

Researchers from the EPEC group supervise master projects in robotics, music technology, and machine learning. Come work with us on predictive models, embodied interactive systems and new robotic interactions!

Funding

Supported by The Research Council of Norway under FRINATEK grant agreement 240862 from 2015 to 2019. The grant funds 1 PhD and 2 post-doc positions (10% of prop. funded).

Publications

View all works in Cristin

  • Ellefsen, Kai Olav & Rohlfing, Katharina J. (2019). Proceedings of the 9th Joint IEEE International Conference on Development and Learning and on Epigenetic Robotics. IEEE. ISBN 978-1-5386-8129-9. 340 p.

View all works in Cristin

  • (2020). Evolutionary algorithms for intelligent robots.
  • Tørresen, Jim (2019). Making Robots Adaptive and Preferable to Humans.
  • Tørresen, Jim (2019). Kunstig intelligens – hvem, hva og hvor. (Eng. Artificial Intelligence – who, what and where).
  • Becker, Artur; Herrebrøden, Henrik; Gonzalez Sanchez, Victor Evaristo; Nymoen, Kristian; Dal Sasso Freitas, Carla Maria & Tørresen, Jim [Show all 7 contributors for this article] (2019). Functional Data Analysis of Rowing Technique Using Motion Capture Data.
  • (2019). Her er universitetets mest avanserte, selvlærende robot. [Business/trade/industry journal]. Apollon.
  • Tørresen, Jim (2019). Intelligent Robots and Systems in Real-World Environment.
  • (2019). Kunstig intelligens for tilpasningsdyktige roboter.
  • Ellefsen, Kai Olav (2019). Hva Kan Roboter Lære av Biologisk Liv?
  • Tørresen, Jim; Glette, Kyrre & Ellefsen, Kai Olav (2019). Intelligent, Adaptive Robots in Real-World Scenarios.
  • Tørresen, Jim; Glette, Kyrre & Ellefsen, Kai Olav (2019). Adaptive Robot Body and Control for Real-World Environments.
  • Rohlfing, Katharina J. & Tørresen, Jim (2019). Explainability: an interactive view.
  • Miura, Jun & Tørresen, Jim (2019). Intelligent Robot Technologies for Care and Lifestyle Support .
  • Comba, Joao Luiz Dihl & Tørresen, Jim (2019). Visual Data Analysis of Unstructured and Big Data.
  • Nygaard, Tønnes Frostad; Martin, Charles Patrick; Tørresen, Jim & Glette, Kyrre (2019). Self-Modifying Morphology Experiments with DyRET: Dynamic Robot for Embodied Testing.
  • Ellefsen, Kai Olav & Tørresen, Jim (2019). Self-Adapting Goals Allow Transfer of Predictive Models to New Tasks.
  • Teigen, Bjørn Ivar; Ellefsen, Kai Olav & Tørresen, Jim (2019). A Categorization of Reinforcement Learning Exploration Techniques Which Facilitates Combination of Different Methods.
  • Ellefsen, Kai Olav; Huizinga, Joost & Tørresen, Jim (2019). Guiding Neuroevolution with Structural Objectives.
  • Nordmoen, Jørgen Halvorsen & Fadelli, Ingrid (2019). A new method to enable robust locomotion in a quadruped robot. [Internet]. TechXplore.
  • Nygaard, Tønnes Frostad; Nordmoen, Jørgen Halvorsen; Ellefsen, Kai Olav; Martin, Charles Patrick; Tørresen, Jim & Glette, Kyrre (2019). Experiences from Real-World Evolution with DyRET: Dynamic Robot for Embodied Testing.
  • Nordmoen, Jørgen Halvorsen; Nygaard, Tønnes Frostad; Ellefsen, Kai Olav & Glette, Kyrre (2019). Evolved embodied phase coordination enables robust quadruped robot locomotion .
  • Martin, Charles Patrick; Næss, Torgrim Rudland; Faitas, Andrei & Baumann, Synne Engdahl (2019). Session on Musical Prediction and Generation with Deep Learning.
  • Martin, Charles Patrick & Torresen, Jim (2019). An Interactive Music Prediction System with Mixture Density Recurrent Neural Networks.
  • Næss, Torgrim Rudland; Tørresen, Jim & Martin, Charles Patrick (2019). A Physical Intelligent Instrument using Recurrent Neural Networks.
  • Martin, Charles Patrick & Tørresen, Jim (2019). An Interactive Musical Prediction System with Mixture Density Recurrent Neural Networks.
  • Faitas, Andrei; Baumann, Synne Engdahl; Torresen, Jim & Martin, Charles Patrick (2019). Generating Convincing Harmony Parts with Simple Long Short-Term Memory Networks.
  • Glette, Kyrre; Nygaard, Tønnes Frostad & Vogt, Yngve (2019). Her er universitetets nest selvlærende robot. [Business/trade/industry journal]. Teknisk ukeblad.
  • Miseikis, Justinas; Brijacak, Inka; Yahyanejad, Saeed; Glette, Kyrre; Elle, Ole Jacob & Tørresen, Jim (2019). Two-Stage Transfer Learning for Heterogeneous Robot Detection and 3D Joint Position Estimation in a 2D Camera Image Using CNN.
  • Tørresen, Jim (2019). Design and Control of Robots for Real-World Environment.
  • Tørresen, Jim (2019). Supporting Older People with Robots for Independent Living.
  • Tørresen, Jim (2019). Intelligent and Adaptive Robots in Real-World Environment.
  • (2019). Kunstig intelligens for tilpasningsdyktige roboter .
  • Nygaard, Tønnes Frostad; Nordmoen, Jørgen Halvorsen; Martin, Charles Patrick; Tørresen, Jim & Glette, Kyrre (2019). Lessons Learned from Real-World Experiments with DyRET: the Dynamic Robot for Embodied Testing.
  • Tørresen, Jim (2019). Artificial Intelligence and Applications in Health and Care .
  • Tørresen, Jim (2019). Hva er kunstig intelligens?
  • Tørresen, Jim (2019). Sensing Human State with Application in Older People Care and Mental Health Treatment.
  • Ellefsen, Kai Olav & Tørresen, Jim (2019). Evolutionary Robotics: Automatic design of robot bodies and control.
  • Tørresen, Jim (2019). Future and Ethical Perspectives of Robotics and AI.
  • Tørresen, Jim (2018). Roboter kommer nærmere – skal vi glede eller grue oss?
  • Tørresen, Jim (2018). Remote Lab and Applications for High Performance and Embedded Architectures.
  • Martin, Charles Patrick; Xambó, Anna; Visi, Federico; Morreale, Fabio & Jensenius, Alexander Refsum (2018). Stillness under Tension.
  • Jensenius, Alexander Refsum; Martin, Charles Patrick; Bjerkestrand, Kari Anne Vadstensvik & Johnson, Victoria (2018). Stillness under Tension.
  • Martin, Charles Patrick; Jensenius, Alexander Refsum & Tørresen, Jim (2018). Composing an ensemble standstill work for Myo and Bela.
  • Tørresen, Jim; Garcia Ceja, Enrique Alejandro; Ellefsen, Kai Olav & Martin, Charles Patrick (2018). Equipping Systems with Forecasting Capabilities .
  • Martin, Charles Patrick (2018). Creative Prediction with Neural Networks.
  • Garcia Ceja, Enrique Alejandro; Ellefsen, Kai Olav; Martin, Charles Patrick & Tørresen, Jim (2018). Prediction, Interaction, and User Behaviour.
  • Martin, Charles Patrick; Glette, Kyrre & Tørresen, Jim (2018). Creative Prediction with Neural Networks.
  • Martin, Charles Patrick (2018). Predictive Music Systems for Interactive Performance.
  • Nygaard, Tønnes Frostad & Khattar, Shivani (2018). How a shape-shifting robot is learning from its mistakes. [TV]. NBC news.
  • Martin, Charles Patrick (2018). MicroJam.
  • Nygaard, Tønnes Frostad & Gonzales, Robbie (2018). How a Flock of Drones Developed Collective Intelligence. [Business/trade/industry journal]. Wired Science.
  • Nygaard, Tønnes Frostad & Papadopoulos, Loukia (2018). New Evolving Robot Teaches Itself to Walk Through Trial and Error. [Business/trade/industry journal]. Interesting Engineering.
  • Nygaard, Tønnes Frostad & Simon, Matt (2018). The shape-shifting robot that evolves by falling down. [Business/trade/industry journal]. Wired Science.
  • Nygaard, Tønnes Frostad & Dormehl, Luke (2018). This robot taught itself how to walk and it’s as clumsy as a newborn deer. [Business/trade/industry journal]. Digital Trends.
  • Nygaard, Tønnes Frostad & Simon, Matt (2018). How Roboticists Are Copying Nature To Make Fantastical Machines. [Internet]. Wired Science.
  • Nygaard, Tønnes Frostad & Nordmoen, Jørgen Halvorsen (2018). Dynamic Robot for Embodied Testing, Open Source Material.
  • (2018). Automatic design of bodies and behaviors for real-world robots.
  • Moen, Hans Jonas Fossum; Glette, Kyrre; Nygaard, Tønnes Frostad & Johnsrud, Mette (2018). Fem felt der vi får en førerløs fremtid. [Internet]. Titan.uio.no.
  • (2018). Real-World Evolution Adapts Robot Morphology and Control to Hardware Limitations.
  • Nygaard, Tønnes Frostad; Martin, Charles Patrick; Tørresen, Jim & Glette, Kyrre (2018). Exploring Mechanically Self-Reconfiguring Robots for Autonomous Design.
  • Nygaard, Tønnes Frostad; Søyseth, Vegard Dønnem; Nordmoen, Jørgen Halvorsen & Glette, Kyrre (2018). Stand with the DyRET robot.
  • Tørresen, Jim (2018). Kunstig Intelligens – Lærende og tilpasningsdyktig teknologi.
  • Tørresen, Jim (2018). Artificial Intelligence – State-of-the-art.
  • Tørresen, Jim (2018). Ethical Robots and Autonomous Systems.
  • Tørresen, Jim (2018). Intelligent Systems for Medical and Healthcare Applications.
  • Tørresen, Jim (2018). Når etikk betyr alt. Dagens næringsliv. ISSN 0803-9372.
  • Martin, Charles Patrick (2018). Deep Predictive Models in Interactive Music.
  • Næss, Torgrim Rudland; Martin, Charles Patrick & Tørresen, Jim (2019). A Physical Intelligent Instrument using Recurrent Neural Networks. Universitetet i Oslo.
  • Tørresen, Jim; Teigen, Bjørn Ivar & Ellefsen, Kai Olav (2018). An Active Learning Perspective on Exploration in Reinforcement Learning. Universitetet i Oslo.
  • Wallace, Benedikte & Martin, Charles Patrick (2018). Predictive songwriting with concatenative accompaniment. Universitetet i Oslo.
  • Fjeld, Matias Hermanrud & Tørresen, Jim (2018). 3D Spatial Navigation in Octrees with Reinforcement Learning. Universitetet i Oslo.
  • Brustad, Henrik & Martin, Charles Patrick (2018). Digital Audio Generation with Neural Networks. Universitetet i Oslo.

View all works in Cristin

Tags: machine learning, robotics, interactive music
Published May 24, 2016 3:38 PM - Last modified Aug. 27, 2020 9:59 PM