English
version of this page
Publikasjoner
Her kan du se en oversikt over våre siste publikasjoner, registrert i NVA.
-
Jesper Andersen, Olivier Lartillot & Stefania Serafin
(2026).
Exploring Real-Time Visualizations as Support for Concert experiences for Hearing-Impaired.
I Sara Comai & Aikaterini Tzompanaki (Red.),
GoodIT '26: Proceedings of the 2026 International Conference on Information Technology for Social.
Association for Computing Machinery (ACM).
ISSN 9798400724831.
s. 550–560.
doi:
10.1145/3794786.3830797.
Fulltekst i vitenarkiv
Vis sammendrag
This study evaluates two visualization strategies designed to enhance concert experience for individuals with hearing impairments. One visualization was integrated into a performance by a classical string quartet, while the other accompanied a band performance.
A total of 67 participants, including 39 individuals with hearing impairments, evaluated their experience through questionnaires. Additionally, in-depth interviews were conducted with 16 participants from the hearing-impaired group.
Analysis of the questionnaire data revealed no significant differences in visualization preferences between hearing impaired and normal hearing participants, though individual preferences varied considerably.
The interview data offered valuable insights into participants’ subjective experiences. Several participants reported that the visualizations were cognitively taxing and, at times, distracting, pulling their focus away from the music rather than enhancing it. Many expressed a preference for clearer introductions to the visualization strategies before the concert, indicating that a better preparation for the audience could help alleviate cognitive load.
Overall, the findings suggest that, while real-time visualizations hold promise as an accessibility tool, their current implementation may not sufficiently enhance the concert experience for hearing-impaired audiences. Future research should focus on simplifying the visual design and incorporating pre-concert orientation. These results contribute to the growing body of knowledge on inclusive practices in the performing arts and highlight important avenues for continued research and development.
-
Enrique Encinas, Andrew Morrison, Alexander Refsum Jensenius, Markéta Dolejšová & John Hill
(2026).
Rhythm and Residue: Vyping as Prompting Inside the Post-Discursive Interface.
I Laura Havinen & Susanne Hägglund (Red.),
Adjunct Proceedings of the 14th Nordic Conference on Human-Computer Interaction.
Association for Computing Machinery (ACM).
ISSN 9798400727986.
s. 1–9.
doi:
10.1145/3821402.3830167.
Fulltekst i vitenarkiv
Vis sammendrag
Prompt engineering strategies emphasise clarity, specificity, and well-structured input, on the assumption that large language models (LLMs) require clean input to interpret user intent. But LLMs are pattern interpolators: they “absorb” noise through statistical reconstruction rather than strict symbol matching. Text-centric HCI has studied this tolerance for two decades without integrating it into prompt engineering as a resource. We introduce vyping as an intentional mode of prompting in which one types into LLMs at the speed of thought, without correction. We developed vyping through sustained first-person inquiry. It can be seen as a micro-practice inside a broader post-discursive turn in which meanings increasingly travel as rhythms and patterns through latent-space proximity rather than as precisely-formed symbols. The mismatch between current LLM interfaces and their (human) users has led to two common layers in implementation: (1) an orthographic residue at the interface (autocorrect, spellcheck, tidy-prompt guides), and (2) an impairment parse shadow at the training layer, a form of overalignment in which the model reads orthographic deviation as a sign that something is wrong with the user. Overall, we offer three attunements (ease, reach, and pulse) as alternatives to efficiency-first prompt engineering, and situate the practice within critical HCI traditions of seamful, frictional, and embodied interaction. The critique is structured around a seed prompt that suspends the impairment parse and makes vyping livable; its section headings are taken from the prompt’s own rules. A copy of the seed prompt is provided at the end.
-
Markus Yuki Nishimura, Kohei Matsumoto, Jim Tørresen & Ryo Kurazume
(2026).
FLexible Multi-Robot Social Navigation Using Diffusion-Based Deep Reinforcement Learning.
I Kazuo Ishii, Tomohiro Shibata, Ayanna Howard, Silvia Rossi & Aurélie Clodic (Red.),
Proceedings of The 35th IEEE International Conference on Robot and Human Interactive Communication (RO-MAN 2026).
IEEE.
ISSN 9798331588656.
s. 2122–2127.
doi:
10.1109/RO-MAN72286.2026.11714669.
Fulltekst i vitenarkiv
Vis sammendrag
Diffusion-based reinforcement learning has recently shown strong performance in robot navigation, and prior work has demonstrated that Q-Score Matching (QSM) is effective in crowded environments. Building on this line of work, we study inference-time guidance for multi-robot social navigation using Multi-Agent Q-Score Matching (MAQSM) as the backbone policy. Rather than modifying the training objective, the proposed method steers reverse diffusion sampling of a trained MAQSM policy at evaluation time toward more coordinated multi-robot behavior. The guidance combines formation consistency and goal alignment, enabling deploymenttime control without retraining. In our implementation, robots share the same diffusion policy parameters, generate per-robot actions under this shared policy, and execute the resulting multi-robot action jointly in the simulator. Experiments first compare QSM and MAQSM to motivate the choice of MAQSM as the underlying multi-robot backbone, and then compare unguided and guided MAQSM in a more challenging bidirectional scenario. The results show that inference-time guidance improves success and safety in denser settings, at the cost of longer navigation time. These findings position post-training guidance as a practical way to improve diffusion-based multirobot policies while preserving the original learning pipeline.
-
Enrique Encinas & Alexander Refsum Jensenius
(2026).
The Perfect Wrong Note: Vyping and the Keyboard as Musical Interface for Human-LLM Interaction.
I Benedict Gaster & João Nogueira Tragtenberg (Red.),
Proceedings of the International Conference on New Interfaces for Musical Expression.
The International Conference on New Interfaces for Musical Expression.
doi:
10.5281/zenodo.20784433.
Fulltekst i vitenarkiv
Vis sammendrag
Human interaction with large language models (LLMs) is commonly framed as information exchange, optimized for efficiency and correctness. This paper proposes a different framing: keyboard-as-instrument, where typing to an LLM becomes a form of musical practice. Drawing on the lineage of keyboard instruments, the action-sound framework, and the aesthetics of failure in jazz improvisation and glitch music, the paper introduces vyping (typing without looking) as a technique that treats degraded input as an expressive gesture. When a person vypes, inter-onset intervals and keystroke dynamics carry embodied information that the LLM can integrate, in a process closer to musical comping (responsive accompaniment) than to improvisation proper. Three artifacts (ll00mtube, clix-vibe, and KeyMeter) illustrate this approach, making the temporal and sonic dimensions of typing visible and audible. The paper argues that typos can function as grace notes: productive deviations that open new directions. It proposes reverence (nuance, grace, and respect) as a design orientation for human-AI interaction, while acknowledging the discomfort of caring for a tool entangled with extractive labor and concentrated corporate power.
-
Laura Bishop, Anna Niemand, Sara D'Amario & Werner Goebl
(2026).
Moving together, feeling together: Body coordination, pupil size, and musical togetherness in classical duo performance.
Psychology of Music.
ISSN 0305-7356.
doi:
10.1177/03057356261436796.
Fulltekst i vitenarkiv
Vis sammendrag
This study investigated the relationships between bodily expression, bodily coordination, mental effort, and self-reported experiences of musical togetherness. Singer-pianist duos performed pieces of classical repertoire before and after rehearsing together. Video, head motion, respiration, and pupillometry data were collected. Afterwards, the performers watched a video of their post-rehearsal performance and made continuous ratings of how together they felt. They also provided written descriptions of the cues that informed their togetherness judgements. Our analyses showed stronger head coordination between partners and larger pupil diameter during high-togetherness phrases than during low-togetherness phrases for one of the pieces. Inhalation synchrony and quantity of head motion did not differ between high- and low-togetherness phrases. Pupil size was greater during pre-rehearsal performances than during post-rehearsal performances, suggesting that demands on attention might have reduced after players had jointly constructed a shared interpretation and grown more accustomed to performing together. A thematic analysis of written responses showed that performers’ concept of togetherness related to coherence in musical parameters, moving and breathing together, and sensations of feeling together, shared musical emotion, and effortlessness. We discuss these findings in relation to the musical togetherness model.
-
Ivan Pilkov, Laura Bishop & Carlos Cancino-Chacón
(2026).
Estimating pianists' hand and finger kinematics with markerless motion capture.
I Patrice Guyot & Gregoire Bosselut (Red.),
MOCO '26: Proceedings of the 10th International Conference on Movement and Computing.
Association for Computing Machinery (ACM).
ISSN 9798400725005.
Fulltekst i vitenarkiv
Vis sammendrag
Highly-skilled pianists demonstrate fluent and efficient hand and finger motion. Recent developments in video-based methods for markerless motion capture that rely on deep learning algorithms offer a less intrusive and resource-intensive alternative to traditional marker-based infrared ones. In this work we present an initial look into how such a markerless motion capture system could be developed and utilized for the study of pianists’ hand and finger kinematics. We collect data from different pianists performing technical exercises and present an analysis of the kinematics of hand and finger motion that arise when pianists are challenged by playing at fast and slow tempi. We investigate different kinematic measures and analyze the recorded MIDI to assess the pianists’ strategies for timekeeping and hand coordination and discover certain indications for smoother motions and better control at intermediate tempi. Our results are also in line with previous work in the field and point towards the suitability of this approach for studying pianists’ hand movements.
-
Caroline Palmer, Wenbo Yi & Andrii Smykovskyi
(2026).
Synchrony and Reciprocity in Rhythmic Interaction.
Annals of the New York Academy of Sciences.
ISSN 0077-8923.
1560(1).
doi:
10.1111/nyas.70326.
Fulltekst i vitenarkiv
Vis sammendrag
Multiperson rhythmic tasks such as music performance, dance, and chant typically result in a sequence of actions or events that must be coordinated temporally across individuals. Is reciprocity a bidirectional influence among individuals who perform some action or behavior together, necessary for successful synchronization or for enhancing social interactions among those individuals? Reciprocity is considered a fundamental mechanism for promoting prosocial behavior between individuals and in evolutionary biology. We examine group rhythmic auditory tasks in terms of behavioral synchrony (e.g., body movements, tone onsets); physiological synchrony (e.g., cardiac and respiratory rhythms); and emotional synchrony (e.g., shared emotional responses). The paper identifies scientific studies that test whether reciprocity at one level (behavioral, physiological, emotional) is also shared between those individuals at another level. We review distinctions between individual differences and group‐level differences that may influence behavioral, physiological, and emotional synchrony. Understanding reciprocal relationships among group members is important for psychological and computational models of how relationships evolve over time in auditory rhythmic behaviors.
-
Hugh Alexander von Arnim, Finn Upham & Alexander Refsum Jensenius
(2026).
Exploring Methods for Measuring Audience Body Motion in Concert Halls.
I Ivica Ico Bukvic (Red.),
Proceedings of the Sound and Music Computing Conference 2026.
SMC Network.
Fulltekst i vitenarkiv
Vis sammendrag
Measurement of audience members’ body motion in ecological concert settings must navigate environmental constraints, access to audience members, privacy considerations, and behavioural norms of the performance event. This study compares five distinct technologies for capturing motion from “audience member” participants under simulated symphonic concert conditions: visible-range imaging (RGB), near-infrared imaging (IR), thermal imaging, thermal data, and torso-mounted accelerometry. Seven quantity of motion (QoM) time series were generated from these measurements, each cleaned and normalised to reveal similarities and differences in the information they provide regarding four concert-typical behaviours: Large Actions such as posture changes, Applause, Stillness, and Respiration. Results show comparable, though not identical, quantity of motion measurements across devices in this simulated concert setting. We discuss the advantages and disadvantages of the various signals, share recommendations on key measurement parameters, and discuss scaling these motion capture methods for larger audiences in real concert halls.
-
Sandra Solli, Keith B Doelling, Anne Danielsen, Mathieu Pham Van Cang, Tor Endestad & Luc H. Arnal
(2026).
Motor contributions to temporal prediction extend beyond periodic rhythms | Scientific Reports.
Scientific Reports.
doi:
10.1038/s41598-026-62759-x.
Fulltekst i vitenarkiv
Vis sammendrag
The auditory system requires a reliable and rapid tracking of the temporal dynamics of sounds. While moving in sync with a rhythm can improve timing perception, most research has focused on isochronous rhythms, conflating periodicity with predictability. This study aimed to determine whether the benefits of auditory-motor synchronization extend to aperiodic rhythms with predictable temporal structures and to uncover the neural correlates associated with the motor-enhanced benefit in timing performance. Participants listened to periodic (isochronous) and aperiodic (tempo-changing) rhythms while electroencephalography (EEG) was recorded. They imagined the continuation of each rhythm for two beats and judged the timing of a final target sound while either tapping along or listening attentively. Results showed that participants could synchronize their movements across all rhythm types. However, movement differentially affected temporal judgment across rhythms. Tapping significantly improved timing accuracy for isochronous and decelerating rhythms, demonstrating that strict periodicity is not a prerequisite for motor benefits. However, tapping impaired performance for accelerating rhythms. Behavioral evidence, supported by ERP findings, suggests that movement-induced delayed expectations during acceleration may override the predictive benefits of motor alignment. Thus, while the motor system supports general predictive processing beyond periodicity, accelerations and decelerations involve distinct predictive and motor processing demands.
-
Jim Tørresen, Diana Saplacan Lindblom, Adel Baselizadeh, Tobias Mahler & Lee Andrew Bygrave
(2026).
Reducing Robot Vulnerabilities Through Joint Regulatory Assessment and User-Centered Development and Testing.
I Yueh-Hsuan Weng (Red.),
Social Robots and Ethical Design.
Springer.
ISSN 9789819225156.
Fulltekst i vitenarkiv
Vis sammendrag
This book chapter introduces research examples from a unique collaboration between legal scholars and technology
scholars who have together endeavored to make progress in safe and privacy-preserving robot assistant development
and deployment. This collaboration has taken place within the “Vulnerability in the Robot Society” (VIROS) research
project at the University of Oslo, Norway (VIROS 2025). Institutionally, this is a joint research project between the
Norwegian Research Center for Computers and Law (NRCCL) at the Department of Private Law and the Robotics and
Intelligent Systems (ROBIN) research group at the Department of Informatics. The project explores challenges regarding
digital vulnerabilities that the adoption of robots in human environments poses, particularly as regards privacy, safety,
and security, and how these challenges can be met from legal and technical perspectives. We have been particularly
interested in exploring assistant and healthcare robots since this domain imposes high demands on the technology to be
used. As part of the project, we have analyzed various European Union (EU) regulations that have been introduced in
recent years, with a view to assessing their impact in the domain. The TIAGo robot from PAL Robotics has been the main
robot platform for technical work and experimental studies in the project. A number of novel methods for robot sensing
and control have been implemented. Further, several of them have been assessed through human–robot interaction
studies. This chapter introduces the VIROS project and outlines some of our regulatory and technological research. We also
highlight several of the conflicting trade-offs seen in the domain of HRI (Torresen et al. 2023).
-
Diana Saplacan Lindblom, Sanna Kuoppamäki, Leon Bodenhagen & Jim Tørresen
(2026).
Robots as Welfare Technologies and Actors within Future Homeand Healthcare Services.
I Laura Havinen & Susanne Hägglund (Red.),
Adjunct Proceedings of the 14th Nordic Conference on Human-Computer Interaction.
Association for Computing Machinery (ACM).
ISSN 9798400727986.
Fulltekst i vitenarkiv
Vis sammendrag
This workshop explores whether, how, and under which conditions
Welfare Robots (WRs), may be meaningfully integrated into future
home- and healthcare services and practices. Building on current
debates on welfare technology, AI-driven robots, and post-growth
Human-Robot Interaction (HRI), the workshop invites designers,
roboticists, engineers, healthcare professionals, philosophers, sociologists,
and other practitioners to critically examine and systematically
engage in contributing to exploring design alternatives and
co-design a future model for responsible integration of robots into
future care services, using Story Dialogue Method.
-
Diana Saplacan Lindblom, Yueh-Hsuan Weng, Pedro Pablo Lucas Bravo, Adel Baselizadeh & Jim Tørresen
(2026).
A Cross-Cultural Video-Based Study between Norway and Japan on Informed Consent and Disclosure Mechanisms on the Use of Social Robots in Public and Private Spaces - Users' Perspectives.
I Kazuo Ishii, Tomohiro Shibata, Ayanna Howard, Silvia Rossi & Aurélie Clodic (Red.),
Proceedings of The 35th IEEE International Conference on Robot and Human Interactive Communication (RO-MAN 2026).
IEEE.
ISSN 9798331588656.
Fulltekst i vitenarkiv
-
Claudia Magdalena Sikora, Marieke van Otterdijk, Rebekka Soma-Jestilä, Jim Tørresen & Diana Saplacan Lindblom
(2026).
"There’s something human about it!” - Exploring users’ perception of nonverbal communication of robotic furniture.
I Hooman Samani & Saina Akhond (Red.),
Proceedings of the International Confernece on Social Robotics (ICSR) + ART 2026.
Springer International Publishing .
Fulltekst i vitenarkiv
Vis sammendrag
Non-anthropomorphic robots are integrating into our homes. People
attribute human-like characteristics to these robots, although they do not
resemble humans. This raises the question of whether similar processes would
occur when people interact with robot furniture. Thus, the presented exploratory
pilot study investigates how users intuitively interpret and perceive the non
verbal communication of such robots. In an instrumental case study, we had
eleven participants interacting with the T-ABLE robot through expressive
behavior. Participants were interviewed about their experience. Our findings
indicate that the participants use their associations between behavior and prior to
similar experiences to attribute personality to the robot table. These findings
provide insights for theorizing the intuitive comprehension of the behavior of
non-anthropomorphic robots.
-
Bruno Laeng, Ayako Saneyoshi, Olga Rogulina & Akiyoshi Kitaoka
(2026).
Pupillary adjustments to the illusory depth of rotoreliefs.
Perception.
ISSN 0301-0066.
doi:
10.1177/03010066261473164.
Fulltekst i vitenarkiv
Vis sammendrag
Recent studies in the perception of visual illusions as well as mental imagery indicate that adjustments of the eye pupils reflect the perception instead of the light input stimulating the eyes. The present study put to test the expectation that similar adjustments of the eye pupil and, possibly, of other oculomotor responses like vergence, would be triggered by the stereokinetic effect, that is, illusory depth. In an eye-tracking study, both gaze direction and pupillary changes were measured while observers viewed “rotoreliefs,”’ that is, rotating two-dimensional patterns, that are known to generate a particularly strong impression of depth. Rotoreliefs can be multistable, and in some cases their perceptual interpretations alternate between seeing either a bump or a hole, protruding or extending beyond the screen. We found strong evidence that pupil diameters were larger when the depth illusion was that of a hole (funnel) than of a bump (cone). Additionally, eyes diverged a few seconds after observers reported a reversal from a bump to a hole. Thus, the eyes adjust spontaneously to what looks like a three-dimensional form, regardless of whether this is an illusion or a veridical perception. We propose that such oculomotor adjustments to illusions index the disambiguation of visual input that optimizes possible interactions with external objects in a dynamic 3D world.
-
-
-
Jonna Katariina Vuoskoski & Simon Høffding
(2026).
Empathy, Absorption, and the Feeling of Being Moved by Music.
I Andrea Schiavio, Jonna K Vuoskoski & Youn Kim (Red.),
Music and the Cognitive Humanities: Interdisciplinary Insights.
Oxford University Press.
ISSN 9780197755600.
s. 196–217.
doi:
10.1093/9780197755600.003.0009.
Fulltekst i vitenarkiv
Vis sammendrag
The findings of a recent research concert, MusicLab Copenhagen, illustrate that musical absorption and feeling moved by music appear to be highly similar and interrelated experiences, contributing strongly to listeners’ enjoyment of the music. Both experiences also seem to have an important socio-affective dimension, leading to enhanced positive affect and increased feelings of connectedness to the performers and other audience members. This chapter employs the framework of cognitive humanities, integrating perspectives from music cognition and phenomenology, to clarify the conceptual overlap as well as the subtle differences between the constructs of musical absorption and feeling moved by music. It also outlines a common underlying process: empathic “feeling into” the music.
-
Vinicius Rezende Carvalho, Alejandro Hugo Nasimbera, Silvia Kochen, Anne-Kristin Solbakk & Alejandro Omar Blenkmann
(2026).
Human Single-Neuron Responses to Multi-Feature Auditory Deviants: Evidence From Medial Temporal Lobe.
European Journal of Neuroscience.
ISSN 0953-816X.
63(12).
doi:
10.1111/ejn.70573.
Fulltekst i vitenarkiv
-
Andrii Smykovskyi, Bravo van Kerrebroeck, Jonna Katariina Vuoskoski & Caroline Palmer
(2026).
Individual Tempo Asymmetries and Coupling Dynamics in Dyadic Musical Synchronization.
Proceedings of the Annual Meeting of the Cognitive Science Society.
48,
s. 4659–4665.
doi:
https:/escholarship.org/uc/item/40q8w4b4.
Fulltekst i vitenarkiv
Vis sammendrag
Interpersonal synchronization supports social interaction by enabling coordinated behavior and shared emotional experience, yet how emotions influence the mechanisms underlying synchronization remains poorly understood. We investigated how emotional feedback influences auditory–motor synchronization between dyadic partners with faster and slower Spontaneous Production Rates (SPR). Nonmusicians completed a joint tapping task with pre-feedback, feedback (matched or mismatched positive or negative), and post-feedback phases. Temporal asynchronies were modeled using a delay-coupled oscillator model to estimate participant-specific coupling parameters. Model comparisons between delay-coupled and zero-delay models showed that allowing for a delay significantly improved model fit. Slower-SPR partners coupled more strongly than faster partners, while feedback valence did not affect coupling strength. Coupling strength was positively associated with arousal in pre-feedback trials and with perceived synchronization success under mismatched feedback trials. These findings demonstrate the role of intrinsic frequency differences and shared feedback structure in organizing interpersonal synchronization and its subjective correlates.
-
Burhan Mohammad Sarfraz, Diana Saplacan Lindblom, Adel Baselizadeh & Jim Torresen
(2026).
The Privacy-Preserving Capabilities of a Service Robot in a Scenario-Based Healthcare Setting.
I Lynne Baillie, William D. Smart, Maartje De Graaf, Matthew Gombolay & Ilaria Torre (Red.),
Proceedings of the 21st ACM/IEEE International Conference on Human-Robot Interaction (HRI Companion '26).
Association for Computing Machinery (ACM).
ISSN 9798400723216.
s. 675–679.
doi:
10.1145/3776734.3794481.
Fulltekst i vitenarkiv
-
Rainer Polak, Anne Danielsen, Nori Jacoby, Lara Pearson, Samuel Horlor & Stephane Vincent B Aubinet
[Vis alle 8 forfattere av denne artikkelen]
(2026).
Culture in psychology and neuroscience: Concepts, relevance, and empirical evidence in rhythm perception.
Physics of Life Reviews.
ISSN 1571-0645.
58,
s. 196–222.
doi:
10.1016/j.plrev.2026.07.002.
Fulltekst i vitenarkiv
Vis sammendrag
Perceptual systems adapt through individual experience across the lifespan, an ability referred to as plasticity. To understand perceptual plasticity, a promising avenue is to investigate how perception is shaped by cultural experience, as a process deeply embedded within collective practices of cultural production and social learning. The current review synthesizes findings from recent behavioral experiments investigating cross-cultural variation in rhythm perception. Specifically, these studies show that fundamental perceptual processes, such as event timing and rhythm categorization, display shared features but also systematic differences across cultural groups. Critically, these differences correlate with statistically prominent and socially relevant features of cultural production, revealing how perceptual systems are tuned to their music-cultural environments. Yet, how can cross-cultural differences in perception be related back to the collective practices that produce the diversity of cultural environments in the first place? To bridge this gap, we propose perceptual niche construction as an evolutionary approach that positions culture as both a source and a product of perceptual plasticity. That is, cultural experience tunes individual perception, yielding culturally diverse perceptual processes. These processes, in turn, function as cultural selection pressures shaping collective practices across nested timescales, thus contributing back to the diversity of cultural environments in which perception is tuned. Notably, this approach has important implications for research in psychology and neuroscience: it operationalizes culture as communities of practice, highlights the relevance of contextually situated research, and accounts for the coevolutionary nature of culture-driven perceptual plasticity.
-
Lasse Lehtonen, Jonna Katariina Vuoskoski, Henna-Riikka Peltola, Kaj Ahlsved & Kai Tuuri
(2026).
Videopelien musiikin kokeminen ja musiikilliset käytänteet.
Musiikki.
56(2),
s. 15–45.
doi:
10.51816/musiikki.185954.
Fulltekst i vitenarkiv
Vis sammendrag
Videopeleistä on muodostunut viime vuosikymmeninä merkittävä osa nykykulttuuria. Lukuisat ihmiset pelaavat ja kokevat niitä arjessaan. Artikkelissa neljä musiikintutkijaa esittelee eri näkökulmista, miten he tutkisivat videopelien musiikkia, sen kokemista ja käytänteitä. Tarjotut näkökulmat liittyvät esimerkiksi ludomusikologiaan eli pelimusiikin ja -äänen musiikkitieteelliseen tutkimukseen, mediatutkimukseen, musiikkipsykologiaan, musiikkisosiologiaan sekä etnomusikologiaan ja kulttuurintutkimukseen.
-
Finn Upham, Bilge Serdar Göksülük & Alexander Refsum Jensenius
(2026).
Laughter in the making: social bonding and coordination in dance practices.
Frontiers in Psychology.
17.
doi:
10.3389/fpsyg.2026.1754425.
Fulltekst i vitenarkiv
Vis sammendrag
Laughter is a ubiquitous human behavior with distinct social functions and evolutionary value. And yet its role in artistic and cultural practices has rarely been investigated, except in explicitly humorous performances. This study highlights laughter's central role in the participatory and developmental phases of dance. Grounded in social function frameworks, we argue that laughter functions as a vital mechanism of layered coordination, supporting group dynamics beyond verbal interaction. Through a multimodal analysis of three distinct dance contexts—an amateur line dancing lesson, a Norwegian folk dancing session, and professional duo improvisations (co-located and remote)—we investigate how and why laughter emerges in real-time creative and learning processes. Using video, physiological (heart rate, core body motion), and phenomenological data, we show that laughter is not a break in action but an integral, embodied tool for coordination development. Our exploratory study demonstrates that laughter serves to acknowledge mistakes, negotiate decisions, express difficulty, and share joyful success in dance. Critically, the quality and shared nature of laughter instances were shaped by the available communication channels, the modalities involved, and the direction of interaction. We conclude that laughter is a powerful, efficient form of embodied communication that helps dancers navigate uncertainty, build interpersonal synchrony, and co-construct shared understanding. These results underscore the importance of studying the evolutionary and social value of artistic practices as lived, co-created experiences beyond their most professional and elite forms.
-
Anne Danielsen, Justin London, Martin Torvik Langerød & Guilherme Schmidt Câmara
(2026).
All About That Bass Drum? Asynchrony Effects on the Perceived Timing of Compound Musical Sounds.
Annals of the New York Academy of Sciences.
ISSN 0077-8923.
1560(1).
doi:
10.1111/nyas.70306.
Fulltekst i vitenarkiv
Vis sammendrag
When a sound occurs (i.e., its acoustic onset) is not the same as when we perceive that sound to occur. The latter location is known as the “P‐center” in both music and language perception, and can be a few to over a hundred milliseconds after a sound's acoustic onset. While P‐center perception in music has received scrutiny, it remains unclear how P‐centers emerge when multiple instruments play together, particularly when they are not perfectly synchronized. Here, we investigate the effect of different degrees of instrument asynchrony on the P‐center of their combined sound. In two experiments, participants aligned a click probe to pairs of instruments used in popular music with varying asynchronies (0–±80 ms). Results show that increasing asynchrony shifts the P‐center of the compound sound later in time. Moreover, fast‐attack instruments (e.g., kick drum) exert a strong pull on the P‐center; fast–slow pairs largely retained a single P‐center anchored to the fast‐attack sound. By contrast, pairs of fast‐attack sounds with ≥40 ms asynchronies between their individual P‐centers provided evidence of perceptual segregation of the sound into two events. The findings show how inter‐instrument asynchronies and attack characteristics jointly structure the perceived timing and unity of compound musical sounds.
-
Alexander Refsum Jensenius
(2026).
Sounding Human: Music and Machines, 1740/2020. By Deirdre Loughridge.
Music & Letters.
ISSN 0027-4224.
doi:
10.1093/ml/gcag043.
Fulltekst i vitenarkiv
Vis sammendrag
‘It isn’t real music!’ As I write this review there is an ongoing debate in Norwegian media about a band that has been booked to play in a festival next summer. The band is composed of human performers, but they are playing songs generated by AI. Or, more precisely, they have written the lyrics themselves and then fed them into a commercial AI-based music service that has created a melody and accompaniment. Is this ‘AI music’? Is it ‘real music’? Is it more or less ‘real’ whether they play acoustic instruments or laptops on stage? And, ultimately, does it matter who made what if people want to listen? To understand today’s disruptive introduction of AI-based commercial services better, it may help to look more closely at history. This is where Deirdre Loughridge’s book is a timely and valuable contribution. It reveals that human fascination with—and harsh scepticism of—machine-generated music is nothing new.
-
Rainer Polak
(2026).
Performance in the Round: Embedded Audiency at Music–Dance Events in Mali.
Journal of the Royal Musical Association.
ISSN 0269-0403.
151(1),
s. 161–181.
doi:
10.1017/rma.2026.10066.
Fulltekst i vitenarkiv
Vis sammendrag
Abstract In many West African dance-drumming genres, the emphasis is on involving the gathered community in the performance, inviting them to take turns dancing. In such performance contexts, there is no audience in the strict sense, no group of participants who are not themselves directly involved as performers. Based on ethnographic case studies of music–dance events in rural southern Mali, this article argues for the concept of embedded audiency, showing how musicians provide dancers with the crucial contributions of audiency to performance: focused attention, social recognition, and meaning.
-
Rainer Polak, Lara Pearson & Samuel Horlor
(2026).
Round Table: Audiency beyond the Concert Hall: Theory and Ethnographic Case Studies.
Journal of the Royal Musical Association.
ISSN 0269-0403.
151(1),
s. 147–160.
doi:
10.1017/rma.2026.10064.
Fulltekst i vitenarkiv
Vis sammendrag
In recent years, the neologism audiency has found traction as a direct counterpart to the term performance , not least among theatre and performance scholars. 1 It announces audience research that is inclined to understand phenomena of witnessing as action and as involved in processes that stand in a mutually constitutive relationship with performance. This contrasts with the more familiar focus on groups of people (‘audiences’) and their constituent role identities (‘audience members’). Building on existing work, this round table seeks to further develop the audiency perspective by applying it to contexts outside of concert scenarios and other events characterized by a stable separation of counterposed performer and audience groups. We propose that considering audiency as action and opening it up to a wider range of musical contexts, ranging from rituals to games and from work to healing, can bring a deeper sense of its centrality in musical life.
-
Bilge Serdar, Aleksander Tidemann & Alexander Refsum Jensenius
(2026).
Performative Togetherness in networked music–dance performance.
International Journal of Performance Arts and Digital Media.
ISSN 1479-4713.
s. 1–22.
doi:
10.1080/14794713.2026.2657654.
Fulltekst i vitenarkiv
Vis sammendrag
This article examines how performative togetherness is constructed in a technologically mediated music–dance performance environment. While togetherness is often associated with co-presence and effortless flow, networked contexts introduce perceptual reconfiguration that makes it fragile and effortful. We present the research concert Telematic@PopSenteret, a networked performance involving dancers and musicians distributed across two floors in a museum, connected through audio–video transmission. Using interviews and audio-video recordings, we explore how latency, fractured perception, and the absence of bodily cues transformed the performers’ coordination and induced cognitive strain. We discuss how performative togetherness – defined as the sense of shared meaning-making that emerges through attentional, sensory, and adaptive negotiation – was maintained during the performance.
-
Diego Marin-Bucio
(2026).
A Framework for Human–AI Dance Creation: The Machinic Movement Matrix.
I Patrice Guyot & Gregoire Bosselut (Red.),
MOCO '26: Proceedings of the 10th International Conference on Movement and Computing.
Association for Computing Machinery (ACM).
ISSN 9798400725005.
s. 1–9.
doi:
https:/dl.acm.org/doi/10.1145/3802842.3802849.
Fulltekst i vitenarkiv
Vis sammendrag
This article proposes a conceptual framework for analyzing human–machine co-creation in dance through the lens of embodied interaction and human–AI collaboration. While the integration of AI in the performing arts has expanded rapidly, critical tools for evaluating the nature and degree of machine participation in computational creativity and interactive performance remain limited. To address this gap, the paper introduces a three-axis analytical model that characterizes human–AI interaction through generativity, responsiveness, and agency distribution. Together, these dimensions form a taxonomy of machinic agency in choreographic processes, classifying machine roles as tools, catalysts, puppets, or collaborators.
This work contributes to the growing field of dance technology by providing a theoretical framework and analytical vocabulary for understanding how kinematic communication and relational agency unfold in creative practice. It further proposes a set of conceptual categories—intermedial dance, choreorobotics, high-tech puppetry, AI dance, cyborg dance, and human–AI dance—to distinguish among diverse modes of human–machine performance interaction, offering researchers and artists a structured approach for analyzing and designing embodied human–machine dance collaborations.
-
Bilge Serdar, Aleksander Tidemann & Alexander Refsum Jensenius
(2026).
Mixed Method Audio-Video Analyses of Felt Togetherness in a Networked Music-Dance Performance.
I Patrice Guyot & Gregoire Bosselut (Red.),
MOCO '26: Proceedings of the 10th International Conference on Movement and Computing.
Association for Computing Machinery (ACM).
ISSN 9798400725005.
doi:
10.1145/3802842.3802884.
Fulltekst i vitenarkiv
Vis sammendrag
This paper presents a mixed-method approach to investigating the felt experience of a networked music–dance performance. Using this approach, we explore how a sense of togetherness emerges even when performers are distributed across distant spaces. Drawing on data from the Telematic@Popsenteret research concert, we propose a three-layered analytical framework that integrates computer-based audio-video analyses with qualitative observation, and post-performance interviews. By combining sound–motion synchrony and temporal coupling with performers’ and audience members’ experiential accounts, we examine how dancers and musicians negotiate coordination and shared presence in a telematic environment. Our findings suggest that togetherness in such settings is not merely a matter of temporal alignment, but a dynamically constructed, multimodal process involving perceptual adaptation, cross-modal attunement, and affective awareness.
-
Nanette Nielsen
(2026).
Enacting Musical Creativity: The Value of Human Agency in the Face of AI.
Journal of Consciousness Studies.
ISSN 1355-8250.
33(3),
s. 123–144.
doi:
10.53765/20512201.33.3.123.
Fulltekst i vitenarkiv
Vis sammendrag
In his recent critique of well-established simplified comparisons between the human mind and AI, Alva Noë encourages us to 'rage against the machine' (Noë, 2024). In this article, I build on Noë's timely encouragement, and sketch perspectives from both music studies and enactivist philosophy in order to interrogate what musicking might add to the debate. As a case study, I explore the recent public discourse surrounding the AI-band The Velvet Sundown and consider the implications — mental health related and ethical — of engaging with AI-generated music. I draw on current scholarship on musical creativity and AI to discuss the possibilities and limitations of creative agency in AI, laying the foundation for why human creative agency should be regarded more valuable than the artificial creativity that AI offers. I also discuss some ethical implications of sharing agency with AI, suggesting that we should continue to foster attunement to our creative agency and capabilities, as empowered but also vulnerable musicking human agents. I argue that musicking offers an enactive entanglement through which we are granted an opportunity to embrace risk, resist rules, and learn new modes of orientation and reorientation that serve as empowering tools for navigating our way through the resistant path to being human.
-
Hugh Alexander von Arnim, Anna-Maria Christodoulou, Kayla Burnim, Finn Upham, Tejaswinee Kelkar & Alexander Refsum Jensenius
(2026).
LightHearted—A Framework for Mapping ECG Signals to Light Parameters in Performing Arts.
I Anthony L. Brooks (Red.),
Proceedings of the 14th EAI International Conference on ArtsIT, Interactivity and Game Creation, ArtsIT 2025.
Springer.
ISSN 9783032269997.
s. 719–738.
doi:
10.1007/978-3-032-26999-7_18.
Fulltekst i vitenarkiv
Vis sammendrag
This paper presents LightHearted, an open-source Python framework for mapping the heart’s electrical activity from electrocardiography (ECG) signals acquired from performers to stage lighting in a concert setting. The aim is to provide dynamic lighting coupled to the physiological processes occurring during performance. Drawing upon critical approaches towards using biosignals in interactive systems and live concert research, we outline the framework’s design and implementation and present a case study with the Aarhus Symphony Orchestra. This paper highlights both technical and conceptual challenges of integrating biosensor-based lighting into a large-scale orchestral context. Results from a post-concert audience survey (N = 324) suggest that while responses to the lighting were mixed, it was generally not perceived as distracting and would be welcomed for use in future concerts.
-
Fadi Al-Ghawanmeh, Alexander Refsum Jensenius & Kamel Smaili
(2026).
Arab music improvisation corpus for research (AMICOR): development and machine translation experiments | Language Resources and Evaluation.
Language Resources and Evaluation.
ISSN 1574-020X.
60.
doi:
10.1007/s10579-026-09905-z.
Fulltekst i vitenarkiv
Vis sammendrag
Under-resourced languages (and musics) pose a challenge to machine translation (MT). The challenge is greater when the content of the collected dataset is a varied sample taken from a data population that is even more diverse and dynamic. This is the challenge of Arab music vocal improvisation (mawwal). Here, we present the development of AMICOR, a parallel dataset consisting of vocal improvisatory phrases and their corresponding instrumental responses (or tarjamat in Arabic, which literally means “translations”) in the mawwal tradition. These melodic phrases are handled as “sentences” from the viewpoint of natural language. When developing the dataset, we integrated musicological insights in order to evaluate music theoretical differences between sub-datasets, primarily regarding their size, sentence length, performance quality, and shared musical identity. We then experimented with MT to generate instrumental responses to new vocal sentences, comparing several translation modeling configurations that differ (1) in translation approach (Neural MT (NMT) versus Statistical MT (SMT)), and (2) in the dataset handling approach in respect to the maqam (an Arabic musical term referring roughly to a melodic mode), comparing an individual model for each maqam versus a unified model for all maqamat. We found that merging related sub-datasets does not necessarily lead to better results, and may even favor simpler and shorter sentences with lower performance quality and less sophisticated patterns. This issue applies to both NMT and SMT; however, it is greater for NMT. A comparison of confusion matrices of individual-maqam models suggested that, in such a small dataset, the gap between SMT and NMT performance increases further if the styles, or skills, of potential users differ from those who built the dataset used in the training. Our discussion asserts that key factors in system design are the musical background and performance decisions of vocalists who may use such responsive generative models, as well as dataset size and performance quality.
-
Jinyue Guo, Jim Tørresen & Alexander Refsum Jensenius
(2026).
Investigating Auditory–Visual Perception Using Multi-Modal Neural Networks with the SoundActions Dataset.
Transactions of the International Society for Music Information Retrieval.
9(1),
s. 85–85.
doi:
10.5334/tismir.223.
Fulltekst i vitenarkiv
Vis sammendrag
Musicologists, psychologists, and computer scientists study relationships between auditory and visual stimuli from very different perspectives and using various terminologies and methodologies. This article aims to bridge the gap between phenomenological sound theory, auditory–visual theory, and audio–video processing and machine learning. We introduce the SoundActions dataset, a collection of 365 audio–video recordings of (primarily) short sound actions. Each recording has been human‑labeled and annotated according to Pierre Schaeffer’s theory of reduced listening, which describes the property of the sound itself (e.g., ‘an impulsive sound’) instead of the source (e.g., ‘a bird sound’). With these reduced‑type labels in the audio–video dataset, we conducted two experiments: (1) fine‑tuning the latest audio–video transformer model on the reduced‑type labels in the SoundActions dataset, proving that the model can recognize reduced‑type labels, and observing that the modality‑imbalance phenomenon is similar to the added value theory by Michel Chion and (2) proposing the Ensemble of Perception Mode Adapters method inspired by Pierre Schaeffer’s three listening modes, improving the audio–video model also on reduced‑type tasks.
-
Diego Marin-Bucio, Anne Danielsen, Noumouke Doumbia & Rainer Polak
(2026).
Memory in performance: kinesthetic and procedural dimensions of skill acquisition in dance improvisation.
Frontiers in Psychology.
17.
doi:
10.3389/fpsyg.2026.1751590.
Fulltekst i vitenarkiv
Vis sammendrag
Improvisation is central to creative behavior across artistic and everyday domains, yet it is often portrayed as either pure freedom or rule-bound execution. While research in music and dance has shown that improvisation draws on structured kinesthetic vocabularies, less is known about how cultural rhythm and embodied memory interact in real time within and across genres. This study addresses that gap through ethnographic fieldwork in West Africa, where the first author, trained in contemporary dance, engaged in learning and performing Malian djembe dance. Drawing on autoethnography with a phenomenological orientation, alongside participant observation and conversations with Malian drummers and dancers, the analysis examines how kinesthetic and procedural memories inform real-time performance. Findings suggest that improvisation operates through culturally specific ways of sensing and attending to movement: dancers navigate genre-specific repertoire, rhythmic cues, and bodily affordances to evoke and transform embodied material. However, rather than merely reproducing fixed repertorial units , dancers also reconfigure embodied resources such as movement qualities in responsive and inventive ways. Our research supports the view of improvisation as structured play rather than unbound invention and advances the discourse by emphasizing the reconstructive play of embodied recall—how cultural and personal memories are recomposed in performance. Overall, the study contributes to understanding improvisation as a cognitive and cultural process: not the free invention of form but the creative reorganization of embodied memories within shared perceptual and rhythmic systems.
-
Liv Merve Akca Abrahamsson, Sascha Frühholz & Jonna Katariina Vuoskoski
(2026).
Domain-specific perception of emotional intensity in brief musical and vocal expressions.
JASA Express Letters.
6(2).
doi:
10.1121/10.0042460.
Fulltekst i vitenarkiv
Vis sammendrag
Auditory emotional intensity perception was investigated using behavioral ratings of voice and music stimuli. Principal component analysis revealed distinct domain-specific structures [principal component 1 (PC1) 48%, PC2 11.2%), with the primary dimension for music intensity judgments explaining larger variance. Domain-specific analyses converged on a two-dimensional valence–arousal space, indicating shared structure yet differing variability. These findings advance theoretical understanding of how emotional intensity is organized across auditory domains of voice and music and highlight music as a particularly rich substrate for inter-individual differences in affective intensity perception.
-
Maham Riaz, Cagri Erdem & Alexander Refsum Jensenius
(2026).
Inverse and indirect mappings in embodied AI systems in everyday environments.
Frontiers in Computer Science.
7.
doi:
10.3389/fcomp.2025.1603769.
Fulltekst i vitenarkiv
Vis sammendrag
This paper explores how musicking technologies—interactive systems with musical properties—can enhance everyday public environments. We are particularly interested in investigating the effects of musical interactions in non-musical settings, such as offices, meeting rooms, and social work areas. Traditional music technologies (such as instruments) are built for goal-directed, conscious, and voluntary interactions. We propose a new perspective on embodied AI through systems that utilize indirect, inverse, unconscious, and, at times, involuntary interactions. Four different sound/music systems are examined and discussed with regard to their activity level: a reactive “birdbox,” a reactive painting, active self-playing guitars, and interactive music balls. All these systems are multimodal, containing sensors that detect various physical inputs to produce sound and light, and having varying levels of perceived agency. The paper explores differences between direct/indirect and regular/inverse embodied AI paradigms. This study demonstrates how minimalistic interactions have the potential to yield complex and engaging musicking experiences, challenging the norms of overly intricate AI implementations.
-
Jon Marius Aareskjold-Drecker & Ragnhild Brøvig
(2026).
Hey Siri, Can You Write Me a Chipmunk Soul Track? A Snapshot of AI Tools Currently Used in Music Production.
I Claus Sohn Andersen, Jan-Olof Gullö, Russ Hepworth-Sawyer, Mark Marrington, Justin Paterson & Rob Toulson (Red.),
Innovation in Music: Current Research Perspectives.
Routledge.
ISSN 9781032757858.
doi:
10.4324/9781003475675-9.
Fulltekst i vitenarkiv
Vis sammendrag
This article provides an overview of current AI-assisted tools used in music composition and production and demonstrate their application through research-based music production. By highlighting the diverse range of applications and levels of automation offered by AI tools, we nuance the discourse focused on AI-generated tracks and challenge the assumption that using AI necessarily equates to cheating. We demonstrate how musicians can harness AI to support their artistry without overshadowing human expression, ensuring that creativity and integrity remain at the forefront
-
Ragnhild Brøvig & Ivar Grydeland
(2026).
Love Your Latency: The Glitching Spatiotemporality of Telematic Music Performances.
I Claus Sohn Andersen, Jan-Olof Gullö, Russ Hepworth-Sawyer, Mark Marrington, Justin Paterson & Rob Toulson (Red.),
Innovation in Music: Innovative Creative Practice - 1st Edition.
Routledge.
ISSN 9781032757834.
doi:
https:/www.routledge.com/Innovation-in-Music-Innovative-Creative-Practice/SohnAndersen-Gullo-Hepworth-Sawyer-Marrington-Paterson-Toulson/p/book/9781032757834.
Fulltekst i vitenarkiv
Vis sammendrag
Innovation in Music: Innovative Creative Practice is a groundbreaking collection, bringing together contributions from instructors, researchers, and professionals, focusing on the joy of discovery in the context of music production, music technology, and music performance.
With chapters on augmented creativity, single tonality chord songwriting, musical instruments as live samplers and playing field recordings in music production, this book is recommended reading for students, researchers, and professionals looking for global insights into the fields of music production, business, and technology.
-
Geir Paulsen, Juan Sebastian Cardenas, Rosa Nicoline Pham Alsgaard, Adel Baselizadeh, Md Zia Uddin & Jim Tørresen
(2025).
AI-Based User Gesture Recognition for Human-Robot Interaction Using Wrist Sensors.
I Eisuke Kita (Red.),
2025 11th International Conference on Robotics and Artificial Intelligence (ICRAI), December 19-21, 2025, Nagoya, Japan.
IEEE (Institute of Electrical and Electronics Engineers).
ISSN 9798331590680.
s. 161–165.
doi:
10.1109/icrai68431.2025.11396715.
Fulltekst i vitenarkiv
Vis sammendrag
Natural and intuitive interaction remains a central challenge in human-robot communication. This study presents a privacy-preserving gesture recognition framework that enables command-based interaction through simple hand and arm movements. Motion data are captured using a wrist-worn sensor, eliminating the need for cameras or other intrusive tracking systems. Data from ten participants performing seven gesture classes, including move forwards, move backward, move left-right, spin horizontally, spin vertically, wave, and move up-down are used to train and validate a hybrid Convolutional Long Short-Term Memory (CNN-LSTM) model. An additional non-command state is included to ensure the robot remains inactive when no gesture is detected. The proposed model achieves an overall recognition accuracy of approximately 95% across all gesture classes using cross-validation. This framework enhances the safety, intuitiveness, and fluidity of human-robot interaction and provides a robust foundation for gesture-based robot control and human activity recognition.
-
Håkon Haustreis Tønnessen, Md Zia Uddin & Jim Tørresen
(2025).
PINE: Planning and Identifying Neural Network for Thinking Fast and Slow.
I Eisuke Kita (Red.),
2025 11th International Conference on Robotics and Artificial Intelligence (ICRAI), December 19-21, 2025, Nagoya, Japan.
IEEE (Institute of Electrical and Electronics Engineers).
ISSN 9798331590680.
s. 191–197.
doi:
10.1109/icrai68431.2025.11396706.
Fulltekst i vitenarkiv
Vis sammendrag
The human brain's unique ability to seamlessly switch between quick, effortless reactions and slow, deliberate thinking forms the foundation for the content of this paper. Humans effortlessly navigate complex tasks like walking, speaking, and driving, relying on heuristic responses to their environment. This natural division of labor allows humans to adapt quickly and efficiently, tackling both new challenges and familiar tasks. Drawing inspiration from this cognitive duality, we propose, in this paper, a machine-based analog that employs a two-level functionality mirroring human capabilities. The approach centers on a Reinforcement Learning agent that replicates human learning through trial and error. The thesis introduces the Planning and Identifying Neural Network (PINE), a framework that identifies tasks using a combination of inherited environmental information, observations, and human-readable task descriptors. PINE leverages a model-based Reinforcement Learning algorithm, streamlining agent complexity and significantly reducing solution-finding time compared to model-free algorithms. PINE operates in real-time, utilizing initial environmental observations and task descriptors to identify and categorize encountered tasks. For unknown tasks, PINE employs meta-learning, selecting the most similar known task to expedite the solution-finding process with fewer episodes. Despite the challenge of task identification without interaction or labels, PINE demonstrates high accuracy in recognizing previously solved tasks and providing reliable estimates for the most similar tasks. This innovative two-level learning model represents a significant step towards creating adaptive machines that efficiently handle both familiar and novel challenges.
-
-
Hoang Minh Pham, Farzan Majeed Noori, Md Zia Uddin & Jim Tørresen
(2025).
Heart Rate Forecasting Using Ultra-Wideband Radar with Sequence-to-Sequence Model.
I Luis Cruz, Sven Loncaric, Zhibo Chen, Armando J. Pinho, Jorge Batista & Marko Subasic (Red.),
Proceedings of the 14th International Symposium on Image and Signal Processing and Analysis (ISPA), Coimbra, Portugal, October 29-31, 2025.
IEEE (Institute of Electrical and Electronics Engineers).
ISSN 9798331577551.
s. 16–21.
doi:
10.1109/ispa66905.2025.11259452.
Fulltekst i vitenarkiv
Vis sammendrag
Heart dysfunction can be very dangerous and directly associated with the risk of fatality. Therefore, automatic heart rate monitoring is important for detecting a heart abnormality early and providing timely intervention. The development of advanced sensor technology allows continuous tracking of the heart rate, as well as providing more health-related data sources, which could further improve the forecasting performance. In this study, we investigate the use of recent heart rate values and Ultra-Wideband (UWB) data in the last 20s to predict the next 10s of heart rate. Data were collected from 20 participants performing different activities. We examine the forecasting by using only a heart rate sensor (uni-modality) and by using heart rate sensor and UWB together (multi-modality). Three levels of activity were included in the study: resting (rest), lying after doing exercises (lying-abnormal) and lying after full recovery (lying-normal). A multi-modality Sequence-to-Sequence (Seq2Seq) model has a 10-percent quantile losses of 5.20 for rest activity, 4.92 for lying-abnormal activity, and 4.24 for lying-normal activity. With the lowest loss, Seq2Seq outperforms Autoregressive Integrated Moving Average (ARIMA), Error Trend and Seasonality (ETS), Transformer and Temporal Fusion Transformer (TFT) in forecasting heart rate in the three activity levels. Our results point to a new direction in multimodal prediction of heart rate to assist healthcare, using deep learning approaches.
-
Shunsuke Goka, Ørjan Strand, Jun Miura & Jim Tørresen
(2025).
Situation-Based Navigation Strategy Switching for Mobile Robots in Dynamic Pedestrian Environments.
I Takahiro Uchiya, Ryota Nishimura & Tadaaki Ikehara (Red.),
2025 IEEE 14th Global Conference on Consumer Electronics (GCCE).
IEEE (Institute of Electrical and Electronics Engineers).
ISSN 9798331524166.
doi:
10.1109/gcce65946.2025.11275115.
Fulltekst i vitenarkiv
Vis sammendrag
This paper proposes a method for adaptively switching navigation strategies based on a visual assessment of the current situation. Despite recent progress in motion planning and navigation methods, it is still challenging to adopt a single navigation method in various situations, which are determined by both the environment structure and pedestrian distribution and movements. A promising approach is to switch between multiple navigation strategies depending on the current situation. The proposed method adopts a visual situation classification, trained on an automatically labeled dataset, for choosing an appropriate local motion planner. Experimental comparison with fixed planners using a real robot demonstrates the superiority of our method in terms of both navigation efficiency and safety.
-
Massimo Grassi, Francesca Talamini, Gianmarco Altoè, Elvira Brattico, Anne Caclin & Barbara Carretti
[Vis alle 110 forfattere av denne artikkelen]
(2025).
Do Musicians Have Better Short-Term Memory Than Nonmusicians? A Multilab Study.
Advances in Methods and Practices in Psychological Science (AMPPS).
ISSN 2515-2459.
8(4).
doi:
10.1177/25152459251379432.
Fulltekst i vitenarkiv
Vis sammendrag
Musicians are often regarded as a positive example of brain plasticity and associated cognitive benefits. This emerges when experienced musicians (e.g., musicians with more than 10 years of music training and practice) are compared with nonmusicians. A frequently observed behavioral finding is a short-term memory advantage of the former over the latter. Although available meta-analysis reported that the effect size of this advantage is medium (Hedges’s g = 0.5), no literature study was adequately powered to estimate reliably an effect of such size. This multilab study has been ideated, realized, and conducted in lab by several groups that have been working on this topic. Our ultimate goal was to provide a community-driven shared and reliable estimate of the musicians’ short-term memory advantage (if any) and set a method and a standard for future studies in neuroscience and psychology comparing musicians and nonmusicians. Thirty-three research units recruited a total of 600 experienced musicians and 600 nonmusicians, a number that is sufficiently large to estimate a small effect size (Hedges’s g = 0.3) with a high statistical power (i.e., 95%). Subsequently, we measured the difference in short-term memory for musical, verbal, and visuospatial stimuli. We also looked at cognitive, personality, and socioeconomic factors that might mediate the difference. Musicians had better short-term memory than nonmusicians for musical, verbal, and visuospatial stimuli with an effect size of, respectively, Hedges’s g s = 1.08 (95% confidence interval [CI] = [0.94, 1.22]; large), 0.16 (95% CI = [0.02 0.30]; very small), and 0.28 (95% CI = [0.15, 0.41]; small). This work sets the basis for sound research practices in studies comparing musicians and nonmusicians and contributes to the ongoing debate on the possible cognitive benefits of musical training.
-
Ege de Bruin, Kyrre Glette & Kai Olav Ellefsen
(2025).
Integrating Sample Inheritance into Bayesian Optimization for Evolutionary Robotics.
I Olaf Witkowski, Alyssa M. Adams, Lana Sinapayen, Manuel Baltieri & Mahdi Khosravy (Red.),
ALIFE 2025: Ciphers of Life: Proceedings of the Artificial Life Conference 2025.
MIT Press.
doi:
10.1162/ISAL.a.866.
Fulltekst i vitenarkiv
Vis sammendrag
In evolutionary robotics, robot morphologies are designed automatically using evolutionary algorithms. This creates a body-brain optimization problem, where both morphology and control must be optimized together. A common approach is to include controller optimization for each morphology, but starting from scratch for every new body may require a high controller learning budget. We address this by using Bayesian optimization for controller optimization, exploiting its sample efficiency and strong exploration capabilities, and using sample inheritance as a form of Lamarckian inheritance. Under a deliberately low controller learning budget for each morphology, we investigate two types of sample inheritance: (1) transferring all the parent’s samples to the offspring to be used as prior without evaluating them, and (2) reevaluating the parent’s best samples on the offspring. Both are compared to a baseline without inheritance. Our results show that reevaluation performs best, with prior-based inheritance also outperforming no inheritance. Analysis reveals that while the learning budget is too low for a single morphology, generational inheritance compensates for this by accumulating learned adaptations across generations. Furthermore, inheritance mainly benefits offspring morphologies that are similar to their parents. Finally, we demonstrate the critical role of the environment, with more challenging environments resulting in more stable walking gaits. Our findings highlight that inheritance mechanisms can boost performance in evolutionary robotics without needing large learning budgets, offering an efficient path toward more capable robot design.
-
Finn Upham & Fernando E. Rosas
(2025).
When and How the Audience Moves.
Music & Science.
8,
s. 1–24.
doi:
10.1177/20592043251398280.
Fulltekst i vitenarkiv
Vis sammendrag
Audience motion is a defining component of the face-to-face concert experience. Motion is also a common component of individual audience members’ reactions and actions to live performances. This article investigates patterns in chest-mounted accelerometer measurements from audience members at a chamber music concert experiment. The aim is to contextualize their behavior during music performance using a sequence of exploratory analyses. Combining insight from subjective reports of audience motion; musical, environmental, and biological frequencies; and similarity of motion timing with neighbors or more distant participants, both in-hall audience participants and live-stream viewers show two distinct music–motion patterns: either unobtrusive dynamic stilling or noticeable tempo-matched bouncing. Audience motion outside of music, during applause, speeches, or survey writing, also shows distinct average quantities of motion and degrees of shared information between seat neighbors, prompting a discussion on the constrained opportunities for audience action and social interaction at live classical concerts. Although exploratory, these extensive analyses provide a useful foundation for future work to further understand audience behaviors in concert music settings and beyond.
-
Connor Spiech, Guilherme Schmidt Câmara, Julian Fuhrer & Penhune, Virginia
(2025).
4/4 and more, rhythmic complexity more strongly predicts groove in common meters.
Communications Psychology.
3.
doi:
10.1038/s44271-025-00360-0.
Fulltekst i vitenarkiv
Vis sammendrag
The pleasurable urge to move to music, termed “groove,” is thought to arise from the tension between top-down metric expectations or predictions and rhythmic complexity. Specifically, groove ratings are highest for moderately complex rhythms, balancing expectation and surprise. To test this, meter and rhythmic complexity need to be manipulated independently to assess their impact on groove. Thus, we compared Western listeners’ ratings for musical clips of varying rhythmic complexity composed in either the most common Western meter (4/4) or less common meters (e.g., 7/8). In several behavioral studies (Experiment 1, N = 143; Experiment 2, N = 120; Experiment 3, N = 120), we used Bayesian regression to show that groove is greatest for moderately complex rhythms, but only in 4/4. In non-4/4 meters, simpler rhythms elicited the greatest groove. This provides support for the theory that bottom-up rhythmic features interact with meter in a way that shapes the pleasurable urge to move to music.
-
Emmanuel Coulon, Sacha Baum, Tomas Lenc, Rainer Polak & Sylvie Nozaradan
(2025).
Neural representation of the musical beat is facilitated but not contingent on the repetition of rhythmic patterns.
Scientific Reports.
16(1).
doi:
10.1038/s41598-025-30780-1.
Fulltekst i vitenarkiv
Vis sammendrag
Music often entails perception of periodic beats which serve as internal temporal references to coordinate movements to music. Crucially, beat perception arises even in syncopated musical rhythms, which only weakly cue the beat periodicity. However, syncopated rhythms are often looped in music, suggesting that repetition of rhythmic patterns may facilitate beat perception by providing a periodic structure at a supra-second timescale. Here, we tested this hypothesis by recording separately electroencephalographic (EEG) and behavioral responses (finger tapping) while participants listened to different syncopated rhythmic sequences. These sequences either consisted of a repeated pattern (repetition of 4.8 and 9.6-s-long patterns) or were generated without repetition. Despite the degradation of pattern repetition, neural activity showed a periodized representation of the rhythmic input across conditions, at periodicities corresponding to those expressed in behavioral responses. However, this neural activity was further enhanced in the condition with shorter repeated patterns. Thus, pattern repetition was not necessary but strengthened the neural representation of the beat, demonstrating that supra-second periodicities in the rhythmic input further enhance sub-second periodicities in neural activity. These findings highlight the multiscale temporal processing of musical rhythm, and, more generally, complex rhythmic inputs involved in interpersonal interaction and communication.
-
Pedro Pablo Lucas Bravo, Alexander Szorkovszky, Stefano Fasciani & Kyrre Glette
(2025).
HS-ims: A Platform for Human-Swarm Interactive Music Systems.
I Kenji Tei & Franco Zambonelli (Red.),
2025 IEEE International Conference on Autonomic Computing and Self-Organizing Systems (ACSOS).
IEEE (Institute of Electrical and Electronics Engineers).
ISSN 9798331502157.
doi:
10.1109/ACSOS-C66519.2025.00067.
Fulltekst i vitenarkiv
Vis sammendrag
This paper introduces HS-ims, an integrated virtual environment designed for developing real-time musical multiagent systems. It addresses the need for technological platforms that emphasize sound applications, flexible prototyping, and comprehensive data collection from these multi-agent systems. HS-ims offers a 3D virtual environment with built-in sound synthesis via binaural audio, an Open Sound Control (OSC) API implementation that is language-agnostic, and a data collection module. The platform operates with an External Controller managing multi-agent logic. We present relevant performance metrics and provide examples highlighting how HS-ims has proven valuable in research and education. This encourages further exploration and establishes it as a useful tool for music performance.
-
Björn Thór Jónsson, Cagri Erdem, Stefano Fasciani & Kyrre Glette
(2025).
Live Coding the Lineage.
I Anna Xambo Sedo & Michel Buffa (Red.),
Proceedings of the International Web Audio Conference (WAC).
IRCAM.
doi:
10.5281/zenodo.17642435.
Fulltekst i vitenarkiv
Vis sammendrag
This paper presents a web-based system for exploring and performing with sounds discovered through Quality Diver- sity evolutionary algorithms. Our system renders interactive phylogenetic trees of evolutionary sound discovery processes, transforming genealogical relationships into a performable interface—the “Harpsitree”—using trajectory-based interaction and automatic code generation. The core concept we explore is “algorithmic sketching,” where trajectory-based discovery through evolutionary structures progressively formalises into executable code, bridging visual exploration and textual live coding paradigms. This work contributes a novel performance interface as part of a larger research project investigating evolutionary computation for sound discovery, demonstrating how phylogenetic structures can reveal com- positional affordances through appropriate interaction design.
-
Ragnhild Brøvig
(2025).
Stealing From or Facilitating Hard-Working Musicians? Remixers' Code of Honor.
I Eduardo Antonio Navas, Owen Gallagher & xtine burrough (Red.),
The Routledge Companion to Remix Studies - 2nd Edition - Eduardo Navas.
Routledge.
s. 401–411.
doi:
10.4324/9781003402459-33.
Fulltekst i vitenarkiv
Vis sammendrag
While terms like “theft” and “piracy” have often been used to describe sampling, equating it with criminal behavior overlooks the complexities of copyright law and the ethical perspectives of remix artists. Drawing on interviews with mashup producers, this chapter reveals their perspectives and ethical guidelines regarding sampling, emphasizing the distinction between plagiarism and acknowledged appropriation, where the latter serves as a form of artistic commentary rather than a mere exploitation of others’ work.
-
Anna-Maria Christodoulou, Hugh Alexander von Arnim & Alexander Refsum Jensenius
(2025).
Supporting Narrative Comprehension in Programmatic Music through Music and Light.
I Angela McArthur, Emma-Kate Matthews & Tom Holberton (Red.),
Proceedings of the 17th International Symposium on Computer Music Multidisciplinary Research.
The Laboratory PRISM “Perception, Representations, Image, Sound, Music”.
ISSN 9791097498061.
s. 447–454.
doi:
10.5281/zenodo.17496754.
Fulltekst i vitenarkiv
Vis sammendrag
Programmatic music, such as Tchaikovsky’s Overture Romeo and Juliet, relies on the audience’s ability to associate musical motifs with narrative elements. This is a demanding task for less experienced listeners, particularly when cues are subtle, such as those conveyed through timbre. This paper explores how dynamic stage lighting, driven by physiological signals, can enhance narrative comprehension in orchestral performance. Using the LightHearted interactive lighting system, different characters of the Overture were mapped to distinct colored lights, whose intensities were dynamically modulated in real time by the heart rates of the conductor and selected musicians. This integration aimed to convey subtle narrative cues to the audience in real time. Audience feedback suggests that this approach not only clarifies musical narratives but also enhances the overall experience.
-
Emil Bernhardt
(2025).
Alltid et annet sted – estetisk forflytning og fantasiens plikt.
I Henrik Holm & Anastasiya Alexeeva (Red.),
Estetiske fag i samfunnet.
Cappelen Damm Akademisk.
ISSN 9788202868673.
s. 13–32.
doi:
https:/cdforskning.no/cdf/catalog/book/261.
Fulltekst i vitenarkiv
Vis sammendrag
This essay starts with the following observation: The aesthetic effect always happens somewhere else than we initially believe. I would argue that there is a displacement here, from an
assertion that is manageable to an effect that remains uncontrollable. Furthermore I would argue that this displacement is aesthetically qualifying. What happens never merges with the motivation for what was done; what was done had a different aim than what happens. This perspective emphasises what we might call the event aspect of aesthetics, and our conception of what we can actually do is adjusted accordingly. I approach the idea of such a displacement in three ways: First, I briefly mention three examples from our contemporary cultural sphere. These are what has been called historically informed performance practice in classical music, then what has been called reality literature, and finally the painter Odd Nerdrum’s relationship to classical painting. Secondly, I examine the relationship between the idea of aesthetic displacement and modern aesthetics’ concept of aesthetic autonomy. Might the idea of aesthetic displacement be thought of as an example of such autonomy? Thirdly, I pursue the event and action perspective and ask whether a practical counterpart to aesthetic displacement is possible. Is there anything we can do that somehow corresponds to the fact that something happens? Here I try to develop a concept of a duty of imagination.
-
Cédric Lenoir, Tomas Lenc, Rainer Polak & Sylvie Nozaradan
(2025).
Behavior-Relevant Periodized Neural Representation of Acoustic But Not Tactile Rhythm in Humans.
Journal of Neuroscience.
ISSN 0270-6474.
45(46),
s. 1–14.
doi:
10.1523/jneurosci.0664-25.2025.
Fulltekst i vitenarkiv
Vis sammendrag
Music makes people move. This human propensity to coordinate movement with musical rhythm requires multiscale temporal integration, allowing fast sensory events composing rhythmic input to be mapped onto slower, behavior-relevant, internal templates such as periodic beats. Relatedly, beat perception has been shown to involve an enhanced representation of the beat periodicities in neural activity. However, the extent to which this ability to move to the beat and the related “periodized” neural representation are shared across the senses beyond audition remains unknown. Here, we addressed this question by recording separately the electroencephalographic (EEG) responses and finger tapping to a rhythm conveyed either through acoustic or tactile inputs in healthy volunteers of either sex. The EEG responses to the acoustic rhythm, spanning a low-frequency range (below 15 Hz), showed enhanced representation of the perceived periodic beat, compatible with behavior. In contrast, the EEG responses to the tactile rhythm, spanning a broader frequency range (up to 25 Hz), did not show significant beat-related periodization and yielded less stable tapping. Together, these findings suggest a preferential role of low-frequency neural activity in supporting neural representation of the beat. Most importantly, we show that this neural representation, as well as the ability to move to the beat, is not systematically shared across the senses. More generally, these results, highlighting multimodal differences in beat processing, reveal a process of multiscale temporal integration that allows the auditory system to go beyond mere tracking of onset timing and to support higher-level internal representation and motor entrainment to rhythm.
-
Emil Engelstad Moghaddam, Md Zia Uddin, Jun Miura & Jim Tørresen
(2025).
A Robust Approach for Motion Skill-Based Scene Categorization.
I Filippo Neri (Red.),
Proceedings of the 2025 10th International Conference on Machine Learning Technologies (ICMLT), May 23-25, 2025, Helsinki, Finland.
IEEE (Institute of Electrical and Electronics Engineers).
ISSN 9798331536725.
s. 482–487.
doi:
10.1109/icmlt65785.2025.11193163.
Fulltekst i vitenarkiv
Vis sammendrag
This paper introduces a novel method for autonomous navigation of mobile robots, combining functional scene categorization with tailored navigation strategies. Scene categorization is a computer vision task that identifies environmental types in images. Our approach establishes a taxonomy for scene categorization with the aim of utilization in mobile robots. We used a motion-skill dataset for training different neural networks. The dataset, comprising 19923 images with nine navigation strategy labels, demonstrated the feasibility of coupling environment recognition with neural networks. Three architectures (ResNet-50, BEiT-Base, ConvNeXt-Tiny) achieved notable performance, with ConvNeXt-Tiny leading with a weighted F1 score of 0.934. Pre-training on the SUN397 dataset significantly improved the model performance, emphasizing the importance of leveraging existing scene categorization datasets. This study highlights the synergy between scene categorization and functional scene categorization, providing insights for designing efficient, context-aware autonomous navigation systems.
-
Maham Riaz, Jinyue Guo, Cagri Erdem & Alexander Refsum Jensenius
(2025).
Where to Put That Microphone? A Study of Sound Localization in Ambisonics Recordings.
I Angela McArthur, Emma-Kate Matthews & Tom Holberton (Red.),
Proceedings of the 17th International Symposium on Computer Music Multidisciplinary Research.
The Laboratory PRISM “Perception, Representations, Image, Sound, Music”.
ISSN 9791097498061.
s. 455–466.
doi:
10.5281/ZENODO.17497086.
Fulltekst i vitenarkiv
Vis sammendrag
This paper examines the effects of microphone placement on sound localization in first-order Ambisonics recordings. Two microphone setups were used to capture a moving audio source in a lab environment. Array A, a tetrahedral microphone, was placed in the centre of the recording space. Array B consisted of four similar tetrahedral microphones charting a rectangular perimeter surrounding the space. Motion capture data of the moving sound source shows that anglegrams calculated from the Ambisonics recordings can be effectively used for sound localization. An additional perceptual listening study with binaural renders of the audio signals showed that the centrally-placed Array A provided superior localization. However, the corner-placed Array B performed better than expected.
-
Jinyue Guo, Jim Tørresen & Alexander Refsum Jensenius
(2025).
Cross-modal Analysis of Spatial-Temporal Auditory Stimuli and Human Micromotion when Standing Still in Indoor Environments.
I Angela McArthur, Emma-Kate Matthews & Tom Holberton (Red.),
Proceedings of the 17th International Symposium on Computer Music Multidisciplinary Research.
The Laboratory PRISM “Perception, Representations, Image, Sound, Music”.
ISSN 9791097498061.
s. 871–882.
doi:
10.5281/ZENODO.17502603.
Fulltekst i vitenarkiv
Vis sammendrag
This paper examines how a soundscape influences human stillness. We are particularly interested in how spatial and temporal features of a soundscape influence human micromotion and swaying patterns. The analysis is based on 345 Ambisonics audio recordings of different indoor environments and corresponding accelerometer data captured at the chest of a person standing still for ten minutes. We calculated the temporal and spatial correlation between the person's quantity of motion and the sound energy of the Ambisonic recordings. While no clear temporal correlations were found, we discovered a correlation between the spatial directionality of the micromotion and the sound direction of arrival. The results suggest a potential entrainment between the directionality of environmental sounds and human swaying patterns, which have not been thoroughly studied previously compared to the temporal or spectral features of indoor soundscapes.
-
Sigmund Johannes Ljosvoll Rolfsjord, Safia Fatima, Hugh Alexander von Arnim & Adel Baselizadeh
(2025).
Multimodal Transfer Learning for Privacy in Human Activity Recognition.
I Barakova, Emilia, Allouch, Somaya Ben, Nakadai, Kazuhiro & Nejat, Goldie (Red.),
Proceedings of the IEEE International Conference on Robot and Human Interactive Communication (RO-MAN) 2025.
IEEE (Institute of Electrical and Electronics Engineers).
ISSN 9798331587710.
s. 15–20.
doi:
10.1109/ro-man63969.2025.11217600.
Fulltekst i vitenarkiv
Vis sammendrag
IEEE International Conference on Robot & Human Interactive Communication (RO-MAN)
This conference is a leading forum where state-of-the-art innovative results, the latest developments as well as future perspectives relating to robot and human interactive communication are presented and discussed.
The conference covers a wide range of topics related to Robot and Human Interactive Communication, involving theories, methodologies, technologies, empirical and experimental studies. Papers related to the study of robotic technology, psychology, cognitive science, artificial intelligence, human factors, ethics and policies, interaction-based robot design and other topics related to human-robot interaction are welcome.
-
Balint Laczko, Marie Elisabeth Rognes & Alexander Refsum Jensenius
(2025).
Image Sonification as Unsupervised Domain Transfer.
I Angela McArthur, Emma-Kate Matthews & Tom Holberton (Red.),
Proceedings of the 17th International Symposium on Computer Music Multidisciplinary Research.
The Laboratory PRISM “Perception, Representations, Image, Sound, Music”.
ISSN 9791097498061.
s. 596–607.
doi:
10.5281/zenodo.17497987.
Fulltekst i vitenarkiv
Vis sammendrag
The process of image sonification maps visual features into perceived auditory features. Most established sonification methods rely on identifying salient visual features in the input data and then mapping their distribution to a proportional distribution of auditory features. However, this approach requires both domain expertise and manual feature engineering. Here, we propose a new method of image sonification, leveraging recent advances in representation learning and domain transfer. Our approach introduces a pair of variational auto-encoder models that learn disentangled latent representations of the images and sounds, respectively, and a separate network that maps between these representations. The resulting sonification system encodes images into the latent space and then decodes them as sounds. Both representations and their mapping are learned in an entirely unsupervised manner. When evaluating the system in an interactive real-time setting, we observed that the model successfully learned disentangled representations of image and sound factors in our synthetic datasets.
-
Frida Meijer, Diana Saplacan Lindblom, Adel Baselizadeh & Jim Tørresen
(2025).
"The wooden gripper was warmer and made the robot less threatening"– A Study on Perceived Safety based on Robot Gripper’s Visual and Tactile Properties.
I Barakova, Emilia, Allouch, Somaya Ben, Nakadai, Kazuhiro & Nejat, Goldie (Red.),
Proceedings of the IEEE International Conference on Robot and Human Interactive Communication (RO-MAN) 2025.
IEEE (Institute of Electrical and Electronics Engineers).
ISSN 9798331587710.
s. 1091–1098.
doi:
https:/ieeexplore.ieee.org/document/11217775.
Fulltekst i vitenarkiv
Vis sammendrag
An ageing population and the need of providing adequate care have led to developing robots to relieve healthcare workers and to assist individuals in their own homes. However, the successful integration of robots in such settings relies on more than just ensuring physical safety associated with physical risks (e.g., collisions): it also requires the user’s perceived safety – the users perceiving the robot as not doing any harm. This paper explores the potential influence of a robot grippers’ visual and tactile properties, such as materials and texture, on the users’ perceived safety and comfort of human-robot interaction. An initial survey was distributed to 53 participants, exploring five (n=5) robot gripper designs focusing on the robots’ gripper shape. One design shape was thereafter selected to be constructed as a cover to be placed over the parallel grippers of the TIAGo robot, by using 1) wood filament and 2) plastic. The covers were then tested in an experimental setting with 11 participants. The covers were attached to the TIAGo mobile manipulator robot and participants interacted with both of the designed gripper covers within a controlled laboratory environment. A questionnaire was distributed to all 11 experiment participants, at different stages of the interactions. The findings indicate that the material of the gripper influenced participants’ sense of comfort, familiarity, and perceived capabilities of the robot. The study suggests that perceived safety in human-robot interaction (HRI) is shaped not only by physical factors but also by how materials are personally and contextually interpreted. To better support safe and comfortable interactions, further research is needed to understand how material choices shape users’ perceived safety.
-
Anna-Maria Christodoulou & Olivier Lartillot
(2025).
A Multimodal Dataset of Greek Folk Music.
I Elsa De Luca (Red.),
DLfM '25: Proceedings of the 12th International Conference on Digital Libraries for Musicology.
Association for Computing Machinery (ACM).
ISSN 9798400720833.
s. 19–27.
doi:
https:/dl.acm.org/doi/10.1145/3748336.3748339.
Fulltekst i vitenarkiv
Vis sammendrag
This paper presents a multimodal dataset of Greek folk dance music, focusing on syrtos and balos. Developed to support research in computational musicology, the dataset improves access to Greek musical heritage through manually transcribed MIDI scores, aligned lyrics, and rich metadata, all curated by expert musicologists. Through pattern analysis and feature extraction, we examine both shared melodic structures and unique characteristics of each dance, with some examples reflecting traces of oral transmission. While metadata accompanies the collection to support organization and context, our primary emphasis is on the musical and lyrical content. This work contributes to digital ethnomusicology by showing how multimodal datasets of folk music can inform both analytical research and cultural heritage preservation.
-
Marieke van Otterdijk, Margot Neggers, Jim Torresen & Emilia Barakova
(2025).
Exploring Human Attribution of Emotional Intent to Motion Features in a Humanoid Robot.
I Oskar Palinko, Leon Bodenhagen, John-John Cabibihan, Kerstin Fischer, Selma Šabanović, Katie Winkle, Laxmidhar Behera, Shuzhi Sam Ge, Dimitrios Chrysostomou, Wanyue Jiang & Hongsheng He (Red.),
Social Robotics.
Springer.
ISSN 9789819635184.
s. 323–323.
doi:
10.1007/978-981-96-3519-1_29.
Fulltekst i vitenarkiv
-
Balint Laczko & Alexander Refsum Jensenius
(2025).
Pixasonics: An Image Sonification Toolbox for Python.
I F. Amílcar Cardoso, Paul Vickers, Pedro Martins & Stephen Roddy (Red.),
Proceedings of the 30th International Conference on Auditory Display (ICAD 2025).
Department of Informatics Engineering, University of Coimbra, Portugal.
ISSN 9798991456210.
s. 28–35.
doi:
https:/hdl.handle.net/1853/79958.
Fulltekst i vitenarkiv
Vis sammendrag
Pixasonics is a new Python library for interactive image analysis and exploration through image sonification. It uses real-time audio and visualization to help uncover patterns in image data. With Pixasonics, users can launch one or more small web applications (running in a Jupyter Notebook), probe image data using various feature extraction methods, and map those feature vectors to synthesis parameters. The target users are researchers interested in exploring image and volumetric data and creative users who want an intuitive tool for experimental sound design. Pixasonics’ design aims to strike a balance between an easy-to-use web application with minimal boilerplate code necessary and a library that can be integrated into more advanced workflows. Real-time exploration is at the heart, but it can also be used to script non-real-time sonifications of large datasets. This paper presents Pixasonics, its structure, interface, and advanced features, and discusses preliminary feedback from biology researchers and music technologists.
-
-
Ege de Bruin, Kyrre Glette & Kai Olav Ellefsen
(2025).
Generational Replacement and Learning for High-Performing and Diverse Populations in Evolvable Robots.
I Tayo Obafemi-Ajayi (Red.),
2025 IEEE Symposium on Computational Intelligence in Artificial Life and Cooperative Intelligent Systems.
IEEE (Institute of Electrical and Electronics Engineers).
ISSN 9798331508388.
doi:
10.1109/alife-cis64968.2025.10979828.
Fulltekst i vitenarkiv
Vis sammendrag
Evolutionary Robotics offers the possibility to design robots to solve a specific task automatically by optimizing their morphology and control together. However, this co-optimization of body and control is challenging, because controllers need some time to adapt to the evolving morphology - which may make it difficult for new and promising designs to enter the evolving population. A solution to this is to add intra-life learning, defined as an additional controller optimization loop, to each individual in the evolving population. A related problem is the lack of diversity often seen in evolving populations as evolution narrows the search down to a few promising designs too quickly. This problem can be mitigated by implementing full generational replacement, where offspring robots replace the whole population. This solution for increasing diversity usually comes at the cost of lower performance compared to using elitism. In this work, we show that combining such generational replacement with intra-life learning can increase diversity while retaining performance. We also highlight the importance of performance metrics when studying learning in morphologically evolving robots, showing that evaluating according to function evaluations versus according to generations of evolution can give different conclusions.
-
Andrija Milojevic & Kyrre Glette
(2025).
Design and fabrication of soft locomotion robots based on spatial compliant mechanisms.
Smart materials and structures (Print).
ISSN 0964-1726.
34(7).
doi:
10.1088/1361-665x/addf98.
Fulltekst i vitenarkiv
Vis sammendrag
Soft robotics has emerged as a promising technology that holds great potential for various application areas. This is due to soft materials unique properties, including flexibility, safety, and shock absorption, among others. Despite many advancement in the field, the development of effective design methodologies and production techniques for soft robots remains a challenge. Although numerous robot prototypes have been proposed in recent years, their designs are often complex and difficult to produce. As such, there is a need for more efficient and unified design approaches that can facilitate the production of soft robots with desirable properties. In this paper, we propose a method for designing soft robots using elastic beams and spatial compliant mechanisms. The method is based on an evolutionary approach that enables the creation of designs with both high motion and force transmission ratios. Specifically, we focus on the development of locomotion mechanisms using a central linear actuator. Our approach involves the use of commonly available plastic materials and a 3D printer to manufacture the designs. We demonstrate the feasibility of our approach by presenting experimental results that show successful production and real-world operation. Overall, our findings suggest that the use of elastic beams and an evolutionary approach can facilitate the creation of soft robots with desirable locomotion properties, including fast locomotion up to 3.7 body lengths per second, locomotion with a payload, and underwater locomotion. This method has the potential to enable the development of more efficient and practical soft robots for various applications.
-
Anna-Maria Christodoulou, Kyrre Glette, Olivier Lartillot & Alexander Refsum Jensenius
(2025).
MusiQAl: A Dataset for Music Question–Answering through Audio–Video Fusion.
Transactions of the International Society for Music Information Retrieval.
8(1),
s. 265–282.
doi:
10.5334/tismir.222.
Fulltekst i vitenarkiv
Vis sammendrag
Music question–answering (MQA) is a machine learning task where a computational system analyzes and answers questions about music‑related data. Traditional methods prioritize audio, overlooking visual and embodied aspects crucial to music performance understanding. We introduce MusiQAl, a multimodal dataset of 310 music performance videos and 11,793 human‑annotated question–answer pairs, spanning diverse musical traditions and styles. Grounded in musicology and music psychology, MusiQAl emphasizes multimodal reasoning, causal inference, and cross‑cultural understanding of performer–music interaction. We benchmark AVST and LAVISH architectures on MusiQAI, revealing strengths and limitations, underscoring the importance of integrating multimodal learning and domain expertise to advance MQA and music information retrieval.
-
Benedikte Wallace, Kyrre Glette & Alexander Szorkovszky
(2025).
How can we make robot dance expressive and responsive? A survey of methods and future directions.
Frontiers in Computer Science.
7.
doi:
10.3389/fcomp.2025.1575667.
Fulltekst i vitenarkiv
Vis sammendrag
The development of robots that can dance like humans presents a complex challenge due to the disparate abilities involved and various aesthetic qualities that need to be achieved. This article reviews recent advances in robotics, artificial intelligence, and human-robot interaction toward enabling various aspects of realistic dance, and examines potential paths toward a fully embodied dancing agent. We begin by outlining the essential abilities required for a robot to perform human-like dance movements and the resulting aesthetic qualities, summarized under the terms expressiveness and responsiveness . Subsequently, we present a review of the current state-of-the-art in dance-related robot technology, highlighting notable achievements, limitations and trade-offs in existing systems. Our analysis covers various approaches, including traditional control systems, machine learning algorithms, and hybrid systems that aim to imbue robots with the capacity for responsive, expressive movement. Finally, we identify and discuss the critical gaps in current research and technology that need to be addressed for the full realization of realistic dancing robots. These include challenges in real-time motion planning, adaptive learning from human dancers, and morphology independence. By mapping out current methods and challenges, we aim to provide insights that may guide future innovations in creating more engaging, responsive, and expressive robotic systems.
-
Emma Stensby Norstein, Kotaro Yasui, Takeshi Kano, Akio Ishiguro & Kyrre Glette
(2025).
Behaviour Diversity in a Walking and Climbing Centipede-Like Virtual Creature.
Artificial Life.
ISSN 1064-5462.
31(3),
s. 321–344.
doi:
10.1162/artl_a_00476.
Fulltekst i vitenarkiv
Vis sammendrag
Robot controllers are often optimized for a single robot in a single environment. This approach proves brittle, as such a controller will often fail to produce sensible behavior for a new morphology or environment. In comparison, animal gaits are robust and versatile. By observing animals, and attempting to extract general principles of locomotion from their movement, we aim to design a single, decentralized controller applicable to diverse morphologies and environments. The controller implements the three components of (a) undulation, (b) peristalsis, and (c) leg motion, which we believe are the essential elements in most animal gaits. This work is a first step toward a general controller. Accordingly, the controller has been evaluated on a limited range of simulated centipede-like robot morphologies. The centipede is chosen as inspiration because it moves using both body contractions and legged locomotion. For a controller to work in qualitatively different settings, it must also be able to exhibit qualitatively different behaviors. We find that six different modes of locomotion emerge from our controller in response to environmental and morphological changes. We also find that different parts of the centipede model can exhibit different modes of locomotion, simultaneously, based on local morphological features. This controller can potentially aid in the design or evolution of robots, by quickly testing the potential of a morphology, or be used to get insights about underlying locomotion principles in the centipede.
-
Marieke van Otterdijk, Bruno Laeng, Diana Saplacan Lindblom, Adel Baselizadeh & Jim Tørresen
(2025).
Seeing Meaning: How Congruent Robot Speech and Gestures Impact Human Intuitive Understanding of Robot Intentions.
International Journal of Social Robotics.
ISSN 1875-4791.
17,
s. 2279–2292.
doi:
10.1007/s12369-025-01271-0.
Fulltekst i vitenarkiv
Vis sammendrag
Social communication between humans and robots has become critical as a result of the integration of robots into our daily lives as assistants. There is a need to explore how users intuitively understand the behavior of a robot and the impact of social context on that understanding. This study measures mental effort (as indexed by pupil response) and processing time, measured as the time taken to provide the correct answer, to investigate participants’ intuitive understanding of the robot’s gestures. Thirty-two participants participated in a charades game with a TIAGo robot, during which their eyes were tracked. Our findings show a relationship between mental effort and processing time, and indicate that robot gestures, congruence of speech and behavior, and the correctness of interpreting robot behavior influence intuitive understanding. Furthermore, we found that people focused on the robot’s limb movement. Using these findings, we can highlight what features contribute to the intuitive interaction with a robot, thus improving its efficiency.
-
Yueh-Hsuan Weng, David Torabi, Jim Tørresen, Zonghao Dong & Yasuhisa Hirata
(2025).
Bridging Ethics and Reality: Integrating Thought Experiments and Empirical Insights in Robot Ethics.
IEEE robotics & automation magazine.
ISSN 1070-9932.
32(4),
s. 84–90.
doi:
10.1109/mra.2025.3584352.
Fulltekst i vitenarkiv
-
Sara D’Amario & Alexander Refsum Jensenius
(2025).
Cardiac Coherence among Musicians and Audiences During Orchestra Performances.
Music & Science.
8,
s. 1–15.
doi:
10.1177/20592043251370977.
Fulltekst i vitenarkiv
Vis sammendrag
Recent empirical investigations suggest that music performance and perception can evoke a collective cardiac response in performers and audience members, and interpersonal cardiac coupling can be related to musical features. However, the relationship between musicians’ and audiences’ cardiac responses is poorly understood. This study investigates the interpersonal cardiac coherence of selected audience members and performers from the Stavanger Symphony Orchestra and the Norwegian Radio Orchestra during multiple performances of Harald Sæverud’s Kjempeviseslåtten. The cardiac coherence index (CCI) was computed by applying the intrinsic synchrosqueezing transform to the cardiac interbeat interval of each signal, combining noise-assisted multivariate empirical mode decomposition and short-time Fourier transforms. The results show that the CCI values among the audience members were stronger than those of the musicians. Sound pressure level measurements predicted the musicians’ CCI values, whilst musical form structure predicted the audiences’ CCI values. These results advance our understanding of how cardiac rhythms support interpersonal interactions and contribute to research on live orchestra performances.
-
Rainer Polak
(2025).
From Mali to Ghana: Pulsation Non-Isochrony in West African Percussion Music Genres.
Analytical Approaches to African Music.
1(1).
doi:
https:/africa.iftawm.org/aaam-vol-1-iss-1/https:/africa.iftawm.org/aaam-vol-1-iss-1/.
Fulltekst i vitenarkiv
Vis sammendrag
Most theories of African music emphasize the diversity of musical styles in Africa. Still, many also hold on to the notion of Africa being a uniform area with a high degree of stylistic coherence. This paper questions that latter notion by comparing different genres of West African percussion ensemble music from Mali and Ghana concerning the temporal structure of the fast pulse (metric beat division). On this basis, the paper asks whether it is empirically plausible to represent African music by identifying a singular ideal type of African rhythm. The main result is that uneven beat subdivision timing patterns (pulsation non-isochrony) and the superimposition (nesting) of binary and ternary subdivision layers play a substantial role in genres from Mali (Mande) and northern Ghana (Dagbamba) but not in southern and central Ghana (Ewe, Asante). This finding contradicts the widespread assumption that, in African rhythmic systems, the fast pulse in general is structurally isochronous and either binary or ternary. The paper concludes that African rhythmic systems exhibit a greater diversity than theories of African rhythm have indicated and that Africanist music research should emphasize this diversity more consistently than it has done so far.
-
Francesca M. Barbero, Tomas Lenc, Nori Jacoby, Rainer Polak, Manuel Varlet & Sylvie Nozaradan
(2025).
Revealing rhythm categorization in human brain activity.
Science Advances.
11(31).
doi:
10.1126/sciadv.adu9838.
Fulltekst i vitenarkiv
Vis sammendrag
Humans across cultures show an outstanding capacity to perceive, learn, and produce musical rhythms. These skills rely on mapping the infinite space of possible rhythmic sensory inputs onto a finite set of internal rhythm categories. What is the nature of the brain processes underlying rhythm categorization? We used electroencephalography to measure brain activity as human participants listened to a continuum of rhythmic sequences characterized by repeating patterns of two interonset intervals. Using frequency and representational similarity analyses, we show that brain activity does not merely track the temporal structure of rhythmic inputs but, instead, produces categorical representation of rhythms. These neural rhythm categories arise automatically, independent of any motor- or timing-related tasks, yet exhibit strong similarity with categorization observed in overt behavior. Together, these results and methodological advances constitute a critical step toward understanding the biological roots and diversity of musical behaviors across cultures.
-
Bruno Laeng, Hüseyin Berke Canoluk & Shoaib Nabil
(2025).
Pupil adjustments to illusory perceptions of the light intensity of object surfaces.
Frontiers in Human Neuroscience.
19.
doi:
10.3389/fnhum.2025.1604114.
Fulltekst i vitenarkiv
Vis sammendrag
Using infrared eye tracking, we show that when gaze is maintained at the center of one of two equiluminant surfaces of a Cornsweet stimulus, designed by Lotto and Purves, that illusorily appear to be lighter or darker than the other, the eye pupils constrict or dilate, respectively. That is, pupil sizes mirror the subjective experience of differential brightness. Previous studies of pupil responses to illusions of light had focused on illusions of unveridical light sources (e.g., patterns resembling the sun), whereas in the present study, we show pupil adjustments to the illusory brightness of object surfaces within images of realistic scenes. In two control experiments, we also showed that when the edge gradients of the Cornsweet stimulus, which do differ in luminance, were either occluded or presented alone in a black field, there were no differences in pupil diameters. We also conclude that adjustments to the perception of surface reflectance are unlikely to represent anticipatory responses to probable risks of temporary visual impairment (i.e., dazzle to sunlight) and, instead, indicate that a gradual process of disambiguation of the visual scene is sufficient to elicit adjustments to the apparent light intensity of an object’s surface.
-
Olgerta Asko, Vegard Akselsson Volehaugen, Anaïs Llorens, Ingrid Funderud, Sabine Liliana Leske & Jugoslav Ivanovic
[Vis alle 13 forfattere av denne artikkelen]
(2025).
Predictive encoding of auditory sequences in the human prefrontal cortex.
bioRxiv - the preprint server for biology.
doi:
10.1101/2025.08.22.671264.
Fulltekst i vitenarkiv
Vis sammendrag
Abstract Humans extract regularities from the environment to form expectations that guide perception and optimize behavior. Although the prefrontal cortex (PFC) is central to this process, the relative contributions of orbitofrontal (OFC) and lateral PFC (LPFC) remain unclear. Here, we show that the brain tracks sound regularities in an auditory deviance detection task to predict when a target deviant will occur. Intracranial EEG in epilepsy patients reveals prefrontal engagement, with earlier expectancy-related modulation in OFC and later modulation in LPFC. Connectivity analyses indicate bidirectional and asymmetrical expectancy-related information exchange between the two areas, with a first lead by OFC, consistent with its role in initiating predictive encoding. Converging causal evidence shows that OFC lesions abolish sensitivity to expectancy, whereas LPFC lesions yield only modest effects not significantly different from controls. Together, these results provide electrophysiological and causal evidence for distinct, temporally organized contributions of prefrontal subregions to predictive processing. Significance Statement The human brain builds probabilistic associations capturing the dynamic environmental structure in a predictive manner. The ability to encode and deploy predictive information to anticipate future events relies on the prefrontal cortex (PFC). However, the specific roles of PFC subregions in this process remain unclear. Here, we provide converging electrophysiological and causal lesion evidence on the distinct involvement of the orbital and lateral PFC in generating anticipatory neural signals based on probabilistic auditory structure.
-
Kristine Fjellkårstad Orten, Sander Elias Magnussen Helgesen, Bihui Chen, Adel Baselizadeh, Jim Tørresen & Henrik Herrebrøden
(2025).
Can machine learning distinguish between elite and non-elite rowers?
International Journal of Computer Science in Sport.
24(1),
s. 118–132.
doi:
10.2478/ijcss-2025-0007.
Fulltekst i vitenarkiv
Vis sammendrag
A major challenge for sports coaches and analysts is to identify critical elements of athletes’ movement patterns. A potentially relevant tool is machine learning, useful because of its ability to extract patterns from data. In the current study, we employed various deep learning frameworks, including Gated Recurrent Unit networks (GRUs), Convolutional Neural Networks (CNNs), and Multi-Layer Perceptrons (MLPs), to search for differences between elite and non-elite rowers using a rowing ergometer. The MLP model achieved an accuracy of 100% when using all input features, indicating that the problem is suitable as a machine learning task. Our research focused on using a limited amount of the data. Despite using fewer input features, the models managed to classify skill levels with reasonable precision, reaching a best performance of 77% accuracy for the model combining GRU and CNN architectures, 78% for the GRU model, and 94% for the MLP model. From a rowing perspective, the results suggest that movement coordination between upper and lower body limbs, as represented by different feature combinations, is informative in distinguishing between elites and non-elites. The current work suggests that machine learning may supplement human experts in sports coaching, analytics, and talent identification.
-
Oliver Miles, Adrian Hazzard, Solomiya Moroz, Laura Bishop & Craig Vear
(2025).
Meaningful interactions in human-AI musicking.
I Mariana Seiça & Jordan Wirfs-Brock (Red.),
AM '25: Proceedings of the 20th International Audio Mostly Conference.
Association for Computing Machinery (ACM).
ISSN 9798400720659.
s. 58–69.
doi:
10.1145/3771594.3771600.
Fulltekst i vitenarkiv
Vis sammendrag
In this paper we discuss our latest iteration of RAMI (the Robotic Arm for Musicking Inclusively) as prototype digital score. We deploy RAMI as interactive technology for the purpose of improvisation ensemble work, documenting the narrative journey of a single elite musician–M–as they engage with its nascent qualities over three extended workshop sessions. This study builds in part on the musical togetherness model of human-human interaction [4], and necessarily draws adjacent concepts in robotics, human computer interaction (HCI), and digital score. Recording musicking interactions with RAMI, we elicit and report on M’s thematic perceptions of instances of: familiarization; engagement strategy; decision making; connection, agency, and ensemble; assertions of schemas of RAMI; and moments of enjoying RAMI. Beyond the rich, narrative insight that these six themes offer, we critically assess these as variably (un)certain in nature; as particularly certain when asserting two schemas–RAMI as a dancer, and RAMI as a score, and as indicative of an underlying continuum of musician perception that recognises RAMI as an AI tool for musicking, on the one hand, and on the other hand, as an AI agent for embodied collaboration.
-
Laura Bishop, Elpida Hadjidaki-Marder, Sarunas Ledas & Gunnar Liestøl
(2025).
Motion capture for augmented reality storytelling in archaeology and cultural heritage dissemination: Simulating an animal sacrifice at Ancient Phalasarna.
I Timothy Jung, M. Claudia tom Dieck, Seok Chan Jeong, Sung-Hee Kim, Daniel Sahl & S. J. Kim (Red.),
XR and Metaverse: Proceedings of the 9th International XR-Metaverse Conference 2024, Busan, South Korea.
Springer.
ISSN 9783031779749.
s. 209–221.
doi:
10.1007/978-3-031-77975-6_16.
Fulltekst i vitenarkiv
-
Olivier Lartillot, Dana Swarbrick, Finn Upham & Carlos Eduardo Cancino-Chacón
(2025).
Video Visualization of a String Quartet Performance of a Bach Fugue: Design and Subjective Evaluation.
Music & Science.
8.
doi:
10.1177/20592043251352299.
Fulltekst i vitenarkiv
Vis sammendrag
Visualizing music—through music notation, analytical representations, or music videos—might potentially boost the appreciation of music in all its richness. The purpose of this study was to design and test a visualization strategy aimed at explicating to a large audience with diverse backgrounds—especially novices—the multifaceted beauty of the final Contrapunctus in J.S. Bach's The Art of Fugue, performed by the Danish String Quartet. At the surface level of the musical structure, the rich fluctuation of pitch shaped by each musician was depicted in the form of undulating pitch curves. At a deeper structural level, the repetition of pitch curves, distinctive of fugues, was highlighted through vertical alignment—inspired by a technique called paradigmatic analysis, originating from anthropology and music semiology. The visualization was initially prototyped in the form of a real-time technology as part of the MusicLab Copenhagen research concert. The concert audience focused on the performance itself, and did not pay much attention to, nor appreciate, the visualization. To evaluate more thoroughly the potential of the visualization, participants with varied musical expertise and taste were invited to listen to a recorded performance of the piece and watch the visualization on their own computer. A large majority reported that they felt they understood the visualization, around half of them felt that it enhanced their musical understanding, and a small group felt that it helped them to better appreciate the music.
-
Bruno Laeng, Morten Øvervoll & Ece Aybike Ala-Pettersen
(2025).
Original art paintings are chosen over their “color-rotated” versions because of changed color contrast.
Perception.
ISSN 0301-0066.
doi:
10.1177/03010066251345994.
Fulltekst i vitenarkiv
Vis sammendrag
Rotating colors (digitally within CIELAB color space) of an artistic painting is thought to keep constant all aspects of the painting except the hues. When observers are asked to select the preferred image among color-rotated images the “original” version of the artwork is typically selected, while the hue transformed images are rejected. We hypothesized that color contrast may be reduced after such digital rotations, which was supported by feature analyses. We also found that when the original painting or rotations were viewed individually, they did not differ in both hedonic ratings and pupil responses, though observers selected the original paintings in a forced-choice test. Hence, we generated versions of the paintings where color contrast was either enhanced or reduced and forced-choice experiments (online or in the lab) confirmed that the higher color contrast image within a pair was preferred (regardless of whether the image was an original painting or not). Eye tracking revealed that images with relatively higher contrast captured attention. We conclude that previous reports of a preference for the original artworks may have reflected reductions in color contrast of the color-rotated alternatives. These findings point to color contrast as a potential esthetic primitive feature but at the same time cast some doubts on relying exclusively on the results of forced choice tests for revealing genuine esthetic preferences.
-
Heidi Marie Umbach Hansen, Espen Røysamb, Olav Mandt Vassend, Nikolai Olavi Czajkowski, Tor Endestad & Jonna Katariina Vuoskoski
[Vis alle 8 forfattere av denne artikkelen]
(2025).
Dimensions of music use motivations: Genetic and environmental underpinnings, and associations with Big Five and Empathy traits.
PLOS ONE.
20(8).
doi:
10.1371/journal.pone.0329808.
Fulltekst i vitenarkiv
Vis sammendrag
People differ in their motivation for seeking musical experiences and these differences appear to be partially attributable to their personality. However, little is known about the role of genetic and environmental factors in shaping individual differences in motivations for music use and their shared etiology with personality. This study investigated, using the classical twin design in a sample of 2611 Norwegian twins, the genetic and environmental architecture of four dimensions of motivations for music use (musical transcendence, emotion regulation, social bonding, and musical identity and expression). We also examined their phenotypic associations, as well as genetic and environmental overlap with general personality traits, including the Big Five and Trait Empathy facets. Additive genetic and unique environmental effects largely accounted for the variation in the four dimensions (heritability 38%−52%, mean = 45%), though univariate analyses of the social bonding dimension indicated common environmental influences for this specific subscale. In line with previous studies, trait-congruent phenotypic associations were found between specific personality traits and music use motives, including facets of negative emotionality and musical emotion regulation. Other facets – particularly aesthetic sensitivity (open-mindedness) and fantasy (trait empathy) – were closely tied to all dimensions. Multivariate biometric modeling of the links between personality traits and motivations for music use revealed that these relationships were primarily driven by correlated genetic factors, with personality traits accounting for 40%−66% of the total genetic variance and 5%−17% of the total environmental variance in the music use motivation dimensions. These findings shed new light on the etiology of dispositional music use and provide a comprehensive baseline for future investigations of associations with personality, mental health, and well-being.
-
Tomas Lenc, Cédric Lenoir, Peter Keller, Rainer Polak, Dounia Mulders & Sylvie Nozaradan
(2025).
Measuring self-similarity in empirical signals to understand musical beat perception.
European Journal of Neuroscience.
ISSN 0953-816X.
61(2).
doi:
10.1111/ejn.16637.
Fulltekst i vitenarkiv
Vis sammendrag
Experiencing music often entails the perception of a periodic beat. Despite being a widespread phenomenon across cultures, the nature and neural underpinnings of beat perception remain largely unknown. In the last decade, there has been a growing interest in developing methods to probe these processes, particularly to measure the extent to which beat-related information is contained in behavioral and neural responses. Here, we propose a theoretical framework and practical implementation of an analytic approach to capture beat-related periodicity in empirical signals using frequency-tagging. We highlight its sensitivity in measuring the extent to which the periodicity of a perceived beat is represented in a range of continuous time-varying signals with minimal assumptions. We also discuss a limitation of this approach with respect to its specificity when restricted to measuring beat-related periodicity only from the magnitude spectrum of a signal and introduce a novel extension of the approach based on autocorrelation to overcome this issue. We test the new autocorrelation-based method using simulated signals and by re-analyzing previously published data and show how it can be used to process measurements of brain activity as captured with surface EEG in adults and infants in response to rhythmic inputs. Taken together, the theoretical framework and related methodological advances confirm and elaborate the frequency-tagging approach as a promising window into the processes underlying beat perception and, more generally, temporally coordinated behaviors.
-
Maham Riaz, Jinyue Guo, Bilge Serdar Göksülük & Alexander Refsum Jensenius
(2025).
Where is That Bird? The Impact of Artificial Birdsong in Public
Indoor Environments.
I Mariana Seiça & Jordan Wirfs-Brock (Red.),
AM '25: Proceedings of the 20th International Audio Mostly Conference.
Association for Computing Machinery (ACM).
ISSN 9798400720659.
s. 344–351.
doi:
10.1145/3771594.3771629.
Fulltekst i vitenarkiv
Vis sammendrag
This paper explores the effects of nature sounds, specifically bird sounds, on human experience and behavior in indoor public environments. We report on an intervention study where we introduced an interactive sound device to alter the soundscape. Phenomenological observations and a survey showed that participants noticed and engaged with the bird sounds primarily through causal listening; that is, they attempted to identify the sound source. Participants generally responded positively to the bird sounds, appreciating the calmness and surprise it brought to the environment. The analyses revealed that relative loudness was a key factor influencing the experience. A too-high sound level may feel unpleasant, while a too-low sound level makes it unnoticeable due to background noise. These findings highlight the importance of automatic level adjustments and considering acoustic conditions in soundscape interventions. Our study contributes to a broader discourse on sound perception, human interaction with sonic spaces, and the potential of auditory design in public indoor environments.
-
Henrik Haraldsen Sveen, Laura Bishop & Alexander Refsum Jensenius
(2025).
Cyclic Patterns and Spatial Orientations in Artificial Impulsive Autonomous Sensory Meridian Response (ASMR) Sounds.
I Mariana Seiça & Jordan Wirfs-Brock (Red.),
AM '25: Proceedings of the 20th International Audio Mostly Conference.
Association for Computing Machinery (ACM).
ISSN 9798400720659.
s. 124–131.
doi:
10.1145/3771594.3771651.
Fulltekst i vitenarkiv
Vis sammendrag
Autonomous Sensory Meridian Response (ASMR) is a tingling sensation in the neck and spine often triggered by specific sounds. This paper reports a study on the impact of different cyclic patterns and spatial orientations—defined here as the perceived directionality and motion of sound sources in a three-dimensional auditory space—on inducing ASMR experiences. The results demonstrate that both the type of cyclic pattern and the spatial orientation significantly influence the intensity and nature of ASMR experiences. Furthermore, the research explores synthesizing ASMR-inducing sounds while preserving key audio characteristics from acoustically recorded ASMR content. Through survey data analysis and regression modeling, distinct patterns emerge regarding the relationship between personality traits and ASMR experience. The findings contribute to a deeper understanding of ASMR as a sensory phenomenon and provide insights into the potential applications of artificially generated ASMR stimuli. Additionally, the research sheds light on the role of spatiality in ASMR experiences and the synthesis of ASMR-inducing sounds for future studies and practical applications
-
Maham Riaz, Ioannis Theodoridis, Cagri Erdem & Alexander Refsum Jensenius
(2025).
VentHackz: Exploring the Musicality of Ventilation Systems.
I Doga Cavdir & Florent Berthaut (Red.),
Proceedings of the International Conference on New Interfaces for Musical Expression.
The International Conference on New Interfaces for Musical Expression.
doi:
10.5281/zenodo.15698831.
Fulltekst i vitenarkiv
Vis sammendrag
Ventilation systems can be seen as huge examples of interfaces for musical expression, with the potential of merging sound, space, and human interaction. This paper explores conceptual similarities between ventilation systems and wind instruments and explores approaches to “hacking” ventilation systems with components that produce and modify sound. These systems enable the creation of unique sonic and visual experiences by manipulating airflow and making mechanical adjustments. Users can treat ventilation systems as musical interfaces by altering shape, material, and texture or augmenting vents. We call for heightened attention to the sound-making properties of ventilation systems and call for action (#VentHackz) to playfully improve the soundscapes of our indoor environments.
-
Pedro Pablo Lucas Bravo, Stefano Fasciani, Alexander Szorkovszky & Kyrre Glette
(2025).
An Interactive Self-Assembly Swarm Music System in Extended Reality.
I Mariana Seiça & Jordan Wirfs-Brock (Red.),
AM '25: Proceedings of the 20th International Audio Mostly Conference.
Association for Computing Machinery (ACM).
ISSN 9798400720659.
s. 255–269.
doi:
10.1145/3771594.3771620.
Fulltekst i vitenarkiv
Vis sammendrag
This paper explores the music-making capabilities of a swarm intelligence type of algorithm known as self-assembly in an interactive context using Extended Reality (XR) technologies. We describe the modifications made to a fully autonomous version of this algorithm, which we proposed in a previous work, allowing us to adapt it for user-interactive music. Moreover, we present the design of an XR system that supports this adaptation, modelled as a human-swarm interactive music system, which is implemented in the Meta Quest 3 headset. An auto-ethnographic study was conducted to discover the affordances of the system in a music improvisation session. The study, supported by empirical measurements collected during the session, enables a comparison between the interactive version and the original autonomous offline version, providing valuable insights into how a user can influence the swarm's behaviour. The results are used to discuss the music performance possibilities and future directions for this type of interactive music system.
-
Maham Riaz, Jinyue Guo & Alexander Refsum Jensenius
(2025).
Comparing Spatial Audio Recordings from Commercially Available 360-degree Video Cameras.
I Anthony L. Brooks, Domna Banakou & Slavica Ceperkovic (Red.),
Proceedings of the 13th EAI International Conference on ArtsIT, Interactivity and Game Creation, ArtsIT 2024.
Springer.
ISSN 9783031972546.
s. 160–172.
doi:
10.1007/978-3-031-97254-6_12.
Fulltekst i vitenarkiv
Vis sammendrag
This paper investigates the spatial audio recording capabilities of various commercially available 360-degree cameras (GoPro MAX, Insta360 X3, Garmin VIRB 360, and Ricoh Theta S). A dedicated ambisonics audio recorder (Zoom H3VR) was used for comparison. Six action sequences were performed around the recording setup, including impulsive and continuous vocal and non-vocal stimuli. The audio streams were extracted from the videos and compared using spectrograms and anglegrams. The anglegrams show adequate localization in ambisonic recordings from the GoPro MAX and Zoom H3VR. All cameras feature undocumented noise reduction and audio enhancement algorithms, use different types of audio compression, and have limited audio export options. This makes it challenging to use the spatial audio data reliably for research purposes.
-
Heidi Marie Umbach Hansen, Bruno Laeng, Olav Mandt Vassend, Nikolai Olavi Czajkowski, Tor Endestad & Anne Danielsen
[Vis alle 7 forfattere av denne artikkelen]
(2025).
The role of Big Five personality domains and facets in musical sensibility: a twin study.
Scientific Reports.
15(1).
doi:
10.1038/s41598-025-95661-z.
Fulltekst i vitenarkiv
Vis sammendrag
Musical sensibility can be understood as a propensity to be emotionally and aesthetically engaged by music and may constitute a key feature of a multidimensional definition of musicality. Yet, the nature of this construct is only just beginning to be understood. In a sample of adult Norwegian twins (N = 2592), we aimed to establish whether interindividual variability in musical sensibility may partially be attributable to personality, both in terms of the Big Five personality domains and their lower-order facets, as well as the role of genes and environments. Phenotypic analyses demonstrated that the personality domains of open-mindedness (and the facet aesthetic sensitivity in particular), agreeableness (and the facet compassion), and negative emotionality were all significantly associated with and predictive of musical sensibility. Multivariate biometric twin models further revealed that these relations were driven mainly by genetic influences, accounting for 50–100% of the observed covariance, whereas non-shared environmental influences accounted for the rest. Moreover, genetic correlations of musical sensibility with personality traits were substantial, and particularly strong for open-mindedness, pointing to considerable overlap in the biological mechanisms underlying the two traits. These findings situate musical sensibility within a broader network of psychological dispositions, possibly linked together via common affective systems.
-
Simon Høffding, Remy Haswell-Martin & Nanette Nielsen
(2025).
Absorbed Concert Listening: A Qualitative, Phenomenological Inquiry.
Philosophies.
10(2).
doi:
10.3390/philosophies10020038.
Fulltekst i vitenarkiv
Vis sammendrag
This paper pursues a phenomenological investigation of the nature of absorbed listening in Western, classical music concert audiences. This investigation is based on a data-set of 16 in-depth phenomenological interviews with audience members from three classical concerts with the Stavanger Symphony Orchestra and the Norwegian Radio Orchestra conducted in spring 2024. We identify seven major themes, namely “sharedness”, “attention”, “spontaneous thought/mental imagery”, “modes of listening” “absorption”, “distraction”, and “strong emotional experiences”, and interpret these in light of relevant ideas in phenomenology, cognitive psychology, and ecological aesthetics, more precisely “passive synthesis” from Husserl, the “sense of agency” from Gallagher, and “mind surfing” from Høffding, Nielsen, and Laeng. We show that, like absorbed musical performance, absorbed musical listening comes in many shapes and can be grasped as instantiating variations of passive synthesis, the sense of agency, and mind surfing. We conclude that absorbed listening circles around a kind of paradox of passivity, characterised by a sense of loss of egoic control arising from particular forms of invested, intensive perceptual, cognitive, and affective engagement.
-
Remy Haswell-Martin, Finn Upham, Simon Høffding & Nanette Nielsen
(2025).
Embodied, Exploratory Listening in the Concert Hall.
Behavioral Sciences.
15(5).
doi:
10.3390/bs15050710.
Fulltekst i vitenarkiv
Vis sammendrag
Live music can afford novel, transformative aesthetic interactions for individual audience members. Nevertheless, concert research tends to focus on shared experience. In this paper we offer an account of exploratory listening that foregrounds embodied–enactive engagement and affective resonance through close analysis of the music, physiological measurements, and reflections from interviews. Our analysis centres on data collected from two musician audience members about one specific piece out of a larger interdisciplinary project involving concerts given by the Stavanger Symphony Orchestra and The Norwegian Radio Orchestra in March and June of 2024. Through the combination of in-depth phenomenological interviews with musically skilled audience members and measurements of breathing and body motion, we explore aesthetic enactment beyond common patterns of ‘synchronised’ response, focusing on audience members’ experiences of Harald Sæverud’s ‘Kjempeviseslåtten’ (The Ballad of Revolt) (1943). We find forms of absorbed, both imaginative and embodied involvement, of listeners enacting meaningful contact with, and pathways through, the music that in some ways corroborate crowd patterns but also reveal exploratory expertise and idiosyncratic affective orientations.
-
Sabine Liliana Leske, Tor Endestad, Vegard Akselsson Volehaugen, Maja Dyhre Foldal, Alejandro Omar Blenkmann & Anne-Kristin Solbakk
[Vis alle 7 forfattere av denne artikkelen]
(2025).
Beta oscillations predict the envelope sharpness in a rhythmic beat sequence.
Scientific Reports.
15(1).
doi:
10.1038/s41598-025-86895-y.
Fulltekst i vitenarkiv
Vis sammendrag
Periodic sensory inputs entrain oscillatory brain activity, reflecting a neural mechanism that might be fundamental to temporal prediction and perception. Most environmental rhythms and patterns in human behavior, such as walking, dancing, and speech do not, however, display strict isochrony but are instead quasi-periodic. Research has shown that neural tracking of speech is driven by modulations of the amplitude envelope, especially via sharp acoustic edges, which serve as prominent temporal landmarks. In the same vein, research on rhythm processing in music supports the notion that perceptual timing precision varies systematically with the sharpness of acoustic onset edges, conceptualized in the beat bin hypothesis. Increased envelope sharpness induces increased precision in localizing a sound in time. Despite this tight relationship between envelope shape and temporal processing, it is currently unknown how the brain uses predictive information about envelope features to optimize temporal perception. With the current EEG study, we show that the predicted sharpness of the amplitude envelope is encoded by pre-target neural activity in the beta band (15–25 Hz), and has an impact on the temporal perception of target sounds. We used probabilistic sound cues in a timing judgment task to inform participants about the sharpness of the amplitude envelope of an upcoming target sound embedded in a beat sequence. The predictive information about the envelope shape modulated task performance and pre-target beta power. Interestingly, these conditional beta-power modulations correlated positively with behavioral performance in the timing judgment task and with perceptual temporal precision in a click-alignment task. This study provides new insight into the neural processes underlying prediction of the sharpness of the amplitude envelope during beat perception, which modulate the temporal perception of sounds. This finding could reflect a process that is involved in temporal prediction, exerting top-down control on neural entrainment via the prediction of acoustic edges in the auditory stream.
-
Jatin Agarwala, Sriharsha M.S.S., Jonna Katariina Vuoskoski & Vinoo Alluri
(2025).
Empathy and Music Preferences: Exploring Music Listening Behaviours in
Naturalistic Settings.
Proceedings of the Annual Meeting of the Cognitive Science Society.
47.
Fulltekst i vitenarkiv
Vis sammendrag
Empathy has been linked to music preferences in controlled laboratory settings, but naturalistic settings like music streaming platforms remain unexplored. This study investigates how trait empathy influences music preferences and sequential listening behaviors in real-world settings. To this end, we collected and analyzed one-year Spotify listening histories of 290 Indian university students alongside their trait empathy scores, measured using the IRI scale. Our results reveal that individuals who score high on the IRI subscales of Empathic Concern, Fantasy, and Perspective Taking prefer sad music. Moreover, those scoring high on Empathic Concern or Perspective Taking were found to be more likely to transition from happy to sad music. These findings partially align with previous lab-based research, specifically for the subscales of Empathic Concern
and Fantasy, while providing novel insights into the relations between the Perspective Taking subscale and music consumption. The study also provides novel insights into sequential listening behaviours, thus, strengthening the evidence that empathy shapes musical preferences and listening behaviors across diverse contexts.
-
Hugh Alexander von Arnim, Cagri Erdem, Ulysse Teller Masao Côté-Allard & Alexander Refsum Jensenius
(2025).
A Sensor is not a Sensor: Diffracting the Preservation of Sonic Microinteraction with the SiFiBand.
I Mariana Seiça & Jordan Wirfs-Brock (Red.),
AM '25: Proceedings of the 20th International Audio Mostly Conference.
Association for Computing Machinery (ACM).
ISSN 9798400720659.
s. 318–325.
doi:
10.1145/3771594.3771626.
Fulltekst i vitenarkiv
Vis sammendrag
This paper documents our exploratory work to preserve the interactive music system Stillness Under Tension—developed to explore inverse sonic microinteraction—by porting it from the original and discontinued Myo sensor armband to SiFiBand, a new prototype armband with motion (IMU) and muscle (EMG) sensors. We approach this by merging the Multilevel Dynamic Preservation model with a “diffraction-in-action” method grounded in a theoretical entanglement perspective. Rather than focusing on the Myo version’s artefactual remains, we explore the difference in data representations offered by the two devices as our point of departure. The paper describes the sensor devices, evaluating their data representations given their technical specifications, and describing how these differences propagate throughout our attempt to preserve the system, enacting necessary changes. We discuss the implications of merging these methods in view of the long-term preservation of interactive music systems. Our version 2.0 of Stillness Under Tension finds itself experientially in a position between familiarity and newness.
-
Julian Fuhrer, Kyrre Glette, Jugoslav Ivanovic, Pål Gunnar Larsson, Tristan Bekinschtein & Silvia Kochen
[Vis alle 11 forfattere av denne artikkelen]
(2025).
Direct brain recordings reveal implicit encoding of structure in random auditory streams.
Scientific Reports.
15.
doi:
10.1038/s41598-025-98865-5.
Fulltekst i vitenarkiv
Vis sammendrag
The brain excels at processing sensory input, even in rich or chaotic environments. Mounting evidence attributes this to sophisticated internal models of the environment that draw on statistical structures in the unfolding sensory input. Understanding how and where such modeling proceeds is a core question in statistical learning and predictive processing. In this context, we address the role of transitional probabilities as an implicit structure supporting the encoding of the temporal structure of a random auditory stream. Leveraging information-theoretical principles and the high spatiotemporal resolution of intracranial electroencephalography, we analyzed the trial-by-trial high-frequency activity representation of transitional probabilities. This unique approach enabled us to demonstrate how the brain automatically and continuously encodes structure in random stimuli and revealed the involvement of a network outside of the auditory system, including hippocampal, frontal, and temporal regions. Our work provides a comprehensive picture of the neural correlates of automatic encoding of implicit structure that can be the crucial substrate for the swift detection of patterns and unexpected events in the environment.
-
Weria Khaksar, Diana Saplacan, Lee Andrew Bygrave & Jim Tørresen
(2025).
Robotics in Elderly Healthcare: A Qualitative Analysis of 20 Recent European Research Projects.
ACM Transactions on Human-Robot Interaction.
14(2).
doi:
10.1145/3711936.
Fulltekst i vitenarkiv
-
Jonna Katariina Vuoskoski
(2025).
The social dimension of music listening: Empathy and the experience of feeling moved.
I Katerina Bantinaki, Efi Kyprianidou & Fotini Vassiliou (Red.),
Empathy and the Aesthetic Mind: Perspectives on Fiction and Beyond.
Bloomsbury Academic.
ISSN 9781350409552.
s. 199–212.
doi:
10.5040/9781350409552.0024.
Fulltekst i vitenarkiv
Vis sammendrag
Empathy is a fundamental human capacity that enables us to understand and feel the mental and affective states of others. This capacity is not only restricted to interactions with other humans, but also underpins our engagement with – and responses to – music. This chapter situates the psychological phenomenon of empathy in the context of music listening, and reviews existing empirical evidence on empathy’s role in emotional, neural, and motor responses to music. Multiple strands of evidence suggest that empathy and social cognition play an important role in the affective and pleasurable responses evoked by music. Our social brains resonate with the signs of agency and emotion conveyed by music, eliciting social emotions such as compassion and feeling moved. The social rewards of music listening are grounded in empathic processes, and are able to explain phenomena such as the paradoxical enjoyment of music-induced sadness.
-
Simon Høffding, Rebecca Josefine Five Bergstrøm, Laura Bishop, Pedro Pablo Lucas Bravo, Kayla Burnim & Carlos Eduardo Cancino-Chacón
[Vis alle 28 forfattere av denne artikkelen]
(2025).
Introducing the MusicLab Copenhagen Dataset.
Music & Science.
8.
doi:
10.1177/20592043241303288.
Fulltekst i vitenarkiv
Vis sammendrag
MusicLab Copenhagen was a unique research concert featuring the world-renowned Danish String Quartet in a naturalistic setting. The audience was split between one group physically located in the hall, another group listening to a radio broadcast, and a third group watching a live stream. Qualitative and quantitative data were captured from both musicians and audiences, resulting in a comprehensive dataset that can be used to address many research questions. This document introduces the dataset, explains its structure, and reflects on the related data collection, storing, publishing, and archiving processes.
-
Anne Danielsen, Thea Sørli Paulsrud & Justin London
(2025).
The influence of vocal expertise on the perception of microrhythm in song and speech.
Attention, Perception & Psychophysics.
ISSN 1943-3921.
87,
s. 1750–1770.
doi:
10.3758/s13414-025-03057-y.
Fulltekst i vitenarkiv
Vis sammendrag
Musical expertise affects the perception of the temporal location of a musical sound, often to a significant degree. In a study involving jazz musicians, electronic dance music (EDM) music producers, and Norwegian folk musicians, Danielsen et al. Attention, Perception & Psychophysics, 84, 599–615, (2022) found significant between-group differences regarding the mean location as well as the variability around that mean for a set of control and genre-specific musical sounds. The present study extends these findings to singers who are experts in jazz versus classical music genres. In two experiments participants were presented with sung (Exp. 1) and sung and spoken (Exp. 2) syllables. In both the task was to synchronize either taps or a click track with a looped target sound. In both experiments, we found that classical participants tended to place the mean location later (relative to the acoustic onset) than jazz participants, and likewise had greater variability. Interestingly, and contra to our hypothesis, this between-group difference persisted even when the stimuli were spoken rather than sung. The current study gives further insights into how musical expertise impacts the low-level processing of musical sounds and provides a window into the interaction between top-down and bottom-up aspects of music and auditory perception more generally. In addition, it provides insight into how musicians approach musical and quasi-musical tasks, as well as the way they perceive the acoustic aspects of sound both as a musical object in its own right as well as a cue for perception-action coupling with their fellow musicians.
-
Patrick Georg Grosz, Ragnhild Torvanger Solberg, Jonah Katz, Mai Ha Vu, Alexander Refsum Jensenius & Pritty Patel-Grosz
(2025).
An outline of the narrative grammar of electronic dance music.
Musicae Scientiae.
ISSN 1029-8649.
29(4),
s. 556–575.
doi:
10.1177/10298649251321709.
Fulltekst i vitenarkiv
Vis sammendrag
We argue that electronic dance music (EDM) exhibits a parallel structural organization to that which has been proposed for cartoons (comics) after the model of hierarchical structure proposed in theoretical linguistics. According to this parallel, both systems are governed by general cognitive mechanisms for the narrative organization of tension and release, which are not modality-specific. We show that notions from visual narrative analysis, such as an Establisher–Initial–Peak–Release template, can be applied directly to EDM tracks as an Intro/Breakdown–Buildup–Core–Outro/Cut template. In doing so, we focus on how to formally define and operationalize relevant notions such as Breakdown, Buildup, and Core. As part of our analysis, we show that the scene-setting Establisher segments of visual narratives map onto two distinct categories in EDM: they correspond to intro sections at the beginning of a track and to breakdown sections in the middle of a track; we strengthen the analogy to visual narrative analysis by introducing refinements such as a pre-drop break that often occurs at the end of a buildup segment. To adjudicate between competing hypotheses on the hierarchical structure of a given EDM track, we demonstrate that analytical tests from linguistics and visual narrative analysis can be successfully applied. By introducing these analytical tools, this article sets the stage for further explorations in the linguistically informed analysis of the structure and meaning of EDM.
-
-
-
-
-
Benedikte Wallace, Kristian Nymoen, Jim Tørresen & Charles Patrick Martin
(2024).
Breaking from realism: exploring the potential of glitch in AI-generated dance.
Digital Creativity.
ISSN 1462-6268.
35,
s. 125–142.
doi:
10.1080/14626268.2024.2327006.
Fulltekst i vitenarkiv
Vis sammendrag
What role does deviation from realism play in the potential for generative artificial intelligence (AI) as a creative tool? A deep case-study was performed to explore interactions with AI-generated dance sequences as an inspiration source in dance composition and improvization. We present a simple interface created in collaboration with an experienced dancer for browsing AI-generated dance. By including glitches, the physics-breaking mistakes often encountered in AI-generated artefacts, we examine their affordances and possible use cases through sessions with the dancer. Through a process of reflexive thematic analysis, we identified that generative AI can engage a dancer through surprise, inspiring a transformation from abstract to physical movements. Our work challenges existing notions of the importance of realism in dance generation models, exemplifies the importance of close collaboration with practitioners in evaluating AI-generated artefacts and proposes glitch as a potential use case for dance ideation as it encourages dancers to embody unfamiliar movement qualities and break from ingrained patterns.
-
Connor Spiech, Anne Danielsen, Bruno Laeng & Tor Endestad
(2024).
Oscillatory attention in groove.
Cortex.
ISSN 0010-9452.
174,
s. 137–148.
doi:
10.1016/j.cortex.2024.02.013.
Fulltekst i vitenarkiv
Vis sammendrag
Attention is not constant but rather fluctuates over time and these attentional fluctuations may prioritize the processing of certain events over others. In music listening, the pleasurable urge to move to music (termed ‘groove’ by music psychologists) offers a particularly convenient case study of oscillatory attention because it engenders synchronous and oscillatory movements which also vary predictably with stimulus complexity. In this study, we simultaneously recorded pupillometry and scalp electroencephalography (EEG) from participants while they listened to drumbeats of varying complexity that they rated in terms of groove afterwards. Using the intertrial phase coherence of the beat frequency, we found that while subjects were listening, their pupil activity became entrained to the beat of the drumbeats and this entrained attention persisted in the EEG even as subjects imagined the drumbeats continuing through subsequent silent periods. This entrainment in both the pupillometry and EEG worsened with inc
-
Pedro Pablo Lucas Bravo, Alexander Szorkovszky, Stefano Fasciani & Kyrre Glette
(2024).
Self-Assembly and Synchronization: Crafting Music with Multi-Agent Embodied Oscillators.
I IEEE IEEE (Red.),
2024 IEEE International Conference on Autonomic Computing and Self-Organizing Systems (ACSOS).
IEEE (Institute of Electrical and Electronics Engineers).
ISSN 9798350363876.
s. 145–150.
doi:
10.1109/ACSOS61780.2024.00034.
Fulltekst i vitenarkiv
Vis sammendrag
This paper proposes a self-assembly algorithm that generates rhythmic music. It uses multiple pulsed oscillators embedded in cube-shaped agents in a virtual 3D space. When these units connect with each other, their oscillators synchronize, triggering regular sound events that produce musical notes whose sound dynamics change based on the size of the structures formed. This study examines the synchronization time of these oscillators and the emergent properties of the structures formed during the algorithm’s execution. Moreover, the resulting sound, determined by multiple interactions among agents, is analyzed in the time and frequency domains from its signal. The results show that the synchronization time slightly increases when more agents participate, although with high variability. Also, a quasi-regular pattern of increase and decrease in the number of structures over time is observed. Additionally, the signal analysis illustrates the effect of the self-assembly strategy in terms of rhythmical patterns and sound energy over time. We discuss these results and the potential applications of this multi-agent approach in the sound and music field.
-
Jinyue Guo, Anna-Maria Christodoulou, Balint Laczko & Kyrre Glette
(2024).
LVNS-RAVE: Diversified audio generation with RAVE and Latent Vector Novelty Search.
I Xiaodong Li & Julia Handl (Red.),
GECCO '24 Companion: Proceedings of the Genetic and Evolutionary Computation Conference Companion.
Association for Computing Machinery (ACM).
ISSN 9798400704956.
s. 667–670.
doi:
10.1145/3638530.3654432.
Fulltekst i vitenarkiv
Vis sammendrag
Evolutionary Algorithms and Generative Deep Learning have been two of the most powerful tools for sound generation tasks. However, they have limitations: Evolutionary Algorithms require complicated designs, posing challenges in control and achieving realistic sound generation. Generative Deep Learning models often copy from the dataset and lack creativity. In this paper, we propose LVNS-RAVE, a method to combine Evolutionary Algorithms and Generative Deep Learning to produce realistic and novel sounds. We use the RAVE model as the sound generator and the VGGish model as a novelty evaluator in the Latent Vector Novelty Search (LVNS) algorithm. The reported experiments show that the method can successfully generate diversified, novel audio samples under different mutation setups using different pre-trained RAVE models. The characteristics of the generation process can be easily controlled with the mutation parameters. The proposed algorithm can be a creative tool for sound artists and musicians.
-
Mari Romarheim Haugen
(2024).
Musical Meter as Shape: An Embodied Perspective on Metrical Trajectories and Curves.
I Alexander Refsum Jensenius (Red.),
Sonic Design: Explorations Between Art and Science.
Springer Nature.
ISSN 9783031578922.
s. 37–48.
doi:
10.1007/978-3-031-57892-2_3.
Fulltekst i vitenarkiv
Vis sammendrag
The perception of musical rhythm includes not only the sonic rhythm but also the endogenous reference structures, such as meter. Musical meter is often described and understood as points in time or durations between such points. In this chapter, I argue that musical meter also has a shape. I propose that we perceive and make sense of musical meter based on our previous musical experiences involving meter-related bodily motion. In other words, the meter-related motion is integral to the perceived meter—they are the same. Meter thus has a shape that relates to the embodied sensations of these movements. Also crucial is the notion that musical meter is conditioned by musical culture. This perspective on meter as shape is highly influenced by Godøy’s motor-mimetic perspective on music perception and musical shape cognition and concurs with the multimodal approach to sonic design that acknowledges motion as intrinsic to music performance and perception.
-
Alexander Refsum Jensenius
(2024).
Embodied Musicking Technologies: Inspired by Professor Marc Leman.
I Pieter-Jan Maes (Red.),
Liber Amicorum Marc Leman: A life in music, science, and technology.
Ghent University.
Fulltekst i vitenarkiv
Vis sammendrag
In his seminal book “Embodied Music Cognition and Mediation Technology”, Marc Leman Leman (2008a) drew up a theoretical framework that has influenced a whole new generation of researchers, myself included. Building on a long tradition of systematic musicology, combined with ecological psychology
and modern technology, he convincingly set the direction for a fresh approach to scientific studies of musical experiences. In the following, I will reflect on some concepts that he raised in his discussion, and I will point out some that he left for others, like me, to explore in more detail.
-
-
Nori Jacoby, Rainer Polak, Jessica A. Grahn, Daniel J. Cameron, Kyung Myun Lee & Ricardo Godoy
[Vis alle 34 forfattere av denne artikkelen]
(2024).
Commonality and variation in mental representations of music revealed by a cross-cultural comparison of rhythm priors in 15 countries.
Nature Human Behaviour.
s. 846–877.
doi:
10.1038/s41562-023-01800-9.
Fulltekst i vitenarkiv
Vis sammendrag
Music is present in every known society but varies from place to place. What, if anything, is universal to music cognition? We measured a signature of mental representations of rhythm in 39 participant groups in 15 countries, spanning urban societies and Indigenous populations. Listeners reproduced random ‘seed’ rhythms; their reproductions were fed back as the stimulus (as in the game of ‘telephone’), such that their biases (the prior) could be estimated from the distribution of reproductions. Every tested group showed a sparse prior with peaks at integer-ratio rhythms. However, the importance of different integer ratios varied across groups, often reflecting local musical practices. Our results suggest a common feature of music cognition: discrete rhythm ‘categories’ at small-integer ratios. These discrete representations plausibly stabilize musical systems in the face of cultural transmission but interact with culture-specific traditions to yield the diversity that is evident when mental representations are probed across many cultures.
-
Ragnhild Brøvig & Jon Marius Aareskjold-Drecker
(2024).
Vocal Chops: Another Human/Machine Hybrid.
I Jan-Olof Gullö, Russ Hepworth-Sawyer, Justin Paterson, Rob Toulson & Mark Marrington (Red.),
Innovation in Music: Cultures and Contexts.
Routledge.
ISSN 9781032611167.
doi:
10.4324/9781003462101-8.
Fulltekst i vitenarkiv
-
Adel Baselizadeh, Md Zia Uddin, Weria Khaksar, Diana Saplacan & Jim Tørresen
(2024).
PriMA-Care: Privacy-Preserving Multi-modal Dataset for Human Activity Recognition in Care Robots.
I Dan Grollman & Elizabeth Broadbent (Red.),
HRI '24: Companion of the 2024 ACM/IEEE International Conference on Human-Robot Interaction.
Association for Computing Machinery (ACM).
ISSN 9798400703232.
s. 233–237.
doi:
10.1145/3610978.3640701.
Fulltekst i vitenarkiv
Vis sammendrag
In the field of robotics, caregiving robots and personal assistants are assuming an increasingly prominent role, directly impacting human lives. Especially in healthcare domains, these systems are starting to provide continuous 24/7 care by monitoring patients and delivering real-time insights into their activities. The effective deployment of future robots relies on equipping them with sophisticated Human Activity Recognition (HAR) algorithms. Many HAR algorithms are based on Artificial Intelligence (AI) and Machine Learning (ML) models. The development of these models necessitates suitable datasets. This paper introduces a Privacy-preserving Multimodal dataset for HAR in the context of Human-Robot Interaction (HRI) for Care robots (PriMA-Care). Tailored for care robots, PriMA-Care includes 27 diverse user activities, spanning daily tasks to physical HRI, with data from 10 privacy-preserving sensors and 17 participants. PriMA-Care addresses critical gaps in existing datasets, offering a suitable resource for HAR research in care robots.
-
Alexander Refsum Jensenius
(2024).
Musikkopplevelser, kulturbruk og politikk.
I Ragnhild Torvanger Solberg (Red.),
Tverrfaglege perspektiv på kulturbruk, publikum og deltaking.
Kulturrådet.
ISSN 9788270812165.
s. 87–97.
Fulltekst i vitenarkiv
Vis sammendrag
Hvordan brukes kultur i Norge i dag? Som musikkteknolog har jeg mest kompetanse til å reflektere over musikk, men jeg har også noe erfaring med interaktiv dans og installasjonskunst. I tillegg har forskningen min nå dreid seg mot akustikk, lydkunst, visuell estetikk og arkitektur. Sammen dekker dette mange sider av kunst- og kulturområdet, selv om min inngang
i denne artikkelen primært vil være fra de to disiplinene musikkpsykologi og musikkteknologi. Innenfor musikkpsykologien forsøker vi å forstå hvordan musikk påvirker mennesker, i kropp og sinn. Musikkteknologien dreier
seg derimot om å forstå hvordan verktøy og systemer brukes i musikalske sammenhenger.
-
Anna-Maria Christodoulou, Sagar Dutta, Olivier Serge Gabriel Lartillot, Kyrre Glette & Alexander Refsum Jensenius
(2024).
Exploring Convolutional Neural Network Models for Multimodal Classification of Expressive Piano Performance,
Proceedings of the Sound and Music Computing Conference 2024.
SMC Network.
ISSN 9789893520758.
Fulltekst i vitenarkiv
Vis sammendrag
This paper addresses improving performance analysis by automating the recognition of expressive performance styles. We propose a multimodal fusion approach integrating audio, video, and motion data. We demonstrate the effectiveness of our approach by utilizing convolutional neural network (CNN) models. Training is done on a classical piano dataset of 211 excerpts containing audio, video, MIDI, and motion capture data. The results highlight the robustness of the CNN models; they achieve high accuracy even when trained on a limited dataset. Our study contributes to advancing the field of performance analysis by applying deep learning techniques to multimodal data.
-
Kjell Andreas Oddekalv
(2024).
Lyrisk brunst: Rapanalysens form, mål og formål.
I Peter Fjågesund, Sveinung Nordstoga & Herleik Baklid (Red.),
Songen og teksten. Frå Draumkvedet til Dimmu Borgir.
Novus Forlag.
ISSN 9788283901634.
s. 277–295.
Fulltekst i vitenarkiv
-
Rolf Inge Godøy
(2024).
Generic Motion Components for Sonic Design.
I Alexander Refsum Jensenius (Red.),
Sonic Design: Explorations Between Art and Science.
Springer Nature.
ISSN 9783031578922.
s. 3–24.
doi:
10.1007/978-3-031-57892-2_1.
Fulltekst i vitenarkiv
Vis sammendrag
Sonic design, understood as the activity of intentionally creating sound events, encompasses both musical craftsmanship and analytic reflection. It may include technologies for sound synthesis and processing, as well as traditional methods for sound generation by musical instruments or the human voice, and also principles of orchestration. Common to many instances of sonic design, is having acoustic components that blend with concurrent real or imagined motion sensations. Thus, sonic design can be understood as a multimodal phenomenon, yet we often lack suitable concepts for differentiating and evaluating these multimodal components. This paper aims to present work on developing a scheme to detect, and actively exploit, generic motion components in sonic design, be that as analytic or creative tools.
-
Emil Bernhardt
(2024).
Emphatic Articulation: ‘Klangrede’ as a performative concept in Nikolaus Harnoncourt’s orchestral interpretation.
Studia Musicologica Norvegica.
ISSN 0332-5024.
50(1-2024),
s. 123–142.
doi:
10.18261/smn.50.1.8.
Fulltekst i vitenarkiv
Vis sammendrag
In a 2004 interpretation of Schubert’s Symphony in B minor, Austrian conductor Nikolaus Harnoncourt and the Berlin Philharmonic foreground a certain awareness regarding articulation. This awareness brings with it a broadening of the concept of articulation that transcends choices regarding accents, endings, slurs, and so on. Harnoncourt’s articulation, that is, incorporates what he refers to as the act of ‘pronouncing’ (as in quite deliberately enunciating) the musical material. This practice – what the author of this article labels ‘emphatic articulation’ – can also be framed as an attempt to clarify the relationship between music and language, an issue of importance to Harnoncourt that is most explicitly represented by his notion of Klangrede. The concept of meaning proves crucial to understanding Klangrede, and this article seeks to shed light on this relation in the context of musical performance. According to the 18th-century German philosopher Herder, the human ability to deal with meaning is based on a reflective awareness that only comes into being through the act of speaking itself. With the support of Herder’s ‘reflective awareness’, this article plumbs the depths of the emphatically articulated musical performance as a timebound act, and asks whether it might be understood in a similar way.
-
Lindy Comstock, Vinicius Rezende Carvalho, Claudia Lainscsek, Aria Fallah & Terrence J. Sejnowski
(2024).
Transcranial Magnetic Stimulation Facilitates Neural Speech Decoding.
Brain Sciences.
doi:
10.3390/brainsci14090895.
Fulltekst i vitenarkiv
-
-
Bilge Serdar Göksülük
(2024).
The clash between physical and digital realm: hybrid movement training during the pandemic.
Discover Education.
3(1).
doi:
10.1007/s44217-024-00158-y.
Fulltekst i vitenarkiv
Vis sammendrag
This article is based on ethnographic research conducted in one of the physical training institutions that offer the Laban/Bartenieff Movement Studies (LBMS) certification program in 2021. Because of the COVID-19 pandemic crisis, the training was held in a hybrid format in which some participants were in the studio while others were attending remotely via Zoom. Zoom-mediated movement training for long hours revealed how the intervention of telematic technologies challenged practitioners’ sensorial experience and sense-making process. Moreover, bringing co-located and remote participants’ experiences together in the hybrid setting disclosed different modes of interaction dynamics in the studio and online. Overall, participants described their hybrid experience as a clash. In the article, starting from unfolding those clashes from the enactive perspective, I discuss how remote intercorporeality through an audio–video streaming system, Zoom, challenges participants’ sensorial experience and how remote interaction affects the shared sense-making process in the hybrid format setting.
-
Rolf Inge Godøy
(2024).
Motion shapes for sound shaping.
Frontiers in Psychology.
15,
s. 1–5.
doi:
10.3389/fpsyg.2024.1449021.
Fulltekst i vitenarkiv
Vis sammendrag
The focus of this perspective paper is on relationships between sound-producing
body motion and corresponding perceived sound features, guided by the idea
of shapes as the common denominator of these two domains. The term shape
is used to denote graphical-pictorial renderings of phenomena that we perceive
or imagine, and may have physical manifestations as tracings on paper or on
screen, or as gesticulations, or just as imagined tracings in our minds. Shapes
give us intermittent snapshots of unfolding motion and sound fragments, and the
point of shapes is to make ephemeral sound and motion features tractable as
more permanent objects. Shapes of perceived sound include dynamic, spectral,
textural, pitch-related, harmonic, etc. features as shapes, whereas shapes of
sound-producing motion include both motion trajectories and postures of sound-
producing effectors, i.e., of fingers, hands, arms, etc., or mouth, lips, and tongue.
Se alle arbeider i NVA
-
Andrea Schiavio, Jonna K Vuoskoski & Youn Kim
(2026).
Music and the Cognitive Humanities: Interdisciplinary Insights.
Oxford University Press.
ISBN 9780197755600.
250 s.
doi:
10.1093/9780197755600.001.0001.
Fulltekst i vitenarkiv
Vis sammendrag
Music and the Cognitive Humanities explores how the sciences and humanities can work together to understand how people experience and make music. The volume primarily features chapters coauthored by researchers from scientific fields such as experimental psychology or cognitive science and scholars from musicology, philosophy, or performance studies, creating fresh and accessible perspectives on music-related topics such as creativity, empathy, development, and emotion. The result is a unique and highly readable blend of theory and evidence, offering new insights into how body, thought, action, and culture shape our musical lives and understandings. As part of the Music as Art and Science series, the book illustrates how a cognitive-humanistic approach can deepen our understanding of how people think, feel, and act through music. Clear, engaging, and accessible, it is an essential resource for students, scholars, and practitioners interested in the evolving relationship between mind, body, and music. Ultimately, Music and the Cognitive Humanities offers a compelling vision of how integrated research can enrich our understanding of human musicality in the twenty-first century.
-
Olivier Lartillot & Anders Elovsson
(2025).
Annotemus User’s Guide.
Universitetet i Oslo.
doi:
https:/www.uio.no/ritmo/english/projects/mirage/software/annotemus/guide0.7.2.pdf.
Fulltekst i vitenarkiv
Vis sammendrag
Annotemus is a new software for computer-assisted annotation of music recordings, with a focus on transcription.
Annotemus features a graphical user interface providing functionality for creating annotations on top of a graphical representation of an audio file.
Annotation aids include audio playback of the current window, playback between the start and end of one or several selected notes, playback that starts prior to a selected annotated note and ends at the annotated onset position, playback with a click at each annotated onset position, and playback with a synthesized version of the annotated score played in one of the stereo channels. All playback functionality is offered with the option of slowing it down to various speeds.
-
-
-
Bilge Serdar Göksülük
(2024).
Immersive Technologies and Their Implications in Theatre for Young Audiences:Challenges and Opportunities.
Cândido.
ISBN 9786587602479.
15 s.
Fulltekst i vitenarkiv
Vis sammendrag
Today’s immersive technology creates a real-like ambience, offering a unique interactive and multimodal experience onstage. These implications might look promising for new aesthetic forms. However, using them on the stage in this technology-driven world raises some concerns about their potential long-term impact on young people’s development. In this paper, I will critically evaluate the use of immersive technology in TYA, questioning whether performing arts can offer a new form of aesthetic experience.
-
Se alle arbeider i NVA
Publisert 15. feb. 2018 09:38
- Sist endret 26. nov. 2025 12:59