Website: https://pedrolucas.tech/
LinkedIn: https://www.linkedin.com/in/pedro-lucas-bravo/
GitHub: https://github.com/pedro-lucas-bravo
Academic Interests
My Ph.D. project is related to the exploration of human-swarm interactive music systems .
The main objective is to design and implement music systems based on autonomous agents that interact with both other agents and human users; as well as understanding emergent properties from these systems and from humans engaging with them.
To achieve this goal, this project considers the development of multimodal interactive music systems modeled as swarms of autonomous agents that can show self-organization and emergent behaviors for music performances. The research interest lies in investigating such behaviors when these systems are fully autonomous and when a user influences them during collaborative music performances, as well as deriving design insights to enable such collaboration.
The technologies relevant to this project are:
- Sound Synthesis Engines.
- Game Engines.
- Extended Reality (virtual, augmented, and mixed).
- Spatial Audio.
- Motion Capture.
Ongoing Projects
HS-ims: A Platform for Human-Swarm Interactive Music Systems
This platform features a 3D environment for agents carrying sound synthesizers, intended for research on multi-agent systems in the sound and music interaction domain. It communicates with external controllers in any programming language to manage object logic.
More info : https://github.com/pedro-lucas-bravo/human_swarm_examples
Interactive Self-Assembly Music System
Self-assembly is a natural growth mechanism that occurs on different scales. It involves components that follow local interaction rules, leading to the formation of patterns or structures without human intervention. In this application, a self-assembly algorithm is proposed to generate music. It uses multiple pulsed oscillators embedded in cube-shaped agents in a virtual 3D space. When these units connect with each other, their oscillators synchronize, triggering regular sound events that produce musical notes whose sound dynamics change based on the size of the structures formed. We study the emergent properties of this application and how we can integrate it into a human-swarm interactive music system. The following video shows the autonomous behaviour.
This system was ported to an XR system to include user interactivity. A demonstration of this system is shown in the next video.
Interactive Sonification for 3D Swarmalators
A swarmalator is a type of self-organizing system where agents or particles interact with each other through local rules. The term "swarmalator" is a combination of "swarm," which refers to a group of agents, and "oscillator," which refers to a system that exhibits periodic behavior. In a swarmalator system, each agent has an internal oscillator that determines its behavior, and the agents interact with their neighbours, affecting each other's oscillations and leading to synchronization. This synchronization can result in collective behaviors such as coordinated motion or pattern formation. Sonic and musical properties can be explored using the parameters involved in swarmalators, leading to interesting self-organized compositions and emergent behaviors capable of interacting with humans in a synchronized environment.
This system was implemented in XR. The following video shows a short demonstration.
XR Human-Swarm Interactive Music System
This Interactive Music System (IMS) uses Extended Reality (XR) and Spatial Audio technologies for a multi-track looping session. Each track is represented by an "Agent," a quasi-autonomous entity embodied as a sound source in space visualized as a virtual sphere.