Source-linked AI summary
Exploring Breathing-Music Coupling: Using the Breathing Mirror for Somatic Reflection in Piano Performance
Ziyue Piao, Yohei Wada, Isabelle Cossette, Marcelo M. Wanderley, Akira Maezawa
TL;DR
Pianists’ internal bodily states are difficult to monitor during performance, while existing interfaces often overlook respiratory experience. The Breathing Mirror combines respiratory data with structured reflection, and the study observed breathing synchronized with musical features such as bass notes and pedaling.
Problem
Pianists’ internal physiological experience is difficult to recall precisely during performance, and existing interfaces often neglect how breathing relates to expressive intent.
Source: §1 · p. 1, §2.3 · p. 2Method
The Breathing Mirror integrates respiratory data with Baseline, First-Person, and Interpersonal views for structured somatic reflection.
Source: §1 · p. 1Results
Breathing synchronized with harmonic anchors such as bass notes and pedaling, while the analysis described breathing as a somatic anchor for harmonic transitions and a proxy for cognitive load.
Source: §7 · p. 9Takeaways & Limitations
The findings frame breathing as a potential marker of musical structure and expressive intent in piano performance.
Source: §7 · p. 9Further cross-participant studies are needed to determine whether the duration and timing of the anticipatory shift are consistent markers of professional training.
Source: §6.3 · p. 9
Abstract
from arXiv · showhide
While breathing is essential to living and for sound production in some instruments, for pianists, it is often a hidden and automatic process, making it difficult to analyze or refine. A critical gap exists between data and awareness: while sensors record precise physical metrics, they fail to capture the performer's somatic experience. Conversely, the high cognitive load of performance makes it nearly impossible for musicians to recall their internal states with temporal precision. To address this, we present a system, Breathing Mirror, and associated methodology designed to externalize the pianist's internal somatic experience through three analytical lenses: a Baseline View (synchronized signals), a First-Person View (subjective recall), and an Interpersonal View (collaborative reflection). Through a four-week longitudinal study with a skilled amateur pianist (35 years of experience), we evaluated the system's effectiveness by recording respiratory data using textile-integrated strain sensor belts. The results show that the Breathing Mirror reveals some patterns of breathing-music coupling and identifies critical blind spots where objective data diverges from subjective perception. Furthermore, we propose four somatic themes regarding the link between breathing and musical elements, offering a foundation for future large-scale validation across a broader range of pianists. This work provides a new way to study body signals, transforming breathing from an internal biological function into an articulate expressive parameter.
1 Introduction
The introduction frames pianist breathing as an expressive bodily process that is difficult to consciously track, and presents the Breathing Mirror as a tool for reflecting on breathing alongside musical performance.
1 Introduction
- Although pianists do not use breath to create tone, breathing influences phrasing, timing, and emotional communication, and studies link pianists’ breathing cycles to musical structures.Source: §1 · p. 1
- Sensors capture physical metrics but not subjective feelings or artistic intentions, while performance’s cognitive demands hinder precise recall and can produce a kinesthetic mismatch [31].First-person somaesthetic reflection can document experience, but the introduction notes that complex piano performance makes it difficult to recall physiological states on the rapid musical timeline.Source: §1 · p. 1
- The Breathing Mirror integrates respiratory data with musical output to support somatic reflection in a month-long study of a skilled amateur pianist with 35 years of experience.The approach aims to help performers and researchers co-observe signals and articulate pre-reflective bodily sensations as musical insights.Source: §1 · p. 1
- The system and methodology combine a Baseline View, a First-Person View, and an Interpersonal View, and propose four somatic themes for evaluation with a broader cohort of expert pianists.Source: §1 · p. 1
2 Related Work
Related work frames bodily reflection as a means of attending to lived sensation, yet identifies a gap in real-time somatic access and breathing-aware reflection in piano performance.
2.1 Phenomenological Foundations
- Phenomenological work treats bodily reflection as deliberate attention to sensation, while music scholarship links embodied action and sound but notes kinesthetic mismatch under performance demands.This mismatch separates felt intent from physiological state, making foundational states such as breathing difficult to attend to during complex performance.Source: §2.1 · p. 2
2.2 Somatic Interaction Tools for Performance
- Somatic performance tools center lived bodily experience and use autoethnography or micro-phenomenology, but slow practices lack musical temporal resolution and are difficult to use live.Examples include Body Electric, DogDog, and Suspended Circles.Source: §2.2 · p. 2
2.3 Breathing and Body in Piano Performance
- Breathing-music coupling links respiratory signals to musical structure or expression; breath-aware NIME work centers voice and wind, while piano tools privilege external correctness over respiratory support of expression.MirrorFugue III examines the body and recorded performance through external gestures, but existing interfaces often neglect internal physiology.Source: §2.3 · p. 2
3 The Breathing Mirror Interface
The Breathing Mirror uses synchronized respiratory and musical recordings for post-hoc analysis, pairing visual comparison with time-stamped annotation. Its segmentation pipeline assists analysis, while researchers and the pianist refine and verify detected events.
3 The Breathing Mirror Interface
- The Breathing Mirror displays synchronized performance and respiratory data as a visual mirror for post-hoc reflection rather than real-time monitoring.Pre-recorded data avoids requiring performers to monitor breathing while managing complex finger movements or musical grouping; two high-fidelity belts support temporal alignment with musical performance data.Source: §3 · p. 2
3.1 The Breathing Belts
- The breathing belts use flexible, lightweight carbon-nanotube strain sensors designed for comfortable textile integration and wearable motion sensing.The sensor is described as providing a more linear stretch-resistance relation, fitting into garments, and deforming with the body without significant counter-resistance.Source: §3.1 · pp. 2–3
3.2 Data Acquisition and Transmission
- Thoracic and abdominal belts were recorded alongside piano MIDI and audio, and Rosendahl mif4 synchronized the streams into time-stamped files for visualization.MIDI was recorded at roughly 1 ms temporal resolution, audio at 44.1 kHz, and respiratory signals at 10 kHz; the streams were saved as .mid and .wav files.Source: §3.2 · p. 3
3.3 The Visualization Interface
- The interface synchronizes MIDI, audio, and respiratory data, then lets users compare playback and link somatic reflections to breathing segments on a timeline.It automatically marks inspiration and expiration, allows users to add, move, or delete markers, and provides pre-populated topic labels in its annotation table.Source: §3.3 · p. 3
3.4 Breathing Segmentation Algorithm
- The segmentation pipeline filters and smooths respiratory signals, detects events using adaptive thresholds, and prioritizes the thoracic channel before fusing it with abdominal data.Thoracic events are validated by an abdominal peak within 0.75 s or sufficient relative amplitude; patterns shorter than 0.6 s are excluded, and researchers manually refine detections that the pianist verifies.Source: §3.4 · pp. 3–4
4 Investigation with the Practitioner · 4.1 Methodology
The methodology uses an idiographic study of one somatic expert and treats the Breathing Mirror as a probe for kinesthetic recall, not as an objective truth. Its three views combine synchronized physiological evidence, the pianist’s felt experience, and collaborative reflection.
4.1 Methodology
- The idiographic approach prioritizes deep investigation of one somatic expert’s lived experience over broad statistical sampling.The Breathing Mirror is intended to externalize pre-reflective respiratory gestures; experimental procedures and data acquisition protocols are detailed in Section 4.3.Source: §4.1 · p. 4
- The Breathing Mirror acts as a probe for kinesthetic recall, prompting somatic re-living of breath–music timing rather than providing objective truth to rationalize.Re-experiencing the temporal alignment of breath and music helps the performer move from observation to somatic re-living.Source: §4.1 · p. 4
4.1.1 The Baseline View: Data-supported Objective Reference.
- The baseline view synchronizes and time-stamps respiratory and musical data, creating a navigational map for revisiting performance moments and examining discrepancies with memory.It serves as a physiological record supporting first-person and interpersonal reflection.Source: §4.1.1 · p. 4
4.1.2 The First-Person View: Preserving Somatic Authority.
- The first-person view makes the pianist’s felt sense the primary source of truth, capturing subjective breath qualities during familiar, comfortable performance before external data is shown.In the subsequent reflection phase, the performer recalls and articulates sensations from internal memory.Source: §4.1.2 · p. 4
4.1.3 The Interpersonal View: Intersubjective Reflection.
- The interpersonal view has researchers and the performer jointly review music and breathing evidence, with researchers identifying signal patterns or structural shifts and asking targeted questions.Questions can use a respiratory peak aligned with a musical passage to ask whether the breath was intentional or spontaneous.Source: §4.1.3 · p. 4
- Targeted questioning about breath–phrase connections fosters intersubjective dialogue and richer observation of the embodied musical experience.Researchers facilitate reflection by directing shared attention to specific moments in the multimodal data.Source: §4.1.3 · pp. 4–5
4.2 The Collaborative Practitioner Pianist
The study collaborated with YK, a skilled amateur pianist whose experience spans both classical training with little emphasis on breathing and intensive breath-centered practice. Her lived experience informed the interface and reflection procedures, while a concert-ready piece served as a stable baseline for examining the gap between perceived and actual breathing.
4.2 The Collaborative Practitioner Pianist
- YK was selected as a somatic expert for her 35 years of classical training and dual experience with and without an emphasis on breathing.Her background included 20 years of classical training with little emphasis on breathing, followed by 15 years of intensive breath-centered practice.Source: §4.2 · p. 5
- YK’s specialized lived experience drove iterative interface refinement and the formalization of the somatic reflection procedures.Source: §4.2 · p. 5
- The intervention was not pedagogical: YK had mastered the concert piece, which served as a stable baseline for examining the gap between perceived and actual breathing.Source: §4.2 · p. 5
4.3 Procedure
Across four weekly interviews, the study progressed from familiarization to synchronized performance recording and increasingly detailed somatic annotation, ending with reflection on the full piece.
4.3 Procedure
- Four weekly interviews began with familiarization; sessions two through four used system encounters to refine the interface and understanding of breathing-music coupling, with annotation notes and interview audio saved after each of those sessions.The second author managed the interface, led interviews, and documented somatic annotations in real time; the first co-facilitated, observed respiratory patterns, and prompted reflection when significant breathing events were missing.Source: §4.3 · p. 5
4.3.1 Session 1: Introduction and System Familiarization (30 min-
- The initial meetup established YK’s baseline and introduced Breathing Mirror; the pianist and researchers selected Hisaishi’s six-part Nausicaä opening for its contrasting musical passages.The piece’s dense rhythmic ostinatos and lyrical melodies were intended to elicit varied respiratory responses; prior breathing instruction let the study focus on fluent, pre-reflective habits.Source: §4.3.1 · p. 5
4.3.2 Session 2: Performance Recording and Overview Annotation
- Session 2 paired synchronized respiratory and musical recording with an overview annotation of the piece’s first half using Breathing Mirror.After warm-up and practice runs, YK chose a take she felt best expressed her breathing-shaped musical intent; she used tactile memory at the piano while reviewing the visualization, and feedback informed interface refinements.Source: §4.3.2 · p. 5
4.3.3 Session 3: In-Depth Annotation (60 minutes).
- A refined timestamp interface supported micro-analysis of the first-half annotations, helping YK distinguish spontaneous somatic responses from patterns shaped by prior instruction.Working away from the piano, she completed a detailed review of the first half and began the same reflection process for the second half.Source: §4.3.3 · p. 6
4.3.4 Session 4: In-Depth Annotation and Reflective Discussion
- Session 4 revisited Session 3 annotations to identify instructed respiratory patterns and previously unacknowledged responses, culminating in reflection on the full piece.YK continued working away from the piano and the annotation notes were downloaded at the end.Source: §4.3.4 · p. 6
4.4 Analysis
The analysis combined reflexive inductive thematic analysis of interview transcripts with timestamp annotations linking breathing patterns to thematic markers. These annotations supported triangulation, frequency counts, and a timeline of six primary breathing patterns.
4.4 Analysis
- The first and second authors conducted inductive thematic analysis using Braun and Clarke’s reflexive framework.The first author led coding and candidate-theme development; the second cross-checked code consistency and reviewed the final themes against the participant’s lived experience.Source: §4.4 · p. 6
- Japanese interview recordings from Sessions 2–4 were transcribed, translated into English, jointly audited against the audio, and coded by the first author.The second author facilitated refinement by cross-checking code consistency and reviewing the final themes.Source: §4.4 · p. 6
- Timestamp annotations mapped breathing patterns to thematic markers in a unified CSV, enabling triangulation, coupling-behavior frequency counts, and a timeline of six primary patterns.The timeline showed the distribution and frequency of the patterns across the performance duration.Source: §4.4 · p. 6
5 Findings
The findings map breathing across musical structure and expression, while revealing gaps between YK’s perceived and recorded breathing and showing how system feedback informed the interface. The analysis identified six frequency-ranked themes and used a timeline to visualize their distribution.
5.1 Timeline Overview
- The analysis identified six frequency-ranked breathing–music themes and mapped their timing and density across the performance, scaling circle size to breath-cycle amplitude.The timeline chart presents the occurrences against performance duration.Source: §5.1 · p. 6, Figure 4 · p. 7
5.2 Structural and Harmonic Synchronization
- Deep inhalations often prepared left-hand bass notes, while breathing also marked phrase boundaries and major structural entries.Breath depth could increase when a phrase change coincided with a bass note; inhalations also anticipated mood or instrumental-character shifts and could mirror pedal pressing and releasing.Source: §5.2 · pp. 6–7
5.3 Expressive Control and Adaptive Strategies
- YK suppressed or controlled breathing during ritardando and demanding dynamic passages, while long phrases and strict tempo sometimes forced respiratory substitution or very light breathing.She connected breath-holding to prior wind-instrument practice and described exhaling instead of inhaling when the next note was near.Source: §5.3 · p. 7
5.4 Unconsciousness and Consciousness: The Intuition of Breathing
- YK’s awareness did not always match recorded breathing: tiny inhalations, larger-than-expected breaths, and inhalations ahead of musical events complicated her sense of timing.She also described a leisurely inhalation when returning to the main melody after ritardando, aligned with the phrase and bass.Source: §5.4 · pp. 7–8
- Breathing could be involuntary yet phrase-aligned, disrupted by social stress or mistakes, or deliberately adjusted to create changes in sound quality.YK described these states as a blurred boundary between conscious and autonomous control, with some sound-quality shifts requiring calculated physical input.Source: §5.4 · p. 8
5.5 Practitioner’s Feedback on the Interface Design
- YK found the breathing belts unobtrusive and the visualizations useful for noticing perceived-versus-recorded differences, while requesting piano-oriented score and hand-display refinements.Her feedback prompted a shift toward synchronized MIDI scores; she later preferred traditional sheet music and suggested separating the hands in a modular display.Source: §5.5 · p. 8
6 Discussion
The discussion proposes four emergent somatic themes for future evaluation with larger cohorts of expert pianists, linking breathing to bass-note preparation, cognitive and motor load, expressive anticipation, and pedaling.
6.1 Inhalation as a Somatic Anchor for Structural Bass Notes
- Deep inhalations consistently precede left-hand bass notes, suggesting that breathing anchors postural readiness for resonant low-frequency tones.Breath-circle sizes generally decline from Section A through Section E, indicating varying physiological intensity; future research could test whether preparatory-breath depth correlates with bass-note dynamics. Wind players have been reported to adapt inspiratory volume to upcoming demands.Source: §6.1 · p. 8
6.2 Respiratory Suppression as a Proxy for Cognitive and Motor Load
- Sparse, non-cyclical “breath-killing” events reflect focused motor stillness under high cognitive demand, disrupting bass-note preparation and foot-pedaling actions.Disruptions around 60–70 s and 150 s suggest that error recovery or self-consciousness can supersede breathing-music coupling; breath suppression may indicate sections of expressive delicacy, a possibility requiring cross-participant testing.Source: §6.2 · pp. 8–9
6.3 Temporal Lead-time in Expressive Anticipation
- Inhalation slightly ahead of musical events, especially during spatial-imagery shifts or upper-register entries, suggests respiration anticipates expressive intent.This resembles short-term respiratory anticipation reported in flutists; understanding lead time may inform collaborative AI or robotic systems, while cross-participant research could test whether its timing marks professional training.Source: §6.3 · p. 9
6.4 The Coupling of Respiration and Pedaling
- Time-aligned respiratory cycles consistently couple with bass-note preparation and foot pedaling, whose press-release cycle functionally parallels breathing during phrasing.The discussion proposes that feet and lungs work as a unified system to clarify musical textures and avoid harmonic blurring; broader study could test whether breathing, pedaling, and striking phase-lock to musical form.Source: §6.4 · p. 9
7 Conclusion
The Breathing Mirror used textile-integrated breathing belts and multiple perspectives to externalize a pianist’s somatic experience. Findings link breathing with musical structure and suggest it may support stability and expressive intent, though the proposed themes need further validation.
7 Conclusion
- Breathing synchronized with harmonic anchors such as bass notes and pedaling, while inhalation aligned with kinematic actions, suggesting biological rhythms may be phase-locked to musical structures.The study identifies four emergent somatic themes concerning breathing-music coupling, which require further experimental validation.Source: §7 · p. 9
- Using textile-integrated breathing belts and multiple-perspective reflection, the Breathing Mirror externalized a pianist’s pre-reflective somatic experience and served as an inspiring reflection tool.Source: §7 · p. 9
- Breathing may serve as a somatic anchor for harmonic transitions and a proxy for cognitive load, contributing to structural stability and expressive intent.Source: §7 · p. 9
8 Ethical Standards
The study obtained the pianist’s informed consent and followed anonymity and data-security protocols; the authors also disclosed and manually checked their use of Gemini for visualization and linguistic refinement.
8 Ethical Standards
- The study followed informed-consent, participant-anonymity, and data-security protocols for the expert pianist.Source: §8 · p. 9
- After drafting the code and manuscript, the author used Gemini for data visualization and linguistic refinement, and the authors manually verified and edited its outputs.Source: §8 · p. 9