Source-linked AI summary
Exploring Breathing-Music Coupling: Using the Breathing Mirror for Somatic Reflection in Piano Performance
Ziyue Piao, Yohei Wada, Isabelle Cossette, Marcelo M. Wanderley, Akira Maezawa
TL;DR
Pianist breathing is difficult to analyze and recall because it is often automatic, while existing sensing and reflection methods capture either physical metrics or subjective experience. The paper introduces the Breathing Mirror and evaluates it through a month-long study, finding breathing–music patterns and proposing somatic themes for broader validation.
Problem
Sensors capture physical metrics but not subjective somatic experience, while performance demands make precise first-person recall difficult.
Method
The Breathing Mirror combines synchronized respiratory and musical data with Baseline, First-Person, and Interpersonal Views for somatic reflection in a month-long pianist study.
Results
The study identified breathing–music patterns, including synchronization with harmonic anchors such as bass notes and pedaling, and six primary themes characterizing the relationship.
Takeaways & Limitations
The work treats breathing as a somatic anchor for musical structure and expressive intent while providing four themes for further evaluation.
Takeaways & Limitations
The four emergent somatic themes require further experimental validation, including cross-participant studies to assess whether respiratory lead time is consistent across professional training.
Abstract
from arXiv · showhide
While breathing is essential to living and for sound production in some instruments, for pianists, it is often a hidden and automatic process, making it difficult to analyze or refine. A critical gap exists between data and awareness: while sensors record precise physical metrics, they fail to capture the performer's somatic experience. Conversely, the high cognitive load of performance makes it nearly impossible for musicians to recall their internal states with temporal precision. To address this, we present a system, Breathing Mirror, and associated methodology designed to externalize the pianist's internal somatic experience through three analytical lenses: a Baseline View (synchronized signals), a First-Person View (subjective recall), and an Interpersonal View (collaborative reflection). Through a four-week longitudinal study with a skilled amateur pianist (35 years of experience), we evaluated the system's effectiveness by recording respiratory data using textile-integrated strain sensor belts. The results show that the Breathing Mirror reveals some patterns of breathing-music coupling and identifies critical blind spots where objective data diverges from subjective perception. Furthermore, we propose four somatic themes regarding the link between breathing and musical elements, offering a foundation for future large-scale validation across a broader range of pianists. This work provides a new way to study body signals, transforming breathing from an internal biological function into an articulate expressive parameter.
Ziyue Piao IDMIL, MPBL, CIRMMT, McGill
The passage identifies Yohei Wada as affiliated with Yamaha Corporation.
- Yohei Wada is named in the passage.
- Yamaha Corporation is listed as the affiliation.
- The passage presents an author-affiliation entry rather than research findings.
Keywords
The passage lists keywords covering wearable computing, somatic reflection, physiological sensing, breathing, and piano performance.
- Wearable Computing is listed as a keyword.
- Somatic Reflection and Physiological Sensing are listed as keywords.
- Breathing and Piano Performance are listed as keywords.
1 Introduction
The introduction frames pianist breathing as an underexplored bodily dimension that is difficult to perceive during performance. The paper addresses this gap with the Breathing Mirror and a three-perspective somatic-reflection methodology.
- Motivation: Pianists do not rely on breath to create tone, but breathing may influence phrasing, timing, and emotional communication.
- Motivation: Recent studies link pianists’ breathing cycles with musical structures, suggesting a connection between physical gestures and musical structure.
- Somatic gap: Sensors record physical metrics while first-person recall struggles to preserve internal physiological states during complex piano performance.
- Approach: The Breathing Mirror integrates multimodal respiratory data into a somatic reflective tool and was evaluated in a month-long study with a skilled amateur pianist with 35 years of experience.
- Contributions: The methodology combines Baseline, First-Person, and Interpersonal Views for structured somatic reflection.
2 Related Work
Related work connects somatic reflection, embodied performance, and breathing-aware sensing, while identifying limits in temporal resolution and attention during piano performance. The paper positions breathing as an underexplored internal physiological dimension of piano expression.
- Somatic reflection: Bodily reflection positions the body as a site of conscious inquiry across phenomenology, embodied cognition, and performance practice.
- Somatic reflection: Music-related somatic approaches describe bodily action and sound production as cyclically related and support musical learning and physical coordination.
- Soma design: Soma design treats the lived, feeling body as both the subject and medium of design.
- Externalizing sensation: Autoethnography and micro-phenomenology help externalize subtle, pre-reflective sensations that may go unnoticed during performance.
- Limitations: Somatic practices emphasizing slow movement may lack the temporal resolution required by rapid musical dynamics and live performance.
- Breathing and piano: Breathing is both automatic and consciously controllable, making it a rich soma-design domain for relating respiratory signals to musical structure and expression.
- Breathing and piano: Piano interfaces often emphasize pitch and rhythm while neglecting internal physiological dimensions that support expressive intent.
3 The Breathing Mirror Interface
The Breathing Mirror combines wearable respiratory sensing with synchronized musical data, interactive visualization, and assisted breathing-event segmentation for post-hoc somatic analysis. Its sensor and processing design supports temporal comparison while preserving researcher and performer oversight.
- Breathing belts: Two textile-integrated strain-sensor belts independently monitor thoracic and abdominal displacement for respiratory measurement.The belts are positioned at the mid-thorax and umbilical level and connected to a data-acquisition system.
- Multimodal visualization: The interface aligns MIDI, audio, and respiratory signals for visual comparison and time-stamped qualitative annotation.Reflective playback and linked annotation tables connect breathing segments with subjective somatic reflections at precise performance moments.
- Breathing segmentation: The segmentation pipeline filters sensor data, detects peaks, and fuses thoracic and abdominal channels to identify breathing phases.Fusion addresses temporal misalignment and phase shifts between the two respiratory signals.
- Breathing segmentation: An adaptive prominence threshold based on signal standard deviation supports event detection across varying breathing depths.The threshold is dynamically calculated from the smoothed signal’s standard deviation.
- Breathing segmentation: Thoracic events are validated by abdominal peaks within 0.75 s or by sufficient thoracic amplitude, while patterns shorter than 0.6 s are excluded.The fusion logic also prioritizes the thoracic channel because pilot observations found a higher signal-to-noise ratio than in the abdominal channel.
- Breathing segmentation: Researchers manually refine and the pianist verifies detected events, making the algorithm an assisted-segmentation tool rather than a fully autonomous labeling system.This reduces labeling time while prioritizing data fidelity for qualitative analysis.
4 Investigation with the Practitioner
The investigation frames the Breathing Mirror as a reflective probe combining physiological records, lived bodily experience, and collaborative interpretation. An idiographic study with an experienced pianist examines how temporal alignment can support somatic recall rather than establish objective truth.
- Conceptual approach: The Breathing Mirror uses somatic reflection to externalize the performer’s pre-reflective respiratory gestures through three complementary analytical views.The approach prioritizes a single somatic expert’s lived experience over broad statistical sampling.
- Baseline View: The baseline view provides synchronized, time-stamped physiological and musical records that guide later reflection.It functions as a methodological anchor and navigational map for revisiting performance moments.
- First-Person View: The first-person view treats the pianist’s felt sense as the primary source of subjective experience during performance and recall.The pianist performs first without external data, then articulates sensations from internal memory during reflection.
- Interpersonal View: The interpersonal view has researchers and performer jointly inspect musical and respiratory evidence to prompt deeper reflection through targeted questions.Joint attention supports intersubjective dialogue around aligned respiratory peaks and musical passages.
4.3 Procedure
The four-week procedure combined system familiarization, synchronized recording, repeated annotation, and re-evaluation of breathing patterns with one experienced amateur pianist. The selected piece provided contrasting musical structures for examining respiratory responses across performance contexts.
- Study design: Four weekly interview sessions supported familiarization, system refinement, and progressively detailed reflection on breathing–music coupling.Sessions two through four generated observations that informed both interface refinement and theoretical understanding.
- Session 1: The researchers and pianist established study goals, selected a suitable piece, and introduced the Breathing Mirror during the initial meetup.The baseline phase documented musical experience and prepared the participant for subsequent sessions.
- Musical material: The selected three-minute Hisaishi piece contains six sections alternating between dense rhythmic ostinatos and expansive lyrical melodies.This structural contrast was intended to elicit varied respiratory responses.
- Practitioner: The participant was classified as a skilled amateur because her training was for personal enrichment rather than a formal performance degree, without professional engagements.Her prior instruction on coordinating respiration with phrasing supported analysis of pre-reflective habits in fluent performance.
- Session 2: Session 2 combined high-quality multimodal recording with repeated takes and interface-based annotation of the performer’s preferred expressive performance.The pianist remained at the piano while reviewing data, using tactile contact with phrases to connect bodily memory and visualization.
- Sessions 3–4: Sessions 3 and 4 used timestamp-based re-examination to micro-analyze prior annotations and identify instructed or previously unacknowledged respiratory patterns.The pianist later chose to work away from the piano to support detailed annotation while continuing somatic reflection.
4.4 Analysis
The analysis used reflexive inductive thematic analysis of translated interview material, supported by timestamped annotations linking breathing patterns to thematic markers. These records enabled triangulation and visualization of pattern frequency across the performance.
- Thematic analysis: Two authors conducted inductive thematic analysis using Braun and Clarke’s reflexive framework.They transcribed and translated Japanese interviews, jointly audited the English versions, generated codes, and cross-checked themes.
- Data integration: Annotated timestamps were mapped to thematic markers in a unified CSV file to triangulate observations with the primary notes.The annotations also supported frequency calculations for specific breathing–music coupling behaviors.
- Data integration: A timeline visualization represented the distribution and frequency of six primary breathing patterns across the performance.The visualization summarized how the observed patterns were distributed over performance time.
5 Findings
The study identified recurring breathing patterns linked to bass notes, phrase structure, expressive markings, spatial qualities, pedaling, and performance constraints. The Breathing Mirror also exposed discrepancies between physiological breathing and conscious awareness, while participant feedback supported the belts’ unobtrusiveness and the interface’s reflective value.
- Structural and Harmonic Synchronization: Deep inhalations consistently prepared left-hand bass notes, with breath intensity varying across surrounding musical annotations.The pattern was especially evident in arpeggiated left-hand chords, where inhalation prepared the lowest note.
- Structural and Harmonic Synchronization: Inhalation became deeper at major phrase entries, particularly when a structural change coincided with a bass note.The performer described adapting breath depth as phrases changed and matching the inhalation to the bass.
- Expressive Control and Adaptive Strategies: Breathing anticipated changes in mood, musical scene, instrumental imagery, and spatial depth before corresponding musical events.The performer used inhalation to prepare bodily changes in touch and timbral character, including transitions toward harp-like imagery.
- Expressive Control and Adaptive Strategies: Breath-holding supported controlled playing during ritardando and demanding dynamic passages, partly reflecting prior wind-instrument habits.The performer described suppressing breath to play carefully and holding it during physically effortful passages.
- Expressive Control and Adaptive Strategies: Long phrases and strict tempi forced respiratory substitution, lighter breathing, or omitted inhalation to preserve musical flow.The performer reported exhaling instead of inhaling when notes were close and sometimes barely breathing during dense passages.
- Unconsciousness and Consciousness: The Intuition of Breathing: The system revealed blind spots between perceived and recorded breathing, including micro-inhalations, unexpectedly large resets, and inhalations slightly ahead of musical events.The performer also reported involuntary breathing in some passages, while deliberately calculating breath input for sudden sound-quality changes.
- Practitioner’s Feedback on the Interface Design: The participant found the breathing belts unobtrusive and discovered previously unobserved respiratory patterns through the visualization.She said she forgot she was wearing the belts and preferred sheet-music visualization for legibility.
6 Discussion
The study identifies recurring breathing–music relationships, including inhalation before bass notes, breath suppression under cognitive demand, anticipatory inhalation, and respiratory–pedal synchronization. These observations motivate broader validation of the proposed somatic themes.
- Inhalation as a Somatic Anchor for Structural Bass Notes: Deep inhalation consistently synchronized with left-hand bass-note onsets, although breath volume generally declined from Section A through Section E.The recurring pattern suggests breathing may provide trunk stability and postural readiness for resonant low-frequency tones.
- Breath-Killing Under Cognitive Demand: “Breath-killing” appeared as sparse, non-cyclical respiratory events associated with focused motor stillness during high cognitive demand.Preparation for bass notes and foot-pedaling actions were disrupted near approximately 60–70 s and 150 s, suggesting fragile coupling during error recovery or self-consciousness.
- Temporal Lead-Time in Expressive Anticipation: YK’s inhalation sometimes preceded musical events, particularly during spatial-imagery shifts or upper-register melodic entries.The authors interpret this pre-beat inhalation as short-term respiratory anticipation that sets the expressive stage before the first note.
- Future Validation: Future cross-participant studies are needed to determine whether anticipatory respiratory timing and the four somatic themes generalize across expert pianists.The current observations come from one performer and therefore require broader evaluation.
- The Coupling of Respiration and Pedaling: Respiratory cycles were consistently time-aligned with preparation for bass notes and foot-pedaling actions throughout the performance.The authors describe this relationship as cross-modal synchronization linking breathing, pedaling, and striking to musical structure.
7 Conclusion
The Breathing Mirror externalized a pianist’s pre-reflective somatic experience through textile-integrated breathing belts and multiple-perspective reflection. It revealed synchronization with bass notes and pedaling, while the proposed somatic themes still require experimental validation.
- Conclusion: The Breathing Mirror externalized a pianist’s pre-reflective somatic experiences using textile-integrated breathing belts and a multiple-perspective reflection methodology.The system is presented as a somatic reflection tool for examining respiration during piano performance.
- Conclusion: Breathing synchronized with harmonic anchors including bass notes and pedaling.The conclusion identifies these relationships as evidence of breathing–music coupling in the studied performance.
- Conclusion: Breathing functioned as a somatic anchor for harmonic transitions and as a proxy for cognitive load.The authors connect inhalation–kinematic synchronization with possible phase-locking between internal biological rhythms and musical structures.
- Conclusion: Further experimental research is required to validate the four emergent somatic themes concerning breathing–music coupling.The proposed themes remain a basis for future investigation rather than validated general findings.
8 Ethical Standards
The study reports informed consent, participant anonymity, and data-security protocols. It also discloses AI assistance for visualization and linguistic refinement, with author verification and editing of outputs.
- Ethical Standards: The study obtained informed consent from the expert pianist and followed protocols for participant anonymity and data security.These procedures governed the collection and handling of participant data.
- AI Disclosure: Gemini assisted with data visualization and linguistic refinement after the authors drafted the code and manuscript.The authors manually verified and edited all AI-assisted outputs.