Source-linked AI summary

Under-Mattress Temporal Sensing for Next-Day Agitation Risk Scoring in Dementia Wards

Zhen Liu, Marta Bono, Robbe Decloedt, Ajda Flisar, Maarten Van Den Bossche, Maarten De Vos

arXiv:2608.28152v1cs.AIcs.LG

TL;DR

Agitation fluctuates over short horizons in dementia, but continuous information for estimating next-day risk is limited. This study benchmarked four representations of preceding-night under-mattress signals using patient-grouped evaluation and found stronger discrimination from minute-level modeling than conventional nightly summaries, while calibration and external validation remained necessary.

  • Problem

    Continuous information for estimating next-day agitation risk is limited despite agitation’s short-horizon fluctuations and clinical burden in dementia.

    Source: §I · p. 1
  • Method

    The study compared four representations of preceding-night under-mattress signals using patient-grouped out-of-fold evaluation of discrimination, calibration, fixed-threshold metrics, and period–signal attribution.

    Source: §I · p. 2, B. Four-Paradigm Modeling Pipeline · p. 3, D. Performance Evaluation · p. 4
  • Results

    Full-night sequence modeling achieved the highest AUROC (0.692) and balanced accuracy (0.658), while minute-level pipelines had higher AUROC than nightly summaries and calibration remained limited.

    Source: A. Overall Predictive Performance · p. 5, §V · p. 8
  • Takeaways & Limitations

    Preceding-night under-mattress signals support modest next-day risk discrimination, making minute-level temporal modeling a promising engineering direction for agitation-risk research.

    Source: §V · p. 8

    Generalizability is limited by 65 participants from one specialized hospital unit, with unassessed inter-rater reliability, a broad endpoint, and exploratory model selection on the same folds.

    Source: E. Strengths, Limitations, and Future… · p. 8

Abstract

from arXiv · show

Agitation fluctuates over short time horizons in people living with dementia, yet continuous physiological information for anticipating next-day risk is limited. We assessed whether contactless under-mattress signals from the preceding night inform next-day agitation risk and whether preserving minute-level temporal structure improves performance over conventional nightly summaries. We analyzed 423 patient-nights from 65 subjects in a specialized hospital dementia unit using two under-mattress sensing systems. A unified four-paradigm benchmark compared nightly handcrafted summaries, three-period handcrafted features, full-night sequence modeling, and sliding-window multiple-instance learning. Source-specific preprocessing and five-fold patient-grouped cross-validation were used, with performance estimated from pooled out-of-fold predictions. Evaluation included discrimination, calibration, fixed-threshold metrics, and a comparison of period-signal attribution patterns across two temporal models. Full-night sequence modeling achieved the highest discrimination (AUROC, 0.692; AUPRC, 0.849) and balanced accuracy (0.658). Both minute-level pipelines had higher AUROC than nightly summaries, but differences from three-period handcrafted features were uncertain. Cross-model attribution prioritized activity, heart rate, and respiratory rate during the core overnight period. Calibration remained limited. The preceding night's signals supported modest next-day risk discrimination, with minute-level temporal modeling outperforming nightly summaries. Prospective calibration and external validation are needed before use in individual care decisions. This patient-grouped benchmark identifies contactless overnight sensing as a promising biomedical engineering direction for agitation-risk research in hospitalized dementia cohorts.

I. INTRODUCTION

Agitation is common and burdensome in dementia, but routine observations provide limited continuous information for next-day risk estimation. This study evaluates contactless under-mattress sensing and compares temporal representations for cross-patient prediction in a hospital dementia unit.

  • Agitation affects approximately 40% of care-home residents with dementia and includes motor, verbal, aggressive, and distress-related behaviors.Source: §I · p. 1
  • Earlier identification could support proactive non-pharmacological care because pharmacological management has limited efficacy and substantial safety concerns.Source: §I · p. 1
  • Night-time physiology is a plausible source of short-horizon agitation information, but its predictive value for next-day behavior remains under-specified.Source: §I · p. 1
  • Contactless under-mattress sensors capture movement, respiratory, and cardiac measures through pressure-sensitive sensing and BCG signals without adding burden to patients or staff.Source: §I · p. 1
  • The study addresses whether preceding-night signals support cross-patient next-day risk estimation by comparing four representations and evaluating discrimination, calibration, thresholds, and attribution.Source: §I · p. 2
  • The analysis paired overnight recordings from two passive sensing systems with next-day agitation assessments under a hospital monitoring protocol.Source: A. Study Cohort and Outcome · pp. 2–3

B. Four-Paradigm Modeling Pipeline

The benchmark maps each overnight record to a next-day agitation probability using four representations: whole-night summaries, period-resolved features, full ordered sequences, and sliding-window multiple-instance learning.

B0 – Nightly summary

  • B0 summarizes heart rate, respiratory rate, sleep architecture, activity, and quality across the full night using fold-wise SHAP feature selection and Random Forest prediction.Source: B. Four-Paradigm Modeling Pipeline · p. 3

B1 – Period-resolved summary

  • B1 extracts handcrafted features separately for evening, core overnight, and morning periods, adds cross-period descriptors, and uses Logistic Regression after SHAP-based selection.Source: B. Four-Paradigm Modeling Pipeline · pp. 3–4

D0 – Whole-night raw-sequence modeling

M0 – Sliding-window MIL

  • Final performance uses representative models selected through held-out validation on predefined patient-grouped folds and summarized from pooled out-of-fold predictions.Source: B. Four-Paradigm Modeling Pipeline · p. 4

C. Preprocessing and Cross-Validation

The preprocessing and validation pipeline harmonized heterogeneous sensor streams into minute-level inputs and evaluated all nights with patient-grouped cross-validation to prevent participant leakage.

D. Performance Evaluation

The study evaluated four overnight-signal representations using patient-grouped out-of-fold metrics designed to separate discrimination, probability error, and threshold behavior. Attribution comparison was descriptive and hypothesis-generating rather than causal.

G. Subgroup and Sensitivity Analyses

Additional analyses examined sensor-source variation and a higher-burden agitation definition within the common patient-grouped evaluation framework. The strongest overall pipelines retained higher discrimination and more balanced threshold behavior, while paired gains were clearest against B0.

Source-stratified analysis

Sensitivity analysis

  • The higher-burden sensitivity endpoint required a day-level PAS total score greater than 4, representing agitation in at least two domains with at least one score above 1.Source: G. Subgroup and Sensitivity Analyses · p. 5

Overall performance

  • D0 achieved the highest AUROC, specificity, and balanced accuracy, while M0 achieved similar balanced accuracy; B1 exceeded B0 in AUROC and specificity point estimates.Source: A. Overall Predictive Performance · p. 5

Paired comparisons

C. Calibration and Prevalence-based Baselines

High event prevalence shaped probability and threshold metrics, while calibration remained limited across learned models. Attribution rankings showed moderate agreement and emphasized activity and cardiorespiratory signals during the core overnight period.

Prevalence and calibration

Prevalence-based baselines

Cross-model attribution

Prevalence and calibration

Cross-model attribution

Source-stratified performance

F. Sensitivity to Agitation Endpoint Definition

The selected agitation endpoint materially affects prevalence, operating characteristics, and practical interpretation, while device and evaluation boundaries limit generalizability. Cross-model attribution nevertheless identifies recurring overnight signals relevant to next-day risk.

Endpoint definition

  • 17.3% prevalence followed thresholding at PAS total score greater than 4, down from 72.3%, with substantial changes in operating characteristics.D0 retained the highest AUROC, AUPRC, sensitivity, and balanced accuracy, while B1 had the lowest Brier score and highest specificity.Source: F. Sensitivity to Agitation Endpoint… · p. 6

Generalizability

  • Performance values from prior predictive studies should not be compared directly because their tasks, input representations, and evaluation designs differed.The present benchmark addresses held-out-patient next-day risk scoring rather than earlier explanatory or multi-day settings.Source: A. Temporal Representation and Model… · p. 7

Endpoint definition

  • High event prevalence made sensitivity or probability error alone potentially misleading, because prevalence baselines and B0 combined favorable sensitivity or Brier behavior with poor discrimination or specificity.Calibration remained limited across learned models.Source: A. Temporal Representation and Model… · p. 7

Temporal attribution

  • Activity, heart rate, and respiratory rate during the core overnight period were common high-ranking period–signal combinations across B1 and M0.The convergence prioritizes these signals for targeted physiological validation beyond static nightly summaries.Source: B. Physiological Context of Nocturnal… · p. 7
  • B1 ranked morning activity higher, whereas M0 ranked the core-period binary sleep–wake channel higher, suggesting representation-specific emphasis on transition activity versus local sleep–wake composition.These are attribution patterns rather than mechanistic claims.Source: B. Physiological Context of Nocturnal… · p. 7

Generalizability

  • Patient-grouped evaluation supports cross-patient risk estimation but does not establish patient-specific day-to-day forecasting or transportability across devices and clinical settings.Source-stratified estimates differed between EMFIT and WSA, despite comparatively stable D0 rank discrimination.Source: C. Robustness and Generalizability · p. 7

D. Clinical Interpretation

The study supports cautious clinical interpretation of contactless overnight risk scores as adjunctive prompts rather than standalone treatment triggers. Their scope is constrained by endpoint breadth, limited calibration, sample size, single-site recruitment, and exploratory configuration selection.

Clinical interpretation

  • Any positive primary endpoint includes minor or transient PAS behaviors and does not diagnose clinically actionable agitation.A positive output represents elevated probability of any observed agitated behavior under the study definition.Source: D. Clinical Interpretation · p. 7
  • Sensor-based alerts should prompt timely review of the patient and care context alongside staff judgment, not independently indicate treatment.Agitation may reflect unmet needs, discomfort, or clinical and environmental stressors.Source: D. Clinical Interpretation · p. 7
  • Predicted probabilities cannot yet be interpreted as reliable absolute risks because calibration is limited.A predicted risk of 70% does not necessarily correspond to a 70% observed probability of next-day agitation.Source: D. Clinical Interpretation · p. 7

Study design

  • 423 repeated overnight observations from two passive sensing systems enabled a common four-representation, patient-grouped evaluation under routine hospital care.Source-aware preprocessing and patient-level bootstrap resampling addressed device heterogeneity and within-patient dependence.Source: E. Strengths, Limitations, and Future… · pp. 7–8

Limitations

  • Cross-patient generalizability remains limited by 65 independent participants recruited from one specialized hospital dementia unit.Inter-rater reliability was not assessed, and exploratory configuration selection on the same folds may make reported performance optimistic.Source: E. Strengths, Limitations, and Future… · p. 8

Future work

  • Future work requires prespecified selection, external validation across hospital and device settings, prospective source-stratified calibration, and workflow evaluation.These steps are intended to establish robustness and determine whether scores can support a defined care workflow.Source: E. Strengths, Limitations, and Future… · p. 8

V. CONCLUSION

In this hospital dementia cohort, preceding-night under-mattress signals contained modest information about next-day agitation risk. Minute-level temporal models were stronger than nightly summaries, but external validation and prospective calibration remain necessary before individual care use.

Conclusion

  • Under-mattress signals from the preceding night contained modest information about next-day agitation risk in this in-hospital dementia cohort.The conclusion concerns cross-patient risk estimation in the studied setting.Source: §V · p. 8
  • Full-sequence and sliding-window modeling achieved stronger discrimination than conventional nightly summaries, while advantages over period-specific engineered features remained uncertain.The comparison supports minute-level temporal modeling as a promising engineering direction rather than a definitive winner.Source: §V · p. 8
  • Activity and cardiorespiratory signals during the core overnight period were consistently prioritized across model attributions for further physiological validation.This finding concerns attribution patterns across temporal models.Source: §V · p. 8
  • External validation and prospective calibration are required before resulting scores can guide individual care decisions.The study included ethics approval, representative consent procedures, pseudonymization, and voluntary uncompensated participation.Source: §V · p. 8, Ethical considerations · p. 8

S1. TEMPORAL SEQUENCE PREPROCESSING DETAILS

The preprocessing pipeline harmonizes heterogeneous EMFIT and WSA recordings into source-aware 1-minute overnight sequences, then derives temporal representations for tabular and learned models. B1 preserves coarse timing through three periods and cross-period descriptors, while fold-specific screening supports benchmark comparison without isolating representation effects from classifier choice.

Sequence preprocessing

  • Overnight streams were restricted to 17:00–10:00, paired with the following daytime agitation label, physiologically checked, and marked for missingness and unreliable minutes.The resulting cleaned sequences support downstream temporal modeling.Source: S1. TEMPORAL SEQUENCE PREPROCESSING… · p. 11

Source-specific processing

  • EMFIT data were range-checked, placed on a complete 4-second grid, and aggregated to 1-minute resolution using median HR/RR and mean activity.Its quality flag captures simultaneous signal absence and severe missingness.Source: S1. TEMPORAL SEQUENCE PREPROCESSING… · p. 11
  • WSA data were processed at native 1-minute resolution with median-filtered HR/RR, unfiltered movement score, and device-derived sleep-stage output.Its quality flag marks minutes where HR, RR, and movement are all missing.Source: S1. TEMPORAL SEQUENCE PREPROCESSING… · p. 11
  • EMFIT and WSA were treated as related but non-exchangeable sources because their resolutions, device processing, activity fields, sleep-stage outputs, and quality channels differ.Source-aware imputation and scaling avoid forcing source-specific streams into a common measurement assumption.Source: S1. TEMPORAL SEQUENCE PREPROCESSING… · p. 11

Input channels

  • The five temporal channels were HR, RR, ACT, binary sleep–wake, and quality, with sleep stages encoded as 1 and wake as 0.Missing or unrecognized stages were also encoded as wake, while quality used 0 for valid and 1 for invalid or unknown data.Source: S1. TEMPORAL SEQUENCE PREPROCESSING… · p. 11

Period-resolved features

  • B1 partitioned each overnight record into evening, core overnight, and morning periods to preserve coarse within-night timing for tabular classifiers.It also computed cross-period descriptors such as HR dipping, morning surge, RR dipping, ACT escalation, and variability ratios.Source: S2. THREE-SEGMENT HANDCRAFTED FEATURE… · p. 11

Benchmark design

  • B0 and B1 shared patient-grouped folds, source-aware preprocessing, candidate classifiers, top-30 SHAP-FS, and mean held-out-fold AUROC selection, but selected classifiers differed.Thus performance differences cannot be attributed to temporal representation alone.Source: S3. B0/B1 TABULAR MODEL CONFIGURATIONS · p. 12

S4. D0/M0 TEMPORAL MODEL CONFIGURATIONS

D0 and M0 were selected through exploratory, patient-grouped configuration screening before pooled out-of-fold evaluation. InceptionTime represented D0, Transformer represented M0, and 90-minute windows with 45-minute strides represented the selected M0 configuration.

Screening limitations

  • Candidate selection and performance estimation reused the same patient-grouped folds, so configuration comparisons are exploratory.This limitation applies to the screening evidence rather than the pooled out-of-fold primary analysis.Source: S5. MODEL-FAMILY AND CONFIGURATION… · p. 13

D0 configuration

  • InceptionTime achieved the highest mean held-out-fold AUROC among evaluated D0 candidates and maintained greater specificity than TCN.TCN showed high sensitivity but low and variable specificity.Source: S5. MODEL-FAMILY AND CONFIGURATION… · p. 13

M0 configuration

S7. HIGHER-BURDEN AGITATION ENDPOINT SENSITIVITY

A stricter higher-burden agitation definition changed model operating characteristics while retaining the leading D0 ranking for several discrimination and threshold metrics. Patient-level analyses remained limited by short follow-up, single-class outcomes, and substantial heterogeneity.

Higher-burden endpoint

Interpretation

Per-patient heterogeneity

  • D0 had the highest median within-patient AUROC at 0.60, but only 37 of 65 patients were evaluable and follow-up ranged from 3 to 10 nights.B0 followed at 0.58, while B1 and M0 had medians of 0.50; broad interquartile ranges indicated substantial heterogeneity.Source: S8. PER-PATIENT HETEROGENEITY · p. 14, Figure S1 · p. 14
  • Selected patient-level trajectories were illustrative rather than inferential comparisons.Patients with at least seven observed nights were eligible, with examples chosen by predefined outcome and follow-up criteria.Source: S9. SINGLE-SUBJECT PREDICTION… · p. 14, Figure S2 · p. 15
Loading 2608.28152v1…