Next Article in Journal
Revisiting the Surface Brightness Profile of the Stellar Disk with the Statistical Mechanics of the Self-Gravitating System with the Central Body
Previous Article in Journal
Study on the Tip Leakage Loss Mechanism of a Compressor Cascade Using the Enhanced Delay Detached Eddy Simulation Method
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

pRR30, pRR3.25% and Asymmetrical Entropy Descriptors in Atrial Fibrillation Detection

by
Bartosz Biczuk
1,2,*,†,
Szymon Buś
3,†,
Sebastian Żurek
1,
Jarosław Piskorski
1 and
Przemysław Guzik
4,5
1
Institute of Physics, University of Zielona Góra, 65-069 Zielona Góra, Poland
2
The Doctoral School of Exact and Technical Sciences, University of Zielona Góra, 65-417 Zielona Góra, Poland
3
Institute of Electronic Systems, Faculty of Electronics and Information Technology, Warsaw University of Technology, 00-650 Warszawa, Poland
4
Department of Cardiology—Intensive Therapy, Poznan University of Medical Sciences, 60-355 Poznań, Poland
5
University Centre for Sports and Medical Studies, Poznan University of Medical Sciences, 60-802 Poznań, Poland
*
Author to whom correspondence should be addressed.
These authors contributed equally to this work.
Submission received: 19 January 2024 / Revised: 5 March 2024 / Accepted: 22 March 2024 / Published: 28 March 2024

Abstract

:
Background: Early detection of atrial fibrillation (AF) is essential to prevent stroke and other cardiac and embolic complications. We compared the diagnostic properties for AF detection of the percentage of successive RR interval differences greater than or equal to 30 ms or 3.25% of the previous RR interval (pRR30 and pRR3.25%, respectively), and asymmetric entropy descriptors of RR intervals. Previously, both pRR30 and pRR3.25% outperformed many other heart rate variability (HRV) parameters in distinguishing AF from sinus rhythm (SR) in 60 s electrocardiograms (ECGs). Methods: The 60 s segments with RR intervals were extracted from the publicly available Physionet Long-Term Atrial Fibrillation Database (84 recording, 24 h Holter ECG). There were 31,753 60 s segments of AF and 32,073 60 s segments of SR. The diagnostic properties of all parameters were analysed with receiver operator curve analysis, a confusion matrix and logistic regression. The best model with pRR30, pRR3.25% and total entropic features (H) had the largest area under the curve (AUC)—0.98 compared to 0.959 for pRR30—and 0.972 for pRR3.25%. However, the differences in AUC between pRR30 and pRR3.25% alone and the combined model were negligible from a practical point of view. Moreover, combining pRR30 and pRR3.25% with H significantly increased the number of false-negative cases by more than threefold. Conclusions: Asymmetric entropy has some potential in differentiating AF from SR in the 60 s RR interval time series, but the addition of these parameters does not seem to make a relevant difference compared to pRR30 and especially pRR3.25%.

1. Introduction

Atrial fibrillation (AF) is a cardiac arrhythmia with irregular heartbeats. It can lead to the development of tachyarrhythmias, heart failure, dementia and arterial emboli, with ischaemic cerebral stroke being the most common complication [1]. AF also increases the risk of dying prematurely.
AF is often asymptomatic, especially in men and older people [2], and its complications, e.g., ischaemic stroke, may be the first presentation of this arrhythmia. The incidence of AF increases with age and is usually associated with many diseases or risk factors like hypertension, obesity, smoking, coronary artery disease, valvular heart disease, lung disease and hyperthyroidism [3]. However, AF is not rare in otherwise healthy people, e.g., those involved in long-term endurance sports [4]. AF can also be caused by alcohol consumption and the abuse of illicit substances such as methamphetamine, cocaine, opiates and cannabis [5].
An increasing incidence of AF and its clinical importance require effective and timely diagnosis. Recently, parameters derived from heart rate variability (HRV) analysis have become more commonly applied for AF detection in ECGs [6]. Several HRV descriptors have been proposed, such as the standard deviation of the interbeat intervals (SDRR), root mean square of successive differences between normal heartbeats (rMSSD) and percentage of differences higher than 50 ms (pRR50) [7].
pRR50 is the most studied but specific example of a parameter from the pRRx family (percentage of successive RR interval differences greater than or equal to x ms). Buś et al. [8] explored different parameters from the pRRx family and found that the optimal diagnostic properties for AF detection were found for the threshold x = 31 ms (AUC = 0.958, sensitivity = 95.35%, specificity = 90.47). The study was performed on a dataset of over sixty thousand 1 min segments of RR intervals. Using the same data, they reported that the pRRx% parameters (defined like pRRx but with a threshold x% relative to the previous RR interval) have even better diagnostic properties with pRR3.25% (AUC = 0.972, sensitivity = 97.16%, specificity = 93.75%) outperforming other pRRx% and pRRx parameters. Both the pRRx and pRRx% families count occurrences of unusually large successive differences in RR intervals and are generally much greater in AF than in normal sinus rhythm (SR).
Asymmetric entropy based on monotonic runs, introduced by Piskorski and Guzik [9], is another set of features used in HRV analysis. Unlike other entropy measures, asymmetric entropy separately examines information derived from monotonic runs consisting of heart rate accelerations, decelerations or consecutive RR intervals that do not change (neutral monotonic runs).
We hypothesized that heart rate entropy derived from deceleration, acceleration and neutral runs might differ between ECGs derived from sinus rhythm and atrial fibrillation. If so, the measurement of asymmetric entropy may be useful in distinguishing SR and AF segments of the ECG. This study compared the asymmetric entropy-based descriptors with pRR30 and pRR3.25% and their possible combinations for AF detection in 1 min segments of RR intervals.

2. Materials and Methods

2.1. Data

This study used de-identified data from the Long-Term Atrial Fibrillation Database (LTAFDB) [10,11]. The LTAFDB consists of 84 extended 24 h Holter electrocardiographic (ECG) recordings sampled at 128 Hz. The database contains information on R-wave locations and corresponding heart rhythms (normal, supraventricular, ventricular, atrial and technical artefacts) in patients with paroxysmal AF and other arrhythmias. For our analysis, we selected only continuous ECG fragments with either AF or sinus rhythm (SR) lasting at least 60 s, discarding segments labelled as other rhythms.
The data pre-processing method used is shown in Figure 1. The RR interval time series were divided into 60 s contiguous segments. Each RR interval within the segment had to originate from SR to label the whole segment as SR. If not, the segment was excluded from further analysis. Similarly, for AF segments, each beat within the segment had to be AF, and segments containing ventricular beats were also excluded. To minimize the number of potentially unidentified technical artefacts, we removed RR intervals shorter than 240 ms or longer than 3000 ms for both SR and AF. Segments where the total length of excluded RR intervals exceeded 3% (1.8 s) of the segment length were excluded from the analysis. The choice of a 3% threshold for excluding segments based on the total length of excluded RR intervals was influenced by established guidelines in the field. Specifically, [1] advocate for the exclusion of segments where more than 10% of RR intervals are not of sinus origin or are artifacts. Our decision to narrow this threshold to 3% was primarily due to the specific context of our study, which involved very short 1 min segments. After pre-processing, the total 60 s RR series was 63,636 (31,919 SR, 31,717 AF). ECG segments where the total length of RR intervals after filtering was less than 58 s were also discarded.

2.2. Software

We utilized the Python programming language (version 3.9, Python Software Foundation, Wilmington, DE, USA) for statistical analysis. Specifically, for matrix manipulation, we employed the NumPy library, while plots were generated using the Matplotlib library. For training and testing logistic regression models, we utilized the Scikit-learn library.
In our analysis, part of the runs-based asymmetrical calculation was facilitated by the HRAexplorer v0.1.0, a free GPL3 software written in Python, available for review and download at https://github.com/jaropis/pyHRAExplorer, accessed on 26 March 2024. HRAexplorer is an open-source online tool tailored for HRV and heart rate asymmetry (HRA) analysis. It enables the calculation of various HRV and HRA descriptors, as well as the statistical and visual analysis of uploaded RR intervals time series. An interactive online version of this software in the R programming language may be found at https://hraexplorer.com/ and source code can be found at https://github.com/jaropis/HRAExplorer, (accessed on 26 March 2024).
Additionally, data pre-processing and the calculation of pRRx and pRRx% parameters were conducted using code sourced from https://github.com/simonbus/prrx_af (accessed on 26 March 2024). This repository contains Python scripts designed for pre-processing data from the Long-Term Atrial Fibrillation Database LTAFDB, including data extraction, RR intervals annotation and filtering.

2.3. Asymmetrical Entropy

Asymmetrical entropy is an approach presented in [9]. In summary, the RR series is partitioned into monotonic runs, as shown in Figure 2. If we define a series of RR intervals as follows:
R R N ( R R 1 , R R 2 , , R R N )
We can use this to build a series of differences. Starting from the second element, we subtract the (i − 1)th element from the i-th element as follows:
Δ ( δ 1 , δ 2 , , δ N 1 )
For the above equation, the single difference looks like the following:
δ i = R R i + 1 R R i
We can use this series to construct a symbolic series of signs of those differences:
s g n δ i = { + ,     δ i > 0 ,     δ i < 0   0 ,     δ i = 0
Using this, we can write definitions for the acceleration, deceleration and neutral series:
Definition 1. 
A deceleration series of length i (DRi) is an uninterrupted series of i decelerations (sign +) that starts and ends with an acceleration (sign −) or neutral difference (sign 0).
Definition 2. 
An acceleration series of length i (ARi) is an uninterrupted series of i accelerations (sign −) that starts and ends with a deceleration (sign +) or neutral difference (sign 0).
Definition 3. 
A neutral series of length i (NRi) is an uninterrupted series of i neutral differences (sign 0) that starts and ends with an acceleration (sign −) or deceleration (sign +).
It is common practice [9,10,11] to remove neutral runs from the record by adding white noise with a sufficiently small standard deviation. However, we will include neutral runs in our calculation and model building.
We calculate the Shannon entropy for each type of the monotonic run. If we define the value p as a probability estimate of how likely it is to find an interval in the RR recording that belongs to a given run type of a given length:
p i , k = n u m b e r   o f   r i k × i n
where i is the run length and k is the run type, which can be an AR, DR or NR, the Shannon entropy for this estimator is as follows:
H k = i = 1 m a x ( i ) k p i , k · l n   p i , k
Mathematical details can be found in [9,12,13].

2.4. pRR30 and pRR3.25%

The pRR50 metric is a well-known but singular instance within the broader pRRx category, which quantifies the percentage of consecutive RR interval variances exceeding x milliseconds. In their comprehensive study, Buś et al. (2022) [8] conducted an extensive examination of various pRRx family parameters. They identified that the threshold of 31 ms yielded the most favourable diagnostic characteristics for identifying atrial fibrillation (AF), demonstrating an area under the curve (AUC) of 0.958, with a sensitivity of 95.35% and a specificity of 90.47%. This analysis was based on an expansive collection of over 60,000 one-minute RR interval segments.
Further analyses in [8] revealed superior diagnostic capabilities within the pRRx% subgroup, which is akin to pRRx but applies a percentage threshold relative to the preceding RR interval. Specifically, the parameter pRR3.25% emerged as notably effective, surpassing other pRRx and pRRx% metrics. This parameter achieved an AUC of 0.972, a sensitivity rate of 97.16% and a specificity of 93.75%, indicating a significant improvement in detecting AF compared to traditional methods. Both pRRx and pRRx% parameters function by detecting significant successive variations in RR intervals, which are markedly more prevalent in cases of AF compared to normal sinus rhythm [8]. For these reasons we have decided to make pRR3.25% and pRR30, rather than pRR50, the focus of this study.

2.5. Statistical Analysis

To establish the normality of the data we used the Shapiro–Wilk normality test [14] and confirmed the numerical results from this test by visually inspecting the qq plot of the data. Non-parametric Spearman correlation was used to analyse associations between parameters. The receiver operating characteristic (ROC) [15] was used to investigate which parameters discriminated between the 60 s segments of sinus rhythm (SR) and atrial fibrillation (AF). For each HRV parameter studied, Youden’s criterion [16] was used to calculate the optimal cut-off from the ROC curve [17].
We used a 2:1 ratio to divide the final set of 63,826 recordings into the training dataset (42,763 samples) and the test dataset (21,063 samples). The main reason for selecting this ratio was striving for a balanced trade-off [18]. Given the relatively low complexity of our models (e.g., the number of parameters), and the large dataset, we felt that giving ⅓ of the data to the test set would not impair the training process, while at the same time giving us more certainty that our results are not the effect of randomness. This makes our approach more conservative and less prone to accidental findings. Univariate and multivariate logistic regression examined individual parameters or their combinations with either pRR30 or pRR3.25% or both pRR30 and pRR3.25%. A non-parametric bootstrap with 1000 samples was used to estimate classification metrics with a 95% confidence interval. Only p < 0.05 was considered statistically significant.

3. Results

Our data consisted of 64,738 segments, from which 912 were discarded after filtration, leaving 63,826 segments. A total of 31,753 of them were classified as AF and 32,073 as SR. The mean RR was 698 ms for AF and 858 ms for SR.

3.1. Entropy Distribution

Figure 3 presents histograms for all studied types of asymmetrical entropy: the total entropy (H), entropy of acceleration runs (HAR), entropy of deceleration runs (HDR) and entropy of neutral runs (HNR). All forms of entropy have narrower and higher histograms for AF than for SR. The peaks of the histograms for H overlap for AF and SR, but are separated for HAR, HDR and HNR. The median HAR and HDR were higher for AF than for SR. In contrast, the median H and HNR were lower in AF.
Figure 4 shows how the histograms of the pRR30 and pRR3.25% differ in AF and SR. For SR, the most common values of pRR30 and pRR3.25% were close to 0%. The rates gradually decreased for higher values of pRR30 and pRR3.25%. In contrast, the distributions are shifted to the right for AF and the most common values of pRR30 and pRR3.25% were around 85% and 90%, respectively.
Figure 5 shows the Spearman correlation values between all of the features examined for the SR and AF data separately. For SR, HNR correlated strongly and negatively (dark blue) with pRR30 (−0.77) and pRR3.25% (−0.71). The correlations between HNR and pRR30 and pRR3.25% were weaker for AF, with the most pronounced correlations for HNR and pRR30 (−0.59).

3.2. Diagnostic Properties of Single HRV Parameters

Table 1 characterizes the diagnostic properties of all investigated parameters to differentiate AF from SR for the 1 min ECG segments. As pRR3.25% has the highest AUC, it is considered the reference value for comparisons with other parameters and is included in all multivariate diagnostic models. AUC for the discrimination of AF from SR for the 1 min RR interval ECG segments were all significantly different from 0.5. (p at least < 1 × 10−114). The top three strongest candidates for AF detection are pRR3.25% (AUC = 0.9727) pRR30 (0.9596) and HNR (0.9315).
Figure 6 shows the classification metrics for AF detection on the testing dataset using the optimal cut-off method for single HRV parameters. For every metric, the best score achieved three parameters: pRR3.25%, pRR30 and HNR. The NPV difference between pRR30 and HNR was the smallest. The whiskers on the plots represent 95% confidence intervals from the bootstrap.

3.3. Diagnostic Values of Models Built Using pRR30, pRR3.25% and Asymmetric Entropy Indices

Table 2 presents results of AF detection using univariate or multivariate logistic regression models on the testing dataset. The highest AUC was achieved by the model with three parameters, pRR30, pRR3.25% and H, while pRR30, pRR3.25% and HAR had the highest DOR. From the univariate models, pRR3.25% had the highest AUC and all other metrics.
From Table 2 we selected three models for further validation. These included the best (in AUC) single-feature model, which was pRR3.25%, the best two-feature model, which was pRR3.25% and pRR30 and the best three-feature model which was pRR3.25%, pRR30 and H. A 1000-resampled bootstrap test revealed a statistically significant difference in AUC (p-value = 0.02) between the one-feature and two-feature models. Furthermore, the comparisons between the one-feature versus three-feature and two-feature versus three-feature models yielded p-values less than 10−6, indicating highly significant differences. The same bootstrap methodology was employed to assess the performance of the models in terms of accuracy, sensitivity, specificity, DOR, FNs and FPs. In all cases, the differences between the models were statistically significant, with p-values consistently below 10−5. Figure 7 provides histograms with a visual representation of these findings.
It is worth noting that the scales in Figure 7 for accuracy, sensitivity and specificity on the respective x-axes have been adapted. In this way it is easier to see the small differences. In practice, however, the range of these differences is negligible. Optimizing the models for AUC occurs at the expense of not detecting AF. The median of FNs for pRR3.25% alone and for pRR3.25% with pRR30 increased from less than 200 to almost 700 undetected AF for the model with pRR3.25%, pRR30 and H.

4. Discussion

We found that both pRR3.25% and pRR30 outperformed all asymmetric entropy parameters in their diagnostic value for detecting AF in 1 min ECGs. For AF detection, the best single parameter was pRR3.25% with an AUC of 0.972 and a DOR of 643, the second best was pRR30 with an AUC of 0.959 and a DOR of 233.5, and the third best was HNR with an AUC of 0.93 and a DOR of 84.5. All combinations that had either a higher AUC or DOR than a single pRR3.25% contained pRR3.25%. The best combination when measured by AUC was pRR3.25%, pRR30 and H, while when measured by DOR it was pRR3.25% and H. However, the combined models with higher AUC or DOR had increased false negative values. Using pRR3.25% as a reference, the observed increases in AUC were of negligible clinical value as they were up to 0.006, which is a less than 1% improvement. In addition, using the best combination, i.e., pRR3.25%, pRR30 and H, was associated with a risk of increasing false-negative AF diagnoses—the number of undiagnosed AF episodes increased almost fourfold.
This study is not the first one to demonstrate entropy-based features for AF detection. In [19] Richman JS and Moorman JR have introduced sample entropy, a novel method for comparing two physiological time series. Liu C et al. and Zhao L et al. [20,21] have compared different entropic measures and proposed a novel one, called normalized fuzzy entropy for AF detection. They have achieved 0.86 accuracy for 60 beat-long RR segments. Their approach and other tested features were based on sample entropy [19].
Runs-based asymmetrical entropy is very different from sample entropy. It does not depend on parameters that represent matching radius for determining similarity between sequences of data points within a time series and can break relative consistency, which means that it does not always provide consistent results when the sample size increases [22]. Run-based asymmetric entropy has a more straightforward interpretation. It quantitatively separates the contributions of accelerating, decelerating and neutral runs to the overall asymmetry of the time series (Figure 2).
We found a negative correlation between the asymmetric entropy of NR and pRR30. In addition, the HNR distribution differed between AF and SR. The AF classifier built from HNR alone had an accuracy of over 0.88, the best among other run-based asymmetric entropy parameters. Neutral runs are either ignored, removed from the analysis or replaced by the addition of white noise [9,12,13]. However, neutral runs may contain valuable information, especially in the context of AF detection. Typically, their contribution to HRV is either zero (to short-term HRV) or random and depends on the ECG sampling frequency. However, their lower rate in AF provides interesting information.
The nature of AF makes RR intervals highly random, with low stability. This results in a low probability of finding two or more consecutive RR intervals of the same duration. It also explains why there are fewer neutral runs in AF than in SR. Changes in RR interval duration in SR are gradual. They are controlled by many physiological mechanisms that modulate sinus node depolarisation. In AF, fast fibrillation waves above 350 depolarisations/minute reset and quieten the sinus node. Changes between successive RR intervals in AF are less well controlled and therefore more dramatic. We have previously reported higher values of pRRx and pRRx% in AF than in SR [8]. Therefore, the probability of small changes between consecutive RR intervals is low in AF but higher in SR. Here we show that information derived from neutral runs has some diagnostic properties. However, it is uncertain whether this information should be incorporated into AF detection algorithms. All run-based asymmetric entropy measures, either as single parameters or in combination with pRR3.25% or pRR30, are not particularly effective in discriminating AF from SR. They are also more complex to calculate than pRR3.25% or pRR30.
As previously shown, the pRRx and pRRx% families have interesting diagnostic properties for distinguishing ECG segments with AF from SR. First, we demonstrated that pRR30 outperformed other commonly used HRV indices including SDNN, SD1, SD2, SD2/SD1 and the coefficient of variation, for the same purpose [8]. Second, we showed that pRR30 is outperformed by the pRRx% family, especially pRR3.25%. In this study, we report that both pRR30 and pRR3.25 have better diagnostic properties for AF detection than any of the run-based asymmetric entropy descriptors. Adding asymmetric entropy-derived descriptors to models with pRR30 or pRR3.25 slightly improved their AUC or DOR, but at the cost of increasing FNs.
The impact of false positive and false negative results can vary depending on the specific condition being tested for and the context in which the test is performed. For example, a false positive result for a serious condition may lead to unnecessary treatment or further testing. Conversely, a false negative result may delay necessary treatment. In AF, a false-negative diagnosis appears to be more harmful than a positive diagnosis. A patient with undiagnosed AF will not receive antithrombotic treatment and will remain at an increased risk of ischaemic stroke. In contrast, a false-positive result leads to further testing and has no immediate negative consequences [23,24].
The proposed diagnostic methodology, utilizing pRR3.25% and pRR30 parameters along with run-based asymmetric entropy descriptors, presents a streamlined and efficient approach for atrial fibrillation detection. One of the significant advantages of this methodology is its ease of implementation: once the model is trained, the input for the model can be selected in a real-time or online fashion. This process is particularly beneficial as it does not require storing the entire recording in memory, making it highly suitable for continuous monitoring applications. Furthermore, the foundation of this methodology on counting statistics not only simplifies the implementation but also reduces the computational burden, making it an efficient approach for real-time data analysis.
The low computational requirements and the ability to process data incrementally mean that, once trained, these models can be seamlessly integrated into low-energy devices. This adaptability makes the methodology particularly suitable for a wide range of applications, including implantable medical devices, mobile-phone-based health monitoring apps, and home health monitors. The integration of this diagnostic tool into such devices can facilitate continuous, real-time monitoring of cardiac activity, offering significant benefits for the early detection and management of atrial fibrillation in diverse settings and promoting widespread access to advanced healthcare diagnostics.
Our study had several limitations. The analysis was based on RR intervals from 1 min ECGs only, potentially missing longer-term cardiac dynamics that contribute to entropy. We cannot extrapolate our findings to ECGs of shorter or longer duration. Our study focused on the analysis of one-minute length segments, reflecting the specific requirements of our research objectives. Given the substantial dataset comprising over 60,000 such segments, we opted for a stringent criterion to ensure the high quality and reliability of our study outcomes. The decision to discard segments with less than 58 s of total RR interval length aimed to maintain consistency and rigor in our analysis. Furthermore, we would like to reference a relevant study, Buś et al. [25], which investigated the diagnostic value of segment length for AF detection. This study demonstrated that the diagnostic performance of HRV for AF detection is closely associated with the length of the ECG recording. Specifically, the diagnostic properties of HRV indices, particularly pRR50, exhibited significant improvement with longer recordings. For instance, the study reported an area under the curve (AUC) ranging from 0.881 for 5 s segments to 0.980 for 300 s segments, with corresponding diagnostic odds ratios indicating improved performance with longer segment lengths. These findings underscore the importance of segment length in optimizing the diagnostic accuracy of HRV analysis, with longer recordings generally associated with better performance. The sampling frequency of our data was only 128 Hz, which increases the rate of neutral RR intervals for technical rather than physiological reasons. In this study, we tested the ability to detect AF using classic simple logistic regression models. Although we achieved a high accuracy rate of 0.96, there is potential for even higher accuracy rates using more complex machine learning models. ML algorithms may perform better with random forest than with logistic regression. Whether this applies to our results is uncertain. It is noteworthy that the AUC for AF detection by pRR3.25% is already close to 1 and there is not much room for improvement. However, it may be worth exploring a wider range of machine learning models, such as XGBoost [26] or Random Forest [27], to determine their ability to detect AF from the asymmetric entropy of neutral runs. These models may be able to capture more complex relationships between the features and the target variable.
The novelty of our study lies in the comprehensive investigation of AF detection using a novel combination of runs-based asymmetric entropy and pRR30 with pRR3.25% and pRR30. Runs-based asymmetric entropy has not previously been tested as a candidate for AF detection. Another novelty was not to remove neutral runs but to include them and analyse their characteristics, which seems to be useful. We recognize that researchers may exclude neutral runs from analysis as they are often treated as artefacts in the recording process, primarily stemming from poor resolution and a lack of contribution to the structural (run-based) metrics. Indeed, if we consider the neutral runs as unresolved acceleration and deceleration runs, their exclusion in sinus rhythm should not change any results. Excluding neutral runs from analysis in this particular study can be problematic for several reasons. Firstly, although they have no effect on short-term HRV, neutral runs contribute significantly to long-term and total HRV. Removing them could be misinterpreted as data manipulation. Secondly, research specifically investigating neutral runs remains scarce, limiting our understanding of their potential influence. In the context of our study focused on AF detection, the inclusion of neutral runs was of particular importance. A less organized rhythm characterizes AF compared to sinus rhythm. This reduced structure translates into a low probability of finding two or more identical RR intervals within the data, making them comparable to random sequences or shuffled heart cycles. By including neutral runs in our analysis, we aimed to capture and account for the less organized nature of AF. Our data showed a significant difference in entropy associated with neutral runs between AF and sinus rhythm. To our knowledge, this finding is the first demonstration of such an association.

5. Conclusions

pRR3.25% stands out as a robust and reliable choice for effectively identifying AF episodes, even in comparison with runs-based asymmetrical entropy. While it is observed that more complex models such as pRR3.25%, pRR30 and H exhibit slightly enhanced performance on a general scale, this marginal improvement is often overshadowed by the substantial drawback of a nearly fourfold increase in false negatives. Notably, it is worth emphasizing that every superior model inherently encompasses the pRR3.25% parameter. This underscores the foundational importance of pRR3.25% in contributing to the diagnostic accuracy of any enhanced model. In practical clinical applications, the single-parameter model with pRR3.25% emerges as the optimal choice, delivering a commendable balance between detection precision and false-negative rates.
Our results suggest that HNR may be a helpful parameter for AF detection, and future studies should investigate its potential further.

Author Contributions

Conceptualization, J.P. and P.G.; Data curation, S.B.; Formal analysis, B.B. and S.B.; Investigation, B.B.; Methodology, B.B., S.B. and S.Ż.; Project administration, P.G.; Resources, P.G.; Software, B.B., S.B. and J.P.; Supervision, J.P. and P.G.; Visualization, B.B. and S.B.; Writing—original draft, B.B. and S.B.; Writing—review & editing, B.B., S.B., S.Ż., J.P. and P.G. All authors have read and agreed to the published version of the manuscript.

Funding

This research received no external funding.

Institutional Review Board Statement

Not applicable.

Data Availability Statement

The data presented in this study are openly available in The Long-Term AF Database at https://0-doi-org.brum.beds.ac.uk//10.13026/C2QG6Q.

Conflicts of Interest

The authors declare no conflicts of interest.

References

  1. Hindricks, G.; Potpara, T.; Dagres, N.; Arbelo, E.; Bax, J.; Blomström-Lundqvist, C.; Boriani, G.; Castella, M.; Dan, G.; Dilaveris, P. 2020 ESC Guidelines for the diagnosis and management of atrial fibrillation developed in collaboration with the European Association for Cardio-Thoracic Surgery (EACTS): The Task Force for the diagnosis and management of atrial fibrillation of the Europea. Eur. Heart J. 2021, 42, 373–498. [Google Scholar] [CrossRef]
  2. Ble, M.; Benito, B.; Cuadrado-Godia, E.; Pérez-Fernández, S.; Gómez, M.; Mas-Stachurska, A.; Tizón-Marcos, H.; Molina, L.; Martí-Almor, J.; Cladellas, M. Left Atrium Assessment by Speckle Tracking Echocardiography in Cryptogenic Stroke: Seeking Silent Atrial Fibrillation. J. Clin. Med. 2021, 10, 3501. [Google Scholar] [CrossRef] [PubMed]
  3. Roten, L.; Goulouti, E.; Lam, A.; Elchinova, E.; Nozica, N.; Spirito, A.; Wittmer, S.; Branca, M.; Servatius, H.; Noti, F.; et al. Age and Sex Specific Prevalence of Clinical and Screen-Detected Atrial Fibrillation in Hospitalized Patients. J. Clin. Med. 2021, 10, 4871. [Google Scholar] [CrossRef] [PubMed]
  4. Turagam, M.K.; Flaker, G.C.; Velagapudi, P.; Vadali, S.; A Alpert, M. Atrial Fibrillation In Athletes: Pathophysiology, Clinical Presentation, Evaluation and Management. J. Atr. Fibrillation 2015, 8, 1309. [Google Scholar] [CrossRef]
  5. Lin, A.L.; Nah, G.; Tang, J.J.; Vittinghoff, E.; A Dewland, T.; Marcus, G.M. Cannabis, cocaine, methamphetamine, and opiates increase the risk of incident atrial fibrillation. Eur. Heart J. 2022, 43, 4933–4942. [Google Scholar] [CrossRef]
  6. Rizwan, A.; Zoha, A.; Ben Mabrouk, I.; Sabbour, H.M.; Al-Sumaiti, A.S.; Alomainy, A.; Imran, M.A.; Abbasi, Q.H. A Review on the State of the Art in Atrial Fibrillation Detection Enabled by Machine Learning. IEEE Rev. Biomed. Eng. 2020, 14, 219–239. [Google Scholar] [CrossRef] [PubMed]
  7. Khan, A.A.; Lip, G.Y.H.; Shantsila, A. Heart rate variability in atrial fibrillation: The balance between sympathetic and parasympathetic nervous system. Eur. J. Clin. Investig. 2019, 49, e13174. [Google Scholar] [CrossRef] [PubMed]
  8. Buś, S.; Jędrzejewski, K.; Guzik, P. Statistical and Diagnostic Properties of pRRx Parameters in Atrial Fibrillation Detection. J. Clin. Med. 2022, 11, 5702. [Google Scholar] [CrossRef] [PubMed]
  9. Piskorski, J.; Guzik, P. The structure of heart rate asymmetry: Deceleration and acceleration runs. Physiol. Meas. 2011, 32, 1011–1023. [Google Scholar] [CrossRef]
  10. Goldberger, A.L.; Amaral, L.A.N.; Glass, L.; Hausdorff, J.M.; Ivanov, P.C.; Mark, R.G.; Mietus, J.E.; Moody, G.B.; Peng, C.-K.; Stanley, H.E. PhysioBank, PhysioToolkit, and PhysioNet: Components of a new research resource for complex physiologic signals. Circulation 2000, 101, E215–E220. [Google Scholar] [CrossRef]
  11. Petrutiu, S.; Sahakian, A.V.; Swiryn, S. Abrupt changes in fibrillatory wave characteristics at the termination of paroxysmal atrial fibrillation in humans. Europace 2007, 9, 466–470. [Google Scholar] [CrossRef] [PubMed]
  12. Shannon, C.E. A Mathematical Theory of Communication. Bell Syst. Tech. J. 1948, 27, 379–423. [Google Scholar] [CrossRef]
  13. Levene, H.; Wolfowitz, J. The covariance matrix of runs up and down. Ann. Math. Stat. 1944, 15, 58–69. [Google Scholar] [CrossRef]
  14. Shapiro, S.S.; Wilk, M.B. An Analysis of Variance Test for Normality (Complete Samples). Biometrika. 1965, 52, 591–611. [Google Scholar] [CrossRef]
  15. Fawcett, T. An Introduction to ROC analysis. Pattern Recogn. Lett. 2006, 27, 861–874. [Google Scholar] [CrossRef]
  16. Youden, W. Index for rating diagnostic tests. Cancer 1950, 3, 32–35. [Google Scholar] [CrossRef] [PubMed]
  17. Glas, A.S.; Lijmer, J.G.; Prins, M.H.; Bonsel, G.J.; Bossuyt, P.M.M. The diagnostic odds ratio: A single indicator of test performance. J. Clin. Epidemiol. 2003, 56, 1129–1135. [Google Scholar] [CrossRef] [PubMed]
  18. Hastie, T.; Tibshirani, R.; Friedman, J. Model Assessment and Selection. In The Elements of Statistical Learning, 2nd ed.; Springer: Berlin/Heidelberg, Germany, 2009; pp. 220–221. [Google Scholar]
  19. Richman, J.S.; Moorman, J.R. Physiological time-series analysis using approximate entropy and sample entropy. Am. J. Physiol. Heart Circ. Physiol. 2000, 278, H2039–H2049. [Google Scholar] [CrossRef] [PubMed]
  20. Liu, C.; Oster, J.; Reinertsen, E.; Li, Q.; Zhao, L.; Nemati, S.; Clifford, G.D. A comparison of entropy approaches for AF discrimination. Physiol. Meas. 2018, 39, 074002. [Google Scholar] [CrossRef]
  21. Zhao, L.; Liu, C.; Wei, S.; Shen, Q.; Zhou, F.; Li, J. A New Entropy-Based Atrial Fibrillation Detection Method for Scanning Wearable ECG Recordings. Entropy 2018, 20, 904. [Google Scholar] [CrossRef]
  22. Żurek, S.; Grabowski, W.; Wojtiuk, K.; Szewczak, D.; Guzik, P.; Piskorski, J. Relative Consistency of Sample Entropy Is Not Preserved in MIX Processes. Entropy 2020, 22, 694. [Google Scholar] [CrossRef] [PubMed]
  23. Renshaw, A.A.; Gould, E.W. Reducing false-negative and false-positive diagnoses in anatomic pathology consultation material. Arch. Pathol. Lab. Med. 2013, 137, 1770–1773. [Google Scholar] [CrossRef] [PubMed]
  24. Klinkman, M.S.; Coyne, J.C.; Gallo, S.; Schwenk, T.L. False positives, false negatives, and the validity of the diagnosis of major depression in primary care. Arch. Fam. Med. 1998, 7, 451–461. [Google Scholar] [CrossRef] [PubMed]
  25. Buś, S.; Jędrzejewski, K.; Guzik, P. Impact of Electrocardiogram Length on Diagnostic Properties of Heart Rate Variability Indices in Atrial Fibrillation Detection. In Proceedings of the 2022 12th Conference of the European Study Group on Cardiovascular Oscillations (ESGCO), Vysoké Tatry, Slovakia, 9–12 October 2022; pp. 1–2. [Google Scholar] [CrossRef]
  26. Chen, T.; Guestrin, C. XGBoost: A Scalable Tree Boosting System. In Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, San Francisco, CA, USA, 13–17 August 2016; Association for Computing Machinery: New York, NY, USA, 2016; pp. 785–794. [Google Scholar] [CrossRef]
  27. Breiman, L. Random Forests. Mach. Learn. 2001, 45, 5–32. [Google Scholar] [CrossRef]
Figure 1. Data pre-processing scheme [8].
Figure 1. Data pre-processing scheme [8].
Entropy 26 00296 g001
Figure 2. Example of runs-based partitioning of a short tachogram. The runs can be classified as deceleration and acceleration runs of length i (DRi and ARi, respectively), with neutral runs represented by the symbol Ni, which can interrupt the deceleration/acceleration runs. A full grey circle indicates the start of a deceleration run. A full black circle marks the start of an acceleration run. These circles can be used as reference points for the respective runs [9].
Figure 2. Example of runs-based partitioning of a short tachogram. The runs can be classified as deceleration and acceleration runs of length i (DRi and ARi, respectively), with neutral runs represented by the symbol Ni, which can interrupt the deceleration/acceleration runs. A full grey circle indicates the start of a deceleration run. A full black circle marks the start of an acceleration run. These circles can be used as reference points for the respective runs [9].
Entropy 26 00296 g002
Figure 3. Histograms of different types of asymmetrical entropy for AF and SR.
Figure 3. Histograms of different types of asymmetrical entropy for AF and SR.
Entropy 26 00296 g003
Figure 4. Histograms of prr30 and prr3.25% AF and SR recordings.
Figure 4. Histograms of prr30 and prr3.25% AF and SR recordings.
Entropy 26 00296 g004
Figure 5. Spearman correlation matrix for HRV parameters for SR and AF data. Lower triangle: correlation coefficients; upper triangle: p-values.
Figure 5. Spearman correlation matrix for HRV parameters for SR and AF data. Lower triangle: correlation coefficients; upper triangle: p-values.
Entropy 26 00296 g005
Figure 6. Classification metrics of AF detection on the test dataset using the optimal cut-off method. DOR—diagnostic odds ratio [17], PPV—positive predictive value, NPV—negative predictive value.
Figure 6. Classification metrics of AF detection on the test dataset using the optimal cut-off method. DOR—diagnostic odds ratio [17], PPV—positive predictive value, NPV—negative predictive value.
Entropy 26 00296 g006aEntropy 26 00296 g006b
Figure 7. Histograms presenting the 1000-times bootstrapped results of the model built from pRR3.25% vs. pRR30 and pRR3.25% vs. the model built from pRR30, pRR3.25% and HAR. The biggest difference was in FNs where adding H to the model increases the number of FNs over three times compared to models without H.
Figure 7. Histograms presenting the 1000-times bootstrapped results of the model built from pRR3.25% vs. pRR30 and pRR3.25% vs. the model built from pRR30, pRR3.25% and HAR. The biggest difference was in FNs where adding H to the model increases the number of FNs over three times compared to models without H.
Entropy 26 00296 g007
Table 1. Area under the ROC curve (AUC) and optimal cut-off values for the training set. Median values of classification metrics (from the confusion matrix) for AF detection in the test set using single HRV parameters with the optimal cut-off.
Table 1. Area under the ROC curve (AUC) and optimal cut-off values for the training set. Median values of classification metrics (from the confusion matrix) for AF detection in the test set using single HRV parameters with the optimal cut-off.
ParameterAUCCut-Off for AFAccuracySensitivitySpecificityPPVNPVDOR
pRR3.25%0.9727<72.3684%95.7599.6092.2592.1299.602931.82
pRR300.9596<66.8874%91.0095.6286.8086.8295.62143.70
HNR0.9315<0.188484.8695.4575.2677.8394.7963.82
HAR0.6951<0.754667.8586.8350.5961.5280.866.76
HDR0.6686<0.772667.6891.4946.0060.6685.619.16
H0.6186<2.064760.0385.6836.6955.1873.803.47
Table 2. Comparison of different metrics for AF detection using univariate and multivariate logistic regression models. The three top metrics with the highest AUC are bolded. pRR3.25% stands out as the most powerful individual metric, exhibiting the highest AUC. Notably, it consistently appears in the top-performing metric pairs and triplets, consistently demonstrating superior performance in distinguishing AF from SR.
Table 2. Comparison of different metrics for AF detection using univariate and multivariate logistic regression models. The three top metrics with the highest AUC are bolded. pRR3.25% stands out as the most powerful individual metric, exhibiting the highest AUC. Notably, it consistently appears in the top-performing metric pairs and triplets, consistently demonstrating superior performance in distinguishing AF from SR.
FeatureAUCAccuracyDORFP + FN [%]FP [%]FN [%]
pRR3.25%0.9720.9513643.04.873.980.88
pRR300.9590.9277233.57.235.571.65
H0.6130.61182.638.8224.314.52
HAR0.70.65363.634.6416.1118.53
HDR0.670.61552.638.4516.9121.54
HNR0.930.884284.511.589.032.55
pRR3.25 & pRR30%0.9780.955687.14.53.570.93
pRR3.25% & H0.9860.9566705.64.343.380.96
pRR3.25% & HAR0.9820.9549693.04.513.590.92
pRR3.25% & HDR0.9770.9517623.34.833.90.93
pRR3.25% & HNR0.9740.9516632.34.843.930.91
pRR30 & H0.9730.9327252.36.735.011.72
pRR30 & HAR0.9690.9312240.56.885.131.76
pRR30 & HDR0.9630.9279235.87.215.571.64
pRR30 & HNR0.960.9284232.97.165.471.69
pRR30 & pRR3.25%, & H0.9880.9577695.54.233.201.03
pRR30 & pRR3.25%, & HAR0.9850.9581732.44.193.220.97
pRR30 & pRR3.25%, & HDR0.9820.9541633.74.593.581
pRR30 & pRR3.25%, & HNR0.9790.9537631.34.633.650.99
HNR & HAR, & HDR0.9350.883882.811.629.012.61
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

Share and Cite

MDPI and ACS Style

Biczuk, B.; Buś, S.; Żurek, S.; Piskorski, J.; Guzik, P. pRR30, pRR3.25% and Asymmetrical Entropy Descriptors in Atrial Fibrillation Detection. Entropy 2024, 26, 296. https://0-doi-org.brum.beds.ac.uk/10.3390/e26040296

AMA Style

Biczuk B, Buś S, Żurek S, Piskorski J, Guzik P. pRR30, pRR3.25% and Asymmetrical Entropy Descriptors in Atrial Fibrillation Detection. Entropy. 2024; 26(4):296. https://0-doi-org.brum.beds.ac.uk/10.3390/e26040296

Chicago/Turabian Style

Biczuk, Bartosz, Szymon Buś, Sebastian Żurek, Jarosław Piskorski, and Przemysław Guzik. 2024. "pRR30, pRR3.25% and Asymmetrical Entropy Descriptors in Atrial Fibrillation Detection" Entropy 26, no. 4: 296. https://0-doi-org.brum.beds.ac.uk/10.3390/e26040296

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop